Troubleshooting

Discuss techniques for troubleshooting setups, the flow of data and observing data at various stages in a pipeline.

This section will highlight some techniques for troubleshooting and collecting insight at various steps of the pipeline as data flows through the system.

Webhook.site

Webhook.site is a free website that can be used to make HTTP requests to and see the full HTTP payload to verify its contents. By creating a Destination in pipeline and connecting the output of a Processor to it, you can view the data on Webhook.site as it appeared at that stage of the pipeline.

  1. Visit https://webhook.site/ in a browser.

  2. Copy your unique URL to the clipboard:

    Webhook.site URL
  3. Open the PetClinic Preprocess pipeline and click DestinationsAdd.

  4. Select the HTTP destination.

  5. Configure the following:

    • Title as To Webhook.site
    • add a meaningful Description such as Send output to Webhook.site
    • leave End-to-end Acknowledgement as checked
    • set the URI to the value you copied from the Webhook.site page
    • set the Encoding to json
    • leave Compression and Authentication → Strategy as none

    Configured - Webhook.site

    Click Save.

  6. With the Webhook.site destination configured, we can select the output from any Source or Processor and send it to the destination. For this example, drag a connection from the output of the Discard DEBUG Msgs filter to the To Webhook.site destination. The pipeline will now look like this:

    Pipeline with Webhook.site

    This will send a copy of the output from the Discard DEBUG Msgs processor to Webhook.site where we can inspect the contents of the payload for debugging purposes:

    Pipeline with Webhook.site