Edge Delta Pipeline Dashboard

Pipelines Dashboard in the Edge Delta web application.

  3 minute read  

Overview

Click Pipelines and select the Dashboard tab to view the Dashboard. This tab provides a quick overview of the health of all your Fleets.

Dashboard

The Pipeline Summary pane provides a graphical overview of all your Fleets. It shows data volumes per source type and combined for all sources, volume of data streamed to streaming destinations, and the Optimization rate, which is the ratio between the incoming and outgoing data. A higher optimization rate reduces the amount of data being streamed to high cost destinations.

The Incoming Events and Outgoing Events panes show the count of JSON objects processed and streamed to your destinations. This is also reflected as a data size in the Incoming Bytes and Outgoing Bytes panes. In the dashboard, Bytes Analyzed and Outgoing Bytes does not include extra or enriched metadata but Bytes Streamed does. You can specify the Lookback period in the filters bar.

You can hover on each metric in the Dashboard and click the Open in metrics explorer link to view it in context.

Dashboard Settings

You can switch between viewing metrics for data volume or events in the Pipeline dashboard. In addition, you can choose whether to include Edge Delta destinations in the Dashboard or not. Both these settings affect how the Optimization Rate is calculated. Bear in mind, when events are viewed including those that are routed to Edge Delta, there may be more events generated by the pipeline than ingested. This reduces the apparent Optimization rate to 0%. This is due to the events required for Edge Delta back functionality such as pipeline node monitoring.

Fleets Table

The Dashboard tab on the Pipelines page also contains the Fleets table. Its lists Fleets and provides statistics for those with active agents including incoming events and bytes, and outgoing events and bytes. A graph for each active fleet enables a quick trend evaluation and any Fleets with old versions are indicated.

The Agents tab pivots on host names, many of which may use the same pipeline.

Select a fleet for more details in a details pane:

  • Click Add Agents to deploy new agents into the fleet using the same Pipeline configuration.
  • Click View/Edit Pipeline to make changes to the Pipeline configuration for all agents in this Fleet.
  • Click Delete Fleet to delete the Pipeline Configuration. Deployed agents should be removed as their Pipeline ID will no longer be authorized by the Edge Delta API.
  • Open the YAML tab to view the YAML version of the Pipeline configuration. You might copy this YAML for example to use it as a local ConfigMap.
  • Click Deployment Status to view the status of each agent in the Fleet.
  • Click Pipeline History to view previous versions of the Pipeline, which you can compare and restore.
  • Click Compound nodes to view a list of Compound nodes used in the Fleet’s Pipeline.

See Also