Configuring an Edge Delta Pipeline

Use Visual Pipelines or a text editor to configure a Pipeline.

  3 minute read  

Overview

A Fleet is a set of agents configured with a Pipeline. Edge Delta Fleets with v3 configurations (Agent v0.1.71 or higher) can be configured using Visual Pipelines. Fleets older than v0.1.71 use configuration v2.

Create a Pipeline Configuration

  1. Click Pipelines.
  2. Click New Fleet.
  3. Select Edge Fleet and click Continue.
  4. Select the appropriate template and click Continue.
  5. Specify a name to identify the Fleet.
  6. Click Generate Config.
  7. Execute the installation commands, they include the unique ID for the Fleet.
  8. Expand the namespaces and select the input sources you want to monitor.
  9. Select the Destination Outputs you want to send processed data to, such as the Edge Delta Observability Platform.
  10. Click Continue.
  11. Click View Dashboard.

Delete a Pipeline Configuration:

  1. Click Pipelines.
  2. Select the Fleet configured with the pipeline you want to delete.
  3. Click Delete Pipeline.

Deleting a Pipeline will remove the Pipeline ID. Any active Fleets configured with this ID will no longer be able to communicate with the Edge Delta backend.

Open a Pipeline configuration Using Visual Pipelines

  1. In the Edge Delta App, click Pipelines.
  2. Select the Fleet with the Pipeline you want to view.
  3. Click View/Edit Pipeline.

Create a Node

To create a node:

  1. Open Visual Pipelines.
  2. Click Edit Mode.
  1. Click either Add Input, Add Processor, or Add Output and select the type of node, for example Add Processor - Transformation - Mask Processor.
  1. The node appears in the appropriate pane and the configuration pane opens.
  2. Enter the configuration details and click Okay.

Alternatively, you can add a processor node directly onto an existing link - hover over the link, click the Add (+) icon, and select the node type. This creates the new processor node in the position where the add icon was, and also connects it to the upstream and downstream nodes on the link.

To delete a node, select it and hover over it, then select the Bin icon.

Test Node Configuration

Some nodes have a testing feature where you can specify an input log and see output based on the configuration of the node. See Designing Pipelines and Testing Nodes.

Configure Agents using a Text Editor

Some configuration v3 parameters are advanced, requiring them to be configured only in YAML rather than Visual Pipelines. You may also prefer or be required to configure in YAML using a text editor, for example if you are passing in a local configuration file.

To edit a v3 configuration using YAML:

  1. Click Pipelines and select the fleet you want to edit.
  2. Click View/Edit Pipeline.
  3. Click Edit YAML.

The Edit Configuration dialog box opens. You can edit the configuration and view the change diff.

  1. Click Done.

Next Steps

Next you need to wire up the new node using links.