Edge Delta Ingestion Preferences

Configure Ingestion Preferences for Edge Delta Agents.

See the latest ED Output nodes here.

Overview

The Edge Delta agent sends certain data to the Edge Delta back end in addition to the data configured with inputs.

Setting Agent Data Ingestion Preferences:

  1. In the Edge Delta App, click Pipelines, and then click Settings.
  2. Review the Data Ingestion Preferences section.

If you believe that these data types contain sensitive data that should not be sent to the Edge Delta backend, please contact support.

Agent Data Settings

Agent Self Logs

This data type represents the output of agent logs, which helps Edge Delta Support and engineering to troubleshooting agent behavior.

Alerts

This data type represents a signal detected by the agent regarding an unexpected event. This information and corresponding metadata are sent to the Edge Delta backend by default. This data type is based on the threshold settings in the agent configuration.

Log Archiving

This data type represents the compressed storage of raw logs on a cloud storage service, such as S3. Edge Delta maintains separate S3 buckets per customer organization. This data type populates the Log Search page where you can filter for specific logs.

Due to an ingestion delay of archived files, logs in from the past few minutes may not display.

Log Patterns

Patterns are reduced versions of the original log line where specific parts are placed with asterisks *. Typically, these patterns do not contain sensitive data. This data type can be enabled by adding a cluster processor.

Log Pattern Samples

This data type represents the raw logs that match a specific pattern. For each distinct cluster pattern found by the agent, the agent also sends a few samples of that cluster.

Alert Contextual Logs

This data type represents the logs generated from an issue. An issue can be an anomaly detected by an individual agent or by the backend processing jobs. Contextual logs are useful to investigate an issue and find a root cause. In the Edge Delta App, you can use the Metrics - Anomalies page to view all signals and findings.

Events

An event is a Kubernetes-based anomaly. By default, Edge Delta consumes Kubernetes system events, and then displays those events on the Metrics - Anomalies page.

Agent Health Data

This data type represents the various critical internal components of the agent. This data includes:

  • Success count
  • Failure count
  • Last error
  • Start time

Agent Heartbeats

This data type represents the heartbeat that the agent sends to the backend every minute. Edge Delta uses this information to ensure that the agent is running. This information populates the Pipeline Status page of the Edge Delta App.

Metrics

This data type can be collected from the environment, such as system_stats, or generated by a processor.

Turning off metrics will disable the pipeline status page, which is populated by metrics.