Edge Delta Benchmarks

Performance and resource utilization of the Edge Delta agent.

  2 minute read  

Overview

Our team ran a series of tests to measure the performance and resource utilization of the Edge Delta agent compared to other log collection agents. To do so, we ran popular agents on Amazon EC2, collecting varying data volumes.

The Edge Delta agent v3 is responsible for more tasks than other log collection agents. In addition to collecting and forwarding data, Edge Delta’s agent:

  • Processes log data (e.g., filter, shape/transform, logs-to-metrics, and more)
  • Runs AI/ML to detect anomalies
  • Clusters recurring loglines into Patterns

Note: The performance benchmarks may change between minor Agent versions. These fluctuations might not be explicitly documented in the Agent’s changelog.

Test Specifications

  • Instance size: Amazon EC2 c5d.4xlarge
  • Pipeline configuration version: v3

Measurements

CPU Utilization: The percentage of the instance’s central processing unit (CPU) actively executing tasks to understand system efficiency.

Memory Utilization: The proportion of a computer’s random access memory (RAM) actively in use. Efficient management ensures optimal system performance and responsiveness.

Performance Benchmarks

CPU Utilization %

Events per second Edge Delta Splunk UF Splunk HF FluentBit Fluentd Vector Filebeat Logstash OpenTelemetry
1000 2% 4% 1% 1% 3% 3% 4% 34% 3%
5000 3% 9% 1% 2% 4% 5% 18% 39% 7%
10000 4% 9% FAILED 2% 4% 5% 37% 63% 10%
20000 5% 29% FAILED 4% 4% 5% 52% 69% 25%
50000 8% FAILED FAILED 10% 12% 8% 57% 92% 32%
500000 62% FAILED FAILED 79% FAILED 83% FAILED FAILED FAILED

Memory Utilization %

Events per second Edge Delta Splunk UF Splunk HF FluentBit Fluentd Vector Filebeat Logstash OpenTelemetry
1000 78MB 125MB 125MB 14MB 72MB 167MB 123MB 1.12GB 174MB
5000 78MB 125MB 125MB 14MB 74MB 145MB 132MB 1.12GB 174MB
10000 78MB 126MB FAILED 14MB 76MB 152MB 132MB 1.15GB 174MB
20000 79MB 126MB FAILED 14MB 76MB 158MB 145MB 1.2GB 174MB
50000 80MB FAILED FAILED 14MB 76MB 167MB 149MB 1.2GB 174MB
500000 80MB FAILED FAILED 14MB FAILED 176MB FAILED FAILED FAILED