Edge Delta Benchmarks
2 minute read
Overview
Our team ran a series of tests to measure the performance and resource utilization of the Edge Delta agent compared to other log collection agents. To do so, we ran popular agents on Amazon EC2, collecting varying data volumes.
The Edge Delta agent v3 is responsible for more tasks than other log collection agents. In addition to collecting and forwarding data, Edge Delta’s agent:
- Processes log data (e.g., filter, shape/transform, logs-to-metrics, and more)
- Runs AI/ML to detect anomalies
- Clusters recurring loglines into Patterns
Note: The performance benchmarks may change between minor Agent versions. These fluctuations might not be explicitly documented in the Agent’s changelog.
Test Specifications
- Instance size: Amazon EC2 c5d.4xlarge
- Pipeline configuration version: v3
Measurements
CPU Utilization: The percentage of the instance’s central processing unit (CPU) actively executing tasks to understand system efficiency.
Memory Utilization: The proportion of a computer’s random access memory (RAM) actively in use. Efficient management ensures optimal system performance and responsiveness.
Performance Benchmarks
CPU Utilization %
Events per second | Edge Delta | Splunk UF | Splunk HF | FluentBit | FluentD | Vector | Filebeat | Logstash | OpenTelemetry |
---|---|---|---|---|---|---|---|---|---|
1000 | 2% | 4% | 1% | 1% | 3% | 3% | 4% | 34% | 3% |
5000 | 3% | 9% | 1% | 2% | 4% | 5% | 18% | 39% | 7% |
10000 | 4% | 9% | FAILED | 2% | 4% | 5% | 37% | 63% | 10% |
20000 | 5% | 29% | FAILED | 4% | 4% | 5% | 52% | 69% | 25% |
50000 | 8% | FAILED | FAILED | 10% | 12% | 8% | 57% | 92% | 32% |
500000 | 62% | FAILED | FAILED | 79% | FAILED | 83% | FAILED | FAILED | FAILED |
Memory Utilization %
Events per second | Edge Delta | Splunk UF | Splunk HF | FluentBit | FluentD | Vector | Filebeat | Logstash | OpenTelemetry |
---|---|---|---|---|---|---|---|---|---|
1000 | 78MB | 125MB | 125MB | 14MB | 72MB | 167MB | 123MB | 1.12GB | 174MB |
5000 | 78MB | 125MB | 125MB | 14MB | 74MB | 145MB | 132MB | 1.12GB | 174MB |
10000 | 78MB | 126MB | FAILED | 14MB | 76MB | 152MB | 132MB | 1.15GB | 174MB |
20000 | 79MB | 126MB | FAILED | 14MB | 76MB | 158MB | 145MB | 1.2GB | 174MB |
50000 | 80MB | FAILED | FAILED | 14MB | 76MB | 167MB | 149MB | 1.2GB | 174MB |
500000 | 80MB | FAILED | FAILED | 14MB | FAILED | 176MB | FAILED | FAILED | FAILED |