Agent v2.4.0

July 28, 2025

New Features

• Deotel Processor: Added the Deotel processor which converts OpenTelemetry formatted data back to simplified formats for non-OTLP destinations. This processor extracts core content from OTLP wrapper metadata, enabling integration with legacy systems, webhooks, and custom applications that don’t support OpenTelemetry format.

Improvements

• Source Detection Enhancements: Added trace-level logging for the source detection node to improve debugging and operational visibility. Included error or message fields in source detection results for improved feedback to the user interface. Improved log detection performance by immediately triggering detection tasks and retrieving Kubernetes logs via API (up to 1MB) for more accurate log rate calculations. Modified permission checks for Linux/Mac source detection to skip sources when not authorized and log skipped cases. Updated permission-checking logic to avoid use of syscall. Enhanced coordinator and gRPC integration to support sample collection for non-deployed inputs. Made error handling more robust and results more explanatory for the frontend. Added support for collecting and displaying live tail data from detected sources before pipeline deployment, enabling faster validation of data visibility in the UI.
• Telemetry Generator Template Improvements: Enhanced template preview to display realistic sample values for variables (e.g., IPs, UUIDs) instead of placeholders. Enabled automatic variable detection from pasted log samples, generating consistent and editable template variables for dynamic fields. Added support for dynamic variables in resource and attributes sections of telemetry generator templates. Integrated tool to generate and validate templates from sample logs, with validation errors reported for further manual editing.
• Telemetry Generator Trace Enhancements: Added backend support for calculating and emitting error ratios when generating traces. Added support for setting parent-to-child span ratios and trace depth in trace generation.
• GCS Destination & Archive Improvements: Allowed use of pod credentials (Workload Identity) for GCS destination by making credentials path optional if HMAC keys are also missing. Made HMAC key fields visible in the GCS destination configuration. Introduced a new GCS archive buffer strategy and improved stability by handling nil data gracefully.
• OTLP Source Log Attribute Support: Added extraction of severity text from OTLP log records when present, improving attribute fidelity.
• OTTL Context Filter Improvements: Added a flush check during shutdown, implemented a default timeout (10s) and maximum capacity limit (10MB), and introduced force flush and interval setting functionality from sequence nodes. Improved test node wait handling for stateful processors and fixed flaky tests.
• Destination Health Metrics: Added health metrics for backpressure, rejected, and timeout states to pipeline destination handling, providing deeper insights into pipeline health.
• Sample Processor Enhancements: Improved error handling for probabilistic sampling by allowing partial hash calculations when some default log fields are missing or malformed. Errors encountered during sampling are now joined and reported collectively.

Bug Fixes

• Sample Collector Shutdown Fix: Resolved an issue where the sample collector failed to stop properly, which could result in agent shutdown delays.
• Telemetry Generator Node Nil Pointer Fix: Addressed a nil pointer dereference when running the Telemetry Generator node.
• OTTL Context Filter Issue: Fixed the flushing logic for consecutive extended windows in the OTTL context filter, ensuring timely log emission. Corrected setting of the flush interval in OTTL context filter nodes when configured from sequence nodes.