Agent v1.11.0

new Knowledge Library has been released, providing solutions, Fleets on the Pipelines, Support for OTEL Log Format, and Helm Chart Improvements.

July 16, 2024

This update provides robust enhancements and fixes for better performance, reliability, and functionality across different environments and workflows.

Enhancements

  • A new Knowledge Library has been released, providing solutions for common regex, CEL, and GROK patterns.
  • Fleets on the Pipelines - Dashboard page can be sorted by telemetry data such as number of deployed agents.
  • Support for OTEL Log Format: Improved support for sending logs in OTEL format to the backend, ensuring backwards compatibility and gradual transition while running older and newer schemas concurrently.
  • Helm Chart Improvements: Fixed missing annotations for push services in the Helm chart to avoid issues when setting up a load balancer.
  • Kubernetes Events Handling: Updated K8s events tailer to include modified events, ensuring all events are ingested even when a Back-off event is patched.
  • Log to Pattern Node Enhancement: Added capability to pick a field in the agent data item for clustering instead of the default body field.
  • Log Forwarding via OTEL: Improved the flushing logic and interval management for OTEL logs, and enabled log forwarding to pusher when archive ingestion is active.
  • Field Name for File Input: Updated source detection to add ed.source.name and replace invalid characters with an underscore.

Bug Fixes

  • Debug Output with Linux: Addressed a nil pointer exception in the debug output with Linux pipelines.
  • CPU Profile Capture on Windows: Removed the attempt to capture CPU profile on Windows to prevent error messages.
  • Metrics Reporting Fix: Corrected an error with log to metric processor to avoid stopping item processing due to variable shadowing.
  • Update Archive Payload Schema: Updated schema to align with OTEL schema and fixed a deadlock issue during the stop procedure.
  • Fixed host.ip value for agents behind NAT: Changed the ingestion method to use the default gateway interface’s IP instead of backend-imposed IPs, ensuring the correct internal IP address is reported.

Miscellaneous

  • HTTP Input Enhancements: Support for all routes and multiple methods (POST, PUT, PATCH, DELETE) for HTTP input, with attributes added for enhanced flexibility.
  • Leader Election Improvements: Removed the ED_LEADER_ELECTION_ENABLED environment variable requirement for leader election and made it enabled by default.
  • K8s Role Permissions: Added get secret permissions for Kubernetes roles required for specific cleanup operations.
  • Log Threshold Monitors: Fixed the issue with log threshold monitors not ingesting empty strings.
  • Rehydration Fixes: Corrected issues with rehydration not pulling Avro/Zstd files.
  • Grok Fixes: Combined pattern and custom pattern fields to prevent validation failures and improve reliability.
  • Data from Debug Output nodes is no longer available on the node itself. It is only available on the full Debug Output page.
  • RBAC group names are now case insensitive.
  • Default k8s_input exclusions have now been trimmed to automatically ingest all K8s control and management plane telemetry data.