Monitoring AWS Elastic Container Service Assets with Edge Delta

Overview

This input type allows you to specify a set of ECS assets (tasks, containers, etc.) for Edge Delta to monitor.

Example

inputs:
  ecs:
    - labels: "errorcheck"
      include:
        - "container-name=myecho,task-family=test-task,task-version=2"
      exclude:
        - "container-name=.*xray.*"

Required Parameters

labels

Enter a descriptive label for this input. When you create a workflow, you will use this label to enter your input into the workflow.

inputs:
  ecs:
    - labels: "<input name>"

Optional Parameters

auto_line_detection

Enter true to enable auto line detection for log messages with multiple lines.

inputs:
  ecs:
    - labels: "<input name>"
      auto_detect_line_pattern: true

boost_stacktrace_detection

Enter true to fallback (troubleshoot) missing content that resulted from the auto_detect_line_pattern parameter.

inputs:
  ecs:
    - labels: "<input name>"
      auto_detect_line_pattern: true
      boost_stacktrace_detection: true

exclude

If exclude is specified it drops some logs that match its Golang regex rules. To specify which input to add, you must provide a Golang regex pattern. Comma separated values indicate AND rules, while separate rules indicate OR matching. In this example logs that match rule-1 and rule-2 are excluded. Logs that match rule-3 are also excluded. A log matching only rule-1 would not be excluded.

• If neither include nor exclude are specified, then everything from the input is passed.
• If include is specified as well as exclude, then logs matching in include are passed unless they are dropped by exclude.

inputs:
  ecs:
    - labels: "<input name>"
      exclude:
        - "rule-1,rule-2"
        - "rule-3"

filters

Enter an existing filter to add to this input. To learn how to create a filter, see Filters.

inputs:
  ecs:
    - labels: "<input name>"
      filters:
        - info

include

If include is specified it only passes matching logs, dropping all others. It is specified with a Golang regex pattern. Comma separated values indicate AND rules, while separate rules indicate OR matching. In this example logs that match rule-1 and rule-2 are excluded. Logs that match rule-3 are also excluded. A log matching only rule-1 would not be excluded.

• If neither include nor exclude are specified, then everything from the input is passed.
• If include is specified as well as exclude, then logs matching in include are passed unless they are dropped by exclude.

inputs:
  ecs:
    - labels: "<input name>"
      include:
        - "rule-1,rule-2"
        - "rule-3"

late_arrival_handling

Use this parameter to configure how to accommodate delayed data. Specifically, you can use the ignore_after parameter to configure when to ignore metrics or pattern logs. For example, for ignore_after, if you enter 15m, then the input will ignore logs whose timestamp is older than 15 minutes.

inputs:
  ecs:
    - labels: "<input name>"
      late_arrival_handling:
      rule_metrics:
        ignore_after: 15m
      patterns:
        ignore_after: 4h
        report_with_original_timestamp: true