Edge Delta File Input

Specify a file from which to consume logs.

Overview

The File Input node captures log input from specific files. These messages are sent as logs into the pipeline as they arrive in the file.

Example Configuration

nodes:
  - name: my_file_input
    type: file_input
    path: "/var/logs/test-app/*.log"

Required Parameters

name

A descriptive name for the node. This is the name that will appear in Visual Pipelines and you can reference this node in the yaml using the name. It must be unique across all nodes. It is a yaml list element so it begins with a - and a space followed by the string. It is a required parameter for all nodes.

nodes:
  - name: <node name>
    type: <node type>

type: file_input

The type parameter specifies the type of node being configured. It is specified as a string from a closed list of node types. It is a required parameter.

nodes:
  - name: <node name>
    type: <node type>

path

The path parameter specifies the file paths to tail for log messages. It is a string. A path is required. Wildcards are supported:

  • /etc/systemd/system/billingservice/*.log includes all .log files in the billingservice folder.
  • /etc/systemd/system/billingservice/**/*.log includes all .log files in the billingservice folder and any sub-folders.
nodes:
  - name: <node name>
    type: file_input
    path: "/var/logs/app/*.log"

Optional Parameters

exclude

The exclude parameter specifies the file paths to exclude from tailing for log messages. These are files that might otherwise be tailed as they are located within the path parameter. It is a string and it supports wildcards. The exclude parameter is optional.

nodes:
  - name: my_file_input
    type: file_input
    path: "/var/logs/app/*.log"
    exclude: "/var/logs/app/test*.log"