Edge Delta Demo Input

Generate random logs for testing.

3 minute read

Overview

The Demo Input node generates sample logs of a specified type and at a specified rate. Use this node to quickly configure and test a pipeline using data similar to your usecase.

Sample Output

The following types can be generated by the Demo Input node. Click each type for an example of the output generated.

115.97.90.213 - bradtke7240 [01/Apr/2024:12:06:05 +0000] "DELETE /robust/synergize HTTP/1.0" 201 16554

2024-04-01T12:06:05.975Z ERROR middleware/authz.go:383 request flog_log_generator spec:{uri:/v1/orgs/b9df8fc0-084b-11ee-be56-0242ac120002/confs/- method:GET password:RFPtW3} latency:200ms

201.134.96.0 - labadie3470 [01/04/2024:12:06:05 +0000] "HEAD /v1/account/balance HTTP/2.0" 200 22224 "http://www.globalinfomediaries.com/reinvent" "Mozilla/5.0 (Macintosh; PPC Mac OS X 10_5_8) AppleWebKit/5351 (KHTML, like Gecko) Chrome/38.0.853.0 Mobile Safari/5351"

{
  "host": "89.140.186.125",
  "user-identifier": "-",
  "time_local": "01/04/2024:12:06:04 +0000",
  "method": "HEAD",
  "request": "/extend/recontextualize/drive",
  "protocol": "HTTP/2.0",
  "status": 302,
  "bytes_sent": 15107
  }

75.200.151.46 - conn1089 [01/04/2024:12:06:05 +0000] "HEAD /generate/systems HTTP/2.0" 504 6674

{
  "host": "83.59.151.5",
  "user-identifier": "dickinson2266",
  "time_local": "01/04/2024:12:06:05 +0000",
  "method": "DELETE",
  "request": "/implement",
  "protocol": "HTTP/1.0",
  "status": 406,
  "bytes_sent": 23179
  }

[{INFO}] {188.196.110.52:1937} - 7 "A IN example.org. udp 41 false 4096" NOERROR qr,rd,ra,ad 28 0.944188

{
  "timestamp": "2024-04-01T12:06:04.975Z",
  "level": "DEBUG",
  "msg": "user msg",
  "user": {"email":"john@example.com","id":12345,"name":"john_doe"},
  "request": {"ip":"192.168.0.1","method":"POST","path":"/login"},
  "response_time_ms": 123
  }

clickhouse {2024-04-01T12:06:05.975Z} [ {3958} ] {{29d7dd2c-8caf-456d-b5c2-1921f1ca0cb8}} <{ERROR}> ({server}( {demo-application})?|{clickhouse-server}): {Query execution completed}

6506:M 01 Apr 12:06:04.990 INFO: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.

83.237.11.230 - - [01/Apr/2024:12:06:04 +0000] "GET /index.html HTTP/1.1" 203 565 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.62 Safari/537.36"

Example Configuration

This configuration will emit an event every 1 second, it will be either an nginx_log log or an apache_common_json log.

nodes:
  - name: demo_input
	type: demo_input
	events_per_sec: 1
	log_type: 
	  - nginx_log
	  - apache_common_json

Required Parameters

name

A descriptive name for the node. This is the name that will appear in Visual Pipelines and you can reference this node in the yaml using the name. It must be unique across all nodes. It is a yaml list element so it begins with a - and a space followed by the string. It is a required parameter for all nodes.

nodes:
  - name: <node name>
    type: <node type>

type: demo_input

The type parameter specifies the type of node being configured. It is specified as a string from a closed list of node types. It is a required parameter.

nodes:
  - name: <node name>
    type: <node type>

events_per_sec

The events_per_second parameter specifies the number of error logs that will be generated per second. It is specified as an integer and is a required parameter.

nodes:
  - name: <node name>
	type: demo_input
	events_per_sec: 2
	log_type: 
	  - <log type>

log_type

The log_type parameter specifies the types of logs the node should emit. It is specified as a map and at least one type is required.

nodes:
  - name: <node name>
	type: demo_input
	events_per_sec: 2
	log_type: 
	  - <log type>
      - <log type>