Edge Delta Hosted Agents

Installing Edge Delta Hosted Agents.

Overview

Hosted Agents are Edge Delta agents that are hosted in cloud infrastructure owned and managed by the Edge Delta team. You might decide to use hosted agents in the following scenarios:

  • data sources are serverless workloads such as AWS Lambda functions or events generated from Amazon Kinesis.
  • lightweight edge environments host thin data producers, such as Internet of Things.
  • you do not want to take on resource management associated with hosting an additional workload.
  • security limitations exist for deploying an agent in your environment.

You can create, configure, and remove agent configurations using the Edge Delta interface. The hosted agent can optionally expose an HTTPS endpoint so you can push data to it. If you don’t create an HTTPS endpoint, you can still pull data into the agent by specifying an input in the agent configuration. When you create a hosted agent, you should select a configuration that is logically close to your data source, for example, in the same region or hosted on the same provider.

Push or Pull Data Inputs

Hosted agents cater for both push or pull data input integrations. To push data to the hosted agent, configure an HTTPS endpoint and configure your sources such as a CDN or Amazon Kinesis to push data to that endpoint. To pull data into the hosted agent, add an input node configured with your data source’s endpoint to the Hosted Agent’s pipeline configuration.

Managing a Hosted Agent

Click Pipelines - Hosted Agents.

Header Description
Name A friendly name for the hosted agent.
Status The agent status:
- pending or provisioning: The agent is initializing so it can’t be updated or deleted.
- scaling: The agent is updating so it can’t be further updated or deleted.
- ready: The agent is operational so it can be updated or deleted.
- failed: The agent has failed and it must be deleted, failed agents can’t be updated.
- marked-for-delete: The agent is in the process of being deleted.
Count The number of agents deployed in the Hosted Agents.
HTTPS Endpoint The URL of the HTTPS endpoint that the hosted agent exposes.
Actions A kebab (⋮) menu to Edit or Delete a hosted agent .

Creating a Hosted Agent

  1. Click Pipelines in the Edge Delta Web App and select Hosted Agents.
  2. Click + Create.
  3. Enter a descriptive name for the hosted agent.
  4. Select an agent version. The interface lists the current stable version (the latest version number) and most recent candidate version (containing rc). Choose the current stable version. If this configuration doesn’t work you can contact Edge Delta support to experiment with the candidate.
  5. Select a public cloud provider. If your preferred cloud provider is not listed, contact Edge Delta support.
  6. Select the region where the hosted agent will be hosted.
  7. For Config ID, there are 2 options:
  • select Generate one for me if you want to create a new agent configuration.
  • If you have already configured an agent and you want to reuse that configuration, select the configuration ID from the drop down.
  1. Select the HTTPS checkbox if you want your data source to push data to a secure HTTP endpoint on the hosted agent.
  2. Click Create.

The new hosted agent is added to the Hosted Agents table. If you configured an HTTPS endpoint, the URL is listed on the table. Configure your workloads to push to this endpoint. When an HTTPS endpoint is configured, the following node configuration will tail a file in the Edge Delta hosted infrastructure that is populated by that HTTPS endpoint.

nodes:
- name: captured_requests
  type: file_input
  path: /var/captured_requests/body_*.json

If you created a hosted agent with an existing pipeline configuration in step 7, and you selected HTTPS to push traffic to it, you need to add this node manually.

If you created a hosted agent without HTTPS, you need to add an input node to its pipeline and specify your data source’s endpoint to pull traffic from your data source.

Hosted Agent Resources

You can change a Hosted Agent’s memory limit, CPU limit or agent count on the Hosted Agents page: Select Edit from the kebab (⋮) menu for the agent you want to update. The Edit Hosted Agent page opens and you can make the changes to the resource settings.

Delete a Hosted Agent

To delete a hosted agent, open the Hosted Agent page and select Delete from the kebab (⋮) menu for the agent you want to remove. The configuration will remain listed in the Pipelines page until you delete it there too, although it will not have any active agents using it.