Creating Edge Delta Cloud Fleets

Installing Edge Delta Cloud Fleets.

Overview

Cloud Fleets are Edge Delta Fleets that are hosted in cloud infrastructure owned and managed by the Edge Delta team. You might decide to use Cloud Fleets in the following scenarios:

  • data sources are serverless workloads such as AWS Lambda functions or events generated from Amazon Kinesis.
  • lightweight edge environments host thin data producers, such as Internet of Things.
  • you do not want to take on resource management associated with hosting an additional workload.
  • security limitations exist for deploying a Fleet in your environment.

You can create, configure, and remove Fleet configurations using the Edge Delta interface. The Cloud Fleet can optionally expose an HTTPS endpoint so you can push data to it. If you don’t create an HTTPS endpoint, you can still pull data into the Fleet by specifying an input in the Pipeline configuration. When you create a Cloud Fleet, you should select a location that is logically close to your data source, for example, in the same region or hosted on the same provider.

Push or Pull Data Inputs

Cloud Fleets cater for both push or pull data input integrations. To push data to the Cloud Fleet, configure an HTTPS endpoint and configure your sources such as a CDN or Amazon Kinesis to push data to that endpoint. To pull data into the Cloud Fleet, add an input node configured with your data source’s endpoint to the Cloud Fleet’s pipeline configuration.

Managing a Cloud Fleet

Click Pipelines - Cloud Fleets.

Header Description
Name A friendly name for the Cloud Fleet.
Status The Fleet status:
- pending or provisioning: The Fleet is initializing so it can’t be updated or deleted.
- scaling: The Fleet is updating so it can’t be further updated or deleted.
- ready: The Fleet is operational so it can be updated or deleted.
- failed: The Fleet has failed and it must be deleted, failed Fleets can’t be updated.
- marked-for-delete: The Fleet is in the process of being deleted.
Count The number of agents deployed in the Cloud Fleets.
HTTPS Endpoint The URL of the HTTPS endpoint that the Cloud Fleet exposes.
Actions A kebab (⋮) menu to Edit or Delete a Cloud Fleet .

Creating a Cloud Fleet

  1. Click Pipelines in the Edge Delta Web App and select Cloud Fleets.
  2. Click + Create.
  3. Enter a descriptive name for the Cloud Fleet.
  4. Select an agent version. The interface lists the current stable version (the latest version number) and most recent candidate version (containing rc). Choose the current stable version. If this configuration doesn’t work you can contact Edge Delta support to experiment with the candidate.
  5. Select a public cloud provider. If your preferred cloud provider is not listed, contact Edge Delta support.
  6. Select the region where the Cloud Fleet will be hosted.
  7. For Config ID, there are 2 options:
  • select Generate one for me if you want to create a new Pipeline configuration.
  • If you have already configured an agent and you want to reuse that configuration, select the configuration ID from the drop down.
  1. Select the HTTPS checkbox if you want your data source to push data to a secure HTTP endpoint on the Cloud Fleet.
  2. Click Create.

The new Cloud Fleet is added to the Cloud Fleets table. If you configured an HTTPS endpoint, the URL is listed on the table. Configure your workloads to push to this endpoint. When an HTTPS endpoint is configured, the following node configuration will tail a file in the Edge Delta hosted infrastructure that is populated by that HTTPS endpoint.

nodes:
- name: captured_requests
  type: file_input
  path: /var/captured_requests/body_*.json

If you created a Cloud Fleet with an existing pipeline configuration in step 7, and you selected HTTPS to push traffic to it, you need to add this node manually.

If you created a Cloud Fleet without HTTPS, you need to add an input node to its pipeline and specify your data source’s endpoint to pull traffic from your data source.

Cloud Fleet Resources

You can change a Cloud Fleet’s memory limit, CPU limit or agent count on the Cloud Fleets page: Select Edit from the kebab (⋮) menu for the Fleet you want to update. The Edit Cloud Fleet page opens and you can make the changes to the resource settings.

Delete a Cloud Fleet

To delete a Cloud Fleet, open the Cloud Fleet page and select Delete from the kebab (⋮) menu for the Fleet you want to remove. The configuration will remain listed in the Pipelines page until you delete it there too, although it will not have any active Fleets using it.