Preparing to run the InfluxDB collector
Setting up pre-requisites for running the collector
Make sure that the machine from where you are running the collector meets the following hardware and software requirements.
Item | Requirement |
|---|---|
Hardware (for on-premise runs only) Note: The following specs are based upon running one collector process at a time. Please adjust the hardware if you are running multiple collectors at the same time. | |
RAM | 8 GB |
CPU | 2 Ghz processor |
Software (for on-premise runs only) | |
Docker | Click here to get Docker. |
data.world specific objects (for both cloud and on-premise runs) | |
Dataset | You must have a ddw-catalogs dataset set up to hold your catalog files when you are done running the collector. If you are using Catalog Toolkit , follow these instructions to prepare the datasets for collectors. |
Network connection | |
Allowlist IPs and domains | |
Setting up InfluxDB
The collector harvests metadata from InfluxDB using token-based authentication. This section walks you through the process of creating this user.
Important
You will use this information while setting up the collector parameters.
To set up a user for the collector:
Follow the InfluxDB instructions to create a new user that the collector will use for authenticating to InfluxDB.
From the InfluxDB API Tokens page, generate a new custom API Token with read permissions on the objects that will be harvested: Buckets, Telegrafs, Labels, Orgs, Tasks.