Connection manager with DATASOURCE NAME
Using the Connection Manager
Browse to the profile page of the organization for which you want to set the connection manager. You can do this from Left sidebar > Organizations or by clicking the organization name from anywhere in the application.
On the Settings tab go to the Connection manager section.
From here you can create new connections, edit and delete collections and manage tasks for the connection.
Create a connection
To create a new connection to your data sources, click the Add connection button.
The dialog opened lists the database sources for which you can create an organization level connection:
Select a source to be presented with the configuration screen for your connection.
Edit or delete existing connections
The Three dot menu to the right of a connection name gives options to Create task, Edit connection, and Delete connection.
Edit connection links to the same configuration page used to create the connection, and you need to have the same security information (login, password, etc.) to change anything about the connection.
Delete connection prompts you to be sure you want to proceed, but does not require any further validation.
Note
Any organization admin or other authorized person with the credentials for a connection can modify it, and any data steward or other authorized person with access to the Connection manager can delete connections.
Tasks
A metadata task catalogs the metadata for a data source and places the extracted information into a specified Collection. For now, the system only supports creating metadata tasks. Use the Create task option available in the Three dot menu to the right of a connection to create a new task for the configured connection.
Note
Before creating a task you need to have a collection in which to put your task output. The collection must be created before the task.
Caution
Tasks work with version 2.x of DWCC. If you are still using DWCC v1.x, see the article on DWCC v2.0 for more information.
The Create task button opens a dialog where you can configure your new task. To create a task you will be prompted to choose a database and schema as appropriate. You also need to add it to a collection.
The Three dot menu to the right of each task gives options to sync, edit, or delete the tasks.
Sync runs the task again, pulling in any new metadata.
Edit task details opens the Edit task window where you can change any of the original configuration (database, schema, or collection),
Delete task removes the task.
Create a connection
To create a new connection to your data sources, click the Add connection button.
The dialog opened lists the database sources for which you can create an organization level connection:
Select a source to be presented with the configuration screen for your connection.
Database configurations
Select your database from the following list to get specific configuration for it:
Edit or delete existing connections
The Three dot menu to the right of a connection name gives options to Create task, Edit connection, and Delete connection.
Edit connection links to the same configuration page used to create the connection, and you need to have the same security information (login, password, etc.) to change anything about the connection.
Delete connection prompts you to be sure you want to proceed, but does not require any further validation.
Note
Any organization admin or other authorized person with the credentials for a connection can modify it, and any data steward or other authorized person with access to the Connection manager can delete connections.
Tasks
A metadata task catalogs the metadata for a data source and places the extracted information into a specified Collection. For now, the system only supports creating metadata tasks. Use the Create task option available in the Three dot menu to the right of a connection to create a new task for the configured connection.
Note
Before creating a task you need to have a collection in which to put your task output. The collection must be created before the task.
Caution
Tasks work with version 2.x of DWCC. If you are still using DWCC v1.x, see the article on DWCC v2.0 for more information.
The Create task button opens a dialog where you can configure your new task. To create a task you will be prompted to choose a database and schema as appropriate. You also need to add it to a collection.
The Three dot menu to the right of each task gives options to sync, edit, or delete the tasks.
Sync runs the task again, pulling in any new metadata.
Edit task details opens the Edit task window where you can change any of the original configuration (database, schema, or collection),
Delete task removes the task.
Currently supported data sources
We support working with many data sources, and we continue to add new sources all the time. Below is a list of the data sources we connect to, and the options for connecting to them. The links for each go to the configuration instructions in Connection Manager or the metadata collector:
data source | Extract data from data source | Collect metadata from data source | Create a live connection to data source |
|---|---|---|---|
Apache Spark | not yet | not yet | |
Athena | |||
AWS Glue | not yet | not yet | |
Azure Synapse | yes* | ||
BigQuery | |||
Databricks | not yet | not yet | |
Datakin | not yet | not yet | |
DB2 | not yet | not yet | |
dbt | not yet | not yet | |
Denodo | |||
Domo | not yet | not yet | |
Dremio | not yet | not yet | |
Generic JDBC | not yet | not yet | |
Hive | not yet | not yet | |
Hive metastore | not yet | not yet | |
Infor Ion | |||
Looker | not yet | not yet | |
Manta | not yet | not yet | |
Marquez | not yet | not yet | |
Monte Carlo | not yet | not yet | |
My SQL | not yet | ||
Open API | not yet | not yet | |
Oracle | not yet | ||
PostgreSQL | |||
PowerBI | not yet | not yet | |
Presto | not yet | not yet | |
Redshift | |||
Reltio | not yet | not yet | |
Salesforce | not yet | not yet | |
Snowflake | |||
SQL Anywhere | not yet | not yet | |
SQL Server | |||
Tableau Server | not yet | not yet | |
Vertica | not yet | not yet |
*Collecting metadata from Azure Synapse is currently only available through the Collection Manager.