Skip to main content

About the Manta collector

Use this collector to harvest lineage relationships from Manta including metadata for databases, tables, and columns and make it searchable and discoverable in data.world.

Important

The Manta collector can be run in the Cloud or on-premise using Docker or Jar files.

Note

The latest version of the Collector is 2.251. To view the release notes for this version and all previous versions, please go here.

Important things to note

  • The collector only harvests metadata from connections that a user has set up in Manta. It does not work when the user imports an export file or dump file from another instance of Manta.

  • The Manta collector supports the following database: PostgreSQL, Microsoft SQL Server, Teradata, Oracle, Hive, DB2, Snowflake.

What is cataloged

The collector catalogs the following information.

Table 1.

Object

Information cataloged

Database

Table, Type, Name

Schema

Name

Table

Name

Columns

Column Type, Name, Index, JDBC type

File resource

Name



Lineage for Manta

The MANTA collector harvests information in MANTA scans for the MANTA scan sources that we support (intra-database lineage for relational databases, and ETL processes from Informatica PowerCenter and Talend).

For relational databases, the collector harvests lineage relationships between views and the tables from which each view selects data, and stored procedures with tabular results and tables referenced by each procedure.

For ETL technologies, the collector harvests lineage relationships between source and sink tables in each ETL process.

Manta versions supported

  • The collector supports Manta versions R35, R38.1, R40.1, R41 and R42. Because of known issues, the collector does not work for versions R37 and R38.

Important

The collector uses MANTA’s batch export integration functionality which requires MANTA version R30 or above, and a license that enables the batch export integration functionality.

Authentication supported for cataloging Manta

The collector supports both username & password and token-based authentication.

Important

Token-based authentication works for connections that a user has set up in Manta, but does not work when the user imported a dump file.

For username/password authentication, make sure you set the following parameters:

  • --manta-user

  • --manta-password

For token-based authentication, make sure you set the following parameters:

  • --manta-token-url

  • --manta-client-id

  • --manta-client-secret

In this section: