Catalog collector release notes

SQL Server collector: Added support for Active Directory Service Principal and Entra ID authentications.

Amazon S3 collector: Enhanced object filtering based on configuration options to include or exclude object names before checking the maximum resources limit.

AWS Glue Collector: Added functionality to catalog partitioned columns.

Power BI Service and Power BI Gov collectors: Resolved an issue with the CombineColumns transform step that was causing warnings in some cases due to misalignment in lineage to source columns.

dbt Core collector: Improved handling of situations where the profiles.yml file is mistakenly specified as a directory.

Salesforce collector: The security token configuration option is no longer required, as there are scenarios where authentication to the Salesforce API does not require it.

Power BI Service and power BI Gov collectors: Fixed a problem that was occurring while attempting to replace parameters in custom SQL when the parameter name contained a special character.

dbt cloud collector: Fixed an issue in which the user-specified Snowflake account override was being ignored by the collector.

Reltio collector: The collector now supports client_credentials authentication, in addition to the existing user and password authentication.

Denodo collector: The collector now harvests primary and foreign keys by schema to improve performance.

Databricks collector: Introduced a new parameter, --exclude-system-functions, which allows collector to exlude harvesting of built-in Databricks system functions.

Power BI Service and Power BI Gov collectors: The collectors now catalog the following additional properties:

Oracle collector: Modified the --linked-host option to require the database name for a linked database, as there was no reliable way to query this through the link.

Power BI Service and Power BI Gov collectors: Fixed an issue with parsing parameters in SQL to account for the use of Text.From().

The following two new collectors are now available in private preview. If you would like access to this collector, please contact your Customer Success Director.

Azure Data Lake Storage Gen2 collector: Enabled harvesting of Azure blob storage. Two new parameters are Introduced as a result of this change: --disable-adls-gen2, --disable-azure-blob-storage

PowerBI collector:

ADLS (Azure Data Lake Storage) Gen2 collector: The collector now supports harvesting Azure blob storage.

Redshift collector: Added support for harvesting materialized views.

Databricks collector: Skipped collection of extended table metadata for system database to ensure stable run.

Monte Carlo collector: Resolved a null pointer error caused by unexpected null values.

PowerBI collector: The collector now supports parsing custom SQL queries for Databricks sources.

Oracle collector:

Databricks collector:

SQL Server Integration Services (SSIS) collector: Fixed an issue with missing file connection strings.

SQL Server collector: Added support for parsing WITH TIES and TRY_CAST statements.

PowerBI collector: Added an optional starter datasource YAML file required for harvesting lineage. If the YAML file is missing or incomplete, a template will be generated in the collector logs for easy reference.

All collectors: Fixed an issue with detecting the existence of configured datasets.

SQL Server collector now catalogs:

PowerBI collector: Improved data source titles for better specificity.

Salesforce collector: Optimized the process of fetching authentication tokens to reduce the number of Salesforce API calls.

Sigma collector: Fixed an issue with API structure changes due to pagination limits.

Redshift collector:  Resolved an issue where the collector incorrectly reported that the provided credential did not have access to the database tables being harvested.

Snowflake collector:

Denodo collector:

SQL Server collector: Added support for lineage in stored procedures that do not use BEGIN/END statements in the procedure body.

dbt Cloud collector: The collector now accommodates large numeric values for account, project, and run identifiers.

Redshift collector: Fixed an issue with view parsing for lineage when no schema binding is present.

The following two new collectors are now available in private preview. If you would like access to this collector, please contact your Customer Success Director.

The Amazon QuickSight collector is now generally available to all customers.

Power BI Report Server (PBIRS) collector: Fixed an issue when collector resource does not have a parent folder.

Oracle collector: The collector now supports cataloging lineage when database links are used in view and stored procedure and function definitions.

Snowflake collector: The collector now properly handles comments in view SQL definition during lineage parsing.

Sigma collector: Resolved an error caused by changes in the API response structure when the number of records exceed the default pagination limit.

Snowflake, Redshift, Databricks, Denodo, Oracle, PostgreSQL, Teradata, MySQL, Db2, Netezza, SQL Server collectors: The collectors now support harvesting decimal digits metadata for columns.

Generic JDBC, Denodo, MySQL, SQL Server collectors: Resolved arithmetic overflow error when converting expressions to data type bigint.

SSIS collector: Added database location information when creating a database asset.

Tableau collector: The collector now supports filtering descendant projects.

Salesforce collector: The collector now properly handles null responses from the Salesforce API.

Snowflake collector: Fixed an issue where column nodes were not being copied to the interleaved Snowflake graph.

Tableau collector: Fixed an issue with missing owner users for various resources.

Power BI and Power BI Gov collectors: Added new relationships from app report to workspace report.

Salesforce Collector: Implemented a fix to avoid exceptions when custom object field metadata contains null values.

Denodo Collector: Resolved an issue with harvesting view SQL.

Power BI Service and Power BI Gov collectors:

Power BI Gov collector: The collector now supports harvesting of user workspaces using the --include-user-workspace parameter.

Databricks collector: The collector now supports harvesting data from ADLS (Azure Data Lake Storage) Gen2 external location.

dbt Core collector: Added support for dbt projects using the dbt-sqlserver adapter.

SQL Server Reporting Services (SSRS) and Power BI Report Server (PBIRS) collectors: Fixed an issue that occurred while fetching information on data sources for a report.

SQL Server Reporting Services (SSRS) and Power BI Report Server (PBIRS) collectors: Fixed an issue that caused API requests to return an HTTP 404 error.

Go here to access release notes for previous version.