Skip to main content

Catalog collector release notes

Important

Published versions of collectors are available as a docker image and a JAR file.

Release version 2.273

Details about the release

Table 1.

Item

Details

Release version

2.273

Release date

12 April, 2025

Docker image ID

Jar file



Bug fixes

  • Monte Carlo collector: Fixed alignment issues in generated table information from Monte Carlo Monitor by properly escaping pipes ('|') in monitor names.

Release version 2.272

Details about the release

Table 2.

Item

Details

Release version

2.272

Release date

11 April, 2025

Docker image ID

Jar file



New features and changes

  • A new collector, the SAP HANA collector, is now available in public preview.

  • SSIS collector: Now captures the connections between packages through the control flow, improving visibility of package relationships.

  • Databricks collector: The collector now harvests lineage only within the current schema. A new option Harvest entire lineage (--harvest-entire-lineage) is added to enable harvesting lineage from external schemas.

  • Microsoft Fabric collector: Enhanced to support additional syntaxes for Semantic Model table connections to Fabric warehouse/lakehouse resources, broadening compatibility and connectivity.

Bug fixes

  • QlikSense collector: Made performance improvements to increase the efficiency and speed of the collector.

  • Microsoft Fabric collector: Fixed issues with Lakehouses and SQL endpoints to ensure database resources are associated with the correct resource, enhancing accuracy.

Release version 2.271

Details about the release

Table 3.

Item

Details

Release version

2.271

Release date

3 April, 2025

Docker image ID

Jar file



Bug fixes

  • Tableau collector: Fixed an issue to ensure proper handling of sites and projects with large quantities of column and data source fields.

  • Databricks collector: Resolved a parsing issue in view queries where aliases starting with a number caused failures.

Release version 2.270

Details about the release

Table 4.

Item

Details

Release version

2.270

Release date

31 March, 2025

Docker image ID

  • Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

    • amd64: sha256:4ef7ce6fbf19c6ca9be1836d9e7ad11f8846480d037808cf746aff772f5fe9c0

    • arm64: sha256:2f0ac52d9891790444061c718d0b47b808b50d443d1571ec9dbd1426b57b3ffe

Jar file



New features and changes

  • The following two new collectors are now available in public preview.

  • Power BI collector: The collector now harvests column descriptions for Power BI columns.

  • Databricks collector: The collector now supports Oauth service principal authentication for Databricks. Two new parameters, Service principal client ID (--client-id) and Service principal client secret (--client-secret) are introduced for this.

Bug fixes

  • Tableau collector: Fixed an issue with the display of lineage between Tableau Fields and Database Columns, ensuring accurate representation of data relationships.

Release version 2.269

Important

This release was for internal improvements and has no customer impacting changes.

Details about the release

Table 5.

Item

Details

Release version

2.269

Release date

25 March, 2025

Docker image ID

  • Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

    • amd64: sha256:bf16a4096768878ce956b3d215be58a02a5eec0d422f00ae2605a4d632161269

    • arm64: sha256:402330521664791a905a9d4987b8463a75c844e1de179709f67ac41f98ecb25b

Jar file



Release version 2.268

Warning

Collector versions 2.264 through 2.267 have been deprecated. If you are using these versions, please update to version 2.268 as soon as possible.

Details about the release

Table 6.

Item

Details

Release version

2.268

Release date

24 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:71d1c7d7af7e1883ca1285cffc96e7259aeabadc42830511ff014a645de9f5d2

  • arm64: sha256:7912116980fa3e8b1e42e875fef1a57f16888e844afb16fdffdab2539c63d8e3

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.268/dwcc-2.268.zip

  • Sha256: ecd223fac5f28a9a575e9bb1bee71f6a4a2cce46f44830d71c1ee32d3355fed0



New features and changes

  • Snowflake Collector: The collector now harvests system tags.

  • SSIS collector: The collector now supports the inclusion or exclusion of specific databases or servers from being harvested. For new parameters are introduced to use these features: --include-database, --exclude-database, --include-server, --exclude-server.

Bug fixes

  • All collectors: Resolved an issue where collectors created new collections with a new ID, leading to duplicate collections in the catalog.

  • Qlik Sense collector: Fixed an issue where missing user information in Qlik Sense resulted in an exception trace in the logfile.

  • Azure data factory collector: Added a log message to indicate when the Dataset API response lacks sufficient information, such as schema and table details, to construct lineage.

Release version 2.267 (deprecated)

Warning

This collector version is deprecated. Please use version 2.268 or higher to receive the latest collector updates.

Details about the release

Table 7.

Item

Details

Release version

2.267

Release date

17 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:1a57e39be32b58a8e287a5429491461987fe9108628612fa41ddacdb3d493661

  • arm64: sha256:f38814914fa6330d9c696c38b00e6424b92eb2f540a214bef9233a2ba500f172

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.267/dwcc-2.267.zip

  • Sha256: f5fffc04e80a8a81908ac94b54efd520a0ac9d4324f99e9aa389c1229133b9d9



New features and changes

  • Tableau collector: The way we represent ownership information for workbooks, views, and metrics in the Tableau catalog has been updated. The owner is now represented using the kos:hasOwner property.

    Important

    The former approach utilizing kos:createdBy will continue to be supported during a transition period but is deprecated and will be phased out in a future release. This change only impacts users who have written SPARQL queries or exported content using RDF properties. You will want to update your queries accordingly to reflect this update.

Bug fixes

  • Alteryx collector: Increased API call read timeout and improved error handling by capturing and logging processing exceptions.

Release version 2.266 (deprecated)

Warning

This collector version is deprecated. Please use version 2.268 or higher to receive the latest collector updates.

Details about the release

Table 8.

Item

Details

Release version

2.266

Release date

10 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:390cd67a5a71c60669e9389310badb17f0a624868c0abd77fe5c8c963acd93f5

  • arm64: sha256:7151d3cd2794676bcd3e05b2ef9260ba2c1d1b78ca9c1ff347312f7178bd11da

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.266/dwcc-2.266.zip

  • Sha256: faa3bdd9ebaf07a1328316d32b474f0d098b4842289d873c4f3985dc51bf1f9a



Bug fixes

  • Confluent collectors: The collector now correctly handles cases where consumer member assignments are missing a topic description.

Release version 2.265 (deprecated)

Warning

This collector version is deprecated. Please use version 2.268 or higher to receive the latest collector updates.

Details about the release

Table 9.

Item

Details

Release version

2.265

Release date

10 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:9bed576a51eb315ee2b1399d11e0b9fd8d8957792cd577d94cf531fe5d27459f

  • arm64: sha256:d33e1f591f104fea033bf4c8d154c66e08db86131828d815416aedf4de59044e

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.265/dwcc-2.265.zip

  • Sha256: a97b9770a3ca23b8a6974cb6aebd660edc6ea78675bc40fea8d584d81456b33c



Bug fixes

  • Tableau collector: The collector now accurately harvests hidden dashboards. Previously, the feature was limited to hidden Views, which included both Sheets and Dashboards but classified them all as Sheets. With this update, the collector distinguishes between Sheets and Dashboards, assigning the correct type to each entity. This ensures a more accurate representation of hidden Views in Tableau.

Release version 2.264 (deprecated)

Warning

This collector version is deprecated. Please use version 2.268 or higher to receive the latest collector updates.

Details about the release

Table 10.

Item

Details

Release version

2.264

Release date

7 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:6e716b6fd9e635a2a54af5743507d932a7aaf003090b06bb5091c782e4bd39e3

  • arm64: sha256:43ecd32f0fe955eab774011ac8aef6c1fd3024087b4c3f810314dc62ce35d8a8

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.264/dwcc-2.264.zip

  • Sha256: 236d5981adbc919337689d1c175ac82c13c315e4b1aeefb6e7ffa476223d8c42 (



New features and changes

  • A new collector, the AWS Database Migration Service (DMS) collector, is now available in public preview.

  • Tableau collector: Improve command guidance, documentation, and warnings about the required format of the Tableau API URL option.

  • Alteryx collector: The collector now harvests nested workflow nodes and catalogs their relationship with the workflow.

  • Azure Data Factory collector: Made improvements to Azure Data Factory lineage by enhancing the harvesting of lineage from parameterized dataset references. The collector now also harvests both downstream and upstream resources.

  • Oracle collector: Add a new parameter --autonomous-db-connection-string for connection string for autonomous DB.

Release version 2.263

Details about the release

Table 11.

Item

Details

Release version

2.263

Release date

3 March, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:40f9a92cd0715afe2d3cf422c6990251ba72c7b540233d47d269a7c2105ebc8c

  • arm64: sha256:3b361d434add509aaeba3abefc44434fcf0d07ed77abdae8f95ae023d8b8f98e

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.263/dwcc-2.263.zip

  • Sha256: 726d229923640d4f50d035cad0b2f09f6de32bda0799468310fa7526456f5762



New features and changes

  • Tableau collector: The collector now harvests relationships between SQL tables and workbooks, enhancing data connectivity and visualization.

  • AWS Glue collector: Enhanced the collector to harvest lineage from Glue Data Catalog tables to their underlying S3 objects and gather more metadata for tables. The enhanced collector is available with the command catalog-aws-glue, while the legacy collector remains available as catalog-aws-glue-legacy or catalog-awsglue for compatibility. Please coordinate with your Customer Success Director for a smooth transition to the new collector version soon.

    Note that the AWS Glue collector is only available as an on-premise solution, not as a cloud collector.

Bug fixes

  • Tableau collector:

    • Resolved an error in harvesting Custom SQL Tables.

    • Fixed an issue with filtering projects by name or ID.

Release version 2.262

Details about the release

Table 12.

Item

Details

Release version

2.262

Release date

26 February, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:3c5917f723b5ff38e1b092033d48b3b1363301f80cd23003e47c1d475adcbe78

  • arm64: sha256:5892d8b9cb9c2bdac5ef726992dac06c5b85764da20057d26b612ed4864b7ad8

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.262/dwcc-2.262.zip

  • Sha256: 759f3281642799d202701cf204784f35adffa58bfe3b34a394a4f834a4386760



Bug fixes

  • Tableau collector:

    • Fixed an issue with URL encoding.

    • The collector now properly handles server errors in GraphQL pagination.

  • Databricks collector: Fixed an issue where a null pointer exception occurred while harvesting tags from Databricks.

Release version 2.261

Details about the release

Table 13.

Item

Details

Release version

2.261

Release date

19 February, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: 31aa0ebe14a394e4f4cf047507a44a7ca68a2ea9b6f370efa89c15e435d2f8a4

  • arm64: e7216489149aab7e1023de8714d53b1600527682a630bb1affcc0b093e2d7922

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.261/dwcc-2.261.zip

  • Sha256: 501c77d400c9ac9b446b7c68b8ad6173a084fea56f4ff207ba17752a13ccbda3



Bug fixes

  • Databricks collector: Fixed an exception that occurred when the table type did not match any known types.

  • Fivetran collector: Updated to use new APIs for retrieving column lineage due to changes in Fivetran API.

    Important

    Update your collector configurations to the latest version to seamlessly view column lineage without disruptions.

Release version 2.260

Details about the release

Table 14.

Item

Details

Release version

2.260

Release date

13 February, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64:  6f10f8b049d5a7888c1f1d1e6b7a657874942560783e2111079d454e9ff0cc6d

  • arm64:  c753be3a616f20f2e13b9138650c5c60b9564089d5713b26717af029a6d15e10

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.260/dwcc-2.260.zip

  • Sha256: 2b38736cc0bfb89605de63172ab3f15d34634e9fda1e81950a25f8797b20bd14



New features and changes

  • Snowflake collector: Added support for parsing SQL that utilizes IDENTIFIER() function calls when passing exact table names.

Bug fixes

  • Tableau collector (Preview): Added a null check in custom SQL Table logic to prevent errors.

  • SQL Server collector: Reduced excessive log and warning messages during dependency collection to streamline output.

  • Databricks collector: Improved error handling for connection issues with the Databricks host.

Release version 2.259

Details about the release

Table 15.

Item

Details

Release version

2.259

Release date

6 February, 2025

Docker image ID

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.259/dwcc-2.259.zip

  • Sha256: f640358d0fc600177c9ea6ec186701fb95422032bbc0a370c8ad72a6a83c4364



New features and changes

  • Databricks collector: Added support for harvesting resources with the browse privilege.

  • Tableau collector: Now supports harvesting lineage between Custom SQL tables and their upstream tables.

  • Power BI and Power BI Gov collectors: Handling calculated tables as a new type and cataloging table-level lineage to source tables and columns.

Bug fixes

  • Monte Carlo collector: Updated the collector to remove reaction type from incidents, as it has been deprecated in Monte Carlo GraphQL responses.

  • Salesforce collector: Added a null check to prevent exceptions when last modified by information is missing.

Release version 2.258

Details about the release

Table 16.

Item

Details

Release version

2.258

Release date

30 January, 2025

Docker image ID

  • Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

    • amd64: sha256:ad528403bde60ee172d2897a309a3f81d5822ae4703a10038faf0449327387fa

    • arm64: sha256:5ea5eda08a8f9d5aa3b5a0135d483c1e2594cb3befde5235e4aaee59492994ce

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.258/dwcc-2.258.zip

  • Sha256: e65b63cebc9de475da0363e7386c767ad1f1b27ef35c827d2874e46c99bf53e7



New features and changes

Bug fixes

  • Reltio collector: Resolved an issue that caused errors when cataloging containment relationships for certain attribute containers

  • Power BI and Power BI Gov collectors: Stopped cataloging JDBC types for columns in Power BI, as this task is best handled by the database collector. Power BI previously attempted to infer JDBC types based on its column types, which is now corrected.

Release version 2.257

Details about the release

Table 17.

Item

Details

Release version

2.257

Release date

27 January, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: b5db2307f0be0c0a4c3502553eba62cbf9e06317c376b219f4abde6a718b2bf4

  • arm64: af7c072e01ea52cfc6084ee65840137c604b21d1f0b6ea779abad8f676a150b1

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.257/dwcc-2.257.zip

  • Sha256: 41dcb2fc02ea85427a1af272f354e8f9052ffad1bcf5c93fc06ec81bf080321e



New features and changes

  • Power BI and Power BI Gov collectors:

    • Added the ability to include database names in the datasources mapping file, allowing datasource credentials to be restricted to specific databases.

    • Introduced a flag for Power BI tables to indicate when data is loaded manually.

  • Tableau collector: Enhanced the collector to catalog unpublished views, expanding visibility into Tableau assets.

Bug fixes

  • Snowflake collector: Enhanced the incremental collection process to prevent the deletion of specific database column resources, ensuring data integrity and continuity.

  • Monte Carlo collector: Updated to catalog Monte Carlo warehouse IDs instead of hostnames due to API changes.

  • Databricks collector: Fixed an issue where the --include-information-schema option produced an incorrect warning.

  • Denodo collector: Resolved an issue with the internal cleanup function that was unable to remove PRIMARY KEY statements from SQL.

Release version 2.256

Details about the release

Table 18.

Item

Details

Release version

2.256

Release date

17 January, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: 0606de5390dbaca7c2e9d49182bc3997abac527c1ac8b78cc3c919f5967d409b

  • arm64: 939f1ee03131f2a444e5a1024714fb8c760b974af0170cf40d6e34d326e0c7b6

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.256/dwcc-2.256.zip

  • Sha256: d876c31865c2dd85869d72a26672a4c00524442f5705687e896b38186395fb10



Bug fixes

  • Power BI Service and Power BI Gov collectors: Resolved an issue with handling parameters when they are referenced using @ symbol.

Release version 2.255

Details about the release

Table 19.

Item

Details

Release version

2.255

Release date

15 January, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: ce574a7acfa46530255ec8f7d046b66b5bf34c1968e2707b130bdb09fe1404f5

  • arm64: c035cd41f02098abd9e64ffe8306d01baf35e0e80468d3cc15cfc56040d9db48

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.255/dwcc-2.255.zip

  • Sha256: a7216794603a0033c91e65399e856d7fab90b207b1892e94018884afead2f444



New features and changes

  • Databricks collector: Added support for harvesting SQL queries and their associated lineage. A new parameter Page size for harvesting queries (--query-pagination-limit) is introduced for this.

  • Power BI Service and Power BI Gov collectors: Added support for jdbcProperties in the datasources.yaml configuration for connecting to databases when resolving lineage.

Bug fixes

  • Snowflake, Redshift, Databricks, Denodo, Oracle, PostgreSQL, Teradata, MySQL, Db2, Netezza, SQL Server collectors: Database authentication issues are now reported as errors.

  • Oracle collector:

    • Corrected the command description for the autonomous database parameter.

    • Fixed an issue with removing comments containing special symbols.

  • Redshift collector: The collector now correctly harvests distinct utility functions and procedures.

  • Databricks collector: Resolved an issue where column names were not recognized due to case sensitivity mismatches.

Release version 2.254

Details about the release

Table 20.

Item

Details

Release version

2.254

Release date

7 January, 2025

Docker image ID

Link to download the Docker image: https://hub.docker.com/r/datadotworld/dwcc/tags

  • amd64: sha256:f52f106cda278cd04c04377070a469f33702a33c2701a3809564f844109a1fb0

  • arm64: sha256:3bb2521a91fdc5a33845fd0056d56756b4c674e2f1b4aca21c93e6db092cc762

Jar file

Link to download the JAR file: https://releases.data.world/dwcc/2.254/dwcc-2.254.zip

  • Sha256: bf09e8abb8d1869d3e3d3640b38273285b6dcc2d64236632aa84fd3e0ec51d2b



New features and changes

  • Oracle Collector: Now supports harvesting from Oracle Autonomous Database. A new parameter --autonomous-db is introduced for this.

  • Tableau collector: Now supports harvesting of personal space workbooks. A new parameter --tableau-catalog-personal-space-workbooks is introduced for this.

Bug fixes

  • Power BI collector: Resolved an issue with parameter replacements in table source expressions when a parameter name is the same as the name of the table it defines.

  • SQL Server collector: Ensured encryption is enabled for connections when the encrypt JDBC property is configured.

  • Alteryx collector: Fixed an issue encountered while fetching workflow details when the user does not have permission on the workflow.

Release notes for previous versions