Catalog Toolkit release notes

• ServiceNow variable name for fields: Added a new ServiceNow Variable Name property in Catalog Configuration, allowing you to map specific metadata fields to corresponding variables in ServiceNow for use in the Premium automation - Approval: Access Request. This property can now be added to the following metadata field types: Freeform, Select, Date, Account.

• Talend MDP module: Corrected the Table-to-Job and File-to-Job labels and relationship types for improved accuracy. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• OpenAPI 3 MDP module: Corrected identifiers for OpenAPI resources and the Object Schema Field-to-Object Schema relationship, ensuring proper linkage and display. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Hoot Browser Extension MDP module: Added a metadata profile to support configuring resources for the updated Hoot browser extension.

• dbt MDP module: Added support for dbt Semantic Model metadata. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Data Products MDP module: Updated field descriptions and edit hints for improved clarity and usability. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Database MDP module improvements: Added support for database table index metadata, improving visibility into database performance characteristics. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Informatica MDP module: Updated the Task-to-Resource relationships. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Oracle MDP module: Added metadata fields and relationships for Oracle database roles. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• MS Fabric MDP module: Added a Report Is Hidden field, allowing users to identify reports that are hidden within the Fabric environment. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• OpenAPI3 MDP module: Added an Operation-to-Operation Parameter relationship, enriching the representation of API call structures. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Alteryx MDP module: Added a Query field to Workflow Node resources, improving traceability of query logic within workflows. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Databricks MDP module: Added Databricks Model metadata. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Power BI MDP module: Updated the predicate used for the Power BI App → Power BI Workspace relationship for improved accuracy. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• MS SQL Server MDP module: Added replication metadata, extending coverage of SQL Server features. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• MS Fabric MDP module: Added metadata for Dataflow Gen2, Job Run, and Refresh Schedule objects. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Tableau MDP module: Added revision metadata fields for workbooks and published data sources. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Sensitive data classification MDP module: Optimized the transformation query to remove potential sync dependencies, improving performance and reliability.

• Organization browse card support via Catalog Toolkit: This feature is now deprecated. It will no longer be updated or maintained, though existing browse card configurations will continue to function. For an alternative, check out how to create browse cards directly in the UI.

• Sensitive data classification MDP module: Added support for the updated Sensitive Data Classification collector feature.

• Database MDP module improvements

  • Common JDBC configuration consolidation: Moved the common JDBC MDP configuration from individual source modules into the out-of-the-box module, simplifying setup and maintenance across database modules.

  • Primary and foreign key display update: Updated primary key and foreign key displays to use relationships and related fields rather than Markdown links, resulting in a cleaner and more consistent presentation in the UI.

    Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• AWS Glue MDP module: Introduced a metadata field to capture partition keys for Glue tables, improving data discovery and query optimization context. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• MS Fabric MDP module: Added support for Apps, GraphQL APIs, and Spark Job Definitions, expanding the range of Microsoft Fabric resources that can be documented and cataloged. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• MS SQL Server MDP module: Added support for Agent Jobs, enabling visibility into scheduled tasks and job execution metadata. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• OpenAPI ollector: Added support for the new OpenAPI collector. Follow these steps to start using the new collector configurations through CTK.

• API-only resources creation: A new configuration option allows you to designate specific resource types as API-only, preventing them from being created via the UI. This helps enforce tighter control over how certain resource types are instantiated.

• Alteryx collector MDP module: Resolved an issue where workflow versions without comments were incorrectly excluded from the Workflow Versions Markdown table.

• Custom resources: Fixed several issues affecting the custom resources in Catalog Sources, ensuring proper processing and cataloging behavior.

• Amazon Lake Formation collector: Added support for the Amazon Lake Formation collector. Follow these steps to start using the new collector configurations through CTK.

• Alteryx collector: Updated the build query to include comments in the Workflow Details Markdown table, providing additional context directly alongside workflow metadata.

• Microsoft Fabric collector: Added additional metadata properties for both Eventhouse and KQL Database types, further enriching the metadata harvested from Microsoft Fabric environments. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Catalog configuration improvements: The Metadata profile collection types are now instantiable.

• New default collection types: New standard collection types Domain, Glossary Collection, and Source Collection have been added to Catalog Configuration. To start using them, select Allow UI creation for these collection types and update your catalog organization's Metadata Profile to incorporate these changes.

• Azure data factory collector MDP module: Added support for parameterized linked services and their relationships to data sources. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Alteryx collector MDP module: Workflow markdown table updated to sort rows by version number.

• Databricks and Snowflake collectors: Markdown tables displaying Databricks Tags and Snowflake Tags are now sorted alphabetically by key name, making it easier to scan and locate specific tags within your metadata profiles.

• To prepare for an upcoming platform change to how resource types are configured to allow for UI creation, we have introduced new configuration capabilities for Collection Types, allowing you to:

  • Specify whether a Collection Type can be created via the UI (Allow UI creation)

  • Define Parent collection types to better structure your metadata hierarchy

    

• As part of this release, we have run a one-time script in each CTK stack to ensure a smooth transition:

  • All child types of Business Term (i.e., Glossary Types) and all Collection Types have been set to Allow UI creation if this setting had not already been configured.

  • This makes those types instantiable in the UI, although no behavior changes will occur immediately.

  This proactive step ensures your existing types remain usable once the upcoming enforcement takes effect.

  Important

  Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Microsoft Fabric collector: Added support for the Microsoft Fabric collector. Follow these steps to start using the new collector configurations through CTK.

• MDP Workbook Template: A new and improved version of the template is now available for use.

New features and changes

• dbt Core and dbt Cloud collectors: Added dbt Source relationships, supporting updates to the way the dbt collector models these relationships. Be sure to update your catalog organization's Metadata Profile to incorporate these changes.

• Go here to access release notes for previous version.