Plan your catalog metadata structure with the MDP Workbook (CTK)

1. In the Catalog Configuration organization, browse to the DDW Template Files (ddw-template-files) dataset.

2. Download the MDP Workbook - Template.xlsx spreadsheet template file.

To select the source modules:

1. In the Catalog Configuration organization, browse to the Metadata profile collection.

2. Update the metadata profile to specify the Source Modules relevant to your catalog. These are the systems from which technical metadata will be collected. For example, Databricks, Snowflake, Power BI.

1. In the Catalog Configuration organization, browse to the DDW Load Source Modules project.

2. Click Launch workspace.

3. In the Connected datasets section, locate the Data Catalog Configuration dataset for the Catalog Organization organization.

4. In the dataset, locate the source-modules.ttl file, and click the Sync now button.

5. In the same project, locate the export-mdp-module-fields.csv.rq file and click the Run query button to retrieve all out-of-the-box resource types and fields for the selected source modules.

6. Optionally, click Preview query template before running the query, enter a specific  SourceTag (for example, Snowflake) and run the query to return metadata only for that source system. This helps reduce noise if you are focusing on a single collector.

7. Copy the query results and paste them into the Resource Types & Fields tab of your downloaded Excel workbook.

8. Next, locate the export-mdp-module-relationships.csv.rq file, and click the Run query button.

9. Copy the results and paste them into the Relationships tab of your workbook.

1. Open the template using an Excel spreadsheet editor.

2. Explore the tabs at the bottom of the sheet. Each tab plays a specific role in defining your metadata profile:

   Table 1.

   Tab name	Purpose
   Overview & Instructions	Provides context and usage guidance for the workbook.
   Resource Types & Fields	Displays out-of-the-box fields and lets you define custom metadata fields for each resource type.
   Relationships	Displays out-of-the-box relationships and allows to add custom relationships by inserting a new row.
   Glossary	Define custom glossary term types and add relevant metadata fields.
   Collections	Review and answer the questions to establish an effective data collection strategy.

   
   
   

3. Review the Resource Types & Fields and Relationships tabs. These show the out-of-the-box metadata collected by your selected source systems.

   To explore fields collected from a specific source system:  

   1. In the Type Origin column, apply a filter for your source (for example, Snowflake).

   2. In the Field Origin column, filter to show only rows where that source is listed.

   This shows exactly what metadata will be displayed from that collector, helping you identify potential gaps, and understand what is available out of the box before adding anything custom.

4. Use this filtered view to evaluate coverage and plan enrichment. For example:

   • Are important fields like Steward, Classification, or Data Quality missing?

   • Do we need additional fields or relationships specific to our organization?

5. Use the legend and FAQ sections within each sheet to understand field definitions and best practices.

6. Add custom fields, relationships, or glossary term types as needed. Make sure to mark these rows with Custom in the Field Origin column.

7. Use the Design Notes column to communicate context, requirements, or requests to your implementation team or catalog admins.

1. Save the workbook with your organization name included. For example, MDP Workbook - Acme Corp.xlsx.

2. Provide the file to the relevant stakeholders involved in catalog setup or enrichment. This might include team members responsible for metadata strategy, data governance, or catalog configuration.

3. Use the workbook to drive conversations, track requested changes, and align on customizations as your catalog evolves.