About the automations
Data governance teams govern large volumes of diverse data with hundreds, sometimes thousands of stakeholders. Much of that work is manual and time consuming, such as metadata enrichment and managing data access requests. The Data Governance application enables governance teams to more effectively manage tasks and engage stakeholders.
The data.world Data Governance application enables automations and automation-driven workflows. As part of the data.world Data Governance application, automations called Eureka Bots reduce the amount of manual effort needed for data governance tasks, helping to increase productivity, engagement, and trust.
data.world Data Governance Powered By Eureka Bots combines automations with data.world’s Knowledge Graph architecture to create an application that is simple, flexible, and interactive. This new application – part of data.world’s Data Catalog Platform – enables data governance teams to be more productive, customize workflow, and engage stakeholders in data governance processes.
Note that all automations currently update the information in the base layer. The automations get the information from the flattened catalog (user+base layer), but saves its results into the base layer, so that if there are any values set in the user layer, the automation does not override them.
Tip
For more insights from our product experts, watch How Automation Unlocks Productive, Engaging Data Governance
Automation tiers and the capabilities included
The Data Governance application comes in two tiers.
Data Governance Core tier is included with the Standard version of the data.world Platform and includes single-step automations. They simplify governance with actions such as metadata completeness and freshness checks, inherited value assignments, and setting default values. Each automation completes a specific action in one step, offering efficiency in handling repetitive tasks.
Data Governance Premium tier is an add-on to the Platform that augments the Core automations with task management capabilities, and multi-step workflows tailored for complex governance requirements. Premium automations introduce task assignments for metadata completeness, multi-level approval flows, and external integrations, making it ideal for organizations with more complex governance needs. Unique features of Governance Premium include:
Automation name | Description | Governance core tier | Governance Premium tier |
|---|---|---|---|
Assign an inherited value from a related resource to resource fields that do not have any value set. Related resources are based on parent-child relationships,For example, database - table - column. This allows you to easily inherit metadata values from related resources, saving time and reducing redundancy. | ✅ | - | |
Assign default values to free form resource fields that are currently empty. It promotes consistency and accuracy in data entry, assisting in the expansion of your catalog curation. | ✅ | - | |
Monitor and maintain data quality by flagging outdated metadata. The automation updates the Refreshed on date property for each resource in the specified collection to the current time whenever the automation is triggered. | ✅ | - | |
Monitor and maintain data quality by flagging outdated metadata. The automation examines the Refreshed on date property, which represents the last time the resource was refreshed, and establishes a shelf life in days. If the field value remains unchanged within the set period, the resource is tagged as Not Fresh. | ✅ | - | |
Monitor and maintain data quality by flagging incomplete metadata. | ✅ | - | |
For advanced users only. Set up custom automations using query-based actions through SPARQL, allowing dynamic and flexible catalog updates. | ✅ | - | |
Approve access requests for datasets and projects. Not configured from the Automations tab of Organization profile page | ✅ | - | |
Manage suggestions for resources. Not configured from the Automations tab of Organization profile page | ✅ | - | |
A multi-step workflow automation to create and approve tasks for access requests to specific resources. In addition, integrate with your ServiceNow system to act on the approved access requests. | ❌ | ✅ | |
A premium version of Metadata completeness automation that allows you to flag incomplete metadata and create a list of actionable tasks for the identified incomplete resources that can be assigned to user groups for taking action. Alerts the authorized users to navigate to the resource pages and prompts them to complete the missing information. | ❌ | ✅ | |
The premium version of our suggest changes automation allows you to suggest changes to metadata resources and assign tasks to teams for updating and completing this information efficiently. | ❌ | ✅ | |
(Beta release) Premium automation: Snowflake Tag Application and Sync Automation | Update the Snowflake column resources with imported tags or append new ones, and synchronize these tag updates back to Snowflake with a simple button click. | ❌ | ✅ |
Update comments and tags on Databricks column and table resources in data.world and publish these updates back to Databricks either automatically or manually with a simple button click. | ❌ | ✅ |
How does the application work?
Automations and automation-driven workflows are both available in the Platform’s Automation gallery. Tasks can be claimed and managed from a dedicated UI. The application also includes built-in reporting to enable data governance teams to manage progress and prioritize efforts.
Important
Only Organization administrators can view, configure, and run automations.
From the Organization profile page, configure automations and automation-driven workflows using the automation templates available in the Automation templates section.
Manage the configured automations from the Automations section of the page. This section provides a breakdown of your automations, categorizing them into active automations, those that have been configured but not yet enabled, and archived automations that are no longer in use.
As automations are executed over time, their run history is recorded in the History tab. From this tab, you can see when each automation was run, whether it was triggered by a schedule or a user, and the current status of the automation run..
Claim and manage data governance tasks in one place.
