Creating the Databricks publisher automation
Configuring the automation
To create the automation:
On the Organization profile page, go to the Automations tab.
In the Automation templates section, locate the Databricks Metadata Publisher template. Click the Configure button
In the Configure Databricks Metadata Publisher window, set the following and click Next.
Automation name: A name for the automation.
Automation description: A brief description.
On the next screen, set the following and click Next. You can either choose to publish only tags, comments, or both tags and comments.
Publish resource description as a comment in Databricks: Select this option to publish the table or column description in data.world to Databricks.
Metadata fields: Select the metadata fields you want to publish to Databricks as tags. You can select only up to 20 metadata fields.
On the next screen, set the following and click Save and Continue
Connection: Select the Databricks connection you configured for the automation
Enable Automatic Updates: You can choose for metadata to be published automatically by enabling automatic updates. If the option is not enabled, metadata updates are published manually by clicking the Publish Metadata to Databricks button on the resource page.
Enabling automations
Once you have finished setting up the automation, the next step is to turn it on. This action will enable the automation to run.
To enable an automation:
On the Organization profile page, go to the Automations tab.
In the Automation section, locate the automation you want to enable and open it by clicking it.
Click the Enable automation button. This option is available only for automations that have never been enabled. If you enable an automation and then disable it, it cannot be enabled again.
Editing automations
To edit an automation:
On the Organization profile page, go to the Automations tab.
In the Automations section, from the Activated or Pending Activation tabs, select the automation you want to edit. Note that Archived automations cannot be edited.
Click the Edit Automations button. Follow the wizard to make any necessary adjustments to the automation configuration.
Archiving automations
Important
Once you archive an automation it cannot be enabled again. Only active automations can be archived.
To archive an automation:
On the Organization profile page, go to the Automations tab.
In the Automation section, from the Activated tab, locate the automation you want to archive and open it.
Click the Archive automation link.The archived automation is moved to the Archived tab.
