Skip to main content

Managing source system for resources

This topic guides you through the process of making source system fields read-only and adding custom source systems. For details about using source system fields for resources, see Viewing and changing source system for resources.

About source systems for resources

A new default out-of-the-box metadata field, Source System, now consistently displays the name of the source system (for example, Tableau) for a resource. This helps users discover and organize data by source system, and distinguish similarly named resource types, thereby improving the overall data discovery experience.

The source system information is accessible for:

  • Catalog resources (all resources and analysis)

  • Non-catalog resources (datasets and projects) Although it is not visible on the Overview page for non-catalog resources and cannot be edited directly, you can filter on it across different search pages.

  • You can extend the collections and Glossary pages to include the source system.

    The source system is not available for dataset files, dataset tables, dataset columns, dataset queries, and dataset insights.

The possible source system values include:

  • A metadata collector used to harvest the source system, such as Snowflake, Power BI, etc.

  • data.world

  • A custom source system created for your catalog

source_system_view.png

You can use the source system information to effectively filter search results.

source_system_filter.png

When the collector runs, the source system will automatically populate for resources harvested by it. You have the option to allow users to edit the source system in data.world, or make it read-only. If users edit the source system from data.world, the user-defined value will be honored and not overwritten when the collector runs again.

Create custom source system options

  1. Use the following syntax to add a custom source system option. For example, Github.

    @prefix : <https://<your_company_name>.linked.data.world/d/ddw-catalogs/> .
    @prefix dwec: <https://dwec.data.world/v0/> .
    @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
    @prefix skos: <http://www.w3.org/2004/02/skos/core#> .
    @prefix dct: <http://purl.org/dc/terms/> .
    @prefix collectors-concept-scheme: <https://world.data/collectors/concept-scheme/> .
    
    :GithubSourceSystem #replace Github with your prefered source system name
      rdf:type            dwec:Source , skos:Concept;
      skos:inScheme       collectors-concept-scheme:source_systems ;
      dct:title           "Github" ; #replace Github with your prefered title
      skos:prefLabel      "Github" ; #replace Github with your prefered title
      skos:altLabel       "Github" ; #replace Github with your prefered title
      dct:identifier      "GithubSourceSystem" ; #Replace to match the name you provided in line 1.
    .
    source_system_custom.png

Enabling source system for business terms

  • Use the following syntax to make the source system option available for business terms.

    @prefix dwec:     <https://dwec.data.world/v0/> .
    @prefix default:  <https://dwec.data.world/v0/default-profile/> .
    
    default:MetadataPresentation-SourceSystem
      dwec:forType     dwec:BusinessTerm ;
    .

Enabling source system for collections

  • Use the following syntax to make the source system option available for collections.

    @prefix dwec:     <https://dwec.data.world/v0/> .
    @prefix default:  <https://dwec.data.world/v0/default-profile/> .
    
    default:MetadataPresentation-SourceSystem
      dwec:forType     dwec:Catalog ;
    .

Make source system field read-only

  • Use the following syntax to make the source system field read-only. The following example shows how to make the field read-only for database tables, analysis, and PowerBIDashboardTile. To make the field read-only for other resources, you need the Type IRI which can be obtained from the Technical reference page of the resource.

    source_system_non-editable_find_iri.png
@prefix dwec:               <https://dwec.data.world/v0/> .
@prefix default:            <https://dwec.data.world/v0/default-profile/> .
@prefix kos-collectors:     <https://open-kos.org/schema/collectors/> .

default:SourceSystemRegistration
  dwec:hasSourceOfRecordSelector [ a dwec:Selector ;
    dwec:selectByClass        dwec:DatabaseTable ; #to make source system read-only for databse table
    dwec:selectByClass        dwec:Analysis ; #to make source system read-only for Analysis
    dwec:selectByClass   <https://open-kos.org/ext/kos-powerbi/PowerBIDashboardTile> ; #to make source system read-only for PowerBIDashboardTile. Replace it with the resource of your choice.
    dwec:selectByProperty     kos-collectors:wasCatalogedBy ;
  ] ;
.
source_system_non-editable.png