Skip to main content

Syncing files from URL

Have data on another site that you would like to import to data.world for easy sharing, collaboration, and querying? No problem! As long as you have a direct URL to one of our supported file types and permission to access it, data.world will be able to import it easily. This is a great solution for importing data from the web, data portals, cloud storage apps, GitHub, and API endpoints! Even better, if the files change at the source, data.world can automatically update it.

To add files from a URL:

  1. On the Projects Overview page, click the Add data button and click New file.

    project_add_file.png

  2. In the Add data from anywhere window, click the Sync from URL option.

    project_add_files.png

  3. In the Add file from URL window, provide the URL of the data source and any authentication required to access the data. If the URL does not require authentication to access it, enter the shareable link provided by the data source into the source URL field and click Continue. The authentication options are:

    1. Username and password (HTTP): Provide the username and password required to access the source file.

    2. OAuth: This is the modern and more secure authentication used by many sites. Click one of the options next to the field to set the OAuth connection with your data source. Once the connection is established, you can select it from the dropdown added under the Authentication field.

    3. Token: This authentication type is for sources that require token based authentication.

    4. Set the Headers and POST body to make API calls to sites that support REST API.

    5. Click Continue.

      project_add_file_from_URL.png

  4. On the next screen provide the File name. Choose carefully, as this name cannot be edited later. Changing the name would require deleting the connection and creating a new one with the new name. Click Done.

    project_add_file_from_url_name.png

  5. If the application encounters an issue with the source URL, it displays an error requesting you to verify the link and the settings. Click Edit to go back to the file window to fix the errors.

  6. Once your files are added, configure them to update regularly using the automated sync settings.

In this section: