Skip to main content

About the Amazon Lake Formation collector

Warning

This collector is in public preview. It has passed our standard testing, but it is not yet widely adopted. You might encounter unforeseen edge cases in your environment. data.world is committed to promptly addressing any issues with public preview collectors. If you face any problems, please report them through your Customer Success Director, implementation team, or support team for assistance.

Use this collector to harvest tags, permissions and data cells filters from AWS Lake Formation.

Important

The Amazon Lake Formation collector can be run in the cloud or on-premise using Docker or JAR files.

Note

The latest version of the Collector is 2.289. To view the release notes for this version and all previous versions, please go here.

What is cataloged

The collector catalogs the following information.

Table 1.

Object

Information cataloged

Lake Formation Tags

  • Name

  • Allowed Values

  • Permissions

  • Grantable Permissions

Lake Formation Tag Value Pair

  • Key

  • Value

  • Permissions

  • Grantable Permissions

Lake Formation Data Cells Filter

  • Expression

  • Version

  • Permissions

  • Grantable Permissions



Relationships between objects

By default, the harvested metadata includes catalog pages for the following resource types. Each catalog page has a relationship to the other related resource types. If the metadata presentation for this data source has been customized with the help of the data.world Solutions team, you may see other resource pages and relationships.

Table 2.

Resource page

Relationship

Lake Formation Tag Value Pair

  • Belongs to lake formation tag

  • Tags glue catalog database

  • Tags glue catalog table

  • Tags glue catalog column

Glue Catalog Database

  • Accessed by AWS Principal

  • Tagged by Lake Formation Tag Value Pair

Glue Catalog Table

  • Accessed by Aws Principal

  • Tagged by Lake Formation Tag Value Pair

  • Governed by Lake Formation Data Cells Filter

Glue Catalog Column

  • Accessed by Aws Principal

  • Tagged by Lake Formation Tag Value Pair

  • Governed by Lake Formation Data Cells Filter



Authentication supported

The collector supports following authentications. See the AWS documentation to learn more about AWS authentication methods.

  • Authentication details supplied through the AWS credentials file.

  • Explicitly supplied static credentials authentication using AWS Access Key ID and AWS Secret Access Key.