Skip to main content

Using AWS PrivateLink with on-premise collectors

In today's data-driven environment, protecting your data is critical, especially when it's stored behind firewalls or not accessible via the internet. For data.world users, AWS PrivateLink offers a robust solution to this challenge, enabling secure and private connections to your data systems.

AWS PrivateLink facilitates private connectivity between Amazon VPCs, AWS services, and on-premise networks, removing the need for public internet access. This feature ensures your data remains within the AWS network, providing enhanced security and privacy.

This guide focuses on using AWS PrivateLink with data.world's on-premise collectors. By integrating this feature, you can securely connect to your data systems, maintaining data integrity and confidentiality throughout the process.

Warning

This feature is exclusively available for on-premise collectors.

Before proceeding, ensure you have administrative access to both your AWS account and your on-premise systems. Familiarize yourself with AWS networking concepts and verify that your AWS environment supports PrivateLink.

Setting up PrivateLink in AWS

  1. Refer to the  AWS documentation for setting up PrivateLink. This will guide you through creating endpoints and endpoint services in your VPC where your data collectors are located.

  2. After completing this setup, you should have a private network link available on them VPC dashboard in AWS. This link is instrumental in configuring your on-premise collectors.

    aws_private_link.png

Configuring your on-premise collectors

  • In your collector configuration, for the Server option (--server parameter), input the private network link obtained from AWS setup.

    The expected format for the private network link is as follows:

    vpce-<system_generated_value>.<system_generated_value>.vpce-svc-<system_generated_value>.<AWS_Region>.vpce.amazonaws.com

By following these instructions, you will successfully establish a secure, private connection to your data systems using AWS PrivateLink with on-premise collectors, safeguarding your data from external threats while ensuring seamless accessibility.

In this section: