Connectors
...
Databases
PostgreSQL (Aiven.io)

Aiven.io: PostgreSQL Setup

5min

Let's connect your Aiven.io PostgreSQL database

Go ahead and gather the basic details from the Aiven.io console:

  • Database host or IP Address and port #
  • Database Name, Database Username and Password
  • If Logical Replication Slot(s) information if available, otherwise XMIN will be used

PostgreSQL Specifications Required:

  • All recent and LTS versions (5.5 or above) are supported
  • Be cognizant of using binlog_row_metadata settings for PostgreSQL v8+, using a value of MINIMAL to prevent any sync issues.

Basic Connection Setup

Remember DataLakeHouse.io connects to your database instance with credentials supplied by you. We store your credentials securely with our bank-grade protocols. In the connection form please follow these instructions:

  1. Enter your Credentials and Other Information in the Fields
    • Enter in the Name/Alias field, the name you'll use within datalakehouse.io to differentiate this connection from others
    • Enter in the Target Schema Prefix field, is the prefix of schema(s) that gets created on your destination target connection database for each of the schemas you load in this connection.
      • Alphanumeric characters only. It must start and end with a letter but can contain an underscore(_).
    • Enter in the Server/Host field, the name of the public server name or the IP Address (most customers use the IP for this field)
    • Enter in the Port field, where this database is accessible and the firewall restrictions are open
    • Enter in the Database field, the name of the database to connect
    • Enter in the Username/Alias field, the username of user you created in the steps above to give access to DataLakeHouse.io
    • Leave Auth Type field alone. It is set to password because DataLakeHouse is using TLS and requires username and password credentials to access the database
    • Enter in the Password field, the password for the user you created in the steps above
    • Confirm the CDC option (use XMIN if you are unsure of the options, as it is the default and enabled on Aiven.io PostgreSQL databases by default)
  2. Click Save & Test
    • This will attempt to connect to your database with the credentials provided.
    • A message of success or failure will be shown
      • If success you'll be prompted with the schema objects objects of the database and will need to complete the final steps for configuration shown below.
      • If failure happens with the test connection, the connection is still saved but you will need to correct the failure based on the failure reason information provided in the message. You may need to click the sources page if there is any issue.

Instructions (Continued & Final Setup)

This section of steps ensures you have coverage of other important steps required on your database side and in DataLakeHouse.io once you have completed the above test connection successfully.

Enable Logical Replication or XMIN

  • Follow the instructions here for setting up logical replication in PostgreSQL, Test Decoding Replication Setup
  • XMIN is enabled by default in the most recent versions of PostgreSQL, so this is on by default

Other Information About This Connection

From time to time we will update the instruction set here to inform you about this connection or how specifically we must connect to optimally synchronize your data.

If you require any other type of authorization to connect to your account instance please reach out to our support team via our DataLakeHouse Support Portal.