website logo
⌘K
Getting Started 🚀
What is DataLakeHouse.io?
Our Business-Value Focus
Learn the Basic Concepts
Connectors
Operations Applications
ConnectWise
Google Sheets
Aloha POS
BILL
Bloom Growth
Ceridian Dayforce
Food Delivery Service Connector
Facebook Ads
Google Analytics 4
Harvest
Hubspot
Jira
McLeod Transportation
NetSuite (Oracle NetSuite)
Optimum HRIS
QuickBooks Online
Salesforce
Shopify
Square
Square Marketplace
Stripe
Workday HCM
Xero
Databases
SQL Transformations
Terraform: Reverse Terraforming
DBT Cloud Transformations
Sync Bridge (Data Pipelines)
Create a Sync Bridge
Manually Run a Sync Bridge
Deleting a Sync Bridge
Analytics
Access Analytics
Snowflake Usage Analytics
FAQ (about syncing data)
How are new columns are added to the target Data Warehouse?
....
Data Catalog
Create the Catalog
Populate the Catalog
Access the Catalog
Data Warehousing
Snowflake
Open Source DW Models
Alerts & Notifications
Integrations (Slack, etc.)
Logs & Monitoring
Security
Release Notes
April 2022
July 2022
Community Overview
Contributor Agreements
Code Contribution Guide
About
Our
License
Viewpoint
Docs powered by archbee 
7min

Basic PostgreSQL Setup

Let's connect your PostgreSQL database

Go ahead and gather the basic details:

  • Database host or IP Address
  • Database port # (default is 5432)
  • If Logical Replication is configured

PostgreSQL Specifications Required:

  • All recent and LTS versions (5.5 or above) are supported
  • Determine which way to connect: TLS or SSH Tunneling
  • Firewalls on your database server should allow incoming connections through the public internet on your PostgreSQL port (typically 5432 unless your network team has changed it). Be sure to whitelist ( Our IP Grantlist / Whitelist ) our DataLakeHouse.io IP addresses for your database server network access.
  • Be cognizant of using binlog_row_metadata settings for PostgreSQL v8+, using a value of MINIMAL to prevent any sync issues.

Instructions (Basic Connection Setup)

Remember DataLakeHouse.io connects to your database instance with credentials supplied by you. We store your credentials securely with our bank-grade protocols.

  1. Enter your Credentials and Other Information in the Fields
    • Enter in the Name/Alias field, the name you'll use within datalakehouse.io to differentiate this connection from others
    • Enter in the Target Schema Prefix field, is the prefix of schema(s) that gets created on your destination target connection database for each of the schemas you load in this connection. So if your database has a schema named 'public' the target connection when synced will have a schema in that target database named the value of this field + '_public'.
      • Alphanumeric characters only. It must start and end with a letter but can contain an underscore(_).
    • Enter in the Server/Host field, the name of the public server name or the IP Address (most customers use the IP for this field)
    • Enter in the Port field, where this database is accessible and the firewall restrictions are open
    • Enter in the Database field, the name of the database to connect
    • Enter in the Username/Alias field, the username of user you created in the steps above to give access to DataLakeHouse.io
    • Leave Auth Type field alone. It is set to password because DataLakeHouse is using TLS and requires username and password credentials to access the database
    • Enter in the Password field, the password for the user you created in the steps above
  2. Click Save & Test
    • This attempt to connect to your database with the credentials provided.
    • A message of success or failure will be shown
      • If success you'll be prompted with the schema objects objects of the database and will need to complete the final steps for configuration shown below.
      • If failure happens with the test connection, the connection is still saved but you will need to correct the failure based on the failure reason information provided in the message

Instructions (Continued & Final Setup)

This section of steps ensures you have coverage of other important steps required on your database side and in DataLakeHouse.io once you have completed the above test connection successfully.

Enable Logical Replication

  • Follow the instructions here for setting up logical replication in PostgreSQL, Logical Replication Setup

Other Information About This Connection

From time to time we will update the instruction set here to inform you about this connection or how specifically we must connect to optimally synchronize your data.

If you require any other type of authorization to connect to your account instance please reach out to our support team via our DataLakeHouse Support Portal.

Updated 03 Mar 2023
Did this page help you?
Yes
No
UP NEXT
XMIN
Docs powered by archbee 
TABLE OF CONTENTS
Let's connect your PostgreSQL database
Instructions (Basic Connection Setup)
Instructions (Continued & Final Setup)
Enable Logical Replication
Other Information About This Connection