website logo
⌘K
Getting Started 🚀
What is DataLakeHouse.io?
Our Business-Value Focus
Learn the Basic Concepts
Connectors
Operations Applications
Google Sheets
Aloha POS
Bill.com
Ceridian Dayforce
DoorDash for Work
Facebook Ads
Google Analytics 4
Harvest
Hubspot
Jira
McLeod Transportation
NetSuite (Oracle NetSuite)
Optimum HRIS
QuickBooks Online
Salesforce
Shopify
Square
Square Marketplace
Stripe
Workday HCM
Xero
Databases
SQL Transformations
Terraform: Reverse Terraforming
DBT Cloud Transformations
Sync Bridge (Data Pipelines)
Create a Sync Bridge
Deleting a Sync Bridge
Analytics
Access Analytics
FAQ (about syncing data)
How are new columns are added to the target Data Warehouse?
....
Data Catalog
Create the Catalog
Populate the Catalog
Access the Catalog
Data Warehousing
Snowflake
Open Source DW Models
Alerts & Notifications
Integrations (Slack, etc.)
Logs & Monitoring
Security
Release Notes
April 2022
July 2022
Community Overview
Contributor Agreements
Code Contribution Guide
About
Our
License
Viewpoint
Docs powered by archbee 
16min

Basic BigQuery Setup

This is GCP BigQuery connector. Read the following instructions carefully. Go ahead and gather the basic details to connect to your GCP BigQuery project:

  • Your GCP BigQuery account and Project information

BigQuery Specifications and Recommendations:

  • If you have a restrict ingress firewall or networking policy please whitelist/grantlist the specific DataLakeHouse.io IP addresses from our DataLakeHouse.io IP addresses to allow us to work with your account.

Instructions (Basic Connection Setup)

Scroll down to ensure you review all steps, as needed...

Remember DataLakeHouse.io connects to your BigQuery through Service Account access. We pass all credentials securely with our bank-grade protocols.

  1. Grant the BigQuery User role to the Service Account provided in the connection form:
    • Log into your GCP account with an administrator account, usually an account with project owner role access
    • From IAM & Admin menu click on the IAM option, to bing up the permissions for the project: 
    • IAM Setup
      IAM Setup
    • Execute the script by clicking the 'Run Button' 
      • An alternative would be to highlight the entire script and then click the Run button.
  2. On the Connection Form : Enter your Other Information
    • Enter in the Name/Alias field, the name you'll use within datalakehouse.io to differentiate this connection from others
    • Click on Save & Test to save the connection and test that we can connect.
  3. If updating the form Click Save & Test or just Test
    1. Clicking on Save & Test will again save any changes such as the password change, etc.  You will not be able to change the prefix of the schema that will be the target in the destination. Any test of the connection will attempt to connect to your database with the credentials and info provided.
    2. A message of success or failure will be shown:
      • If success you'll be prompted with the schema objects objects of the database and will need to complete the final steps for configuration shown below.
      • If failure happens with the test connection, the connection is still saved but you will need to correct the failure based on the failure reason information provided in the message
  4. GCP Network or Firewall Policy Settings
    1. As mentioned above, if you have configured a restrictive Firewall or Network Policy, please add our grantlist of IP Address:
      • Modify Existing Networking Policy, for example:
        • See GCP gcloud CLI to assign the following IP addresses or contact support for assistance: 34.138.108.146, 34.138.31.121, 35.196.9.75
        • Our IP Grantlist / Whitelist

From time to time we will update the instruction set here to inform you about changes to this connection. If you require any other type of authentication/authorization to connect to your account instance please reach out to our support team via our DataLakeHouse Support Portal.

..

Updated 19 Jan 2023
Did this page help you?
Yes
No
UP NEXT
MongoDB
Docs powered by archbee 
TABLE OF CONTENTS
BigQuery Specifications and Recommendations:
Instructions (Basic Connection Setup)