DBT Cloud Log Stream

dbt Cloud is the enterprise platform extension of the open source project dbt (data build tool) which emerged as a very popular data devOps tool amongst data engineers and analytics engineers for building data models and working with data in a more convenient manner over historical development methods.

Stream the dbt Cloud Log data into the Target Connection of your choice in order to centralize your log data across the application enterprise. Combine this data with Snowflake Usage Analytics to get an even better line of visibiilty in performance metrics.

Connector Prerequisites

Prior to creating the dbt Cloud connector, you need to make sure that:

• You have access to the account identifier (account id) and a Service Token for your account
  • Read this section on Finding your DBT Cloud Information

Instructions (Basic Connection Setup)

DataLakeHouse.io securely connects to your dbt Cloud using their hightest grade security protocols. Using the form in the DataLakeHouse.io portal after selecting this source connector, please complete the following basic steps:

Using the form please complete the following basic steps:

1. Enter a Name or Alias for this connection, in the Name/Alias field, that is unique from other connectors.
2. Enter in the Target Schema Prefix field, a name that will be unique in your target cloud warehouse destination database where you wish to land the data.
3. Enter the Account Id for your dbt Cloud account
4. Enter your API Key or Service Token in the API Key field from your dbt Cloud account
5. Click the Authorize Your Account button which will save the connection.

Finding your DBT Cloud Information

There are two items you need from your dbt Cloud account in order to set up the DLH.io connector properly:

• Account Id
• API Key / Service Token

Locate your Account Id

The account id can be found in the URL of your browser, as typically anything after, https://cloud.getdbt.com/#/accounts/##### is your account number.

For example https://cloud.getdbt.com/#/accounts/12345, so your account number would be 12345.

Another way to find your account id is to go to https://cloud.getdbt.com and hover over your deployment environment and capture the URL.

Locate your Service Token

The Service Token can be found by clicking in the upper right hand of the platform gear icon and selecting the Account Settings option.

From the Account Settings page, click on the Service Tokens option in the left menu.

In the resulting page, click on the New Token option to create a new Service Token,

Create the new Service Token and set the Permission Set to Job Admin or higher. Click Save.

Copy the Service Token and paste into the Source Connection in DataLakeHouse.io. This is the only time you'll be able to Copy the token! Once you close the Service Token screen in dbt you will not be able to recopy the token. You'll need to recreate a Service Token to get another token.

or view in the list an existing token that you wish to use for creating this DLH.io connector and capture it to be entered in the form.

Locate your API Key (alternative option)

The API key can be found in your dbt Cloud account by clicking in the upper right hand corner of the platform gear icon and selecting the Profile Settings option.

API keys are unique to a specific user and follow the user and their credentials. So if the user is deleted that API key is no longer valid versus a Service Token which belongs to the account and is not associated with any specific user directly.

In your profile section scroll down until you see the API section. From here you can copy your API key.

DLH.io recommends only using a Service Token for this connector integration and setup.

Target Connection

When creating your Target Connection you must