Connectors
Operations Applications

DBT Cloud Log Stream

9min
dbt cloud is the enterprise platform extension of the open source project dbt (data build tool) which emerged as a very popular data devops tool amongst data engineers and analytics engineers for building data models and working with data in a more convenient manner over historical development methods stream the dbt cloud log data into the what is a target connection? docid 3wx 24ml25noxc1atdbs4 of your choice in order to centralize your log data across the application enterprise combine this data with snowflake usage analytics docid\ gav2yhwkj5jgqrggcrgoh to get an even better line of visibiilty in performance metrics connector prerequisites prior to creating the dbt cloud connector, you need to make sure that you have access to the account identifier (account id) and a service token for your account read this section on dbt cloud docid\ jutvfqvelhhjtbi pb0dp instructions (basic connection setup) datalakehouse io securely connects to your dbt cloud using their hightest grade security protocols using the form in the datalakehouse io portal after selecting this source connector, please complete the following basic steps using the form please complete the following basic steps enter a name or alias for this connection, in the name/alias field, that is unique from other connectors enter in the target schema prefix field, a name that will be unique in your target cloud warehouse destination database where you wish to land the data enter the account id for your dbt cloud account enter your api key or service token in the api key field from your dbt cloud account click the authorize your account button which will save the connection finding your dbt cloud information there are two items you need from your dbt cloud account in order to set up the dlh io connector properly account id api key / service token locate your account id the account id can be found in the url of your browser, as typically anything after, https //cloud getdbt com/#/accounts/##### is your account number for example https //cloud getdbt com/#/accounts/12345 , so your account number would be 12345 another way to find your account id is to go to https //cloud getdbt com and hover over your deployment environment and capture the url locate your service token the service token can be found by clicking in the upper right hand of the platform gear icon and selecting the account settings option from the account settings page, click on the service tokens option in the left menu in the resulting page, click on the new token option to create a new service token, create the new service token and set the permission set to job admin or higher click save copy the service token and paste into the source connection in datalakehouse io this is the only time you'll be able to copy the token! once you close the service token screen in dbt you will not be able to recopy the token you'll need to recreate a service token to get another token or view in the list an existing token that you wish to use for creating this dlh io connector and capture it to be entered in the form locate your api key (alternative option) the api key can be found in your dbt cloud account by clicking in the upper right hand corner of the platform gear icon and selecting the profile settings option api keys are unique to a specific user and follow the user and their credentials so if the user is deleted that api key is no longer valid versus a service token which belongs to the account and is not associated with any specific user directly in your profile section scroll down until you see the api section from here you can copy your api key dlh io recommends only using a service token for this connector integration and setup target connection when creating your what is a target connection? docid 3wx 24ml25noxc1atdbs4 you must issue handling if any issues occur with the authorization simply return to the sources page in datalakehouse io, edit the source details and click the save & test or authorize your account or re authorize account button to confirm connectivity if any issues persist please contact our support team via the datalakehouse io support portal https //datalakehouse zendesk com