Connectors
Files & Object Storage

Azure Blob Storage

2min

Azure Blob Storage is Microsoft’s object storage solution for the cloud. Users can create data lakes with Azure Blob Storage to support their analytics needs, and it also offers storage so you can design robust mobile and cloud-native applications.

Pre-Requisites:

  • Access to your Azure portal services
  • Ability to create a Blob Storage
  • Ability to update your Azure network firewall

Setup Instructions

DataLakeHouse.io securely connects to your Azure Blob Storage. Using the form in the DataLakeHouse.io portal please complete the following basic steps:

  1. Enter a Name or Alias for this connection, in the 'Name/Alias' field, that is unique from other connectors
  2. Enter a Target Schema Prefix, a name which will be the prefix for the schema at the target destination to where your data will sync
  3. Enter in the Connetion String (SAS) field the Shared Access Signature (SAS) connection string you retrieved from the Azure Pre-Requisite Steps based in the Azure storage account where your files are stored
    • Typically starts with BlobEndpoint, for example: BlobEndpoint=https://<your_storage_account>.blob.core.windows.net/;QueueEndpoint...
  4. Enter any other optional details in the available fields (See the setup video if you need help or contact support)
    • Folder Path, is a path on the root bucket from where desired files will be retrieved
    • File Pattern, is a regular expression (RegEx) used to isolated only certain files to be retrieved
    • File Type, allows for a pre-determined type of file extension to be retreived
  5. Click the Save & Test button. Once your credentials are accepted you should be able to see a successful connection.

Control Each Column Data Type

SQL Transformations allow logic to be executed against a target connection based on a scheduled frequency or triggered event of new data on tables updated via DataLakeHouse.io (DLH.io). This especially helps when you want to control the data type set in your Target Connection since all columns are set as VARCHAR(16777216).

Updated 19 Jun 2024
Doc contributor
Doc contributor
Did this page help you?
PREVIOUS
Email Target
NEXT
Cloudflare R2
Docs powered by Archbee