FTP/SFTP
File Transfer Protocol (FTP) and Secure File Transfer Protocol (SFTP) is supported by DLH.io for synchronization of your data into files that can be pushed to your current FTP or SFTP server, or potentially a third party FTP/SFTP server as part of your downstream process in your data pipelines
Pre-Requisites:
- Access to a FTP/SFTP Server
- Ability to test the FTP/SFTP Server
DataLakeHouse.io securely connects to your FTP/SFTP server. Using the form in the DataLakeHouse.io portal please complete the following entries:
- Enter a Name or Alias for this connection, in the 'Name/Alias' field, that is unique from other connectors
- Enter a Server/Host field, enter the IP or DNS for the server
- Enter a Port field, enter the port number on which to connect
- Enter a Folder Path field, enter the ftp/sftp server folder path where to land the data files/information. Use ./ as the default if unknown, and this will land in the base folder.
- Enter a User field, enter the name of the user for your access credentials
- Select the Auth Type, for which your credentials will access the server. Either your credentials are user and password or user and encrypted key.
- If you select the Username/Password option you'll be prompted to enter your password. If you select Key Pair Authentication you will see the Private Key field where you will enter your private key.
- If selecting Username/Password
- Enter the password in the Password field for your access credentials
- If selecting Key Pair Authentication
- Enter a Private Key field, enter the private key credentials
- Select a Private Key Encrypted? option.
- If yes, then enter the private key password.
- If no, continue to the next step
- Click the Save & Test button. Once your credentials are accepted you should be able to see a successful connection.
SQL Transformations allow logic to be executed against a target connection based on a scheduled frequency or triggered event of new data on tables updated via DataLakeHouse.io (DLH.io). This especially helps when you want to control the data type set in your Target Connection since all columns are set as VARCHAR(16777216).
