Oracle
Oracle RDBMS is one of original enterprise database technologies that exist both on-premise and in the cloud. As a robust platform with maximum efforts focused at the enterprise level, this database technology is capable of transactional and analytical workloads and just about everything in between.
- Versions (10 or above) are supported
- Determine which way to connect: Default or SSH Tunneling
- Firewalls on your database server should allow incoming connections through the public internet on your Oracle port (typically 1521 unless your network team has changed it).
- Be sure to Our IP Grantlist / Whitelist our IP Addresses for cross network database server network access
- Consult with you Oracle administrator as needed on the setup
- We suggest creating a new read-only user to delineate this user service account for DLH.io from any other user access to your database, however, using an existing user is acceptable.
Remember DataLakeHouse.io connects to your database instance with credentials supplied by you. We store your credentials securely with our bank-grade protocols.
- Create a DataLakeHouse.io user on the Oracle database
- Connect to the Oracle database in question with your admin user.
- Create a user for DataLakeHouse.io using the following Oracle logic replacing <newsername> with you a user name that you choose (we recommend 'datalakehouse_ro' to signify a read-only user), and choose a good password that complies with your security policies: CREATE USER <new_username> IDENTIFIED BY tmp!password; GRANT RESOURCE, CONNECT TO <new_username>@'%';
- Enter your Credentials and Other Information in the Fields
- Enter in the Name/Alias field, the name you'll use within datalakehouse.io to differentiate this connection from others
- Enter in the Target Schema Prefix field, is the prefix of schema(s) that gets created on your destination target connection database for each of the schemas you load in this connection. So if your database has a schema named 'dbo' the target connection when synced will have a schema in that target database named the value of this field + '_dbo'.
- Alphanumeric characters only. It must start and end with a letter but can contain an underscore(_).
- Enter in the Server/Host field, the name of the public server name or the IP Address (most customers use the IP for this field)
- Enter in the Port field, where this database is accessible and the firewall restrictions are open
- Enter in the Database field, the name of the database to connect
- Enter in the Userame/Alias field, the username of user you created in the steps above to give access to DataLakeHouse.io
- Leave Auth Type field alone. It is set to password because DataLakeHouse is using TLS and requires username and password credentials to access the database
- Enter in the Password field, the password for the user you created in the steps above
- Click Save & Test
- This attempt to connect to your database with the credentials provided.
- A message of success or failure will be shown
- If success you'll be prompted with the schema objects objects of the database and will need to complete the final steps for configuration shown below.
- If failure happens with the test connection, the connection is still saved but you will need to correct the failure based on the failure reason information provided in the message
This section of steps ensures you have coverage of other important steps required on your database side and in DataLakeHouse.io once you have completed the above test connection successfully.
Enable LogMiner for Change Tracking
- To capture incremental loading delta changes of the database records being synchronized and to reduce your costs we use the native LogMiner feature of Oracle.
- Connect to your Oracle database server and access the file system
- Enable Supplemental Logging and start LogMiner as an admin user with appropriate privileges:
- ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;
- EXECUTE DBMS_LOGMNR.START_LOGMNR(OPTIONS => DBMS_LOGMNR.DICT_FROM_ONLINE_CATALOG + DBMS_LOGMNR.COMMITTED_DATA_ONLY);
- For more instructions follow the the Oracle documentation or confer with your Oracle DBA
- Restart your Oracle server in order for the changes to propagate
From time to time we will update the instruction set here to inform you about this connection or how specifically we must connect to optimally synchronize your data.
If you require any other type of authorization to connect to your account instance please reach out to our support team via our DataLakeHouse.io Support Portal.
