Basic MySQL Setup

let's connect your mysql database go ahead and gather the basic details database host or ip address database port # (default is 3306) replica id for datalakehouse io we connect to the mysql datbase as a replica and thefore need to use this unique id to avoid conflicts with your existing replica ids the number will be a number greater than 100000 so this should eliminate any replica id conflict concerns mysql specifications required all recent and lts versions (5 5 or above) are supported determine which way to connect tls or ssh tunneling firewalls on your database server should allow incoming connections through the public internet on your mysql port (typically 3306 unless your network team has changed it) be sure to whitelist our datalakehouse io ip addresses https //datalakehouse io/whitelist ip addresses for your database server network access be cognizant of using binlog row metadata settings for mysql v8+, using a value of minimal to prevent any sync issues instructions (basic connection setup) scroll down to ensure you review all steps, as needed remember datalakehouse io connects to your database instance with credentials supplied by you we store your credentials securely with our bank grade protocols enter your credentials and other information in the fields enter in the name/alias field, the name you'll use within datalakehouse io to differentiate this connection from others enter in the target schema prefix field, is the prefix of schema(s) that gets created on your destination target connection database for each of the schemas you load in this connection so if your database has a schema named 'dbo' the target connection when synced will have a schema in that target database named the value of this field + ' dbo' alphanumeric characters only it must start and end with a letter but can contain an underscore( ) enter in the server/host field, the name of the public server name or the ip address (most customers use the ip for this field) enter in the port field, where this database is accessible and the firewall restrictions are open enter in the database field, the name of the database to connect enter in the userame/alias field, the username of user you created in the steps above to give access to datalakehouse io leave auth type field alone it is set to password because datalakehouse is using tls and requires username and password credentials to access the database enter in the password field, the password for the user you created in the steps above click save & test this attempt to connect to your database with the credentials provided a message of success or failure will be shown if success you'll be prompted with the schema objects objects of the database and will need to complete the final steps for configuration shown below if failure happens with the test connection, the connection is still saved but you will need to correct the failure based on the failure reason information provided in the message instructions (continued & final setup) this section of steps ensures you have coverage of other important steps required on your database side and in datalakehouse io once you have completed the above test connection successfully enable change tracking and binlog to capture incremental loading delta changes of the database records being synchronized and to reduce cost we use this native feature of mysql connect to your mysql database server and access the file system access the mysql configuration file (ex /etc/my cnf) for more instructions follow the mysql binlog setup process from the mysql documentation make sure the file has the lines as follows in the \[mysqld] section to enable row formatting binary log replication name the binary log, log bin attribute, mysql binlog make sure a server id exists with any number between 1 and 4000000000 make sure the expire logs days to 5, the minimum is one and most customers have a maximum of 7 restart your mysql server in order for the changes to propagate determine that your binlog is configured correctly, other information about this connection from time to time we will update the instruction set here to inform you about this connection or how specifically we must connect to optimally synchronize your data if you require any other type of authorization to connect to your account instance please reach out to our support team via our datalakehouse support portal https //datalakehouse zendesk com