Logical Replication Setup (Aiven.io)

logical replication is the main means for allowing postgresql to have change data capture (cdc) logic to track changes and retrieve only the delta/changes to your database tables synchronized this increases speed of the synchronization so that any system synchronizing data need not retrieve all records from the database tables all the time on each synchornization frequency event to set up logical replication on your postgres database please follow the instructions on this page aiven io access the database you desire to configure to synchronize using datalakehouse io and let's turn on logical replication with the test decoding plugin following the steps below, with aiven io as the data source service connect to the cli type your user login via the command line avn user login name\@domain com enter your password when prompted confirm all is working by running simple cli command avn cloud list call the service in question (find the service deployed in the aiven io panel) avn service cli pg ####### this should render you in a prompt in the terminal, ex defaultdb=> basics for setting up logical replication aiven io provides postgresql instances that support logical replication in the remainder of this document page we highlight a few notes to consider for an aiven io implementation of postgresql logical replicationconfiguration please reference the main postgresql docid\ xsd1kjnrqsds24cxgs0rh logical replication setup docid\ g0n4nu6egi2gepkzvz9yk for the full documentation on configuring your test decoding replication setup docid\ ifqjhkm099aoilqhcfo76 or pgoutput replication setup docid\ mrb 2gddsiobd0olldryo replication setup general settings on aiven io to configure review current settings select setting from pg settings where name ='wal level'; select setting from pg settings where name ='max replication slots'; select setting from pg settings where name ='wal sender timeout'; select setting from pg settings where name ='max wal senders'; ensure that wal level = 'logical' wal sender timeout = 0 or 60000 (0 = infinity) max replication slots >= 8 max wal senders >= 16 any changes for the above can be done in the aiven io advanced configuration section of your postgresql service in aiven io the default wal level senders is set to 0 there are very few other settings you can configure for aiven io that are not already set disk space increase is normal aiven io has a good article on standard operation increase in disk space due to wal, https //developer aiven io/docs/products/postgresql/concepts/pg disk usage html https //developer aiven io/docs/products/postgresql/concepts/pg disk usage html run any of the main postgresql commands to check disk space on the instance \l or \l+ select pg size pretty(pg database size('yourdbname'));