SQL Transformations

transformations allow logic to be executed against a target connection based on a scheduled frequency or triggered event of new data on tables updated via datalakehouse io (dlh io) add a transformation pre sql transformations sql transformations add a transformation click on transformation from the header menu click on new transformation or add a transformation to show the transformation creation form update the form and determine what options to select overview adding a new transformation, be sure to complete all the required details pre sql transformations pre sql transformations are unique to dlh io where provide the ability to reference the in stream data (data streaming per each synchronization frequency) against the existing raw data landing zone this is a perfect use case for conceptual ideas such as refunds, chargebacks, employee punches, etc this option is available by selecting the transformation type in the transformation area see also employee pay summary docid\ paewz2e nk0z0okpzgxax for example of using pre sql logic sql transformations sql transformations are unique to dlh io where provide the ability to reference the in stream data (data streaming per each synchronization frequency) against the existing raw data landing zone this type of transformations runs as the step in the sync bridge execution while a tool such as dbt cloud, dataform or coalesce io can do these light transformations, datalakehouse io can as well in the example below, a sync bridge (data pipelines) docid\ e00kk6kz8klbthcdmpqpm is syncing a google sheet into snowflake in order to control the column data types in snowflake, a transformation is created to drop the contacts new table at the end of each sync bridge run and then a ctas is executed to create the contacts new table with the desired column data types the text of the script in the above image is below for easy reference