Flat File Data Types to Destinations

Since we are data experts and have discussed with dozens of clients what the expectations around raw data from flat files landed in cloud data warehouses should look like, DLH.io defaults that all flat file columns will result as text/string data types.

Why?

The result is that any system or data worker will not have to contend with errors or data mismatch issues nor issues with different data type exchanges or conflicts based on legitimate files structure or content.

Data Scientist/Engineers typically prefer working with raw data. Since flat files themselves are basically csv/txt files, which land into the target/destination, typically in a raw landing zone database schema, this is an agreeable outcome from which then to build or work.