description |
---|
Set up configurations for each data source connected to Datafold |
After setting up a data source, Datafold allows you to set unique configurations for all of our tooling. This is set up in 4 sections:
- ****Indexing **** The process of ingesting the schema from the data warehouse
- Filtering Limiting which datasets and tables are used in Datafold
- ****Profiling The process of computing statistics (number of rows, percentage of nulls, histograms etc) of the tables
- ****Lineage **** The process of fetching the historical SQL statements, which are parsed by Datafold, in order to resolve lineage