Provides some Complex-data specific tools (raw -> consistent -> Postgresql):
drop-invalid-dates comma,separated,date,fields input.csv output.csv
convertsdate
fields to Python dates, fields failing to convert are replaced with None/nullgenerate-date-fixer R_export.txt.xls
generate a script suitable forparallel --gnu
that will create fixed rovat csvs when runcreate-table-fields R_export.txt.xls
createsrovat_n.fields
files to be used bycsv_to_psql
rovat-to-psql rovat_n.csv rovat_n.fields
helps loadingrovat_n.csv
properly into Postgres (usescsv_to_psql
) creates table with correct field types and primary key on (ceg_id
,alrovat_id
)