Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve log utility #183

Open
seabbs opened this issue Jan 22, 2021 · 0 comments
Open

Improve log utility #183

seabbs opened this issue Jan 22, 2021 · 0 comments

Comments

@seabbs
Copy link
Collaborator

seabbs commented Jan 22, 2021

Much of the current logging is informative but not truly helpful and makes understanding errors difficult (as logging doesn't stop on error). Having two layers of logging (summary + trace) would help this. Alternatives would be very welcome. This is of particularly important due to the lack of any other summary of progress either in the current set up or on batch (though perhaps the batch setup will contain some working summaries that I have missed)

Sample informative but not useful log segment:

2021-01-22 00:37:23 DEBUG add stats to output
2021-01-22 00:37:23 TRACE publish_data function
2021-01-22 00:01:40 TRACE run_regional_updates
2021-01-22 00:01:40 TRACE process includes
2021-01-22 00:01:40 TRACE filter datasets
2021-01-22 00:01:40 TRACE process locations
2021-01-22 00:01:40 INFO Processing dataset for united-kingdom
2021-01-22 00:01:40 TRACE loading ancillary data
2021-01-22 00:01:40 TRACE loading generation_time.rds
2021-01-22 00:01:40 TRACE loading incubation_period.rds
2021-01-22 00:01:40 TRACE loading onset_to_admission_delay.rds
2021-01-22 00:01:40 TRACE loading cases
2021-01-22 00:01:40 INFO Getting regional data

and

2021-01-22 00:38:27 TRACE generate metadata
2021-01-22 00:38:27 TRACE get_fields_list_fn
2021-01-22 00:38:27 TRACE get_keyword_list_fn
2021-01-22 00:38:27 TRACE get_author_list function
2021-01-22 00:38:27 TRACE get_dataset_contact_list function
2021-01-22 00:38:27 TRACE get_dataset_description_list function
2021-01-22 00:38:27 TRACE get_software_list function
2021-01-22 00:38:27 TRACE get_geographic_metadata_list
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant