Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated build scripts #17

Open
missinglink opened this issue Jul 11, 2019 · 0 comments
Open

Automated build scripts #17

missinglink opened this issue Jul 11, 2019 · 0 comments
Labels
enhancement New feature or request

Comments

@missinglink
Copy link
Member

missinglink commented Jul 11, 2019

Add scripts to automate the generation of databases based on downloads from source.

The scripts would automate the process of downloading the source data, decompressing it (where relevant), importing it and saving the database.

This would ideally come in the form of terraform scripts which boot up one cloud instance per data source, allowing everything to be processed in parallel.

Additionally, we need to consider:

  • Where the build artefacts (the database and the logs) are stored
  • If we want to automatically merge all the sources into an 'everything.db' or leave that to the end user.
@missinglink missinglink added the enhancement New feature or request label Jul 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant