You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Recently became aware that the bcgov residency in github only has access to 20 github runners. As the load increases this will have impacts on the timing of jobs. For this reason looking to pivot to running the pipeline in openshift.
this ticket will see the python script that does the data aquisition and uploading to object storage as well as the R code that does the transformation of the xml files to csv, run in openshift.
DoD:
helm chart that deploys the kubernetes cron jobs
Investigate if the helm chart can be configured so that the two jobs have dependencies on one another. I.E. the download process runs and then calls the R script job.
To be completed, but not as part of this ticket:
kibana dashboard / query that allows easily identify if job succeeded or not
Recently became aware that the bcgov residency in github only has access to 20 github runners. As the load increases this will have impacts on the timing of jobs. For this reason looking to pivot to running the pipeline in openshift.
this ticket will see the python script that does the data aquisition and uploading to object storage as well as the R code that does the transformation of the xml files to csv, run in openshift.
DoD:
To be completed, but not as part of this ticket:
relates to: #21
The text was updated successfully, but these errors were encountered: