Add Data Command: Phase 1

[Ben-Hodgkiss]

Overview
Data Management have requested a command-line process to automatically run various parts of the process that they go through when adding new endpoints. This has been broken down into phases of work to try and iteratively create a product for them. We are now ready to begin with Phase 1 of the product - testing an endpoint, process the resource and adding the endpoint and look-ups.
In time, this will allow us to retire/stop using the Endpoint Checker. By building this in the command line, we can better create Acceptance Tests that ensure that future pipeline updates, do not cause the add data process to fail (something we have seen with the Endpoint Checker lately).

Tech Approach

• Data Management have asked that an initial call to discuss Phase 1 is set up at the outset of this ticket being picked up.
• A Mural board showing Phase 1 can be found here.

Acceptance Criteria

• A new command line command is created which steps through adding a basic endpoint and can be run from a local copy of the config repo
• Summary outputs from command steps which help with quality checks
• Control / break points in the process which mean user can proceed or not based on quality checks, or add in more required config while running process
• Acceptance tests written to ensure that the command remains performant and is not broken by future pipeline changes
• Handover to Data Management complete.
• Updates to technical documentation.

Dependencies

• Will need close collaboration with DM throughout the build and testing.