Add queue time information

[smlambert]

We currently pull and parse information from Jenkins pipelines, but do not include the queue time (how long a job waits for a particular machine resource). It will be useful to include this information in what we gather, and then make it available via the TRSS API (just like we do for test execution times) so that we might better forecast resource needs.

[llxia]

yes, I agree. I think we should use Jenkins API to get all the stage duration time that we have and display them in a logical way. (i.e., in descending order per stage, group by pipeline/platform, with machine name, etc)

[smlambert]

Related: GSoC 2023 proposal to pull some of this information and consider how to best optimize machine usage

[llxia]

https://github.com/jenkinsci/pipeline-stage-view-plugin/tree/master/rest-api#get-jobjob-namewfapiruns

[llxia]

#784 is the initial step.

[smlambert]

From a discussion today with Lan, we can approach it iteratively:

• leverage the getBuildStages API to store each stage time per build in DB
• create an API to get top 3 worst platforms for queue time within one pipeline
• generalize the API for all other stages (i.e., input: stageName & pipelineName; output: 3 worst platforms within the pipeline)
• new view for display (if necessary/wanted)

A fresh example of calling the existing API that we can leverage is this:
https://trss.adoptium.net/api/getBuildStages?url=https://ci.adoptium.net&buildName=Grinder&buildNum=12192

which fetches the buildStage info from a particular Jenkins job and returns the duration of each stage, in durationMillis

{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/wfapi/describe"},"artifacts":{"href":"/view/Test_grinder/job/Grinder/12192/wfapi/artifacts"}},"id":"12192","name":"#12192 - [email protected]","status":"SUCCESS","startTimeMillis":1736370714030,"endTimeMillis":1736372196611,"durationMillis":1482581,"queueDurationMillis":20,"pauseDurationMillis":0,"stages":[{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/execution/node/8/wfapi/describe"}},"id":"8","name":"Queue","execNode":"","status":"SUCCESS","startTimeMillis":1736370715478,"durationMillis":6793,"pauseDurationMillis":0},{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/execution/node/34/wfapi/describe"}},"id":"34","name":"Setup","execNode":"","status":"SUCCESS","startTimeMillis":1736370722271,"durationMillis":83474,"pauseDurationMillis":0},{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/execution/node/59/wfapi/describe"}},"id":"59","name":"Build","execNode":"","status":"SUCCESS","startTimeMillis":1736370806371,"durationMillis":45215,"pauseDurationMillis":0},{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/execution/node/81/wfapi/describe"}},"id":"81","name":"Test","execNode":"","status":"SUCCESS","startTimeMillis":1736370851632,"durationMillis":1334518,"pauseDurationMillis":0},{"_links":{"self":{"href":"/view/Test_grinder/job/Grinder/12192/execution/node/96/wfapi/describe"}},"id":"96","name":"Post","execNode":"","status":"SUCCESS","startTimeMillis":1736372186205,"durationMillis":9328,"pauseDurationMillis":0}]}