You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
lula evaluate is designed to be used to compare two assessments (a threshold assessment and a new assessment) and provide a pass/fail exit output and exit code as a result of being more/equally compliant (pass) or less compliant (fail).
Current this operates on the assumption of two separate assessment files being compared OR the two latest results in a single assessment file.
As Lula looks to make artifact consolidation into a single-file a first class process - we need the ability to store many assessments-results into a single object AND establish a way to identify which result is the threshold.
Example:
I may have an assessment result with a single finding (currently the threshold) - I perform another assessment (validate) which is less compliant. I now have two results - if I validate again, current logic would use the 2nd result (which was failing) as my new threshold. Instead I still want to use the original threshold to ensure I maintain a specific level of compliance until the assessment has become more compliant and the threshold needs to be updated
Describe the solution you'd like
Given assessment results are being written to a single file
When evaluate is executed
Then the threshold should be a specific result with some identifier
Additional context
Might be room here for props to be introduced
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
lula evaluate
is designed to be used to compare two assessments (a threshold assessment and a new assessment) and provide a pass/fail exit output and exit code as a result of being more/equally compliant (pass) or less compliant (fail).Current this operates on the assumption of two separate assessment files being compared OR the two latest results in a single assessment file.
As Lula looks to make artifact consolidation into a single-file a first class process - we need the ability to store many assessments-results into a single object AND establish a way to identify which result is the threshold.
Example:
I may have an assessment result with a single finding (currently the threshold) - I perform another assessment (validate) which is less compliant. I now have two results - if I validate again, current logic would use the 2nd result (which was failing) as my new threshold. Instead I still want to use the original threshold to ensure I maintain a specific level of compliance until the assessment has become more compliant and the threshold needs to be updated
Describe the solution you'd like
Additional context
Might be room here for
props
to be introducedThe text was updated successfully, but these errors were encountered: