We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When running the evaluation and specifying the same model multiple times currently the evaluation is run X amount of times for the model.
Example:
eval-dev-quality evaluate --runtime docker --result-path ./docker-test --runs 5 --model symflower/symbolic-execution --model symflower/symbolic-execution --model symflower/symbolic-execution --repository golang/plain
This runs the symflower/symbolic-execution 3 times with 5 runs as the model was 3 times specified as parameter.
symflower/symbolic-execution
Question: Do we want this behavior or should we unique the list of models after parsing?
unique
The text was updated successfully, but these errors were encountered:
Munsio
No branches or pull requests
When running the evaluation and specifying the same model multiple times currently the evaluation is run X amount of times for the model.
Example:
This runs the
symflower/symbolic-execution
3 times with 5 runs as the model was 3 times specified as parameter.Question:
Do we want this behavior or should we
unique
the list of models after parsing?The text was updated successfully, but these errors were encountered: