Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run two bpf_conformance tests in parallel and compare the results. #584

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

Alan-Jowett
Copy link
Collaborator

This pull request introduces a new script run_corpus.py to compare the outputs of two bpf_conformance plugins against a corpus of BPF programs. The script ensures that the plugins produce equivalent results, which is crucial for verifying plugin consistency.

Key changes include:

New Script Addition:

  • Script Purpose and Description:

    • Added a script to run two bpf_conformance plugins against a corpus of BPF programs and compare their results. (libfuzzer/run_corpus.py)
  • Command Line Argument Parsing:

    • Implemented argument parsing to read plugin paths, options, and corpus directory from the command line. (libfuzzer/run_corpus.py)
  • Corpus File Handling:

    • Added logic to enumerate and validate files in the corpus directory. (libfuzzer/run_corpus.py)
  • Plugin Execution and Comparison:

    • Implemented the execution of both plugins with the corpus files and compared their outputs. Differences in outputs are reported. (libfuzzer/run_corpus.py)
  • Debugging and Error Handling:

    • Added debug flag for detailed output and comprehensive error handling to manage file and process-related errors. (libfuzzer/run_corpus.py)

@coveralls
Copy link

coveralls commented Oct 23, 2024

Coverage Status

coverage: 79.171% (-0.08%) from 79.25%
when pulling 9525129 on Alan-Jowett:cross_check
into 78729ed on iovisor:main.

Alan Jowett added 6 commits October 23, 2024 15:09
Signed-off-by: Alan Jowett <[email protected]>
Signed-off-by: Alan Jowett <[email protected]>
Signed-off-by: Alan Jowett <[email protected]>
Signed-off-by: Alan Jowett <[email protected]>
Signed-off-by: Alan Jowett <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants