Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test case summary | Improved UI #40

Open
mfornet opened this issue Apr 13, 2020 · 0 comments
Open

Test case summary | Improved UI #40

mfornet opened this issue Apr 13, 2020 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@mfornet
Copy link
Owner

mfornet commented Apr 13, 2020

Print a summary of the test execution.

  • Number of tests passed
  • Number of tests failed
  • Time execution per test.
  • Input / Output of failing tests

Allow tests without output. This tests should not be reported as failing (unless it crashes or is time limit).

Allow configuring tests:

  • Disable/Enable test (most relevant for debugging)
  • Mark test as output not known.
  • Disable All / Enable All

New configuration proposal.

Short circuit run mode: Run test cases until the last test case that failed.

It would be very cool to add the interface from https://github.com/agrawal-d/competitive-programming-helper

This will allow to show all testcase in a better way and interact better with testcase.

It also needs:

  • A way to open summary from any other view (to see and modify test cases).
  • Button to set a test to debug.
  • Button to save a generated test.

When run:

  1. if something failed:

List with all tests and metadata:

  • Test input
  • Test expected
  • Test output | Veredict
  • Time / Memory used
  1. Show small summary in a pop-up that said max-time, and everything went ok. Put a button that open full summary.
@mfornet mfornet added enhancement New feature or request help wanted Extra attention is needed labels Apr 13, 2020
@mfornet mfornet added this to the 0.3.0 milestone Apr 13, 2020
@mfornet mfornet removed this from the 0.3.0 milestone May 19, 2020
mfornet added a commit that referenced this issue May 31, 2020
mfornet added a commit that referenced this issue May 31, 2020
mfornet added a commit that referenced this issue May 31, 2020
* Fix #65 Save all config from companion.

Unblock #89

* Add better layout distribution for debugging.

This is temporary before #40
@mfornet mfornet changed the title Test case summary Test case summary | Improved UI Aug 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant