Suggestion: Everyone should Score + Partial Scoring #843
Conversation
|
Thanks for creating a new clean PR. |
scoresheets/Restaurant.tex
Outdated
| @@ -9,7 +9,8 @@ | |||
| \scoreitem[2]{100}{Detect calling or waving customer} | |||
| \scoreitem[2]{100}{Reach a customer's table without prior guidance/training} | |||
|
|
|||
| \scoreitem[2]{600}{Take and serve an order.} | |||
| \scoreitem[2]{300}{Take and serve an order.} | |||
There was a problem hiding this comment.
Should this be "take an order"? since now serve an order is in there twice
| @@ -2,14 +2,21 @@ | |||
|
|
|||
| \begin{scorelist} | |||
| \scoreheading{Main Goal} | |||
| \scoreitem[5]{60}{Picking tableware and cutlery for transportation to the dishwasher} | |||
| \scoreitem[5]{180}{Placing the tableware and cutlery inside the dishwasher} | |||
| \scoreitem{15}{Navigate to the table to pick up items} | |||
There was a problem hiding this comment.
Should this be scored? It is very simple for a stage 2 challenge.
There was a problem hiding this comment.
Yes, I think we decided it is fine to award small amounts of points for things like this. It motivates teams and also differentiates teams that enter and attempt the test from teams that don't attempt the test at all.
scoresheets/ServeBreakfast.tex
Outdated
| \scoreitem[4]{15}{Perceiving object and categorizing it correctly (visualize or say)} | ||
| \scoreitem[4]{30}{Picking up breakfast items for transportation to the table} | ||
| \scoreitem[4]{30}{Placing breakfast items on the table} | ||
| \scoreitem{100}{Pouring cereal into the bowl} |
There was a problem hiding this comment.
why do we reduce the amount of points for pouring? This is still very challenging for many teams. I think 300 pts is appropriate for such a challenging task.
There was a problem hiding this comment.
I agree. I would leave it at 300 and maybe increase the penalty for spilling? Because pouring without spilling is still very challenging but just pouring can be potentially done closed loop.
Also maybe add the entire package must be poured or add penalty for not pouring entire contents.
Same comments go for the milk pouring in bonus section.
scoresheets/CarryMyLuggage.tex
Outdated
| \scoreitem{50}{Avoiding the crowd of people obstructing the path} | ||
| \scoreitem{50}{Avoiding the small object on the ground} | ||
| \scoreitem{50}{Avoiding the hard-to-see object} | ||
| \scoreitem{50}{Avoiding the area blocked with retractable barriers} | ||
|
|
||
| \scoreheading{Bonus rewards} | ||
| \scoreitem{300}{Successful task completion} |
There was a problem hiding this comment.
what does this mean? is is to accomplish all the main goal items?
There was a problem hiding this comment.
yes. Basically if all sub-tasks are completed, one gets bonus points in order to encourage teams to try and complete the entire task instead of going for solving as many sub-tasks as possible.
There was a problem hiding this comment.
quoting johannes: does this include completing the main goal using deus ex machina? please clarify.
perhaps move this to main goals.
suggestion: give these points for a team solving all main goals without using deus ex machina.
There was a problem hiding this comment.
Yes, bonus points are intended to be for difficult challenges not otherwise required in the stage. Like for carry my luggage: navigating without a map and queuing.
I would remove the Successful task completion items entirely and move the points back to their individual scoring items
There was a problem hiding this comment.
quote Rulebook: "Bonuses: No bonus points can be scored when the robot requests help to solve part of a
task that normally would grant a bonus."
-> So then the Bonus points for task completion wouldn't have been awarded either in my understanding
-> removed it anyway due to the proposed suggestion
scoresheets/CarryMyLuggage.tex
Outdated
| \scoreitem{50}{Avoiding the crowd of people obstructing the path} | ||
| \scoreitem{50}{Avoiding the small object on the ground} | ||
| \scoreitem{50}{Avoiding the hard-to-see object} | ||
| \scoreitem{50}{Avoiding the area blocked with retractable barriers} | ||
|
|
||
| \scoreheading{Bonus rewards} | ||
| \scoreitem{300}{Successful task completion} |
There was a problem hiding this comment.
Yes, bonus points are intended to be for difficult challenges not otherwise required in the stage. Like for carry my luggage: navigating without a map and queuing.
I would remove the Successful task completion items entirely and move the points back to their individual scoring items
| @@ -2,14 +2,21 @@ | |||
|
|
|||
| \begin{scorelist} | |||
| \scoreheading{Main Goal} | |||
| \scoreitem[5]{60}{Picking tableware and cutlery for transportation to the dishwasher} | |||
| \scoreitem[5]{180}{Placing the tableware and cutlery inside the dishwasher} | |||
| \scoreitem{15}{Navigate to the table to pick up items} | |||
There was a problem hiding this comment.
Yes, I think we decided it is fine to award small amounts of points for things like this. It motivates teams and also differentiates teams that enter and attempt the test from teams that don't attempt the test at all.
scoresheets/ServeBreakfast.tex
Outdated
| \scoreitem[4]{15}{Perceiving object and categorizing it correctly (visualize or say)} | ||
| \scoreitem[4]{30}{Picking up breakfast items for transportation to the table} | ||
| \scoreitem[4]{30}{Placing breakfast items on the table} | ||
| \scoreitem{100}{Pouring cereal into the bowl} |
There was a problem hiding this comment.
I agree. I would leave it at 300 and maybe increase the penalty for spilling? Because pouring without spilling is still very challenging but just pouring can be potentially done closed loop.
Also maybe add the entire package must be poured or add penalty for not pouring entire contents.
Same comments go for the milk pouring in bonus section.
|
Adapted to requested changes. Moved back bonus points for task completion to the sub tasks of the main challenges. |
** Note: Your contribution is expected to meet the conventions and policies described in the contribution guidelines **
Description
An attempt to tackle the issues of "Teams should score" and "Partial Points". The changes mostly concern Stage 1 points, in order to give newcomers a chance of scoring, while also giving bonus points for completing (sub) tasks, in order to encourage trying to solve the entire task and not just farm partial points. We kept the Stage 2 grading almost as it was, since the generic way of how the task rewards are phrased, is fitting for the advanced challenges.
Mostly the approach contains splitting up actions into partial steps to allow giving points for perception or picking up of objects, so that teams can still get points even if something goes wrong during e.g. placing.
The total points of the tasks do not total to round numbers - but it was decided to disregard this for now.
PDF for ease of view: rulebook.pdf
Closes issue #
#804 - Teams should score
#808 - Partial Scoring
Changes proposed in this pull request:
Other comments
If this request is marked as a draft, please describe your plans or any specific feedback you would like