Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] README/Docs: advice on how to choose an answer grade #432

Closed
galantra opened this issue Aug 16, 2023 · 10 comments
Closed

Comments

@galantra
Copy link
Contributor

galantra commented Aug 16, 2023

Ideally, the user shouldn't rate the card based on the displayed interval. But we can't prevent the user doing that.

I have definitely done this myself, especially when I had an exam deadline, but also when the initial easy interval was longer than I liked it. Also, there was a time when I used the pass/fail two-button system.

This reminds me that Anki has, in fact, a setting to turn on/off the next intervals display (default: on).

Perhaps it should be mentioned in the Wiki/FAQ:

Draft

Grading your answer

The grade should be chosen based only on how easy it was to answer the card, not how long you want to wait until you see it again.

For example, if you habitually avoid the easy button because it shows long intervals, you can end up in a negative cycle: You'd be making the "easy" situations even rarer and easy grade's intervals longer and longer.

This means you should ignore the intervals shown above the answer buttons and instead focus on how well you recall the information. To help you, you can hide the intervals in the Anki preferences:

image

If you still want to see a deck sooner rather than later, for example because you have an exam coming up, you can use the Advance function of the Helper add-on. Advance is the preferable method because it doesn't skew the grading history of the cards.

Originally posted by @galantra in open-spaced-repetition/fsrs-optimizer#23 (comment)

@L-M-Sherlock
Copy link
Member

Should we add a new page of wiki for this doc or add a new FAQ? @Expertium and @user1823, what do you think of this issue?

@user1823
Copy link
Collaborator

user1823 commented Oct 2, 2023

Making a new Wiki page seems to be an overkill. I suggest adding a new FAQ.

@Expertium
Copy link
Collaborator

Making a new Wiki page seems to be an overkill. I suggest adding a new FAQ.
I agree.
Here's how (IMO) users should grade themselves:

Easy - you answered correctly with no hesitation.
Good - you answered correctly with a little bit of hesitation.
Hard - your answer was only partially correct, and/or you hesitated a lot.
Again - your answer was completely incorrect.

Unrelated, but @user1823, do you mind helping with editing this? #472

@user1823
Copy link
Collaborator

user1823 commented Oct 2, 2023

Here's how (IMO) users should grade themselves:

Easy - you answered correctly with no hesitation.
Good - you answered correctly with a little bit of hesitation.
Hard - your answer was only partially correct, and/or you hesitated a lot.
Again - your answer was completely incorrect.

This is something where preferences vary. Many people (including me) mostly use the Again and Good buttons because choosing between the 4 buttons can be difficult in many situations. It is not that I never use the Hard and Easy buttons. But, this happens very rarely.

Unrelated, but @user1823, do you mind helping with editing this? #472

I will have a look when I have sufficient time.

@cjdduarte
Copy link

Here's how (IMO) users should grade themselves:
Easy - you answered correctly with no hesitation.
Good - you answered correctly with a little bit of hesitation.
Hard - your answer was only partially correct, and/or you hesitated a lot.
Again - your answer was completely incorrect.

This is something where preferences vary. Many people (including me) mostly use the Again and Good buttons because choosing between the 4 buttons can be difficult in many situations. It is not that I never use the Hard and Easy buttons. But, this happens very rarely.

Unrelated, but @user1823, do you mind helping with editing this? #472

I will have a look when I have sufficient time.

It's my case. I simplified the process;

Again: I don’t know
Good: I got it right

@Expertium
Copy link
Collaborator

I mean, that works, but 4 grades allow you to grade yourself more precisely and convey more information to FSRS, which, in turn, allows FSRS to calculate optimal intervals more accurately.

@user1823
Copy link
Collaborator

user1823 commented Oct 2, 2023

I mean, that works, but 4 grades allow you to grade yourself more precisely and convey more information to FSRS, which, in turn, allows FSRS to calculate optimal intervals more accurately.

Though it seems to be logically correct, the data seems to say something else.

I mostly use Good and Again and still the RMSE for my collection (1.2%) is among the lowest RMSEs.

You will say that a statistical significance test must be conducted to confirm this claim; I agree. So, you can just forget about it and consider the next point.

More importantly, the decision fatigue that is avoided by using the two-button approach helps with consistency.

@Expertium
Copy link
Collaborator

I mostly use Good and Again and still the RMSE for my collection (1.2%) is among the lowest RMSEs.

RMSE varies a lot from one user to another, so we would need to analyze lots of colelctions to determien whether RMSE is correlated with only using 2 buttons.

You will say that a statistical significance test must be conducted to confirm this claim; I agree.

Lol, good prediction.
Also, @L-M-Sherlock, I just realized that if the user only uses 2 buttons, he won't be able to utilize the full range of values of D, 1-10 or 0-1 in the beta. Right now the only way to achieve the lowest value of D is by using "Easy", this is a bit of a problem for those who don't use "Easy".

@L-M-Sherlock
Copy link
Member

I just realized that if the user only uses 2 buttons, he won't be able to utilize the full range of values of D, 1-10 or 0-1 in the beta. Right now the only way to achieve the lowest value of D is by using "Easy", this is a bit of a problem for those who don't use "Easy".

But we don't know how it is beneficial to utilize the full range of values of D. And the difficulty is a relative value instead of an absolute value.

@L-M-Sherlock
Copy link
Member

Added in 11th FAQ.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants