|
@andy_matuschak | |||||
|
In September we added a "retry" step to Quantum Country. If you forget something, you'll review it again later that session.
Other systems do something like this, and interviews suggested that readers needed to feel seen+supported when forgetting.
Does it help accuracy? (con't) pic.twitter.com/ChpK5YdLmK
|
||||||
|
||||||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
It seems to helps a little… but not as much as I expected!
Considering questions forgotten after a 2 week break, how likely were those q's to be forgotten next time (a few days later)?
With retry: 79 ±4.1% (N=375)
Without retry: 74 ±1.8% (N=2347)
(95% ci's assume binomial iid)
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
OK, a few pp, but those intervals overlap. And actually, the confidence is likely a bit overstated, since there'll be within-user correlations of samples. I'd guess it'll resolve to 2-3pp.
It'd be nice to have >80% accuracies for lapsed q's. We'll need stronger interventions!
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
Instinctively, I suspect the retry behavior is likely worth keeping around as an emotionally important element. More interviews will help us understand that. But there's a time cost to retrying, so we'll want to replace/augment it with something better if we can!
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
I was quite unclear! The numbers in this tweet are *accuracies* (not rates of forgetting). twitter.com/andy_matuschak…
|
||
|
|
||
|
Alex Dautel
@howtodowtle
|
10. pro |
|
What kind of annoyed me and kept me from going back is that I have to review the easy questions as often as the hard ones (i.e. no easy modifier like in Anki). When I have to answer 20 basic questions I never got wrong to also review 10 hard ones it feels like a waste of time.
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
That’s helpful feedback, thank you. We recently made the schedule much more aggressive in part to help with this. Do you recall when you tried it? I would be curious if it still felt annoying with the new schedule.
|
||
|
|
||
|
Damu
@outlieranalysis
|
10. pro |
|
I am sorry if it is already available but is there a way i can go through the questions again as part of the text itself? When i re-read, i do not see the questions.
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
I'm afraid there isn't such an option at the moment. Could you say more about why it feels like that might be helpful to you?
|
||
|
|
||
|
Tmo
@_ThomasT
|
10. pro |
|
I’m going through it now but I’m taking a couple days to finish it. Does it save my progress?
|
||
|
|
||
|
Andy Matuschak
@andy_matuschak
|
10. pro |
|
Yes, if you register.
|
||
|
|
||