It is not recalculating, no. I will try to put in more benchmarks tomorrow, but it’s a bit of work to figure it all out and I’m trying to develop processes to make this analysis quicker for future grading systems.
The grading system will be a bit chaotic this week, but hopefully by the end it will be better.
We just need a lot of benchmarks to get it started.
For the 다락원 graded readers, will you put them as benchmarks?
I’d say:
토끼전 is not TOPIK 1 but actually TOPIK 2, so somewhere between L8-10
콩쥐팥쥐전 should be TOPIK 2-3
흥부전 is high TOPIK 3
전우치전 and 춘향전 are TOPIK 4, but easier than 또다시 같은 꿈을 꾸었어요 | L25 imo. Those two graded readers should be at the same level I think, 전우치전 has harder grammar and 춘향전 harder vocab, which kinda evens out in the end.
Oh great, that will help a lot! I’ll get that worked in today.
@HopeWaterfall so those 다락원 reader benchmarks made a massive difference! Just those alone triggered essentially the entire 두루책방 series to become ‘graded’ which led to most of those other lower level books becoming graded (as @bibliothecary has put in work grading there!)
Hopefully you will get a lot less silly grading prompts for books now that a lot more things are graded. I still am trying to put some more work into the videos today, along with maybe figuring out a few more good books benchmarks.
I’ve been going through my finished books and extra grading the ones that still had temporary ratings. I noticed that some I’ve already graded a lot were still temporary, for example https://learnnatively.com/book/cdb7c7a388/ :
I noticed a weird level for Korean Stories for Language Learners: Traditional Folktales in Korean and English (Free Online Audio) | L2. I wouldn’t be able to tell exactly what level it should be at, since I haven’t finished it and apparently the later stories are the most difficult, but it’s definitely not L2.
I thought that was weird until I had a look back at the first story - a dialogue of four lines between two characters saying hello, my name is…, and goodbye. L2 seems right.
The later stories might be about L20, but it’s kind of irrelevant since with learning materials it’s only the starting level that’s important.
Oh whoops! Yeah the benchmark was set incorrectly for that… i meant to set at lvl 12 but it was put at lvl zero! Recalculating now. Also updated the current list of benchmarks in the top message.
While I do agree that you could set at lvl 2 and that these graded readers are confusing to grade, I do think I wouldn’t recommend the graded reader to a lvl 2 person if the stories get that hard.
I think a lvl 12 rating is probably a better recommendation… but there’s no hard and fast rule here 
@brandon , currently the further you go down theHarry Potter series , the lower the levels get.
Also, this entire bogus Yes24 series is set at the same level.
It seems a bit misleading to grade it as L12 if half the text is below that level, especially since it will put off those who would benefit from reading the early texts; the higher level essentially renders the first half of the book useless as a learning resource.
I think it would make more sense to set it at the starting level and explain in the description that unlike other graded readers that are set at one level, this is more akin to a textbook that gradually increases in difficulty and takes time to work through.
set those as benchmarks
I marked that as a variant series.
Unfortunately, there’s not a terribly good way to handle these sorts of books. I guess I could not put it as a ‘benchmark’, but even when I didn’t it came out to lvl 11, so not really different.
I think we’ll just have to accept whatever people grade it as. Reviews & Lists can somewhat help mitigate the issue you’re describing.
So yeah, this is a little wacky I know. The reason is that I still am not sure how to incorporate your ‘additional’ gradings. I essentially need to look at a book, see if it’s temporary, and if it is, convert additional gradings to become ‘standard’ gradings.
However, in general it seems like there were enough standard gradings so that it was unnecessary to add that process. In the normal course of affairs, this would never happen - those gradings would’ve never entered the ‘additional’ gradings state. This is only happening for Korean because we’re recalculating it after we’ve had it around for a while.
Korean books and their Japanese equivalent.
Dang bibliothecary. 
What a huge list!
German: D.Gray-man 1 | L24??
Spanish: D.Gray-Man 1 | L24??
(Putting these here since bibliothecary already has a giant list.)
Just gonna split the table since the links aren’t rendering.
Hit the link limit again… 
Last one, I hope! 
You are amazing, thank you !! 
I’m not if I will make all of these benchmarks, but it’s an extremely good reference.
(FYI for some reason the japanese links aren’t showing up on the last table 
)
Edit: Nevermind
I’m still working on them!
These are books with Japanese authors, so I’m still finding the relevant books.
