# \[IMPORTANT UPDATE\] Come help the grading system! Overhauled with Benchmark Books, Movies & TV Shows **URL:** \ **Category:** Korean\ **Created:** [February 7, 2024, 12:58am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897 "2024-02-07T00:58:07Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 7, 2024, 12:58am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/1 "2024-02-07T00:58:07Z")
[UPDATE - See below] Hi all, So, I’ve been thinking about recalculating the Korean difficulty ratings from a new notion of ‘benchmarks’ which I’ve developed from my experiences opening other languages. I think it’ll really improve the accuracy of the system, but I need a little help from you all! Next Step: We need to choose a series of books, movies & TV shows which will serve as the ‘benchmark’ for the grading system. As an example, I always choose Harry Potter volume 1 and put it at lvl 29/30 (~TOPIK 5). This makes it similar to the Japanese Grading system. Once we have a series of book set at certain levels, then the grading system starts to take shape. So any suggestions? What books & movies & tv shows would be appropriate for a particular TOPIK level? Please let me know below! **[UPDATE]** So per your suggestions, i’ve set bookmarks as shown below and _recalculated the entire rating system_. Please take a look and see what you think about how the gradings landed. I know, this will be a little chaotic but I think the end result will be much better! Please let me know if you have more suggestions for benchmarks, it’ll really help us out! **Significant changes** : - You will see that Harry Potter, [소리를 보는 소년](https://learnnatively.com/book/52d4945d7c/), among other things have been bumped up, per your suggestions - Many of the TV benchmarks are simply coming from the Japanese side - I took that level and assumed the Korean level would be relatively close - You will notice that you may have a lot more gradings all of a sudden. If you help us set benchmarks, those will reduce in volume, so please help us out 🙂 ## Benchmark Books - L12 (~TOPIK 2) - [Korean Stories for Language Learners: Traditional Folktales in Korean and English (Free Online Audio)](https://learnnatively.com/book/8803122183/) - Per Analysis - L13 (~TOPIK 3) - [콩쥐팥쥐전 The Story of Kongjwi and Patjwi](https://learnnatively.com/book/ee51785cb8/) - Per HopeWaterfall - - L14 (~TOPIK 2) - [Short Stories in Korean for Intermediate Learners](https://learnnatively.com/book/6ae0aa8556/) - Per HopeWaterfall & Bibliothecary’s suggestions - L18 (~TOPIK 3) - [구멍놀이 친구](https://learnnatively.com/book/c335191d20/) - From beta thread: - L18 (~TOPIK 3) - [흥부전](https://learnnatively.com/book/79a6528bd2/) - Per HopeWaterfall - - L20 (~TOPIK 3) - [호랑이 들어와요 1](https://learnnatively.com/book/b3a9ff4b08/) - Per Analysis - L22 (~TOPIK 4) - [전우치전](https://learnnatively.com/book/83cceb36f0/) - Easier than 소리를, about the same as 춘향전 - L22 (~TOPIK 4) - [춘향전](https://learnnatively.com/book/e2f69e2030/) - Easier than 소리를, about the same as 전우치전 - L24 (~TOPIK 4) - [어린왕자 (공식 한국어판)](https://learnnatively.com/book/f57ad32aee/) - Standard for little prince - L24 (~TOPIK 4) - [이상한 과자 가게 전천당 1](https://learnnatively.com/book/bb3ad93d1a/) - Japanese - - L25 (~TOPIK 4) - [너의 유니버스](https://learnnatively.com/book/b3a0dbe6a6/) - Per Analysis - L25 (~TOPIK 4) - [또다시 같은 꿈을 꾸었어](https://learnnatively.com/book/c4f9c8dac2/) - Japanese Rating - - L25 (~TOPIK 4) - [세계를 건너 너에게 갈게](https://learnnatively.com/book/fb5f711312/) - Per Analysis - L28 (~TOPIK 5) - [소리를 보는 소년](https://learnnatively.com/book/52d4945d7c/) - Easier than HP, harder than other things - - L30 (~TOPIK 5) - [완득이](https://learnnatively.com/book/33bbf0069e/) - Per analysis: - \< L31 책벌레의 하극상 제1부 - 병사의 딸 1 (/book/25ba52950b/) - \> L28 소리를 보는 소년 (/book/52d4945d7c/) - = L30 해리포터와 마법사의 돌 1 (/book/07fcda2e99/) - L30 (~TOPIK 5) - [해리포터와 마법사의 돌 1](https://learnnatively.com/book/07fcda2e99/) - - L31 (~TOPIK 5) - [책벌레의 하극상 제1부 - 병사의 딸 1](https://learnnatively.com/book/25ba52950b/) - japanese - - L9 (~TOPIK 2) - [토끼전 The Story of the Rabbit](https://learnnatively.com/book/e6de23ee00/) - Per HopeWaterfall - ## Benchmark TV Shows - L24 (~TOPIK 4) - [신데렐라와 네명의 기사 S1](https://learnnatively.com/season/4ba195f4a7/) - Per HopeWaterfall’s suggestion - - L27 (~TOPIK 5) - [약속의 네버랜드 S1](https://learnnatively.com/season/c4396255b9/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/daa4e70335/) daa4e703-35fe-4d99-a334-e8b66a6e12df - L27 (~TOPIK 5) - [이누야샤 S1](https://learnnatively.com/season/ae9c43fae9/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/a3fd780b33/) a3fd780b-3388-455a-89e4-8eaf05b21340 - L29 (~TOPIK 5) - [사내맞선 S1](https://learnnatively.com/season/2e8a52af91/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/0209a2f2fc/) 0209a2f2-fc4c-4db8-a653-30780005bc15 - L29 (~TOPIK 5) - [장송의 프리렌 S1](https://learnnatively.com/season/94fa135ea6/) - Japanese - - L30 (~TOPIK 5) - [사이코지만 괜찮아 S1](https://learnnatively.com/season/697e591952/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/7f5d9d994e/) 7f5d9d99-4ed0-49c1-bb50-e192c1525c21 - L30 (~TOPIK 5) - [연애대전 S1](https://learnnatively.com/season/55588f34ce/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/feb1635ae8/) feb1635a-e832-4f7f-8a89-f5107e863f58 - L32 (~TOPIK 5) - [약사의 혼잣말 S1](https://learnnatively.com/season/1aa6d72586/) - Equivalent to jpn [tv show](https://forums.learnnatively.com/season/48e3a1fbb4/) 48e3a1fb-b4b2-40f1-845d-50b7e4f01617 ## Benchmark Movies - L20 (~TOPIK 4) - [이웃집 토토로](https://learnnatively.com/movie/cf8bed2f28/) - Japanese - - L21 (~TOPIK 3) - [벼랑 위의 포뇨](https://learnnatively.com/movie/84499a923a/) - Japanese - - L21 (~TOPIK 4) - [도라에몽: 스탠바이미](https://learnnatively.com/movie/49aa2981c5/) - Equivalent to jpn movie /movie/4106dab0ee/ 4106dab0-eee1-453f-b97c-4b7d2c412a97 - L22 (~TOPIK 4) - [마녀 배달부 키키](https://learnnatively.com/movie/db1594368b/) - Japanese - - L23 (~TOPIK 4) - [도라에몽: 스탠바이미 2](https://learnnatively.com/movie/471050c4aa/) - Equivalent to jpn movie /movie/29573502db/ 29573502-db34-4977-8d2d-e206717b7dda - L24 (~TOPIK 4) - [고양이의 보은](https://learnnatively.com/movie/a2c94034e5/) - Equivalent to jpn movie /movie/df63688544/ df636885-44e4-455f-a989-e2209cd7319a - L25 (~TOPIK 4) - [추억의 마니](https://learnnatively.com/movie/ef1d0fd4de/) - Equivalent to jpn movie /movie/e6005f1e43/ e6005f1e-43ee-4b0c-b4fe-932372bfbcf0 - L26 (~TOPIK 4) - [메리와 마녀의 꽃](https://learnnatively.com/movie/ea522bab49/) - Equivalent to jpn movie /movie/e006a7eef9/ e006a7ee-f92a-4c83-87ae-3d46d5f17b92 - L26 (~TOPIK 4) - [펭귄 하이웨이](https://learnnatively.com/movie/321e63615f/) - Equivalent to jpn movie /movie/9189b8ea39/ 9189b8ea-393c-4d93-a350-55fb34e613b1 - L27 (~TOPIK 5) - [노틀담의 꼽추](https://learnnatively.com/movie/4d5ab8a025/) - Equivalent to jpn movie /movie/9abd7dafc7/ 9abd7daf-c702-4bb8-8907-639ee87173b2 - L27 (~TOPIK 5) - [인어공주](https://learnnatively.com/movie/50f727977b/) - Equivalent to jpn movie /movie/b90ed8c6b0/ b90ed8c6-b030-4bad-b507-b20b65a79a94 - L27 (~TOPIK 5) - [주토피아](https://learnnatively.com/movie/b284b58e20/) - Equivalent to jpn movie /movie/1ca8dfbc20/ 1ca8dfbc-203b-4121-a7a2-190642eeed0b - L27 (~TOPIK 5) - [피터 래빗 2: 파 프롬 가든](https://learnnatively.com/movie/61f06c61ee/) - Equivalent to jpn movie /movie/b0b8590d95/ b0b8590d-954b-47b8-ad13-af85c087cc35 - L28 (~TOPIK 5) - [공주와 개구리](https://learnnatively.com/movie/432f27860f/) - Equivalent to jpn movie /movie/db684a969a/ db684a96-9af1-4b48-9445-43bd489227b9 - L28 (~TOPIK 5) - [라이온 킹](https://learnnatively.com/movie/300119ce96/) - Equivalent to jpn movie /movie/f373e059c8/ f373e059-c8f9-477d-9aaf-abd151eab58c - L30 (~TOPIK 5) - [스타워즈 에피소드 5: 제국의 역습](https://learnnatively.com/movie/c17ea81ab7/) - Equivalent to jpn movie /movie/4590b9b59c/ 4590b9b5-9c4f-4fd0-a249-64086a394dd5 - L30 (~TOPIK 5) - [스타워즈 에피소드 6: 제다이의 귀환](https://learnnatively.com/movie/e7c8ee0196/) - Equivalent to jpn movie /movie/4acadb40ff/ 4acadb40-ffc6-4b00-92ff-e56f193af2c2 - L30 (~TOPIK 5) - [스타워즈 에피소드 7: 깨어난 포스](https://learnnatively.com/movie/aa950ac108/) - Equivalent to jpn movie /movie/f39f2897ec/ f39f2897-ec0c-48e1-962b-058604188685 - L30 (~TOPIK 5) - [스타워즈 에피소드 8: 라스트 제다이](https://learnnatively.com/movie/3e15008b89/) - Equivalent to jpn movie /movie/42fdd844e2/ 42fdd844-e2dc-41b3-98a4-ab31720cb4ff - L30 (~TOPIK 5) - [스타워즈 에피소드 9: 라이즈 오브 스카이워커](https://learnnatively.com/movie/f49715796c/) - Equivalent to jpn movie /movie/6ee5d5c64b/ 6ee5d5c6-4b87-484b-a26c-7566276650f6 - L30 (~TOPIK 5) - [캐리비안의 해적: 블랙펄의 저주](https://learnnatively.com/movie/729dbf3007/) - Equivalent to jpn movie /movie/ff15613175/ ff156131-753f-4738-8fb5-a8b68f03294a - L30 (~TOPIK 5) - [캐리비안의 해적: 죽은 자는 말이 없다](https://learnnatively.com/movie/c59a1a69c4/) - Equivalent to jpn movie /movie/0f9d9f9863/ 0f9d9f98-63b3-4e5a-bef8-7a8fe1d5d295 - L31 (~TOPIK 5) - [스타워즈 에피소드 4: 새로운 희망](https://learnnatively.com/movie/83e8faca03/) - Equivalent to jpn movie /movie/666f21125e/ 666f2112-5ede-438c-9a3b-f37cc1051832 - L37 (~TOPIK 6) - [택시운전사](https://learnnatively.com/movie/f3b5cd388d/) - Equivalent to jpn movie /movie/eb2f1b20b5/ eb2f1b20-b5d0-4846-8f9d-4ef14b0cdfc5 _FWIW I know TOPIK doesn’t correspond perfectly to native material, but just think of it as a general recommendation to someone at a particular TOPIK level_ ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 7, 2024, 1:20am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/2 "2024-02-07T01:20:29Z")
> [@Korean Beta - Feedback from Korean Users](http://forums.learnnatively.com/t/korean-beta-feedback-from-korean-users/4195/131): > > > [@Korean Beta - Feedback from Korean Users](http://forums.learnnatively.com/t/korean-beta-feedback-from-korean-users/4195/129): > > > > [춘향전 | L22??](https://learnnatively.com/book/e2f69e2030/) > > Shouldn’t this (and the others in the series) already have a set level since it’s graded as B2? 🤔 Ah, I didn’t realize it was a graded reader. And now I don’t know how B2 corresponds to TOPIK. Probably TOPIK5? 😅 ---
**Author:** ![HopeWaterfall](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/hopewaterfall/32/6205_2.png) [@HopeWaterfall](https://forums.learnnatively.com/u/HopeWaterfall)\ **Post date:** [February 7, 2024, 1:20am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/3 "2024-02-07T01:20:27Z")
> [@Korean Beta - Feedback from Korean Users](https://forums.learnnatively.com/t/korean-beta-feedback-from-korean-users/4195/130): > > You mean you’ve rated it harder than everything else. Yeah, the grading prompter will just keep asking you until you rate something as equitable / harder than it. As long as something is withing +/- 5 levels it’ll prompt you to compare it. That’s what I meant. The thing that’s weird to me is that it gets compared to pretty much everything I read. Just from my most recent gradings: - L19, L17, that makes sense ; - L7, L14, L12, L10, that’s what I don’t get. (All of these already had stable gradings btw, apart maybe from the L7 one) > [@Korean Beta - Feedback from Korean Users](https://forums.learnnatively.com/t/korean-beta-feedback-from-korean-users/4195/131): > > Shouldn’t this (and the others in the series) already have a set level since it’s graded as B2? Kind of, yeah. The difficulty would be exactly where to put it in B2. The first three of the series have been at the top of that level, but for this one I’m not sure. If we say that 소리를 보는 소년 is level 25, then 춘향전 is definitely below that. But then maybe 소리를 보는 소년 should be set higher, I’m not sure. It’s the same for 전우치전, it is definitely easier than 소리를 보는 소년, and I’d say around the level of 춘향전 I guess. Kinda hard to compare since one has hard vocab and relatively easier grammar, and the other one is the opposite. ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 7, 2024, 1:22am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/4 "2024-02-07T01:22:15Z")
FYI @HopeWaterfall I moved this comment in this thread, so the discussion continues here 🙂 ---
**Author:** ![bibliothecary](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bibliothecary/32/2723_2.png) [@bibliothecary](https://forums.learnnatively.com/u/bibliothecary)\ **Post date:** [February 7, 2024, 1:28am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/5 "2024-02-07T01:28:32Z")
> [@brandon](#): > > And now I don’t know how B2 corresponds to TOPIK. Probably TOPIK5? 😅 I’d guess: > A1 - TOPIK 1 > A2 - TOPIK 2 > B1 - TOPIK 3 > B2 - TOPIK 4 > C1 - TOPIK 5 > C2 - TOPIK 6 ---
**Author:** ![HopeWaterfall](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/hopewaterfall/32/6205_2.png) [@HopeWaterfall](https://forums.learnnatively.com/u/HopeWaterfall)\ **Post date:** [February 7, 2024, 1:31am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/6 "2024-02-07T01:31:05Z")
> [@brandon](#): > > Ah, I didn’t realize it was a graded reader. And now I don’t know how B2 corresponds to TOPIK. Probably TOPIK5? 😅 I think there’s more of a direct comparison between TOPIK lvl and CEFR lvl. At least [this paper](http://archive.sciendo.com/IJAS/ijas.2016.11.issue-1/ijas-2016-0003/ijas-2016-0003.pdf) seems to say that. ---
**Author:** ![bibliothecary](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bibliothecary/32/2723_2.png) [@bibliothecary](https://forums.learnnatively.com/u/bibliothecary)\ **Post date:** [February 7, 2024, 1:59am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/7 "2024-02-07T01:59:21Z")
Books: > [무민 시리즈 (series) | L10](https://learnnatively.com/series/9936b7cdf5/) > [호랑이 들어와요 (series) | L20](https://learnnatively.com/series/c816d90dc9/) > [이상한 과자 가게 전천당 (series) | L20??](https://learnnatively.com/series/38799c1755/) > [또다시 같은 꿈을 꾸었어 | L24](https://learnnatively.com/book/c4f9c8dac2/) > [책벌레의 하극상 (series) | L29](https://learnnatively.com/series/566b2ca13c/) > [어린왕자 (공식 한국어판) | L25??](https://learnnatively.com/book/f57ad32aee/) You could perhaps use the Japanese levels for translated books since they’ll be more accurate as more users have graded them. * * * TV Shows: > [페파 피그 | L10??](https://learnnatively.com/tv/52c339024d/) (L5) > [브레드 이발소 | L15](https://learnnatively.com/tv/18dc9f92fd/) (L10-12) > [미라큘러스 레이디버그 | L18](https://learnnatively.com/tv/880d12c861/) ---
**Author:** ![bungakushoujo](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bungakushoujo/32/24027_2.png) [@bungakushoujo](https://forums.learnnatively.com/u/bungakushoujo)\ **Post date:** [February 7, 2024, 2:17am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/8 "2024-02-07T02:17:23Z")
Just weighing in here as someone in the unique position of being very familiar with the Japanese grading system, having learned a European language and taken language tests in it and thus being very familiar with the CEFR system, and having worked my way through Korean learning materials up through TOPIK 6… I would be tempted to bump the TOPIK to CEFR correspondence levels down ever so slightly, as follows: TOPIK 1: A1 TOPIK 2: A2 TOPIK 3: B1 TOPIK 4: B1.5 TOPIK 5: B2 TOPIK 6: B2.5 ~ C1 My reasoning for that is the scope of grammar covered by the complete TOPIK spectrum does not ever get into very advanced or formal constructions that you can find in a textbook like KGIU advanced, and those constructions are usually a big focus of the CEFR C levels. I feel that the scope of vocab for the TOPIK is also narrower than it is for CEFR C levels. That is just my opinion though which doesn’t matter much in the grand scheme of things… it would probably be easier to keep the TOPIK levels as is corresponding nearly to the CEFR. 😅 In terms of actual benchmarks, though — I’ve read a number of translated books in Korean that I previously read in Japanese and found the levels between them quite similar, so that may be a good place to start? Mileage may vary though, as I am obviously biased with regard to understanding better as I’ve read the story before and am very comfortable deciphering 한자어 from my Japanese background. But, I guess we don’t need to get so scientific starting out here! Some titles to check out that could be used as benchmarks: 야시 (夜市) 편의점 인간 (コンビニ人間) 고백 (告白) 보라색 치마를 입은 여자 (紫のスカートの女) In addition, there’s some discussion within this thread about the level of 소리를 보는 소년. I finished it and graded it and it ended up at level 25 which felt just a bit low. Considering the grammar and vocab I am tempted to say that it felt almost like TOPIK 5, because there were some confusing honorifics and also “difficult” historical vocab and idioms…maybe level 28 or something feels more accurate? 🤔 That could just mean I did a bad job grading it though… Sorry if this response as not at all helpful, I realize it’s a lot of my opinions and musings. 😆 ---
**Author:** ![bungakushoujo](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bungakushoujo/32/24027_2.png) [@bungakushoujo](https://forums.learnnatively.com/u/bungakushoujo)\ **Post date:** [February 7, 2024, 2:22am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/9 "2024-02-07T02:22:58Z")
Commenting to add further, this may be a controversial hot take (or maybe not?), but I would say TOPIK 6 is almost roughly equivalent to JLPT N1, and on the Japanese side we have N1+ as a category when adding books, so something like that may be an idea! I don’t think the Korean side of the site has as many advanced readers, though…and that’s just the opinion of one person. 😆 So I’m seriously happy with whatever! ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 7, 2024, 2:25am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/10 "2024-02-07T02:25:57Z")
> [@HopeWaterfall](#): > > I think there’s more of a direct comparison between TOPIK lvl and CEFR lvl. At least [this paper](http://archive.sciendo.com/IJAS/ijas.2016.11.issue-1/ijas-2016-0003/ijas-2016-0003.pdf) seems to say that. > [@bungakushoujo](#): > > I would be tempted to bump the TOPIK to CEFR correspondence levels down ever so slightly, as follows: FWIW, I was also tempted to bump it down one level, just like I did for Japanese JLPT. JLPT, as i’m sure you know, also claims to be equivalent to CEFR (JLPT N1 = C2), which I think everyone generally agrees is _stretching_ it. All that really matters here is what do we want the level mapping to TOPIK to be and that the levels are relatively similar across languages. I think the current levels are fine, as long as we think equivalent things are in the same ballpark (is Harry Potter at lvl 30 (TOPIK5) a good recommendation?). Also, really appreciate the perspective @bungakushoujo.. especially since it coincides with my suspicion/feeling too 😂 ---
**Author:** ![bungakushoujo](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bungakushoujo/32/24027_2.png) [@bungakushoujo](https://forums.learnnatively.com/u/bungakushoujo)\ **Post date:** [February 7, 2024, 2:34am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/11 "2024-02-07T02:34:32Z")
> [@brandon](#): > > Also, really appreciate the perspective @bungakushoujo… especially since it coincides with my suspicion/feeling too 😂 Fist bump for that 👊🏻 > [@brandon](#): > > All that really matters here is what do we want the level mapping to TOPIK to be and that the levels are relatively similar across languages. I’d be pretty happy with that as it’d mean consistency + the TOPIK levels as a guideline for picking books. > [@brandon](#): > > (is Harry Potter at lvl 30 (TOPIK5) a good recommendation?). That sounds pretty reasonable to me. That would make my assessment of 소리를 보는 소년 at level 27/28 ish have it come out at between TOPIK 4-5, which feels accurate. 🙂 ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 19, 2024, 1:50pm UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/12 "2024-02-19T13:50:15Z")
I’ve added an update to the original post - please read 🙂. The grading system reprocessing will still take a little while (maybe 30 minutes?) so things may be a little weird looking until then. I will edit this comment when it’s done. A few things I’ll call out: - [Short Stories in Korean for Intermediate Learners](https://learnnatively.com/book/6ae0aa8556/) Is this really level 9?? I think i’ve placed it as lvl 18 in Spanish on research (supposedly A2-B1 level, but who knows). - In general, please help benchmark the videos! Let me know what you generally think 🙂 Edit: The processing is mostly done. We are still processing search results (you won’t see everything in search until an hour or two passes…), but you should be able to generally explore 🙂 ---
**Author:** ![HopeWaterfall](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/hopewaterfall/32/6205_2.png) [@HopeWaterfall](https://forums.learnnatively.com/u/HopeWaterfall)\ **Post date:** [February 19, 2024, 6:18pm UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/13 "2024-02-19T18:18:28Z")
> [@brandon](#): > > [Short Stories in Korean for Intermediate Learners](https://learnnatively.com/book/6ae0aa8556/) Is this really level 9?? I think i’ve placed it as lvl 18 in Spanish on research (supposedly A2-B1 level, but who knows). That’s more a problem with the book than with our gradings. The short stories for these intermediate Korean short stories are the same as the ones he uses for his beginner short stories in other languages. That’s why Korean doesn’t have any beginner short stories in Korean by Olly Richards. Maybe L9 is a little low considering vocab, but for grammar it doesn’t have a single intermediate grammar point and all sentences are pretty short and straightforward. Plus, a lot of vocab is defined, which makes reading it a lot easier. I’m guessing that it’s called intermediate instead of beginner because if you’re learning for example Spanish from English, you’ll be able to read a lot more easily than learning Korean from English. (I feel like the Spanish level is a bit high currently, based on what I’ve heard about it, and the difficulty of the Italian one to me. Although I guess I’m not the best judge of that with my prior knowledge in Romance languages making reading a lot easier.) I just started rewatching [신데렐라와 네명의 기사 | L30??](https://learnnatively.com/season/4ba195f4a7/), I feel like it’d be a good TOPIK 4 benchmark. Vocab is pretty simple, and mostly related to daily life. For grammar, there are various politeness levels used, but nothing too crazy either. There’s also technically one character that speaks in dialect, but it’s a side character that doesn’t appear often, so I don’t feel like that would bump the overall level. ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 20, 2024, 3:25am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/14 "2024-02-20T03:25:19Z")
> [@HopeWaterfall](#): > > That’s more a problem with the book than with our gradings. The short stories for these intermediate Korean short stories are the same as the ones he uses for his beginner short stories in other languages. That’s why Korean doesn’t have any beginner short stories in Korean by Olly Richards. Maybe L9 is a little low considering vocab, but for grammar it doesn’t have a single intermediate grammar point and all sentences are pretty short and straightforward. Ah, that’s interesting. Perhaps I’ll bump it up a little then to lvl 12 or lvl 13? 🤔 @bibliothecary do you have any thoughts? > [@HopeWaterfall](#): > > (I feel like the Spanish level is a bit high currently, based on what I’ve heard about it, and the difficulty of the Italian one to me. Now that I look at it again, it was the beginner stories that were quoted as A2/B1, but perhaps that’s too high? That spanish rating is purely the benchmark rating right now, so could definitely move it down. Would lvl 13 make sense (early A2?). > [@HopeWaterfall](#): > > I just started rewatching [신데렐라와 네명의 기시 | L30??](https://learnnatively.com/season/4ba195f4a7/), I feel like it’d be a good TOPIK 4 benchmark. Excellent. I’ll put that as lvl 24 then? In other news, I realized some of those auto-generated benchmarks from the Japanese rating were accidentally plucked from the Korean side before I wiped the ratings, not the Japanese side, oops. Will need to rerun this calculation again. ---
**Author:** ![bibliothecary](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bibliothecary/32/2723_2.png) [@bibliothecary](https://forums.learnnatively.com/u/bibliothecary)\ **Post date:** [February 20, 2024, 3:50am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/15 "2024-02-20T03:50:42Z")
I agree with @HopeWaterfall, it’s A2 at most, but I don’t see the harm in bumping up a couple of levels if need be. ---
**Author:** ![HopeWaterfall](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/hopewaterfall/32/6205_2.png) [@HopeWaterfall](https://forums.learnnatively.com/u/HopeWaterfall)\ **Post date:** [February 20, 2024, 4:56am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/16 "2024-02-20T04:56:24Z")
> [@brandon](#): > > Perhaps I’ll bump it up a little then to lvl 12 or lvl 13? 🤔 Yeah, I feel like that would make sense. > [@brandon](#): > > That spanish rating is purely the benchmark rating right now, so could definitely move it down. Would lvl 13 make sense (early A2?). Probably? This is kinda hard for me to evaluate, because my Spanish level is too high compared to this. Like I said though, if I’m just looking at the Italian version, I can read it with a little bit of guesswork. And as much as kowing French, Spanish and some Latin helps, I feel like calling my not even 2 months of Italian B1 would be outrageous. > [@brandon](#): > > Excellent. I’ll put that as lvl 24 then? Yeah, seems right! ---
**Author:** ![bibliothecary](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bibliothecary/32/2723_2.png) [@bibliothecary](https://forums.learnnatively.com/u/bibliothecary)\ **Post date:** [February 20, 2024, 7:39am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/17 "2024-02-20T07:39:31Z")
Is the grading system still recalculating? My finished books have all returned to temporary ratings: ![download (1)](https://do4ryrayvtpwi.cloudfront.net/original/2X/8/8e08684384f7f552acaeec216c5b9203504f8e3b.jpeg) I’m also being asked to grade [https://learnnatively.com/book/63d9687978/](https://learnnatively.com/book/63d9687978/) against an ever-growing number of books - I had already graded it as higher than other books I had read in the L20s, but now it’s comparing with others starting at L0 (this isn’t extra grading, I clicked on the blue button on the dashboard): ![download](https://do4ryrayvtpwi.cloudfront.net/original/2X/1/1d6e0a6bd1c28cf692bfc8256c956282e3eec51b.jpeg) ---
**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\ **Post date:** [February 20, 2024, 7:44am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/18 "2024-02-20T07:44:15Z")
> [@bibliothecary](#): > > Is the grading system still recalculating? My finished books have all returned to temporary ratings: Unfortunately no. This is the recalculation. TBH, we just need more benchmarks… Korean readership is way more spread out among a lot of books, which means more benchmarks will be necessary. Since we do have a lot of gradings, I’m in the process of trying to figure out some potential benchmarks based on the data we have. If, for example, we go through the 두루책방 series and simply set a bunch of books at a certain level, i’m guessing that will have a large impact. Edit I know the grading is a pain right now… but hopefully with the additional tools and approach we’re building here, it’ll be a big help to the Korean grading system and future grading systems 🙂 ---
**Author:** ![bizoo](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/bizoo/32/3868_2.png) [@bizoo](https://forums.learnnatively.com/u/bizoo)\ **Post date:** [February 20, 2024, 11:47am UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/19 "2024-02-20T11:47:57Z")
regraded what it gave me but it wasnt much tbh. I have no concept of the topik levels or what’s considered hard/easy grammar tbh so I can’t really suggest any benchmarks 😅 ---
**Author:** ![HopeWaterfall](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/hopewaterfall/32/6205_2.png) [@HopeWaterfall](https://forums.learnnatively.com/u/HopeWaterfall)\ **Post date:** [February 20, 2024, 2:28pm UTC](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897/20 "2024-02-20T14:28:13Z")
Is it still in recalculation? A lot of levels that were set are now uncertain, such as the 두루책방 levels. I just graded [최고의 이름 | L12??](https://learnnatively.com/book/f5d9624558/) with 101 auto-generated gradings, but this book is now both graded as a similar level to L2 books and L24?? books. [Next page](https://forums.learnnatively.com/t/important-update-come-help-the-grading-system-overhauled-with-benchmark-books-movies-tv-shows/6897.md?page=2)