# Product Updates & Casual Natively Discussion

**URL:** <https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18>\
**Category:** Natively\
**Created:** [June 12, 2022, 9:03am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18 "2022-06-12T09:03:14Z")\
**Posts on this page:** 20\
**Page:** 22

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 6, 2022, 3:37am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/422 "2022-10-06T03:37:22Z")

</div>

This is more curiosity than anything else, but what’s going on with 本好き’s difficulty rating? It was at 31 basically forever, then dropped to 30 for a few weeks, then went back to 31, and now is at 32. I thought the ratings weren’t supposed to be this volatile, particularly for books with many ratings?

---

<div class="post-metadata">

**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\
**Post date:** [October 6, 2022, 9:18am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/423 "2022-10-06T09:18:43Z")

</div>

No, remember that ELO doesn’t make the ratings stickier as there becomes more gradings… as it assumes the entire notion of a lvl 31 or lvl 30 may be changing.

As we’ve discussed before, we could try other rating systems, but really focusing on movies right now… which has been more difficult than I imagined, as I’m trying to make the entire system more flexible for additional future types 😕

---

<div class="post-metadata">

**Author:** ![Athakaspen](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/athakaspen/32/636_2.png) [@Athakaspen](https://forums.learnnatively.com/u/Athakaspen)\
**Post date:** [October 6, 2022, 6:31pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/424 "2022-10-06T18:31:28Z")

</div>

I do think the ELO system is a bit strange for book rating, since (as I understand) it’s a floating value, which gives more immediate weight to new gradings. This makes sense in chess or another competitive game, where players can get better or worse over time, but for books it would make more sense for old ratings to have equal weight with new ones.

Ideally, I think it would also be good to have an algorithm that checks the ‘transitivity’ of ratings too, so to speak. By that I mean if Book A has consistently been rated harder than Book B, then when Book B’s difficulty level increases, Book A should automatically increase accordingly. I’m not sure an efficient algorithm like this even exists, though… Sounds like complicated graph theory lol.

---

<div class="post-metadata">

**Author:** ![Megumin](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/megumin/32/1227_2.png) [@Megumin](https://forums.learnnatively.com/u/Megumin)\
**Post date:** [October 6, 2022, 9:05pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/425 "2022-10-06T21:05:25Z")

</div>

Aren’t the ELO Ratings more designed towards skill of the user, instead of skill required for a medium?

Also how does it fare being media instead game skills such as chess?  
In a game, you start with a white canvas and then go from there.  
Unless there is stuff like puzzles that are based on ELO scores?

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 7, 2022, 1:33am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/426 "2022-10-07T01:33:14Z")

</div>

> [@Athakaspen](#):
>
> ounds like complicated graph theory lol.

Sounds like some kind of weighted, directed graph. Except with the added complexity of resolving conflicts (i.e. when transitivity is contradicted by the actual gradings). I haven’t done much with graph theory in nearly a decade, so I don’t have anything useful to add beyond that. 😅

It would be kind of fun if @brandon publicly shared the gradings dataset for people to experiment with.

---

<div class="post-metadata">

**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\
**Post date:** [October 7, 2022, 1:51am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/427 "2022-10-07T01:51:57Z")

</div>

> [@Athakaspen](#):
>
> Ideally, I think it would also be good to have an algorithm that checks the ‘transitivity’ of ratings too, so to speak. By that I mean if Book A has consistently been rated harder than Book B, then when Book B’s difficulty level increases, Book A should automatically increase accordingly.

You are correct that there are ‘static’ Elo rating system (see [Bradley-Terry model](https://en.wikipedia.org/wiki/Bradley%E2%80%93Terry_model)) which have to be recalculated for every book every night, which i’ve played around with briefly. However, it has issues as well - sometimes you get books in rating islands not connected to the larger rating system and those books’ ratings don’t resolve to a value.

> [@Megumin](#):
>
> Aren’t the ELO Ratings more designed towards skill of the user, instead of skill required for a medium?

Yes that’s true. However, there’s no rating system tailor-made for the present application, so we do have look at what’s out there and use whats best 🙂.

> [@seanblue](#):
>
> It would be kind of fun if @brandon publicly shared the gradings dataset for people to experiment with.

I would be happy to share a partial dataset if people were actually interested in playing around with it. Just ping me 🙂

I will say though that while the accuracy of the Elo system may be improved, it has the end functionality I want a rating system to have. Namely:

- it generates a rating value
- it accepts pairwise comparisons
- it can handle rating islands & temporary ratings relatively well
- easy to calculate, easy to understand, easy to diagnose issues

Potential improvements:

- static ranking, rather than dynamic ranking (see [Bradley Terry](https://en.wikipedia.org/wiki/Bradley%E2%80%93Terry_model))
- ability to generate personal ranked lists
- ability to allow users to grade all their comparisons, rather than limited to 6 per book (elo would give them too much power)
- stickiness of heavily graded books (would be covered by static ranking)

As I noted, Elo is very simple to use and has the end functionality that I want, which is why its stuck around as long as it has. Once I finish the major additions I’m planning (movies / tv shows, a second language, high priority platform features - tagging, descriptions… a few others), I thought it would make some sense to dedicate time to the grading system.

Elo works surprisingly well though - it just has a tendency to oscillate up and down for highly rated books such as @seanblue mentioned. There are just lots of things to do 🙂

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 7, 2022, 2:05am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/428 "2022-10-07T02:05:45Z")

</div>

> [@brandon](#):
>
> Elo works surprisingly well though - it just has a tendency to oscillate up and down for highly rated books

The exact opposite of the expected behavior of a rating system I think. 😂

> [@brandon](#):
>
> There are just lots of things to do 🙂

Well hopefully someone responds here about how they have a PhD in graph theory and want to help. 😄

---

<div class="post-metadata">

**Author:** ![Megumin](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/megumin/32/1227_2.png) [@Megumin](https://forums.learnnatively.com/u/Megumin)\
**Post date:** [October 7, 2022, 3:08am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/429 "2022-10-07T03:08:57Z")

</div>

> [@seanblue](#):
>
> Well hopefully someone responds here about how they have a PhD in graph theory and want to help.

You can study some data analyst / data scientist PhD books in Japanese, and that’s two birds with one stone! 🤣

> [@brandon](#):
>
> Elo works surprisingly well though - it just has a tendency to oscillate up and down for highly rated books

Thanks for the detailed explanation.  
Maybe there’s a way to hold highly oscillating books without changing the algorithm if it’s already producing satisfying results?

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 7, 2022, 3:36am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/430 "2022-10-07T03:36:00Z")

</div>

> [@Megumin](#):
>
> You can study some data analyst / data scientist PhD books in Japanese, and that’s two birds with one stone! 🤣

I did spend several days last year reading Japanese Wikipedia pages on math. This seems like the natural next step!

---

<div class="post-metadata">

**Author:** ![Naphthalene](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/naphthalene/32/146_2.png) [@Naphthalene](https://forums.learnnatively.com/u/Naphthalene)\
**Post date:** [October 7, 2022, 7:02am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/431 "2022-10-07T07:02:39Z")

</div>

> [@seanblue](#):
>
> This seems like the natural next step!

Here’s one that is not copyrighted (Creative Commons license, see page 3)

[http://www.kunitomo-lab.sakura.ne.jp/2021-3-3Open(S).pdf](http://www.kunitomo-lab.sakura.ne.jp/2021-3-3Open(S).pdf)

---

<div class="post-metadata">

**Author:** ![Eruna](https://deyr2qldo994j.cloudfront.net/letter_avatar_proxy/v4/letter/e/e9a140/32.png) [@Eruna](https://forums.learnnatively.com/u/Eruna)\
**Post date:** [October 7, 2022, 12:28pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/432 "2022-10-07T12:28:36Z")

</div>

Elo has some limitations due to being designed to be able to be calculated by hand in a time when computers were less common place.

Most chess sites etc, use improvements like Glicko-2 instead. Which to my knowledge adds:

- ratings becoming more stable the more comparisons are added.
- ratings slowly becoming more volatile again over time if no new comparisons are added.

Although I don’t know whether the latter bit makes sense for Natively. (I don’t think large amounts of Elo drift over time are particularly common.)

Might be worth looking into.

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 13, 2022, 11:46pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/433 "2022-10-13T23:46:04Z")

</div>

Hey @brandon, per my comment [here](http://forums.learnnatively.com/t/what-are-you-reading-today/38/467), I no longer think [僕が愛したすべての君へ | L30](https://learnnatively.com/book/1a09c149cd/) and [君を愛したひとりの僕へ | L30](https://learnnatively.com/book/e8e33729f8/) should be listed as a series. I think they should be split into separate entries, maybe with a note saying they are related to each other. This would match Amazon and AniList (for the upcoming anime adaptions), which also list them individually. Now that I’ve finished both books, I can say for sure that the order I originally suggested is definitely not the “right” order to read them in. If either is “right”, it’s the opposite, simply based on the chapter structure. But in the end I think they are more like parallel stories that can be enjoyed in either order, and which order is better will probably depend on the person.

---

<div class="post-metadata">

**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\
**Post date:** [October 14, 2022, 7:47am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/434 "2022-10-14T07:47:28Z")

</div>

Noted and thanks!

I’ve now split them ([1](https://learnnatively.com/book/1a09c149cd/), [2](https://learnnatively.com/book/e8e33729f8/)) and erased the first book gradings from affecting the second book. I’ve set the second book at a temporary lvl 30 🙂

I’m not too worried about showing the relations if it’s simply the same universe - they are easily viewable if you search by author.

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 14, 2022, 11:48am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/435 "2022-10-14T11:48:24Z")

</div>

> [@brandon](#):
>
> I’m not too worried about showing the relations if it’s simply the same universe

Well, at the very least they are from the same multiverse. 😜

I’ll try to add reviews to both of them, so I’ll mention that they are related there.

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 14, 2022, 2:59pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/436 "2022-10-14T14:59:32Z")

</div>

They still appear as a series in my library. Will that fix itself at some point, or do you have to fix that manually?

EDIT: It’s fixed now

EDIT 2: But I can’t grade the second book for some reason.

---

<div class="post-metadata">

**Author:** ![cat](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/cat/32/2344_2.png) [@cat](https://forums.learnnatively.com/u/cat)\
**Post date:** [October 14, 2022, 7:10pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/437 "2022-10-14T19:10:29Z")

</div>

Specific to this forum (Discourse) can I ask that `allow user locale` and `set locale from accept language header` be enabled? It does not currently seem to be. Basically I’d like the languages Discourse is [already available in to be auto-translated into several languages](https://community.namati.org/t/translating-our-forum-interface-into-more-languages-such-as-burmese-and-swahili/1875/3) and it looks like there is functionality to automatically pick up user language ([here](https://meta.discourse.org/t/make-a-multi-language-forum/18501) - scroll to bottom it’s a long thread).

It looks like this when enabled, fwiw:

 ![image](https://do4ryrayvtpwi.cloudfront.net/original/2X/b/b10d63164457389580815af8f51395d7b0c32771.png)

---

<div class="post-metadata">

**Author:** ![seanblue](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/seanblue/32/3251_2.png) [@seanblue](https://forums.learnnatively.com/u/seanblue)\
**Post date:** [October 17, 2022, 2:16am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/438 "2022-10-17T02:16:45Z")

</div>

> [@seanblue](#):
>
> But I can’t grade the second book for some reason.

Tagging you @brandon, in can you didn’t notice this.

---

<div class="post-metadata">

**Author:** ![brandon](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/brandon/32/24147_2.png) [@brandon](https://forums.learnnatively.com/u/brandon)\
**Post date:** [October 17, 2022, 9:38am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/439 "2022-10-17T09:38:38Z")

</div>

> [@seanblue](#):
>
> But I can’t grade the second book for some reason.

Sorry about that - should appear now! When I broke them apart I forgot to do something for your personal grading data (you needed the your grading status of that book updated), thanks for catching.

> [@cat](#):
>
> Specific to this forum (Discourse) can I ask that `allow user locale` and `set locale from accept language header` be enabled? It does not currently seem to be. Basically I’d like the languages Discourse is [already available in to be auto-translated into several languages](https://community.namati.org/t/translating-our-forum-interface-into-more-languages-such-as-burmese-and-swahili/1875/3) and it looks like there is functionality to automatically pick up user language ([here](https://meta.discourse.org/t/make-a-multi-language-forum/18501) - scroll to bottom it’s a long thread).

Ok updated!

Apologies I didn’t get back to these messages until today, busy weekend 🙂

---

<div class="post-metadata">

**Author:** ![Megumin](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/megumin/32/1227_2.png) [@Megumin](https://forums.learnnatively.com/u/Megumin)\
**Post date:** [October 17, 2022, 10:47am UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/440 "2022-10-17T10:47:10Z")

</div>

![image](https://do4ryrayvtpwi.cloudfront.net/original/2X/6/6d26f9bb259d6f1b9e605b6a8aca3ade9148baeb.png)

Funny side effect

---

<div class="post-metadata">

**Author:** ![eefara](https://deyr2qldo994j.cloudfront.net/user_avatar/forums.learnnatively.com/eefara/32/85_2.png) [@eefara](https://forums.learnnatively.com/u/eefara)\
**Post date:** [October 17, 2022, 12:03pm UTC](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18/441 "2022-10-17T12:03:27Z")

</div>

Interesting. I see レギュラー for you and Regular for me. 🤔 I’m surprised your (?) language settings affect my display.

[Previous page](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18.md?page=21)

[Next page](https://forums.learnnatively.com/t/product-updates-casual-natively-discussion/18.md?page=23)
