Birdwatch Note Rating
2024-01-25 05:09:51 UTC - HELPFUL
Rated by Participant: 511A89207FD58B957417C13FF795CA68FF97C013E17D9B2D38951548D1E1370F
Participant Details
Original Note:
This paper is built on (very) problematic foundations As RJ Skerry-Ryan at Google pointed out, there is no such thing as raw bytes, and UTF-8 can be considered a hand-designed, highly biased tokenizer. This shouldn't have made it through internal peer-review. References: https://en.m.wikipedia.org/wiki/UTF-8 https://x.com/rustyryan/status/1750338422181609832?s=20
All Note Details