Birdwatch Note Rating
2024-01-25 08:12:58 UTC - NOT_HELPFUL
Rated by Participant: CC8FD715E98F1B8007AA557CF3C7CE38620B945AB1645AB0E86FD6FE630C07BB
Participant Details
Original Note:
This paper is built on (very) problematic foundations As RJ Skerry-Ryan at Google pointed out, there is no such thing as raw bytes, and UTF-8 can be considered a hand-designed, highly biased tokenizer. This shouldn't have made it through internal peer-review. References: https://en.m.wikipedia.org/wiki/UTF-8 https://x.com/rustyryan/status/1750338422181609832?s=20
All Note Details