Birdwatch Note Rating
2024-01-26 02:17:49 UTC - HELPFUL
Rated by Participant: AB84BA7312A27E41A5340E8B03376F0CF05D2260B3242B5AD527D24B17A6D511
Participant Details
Original Note:
This paper is built on (very) problematic foundations As RJ Skerry-Ryan at Google pointed out, there is no such thing as raw bytes, and UTF-8 can be considered a hand-designed, highly biased tokenizer. This shouldn't have made it through internal peer-review. References: https://en.m.wikipedia.org/wiki/UTF-8 https://x.com/rustyryan/status/1750338422181609832?s=20
All Note Details