16 points | by acossta 35 minutes ago ago
3 comments
Looks like their latest internal model performs somewhat similarly to model 4 of anthropic.
What's the perplexity of the average person?
Probably high because humans aren't trained on lowering cross entropy loss. Kind of funny to think that next token prediction is actually an emergent capability of the human brain...
Looks like their latest internal model performs somewhat similarly to model 4 of anthropic.
What's the perplexity of the average person?
Probably high because humans aren't trained on lowering cross entropy loss. Kind of funny to think that next token prediction is actually an emergent capability of the human brain...