2 points | by jonbaer 8 hours ago ago
3 comments
105 comments: https://news.ycombinator.com/item?id=47593422
“Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs” (prismml.com) | 227 points | 10 hours ago
I need a subscription to read that. Though, I don't get why 1 bit LLMs are smaller, if you go from 8 bit to 1 bit, you'll need 8 times more nodes right?
https://archive.ph/XIYG5
105 comments: https://news.ycombinator.com/item?id=47593422
“Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs” (prismml.com) | 227 points | 10 hours ago
I need a subscription to read that. Though, I don't get why 1 bit LLMs are smaller, if you go from 8 bit to 1 bit, you'll need 8 times more nodes right?
https://archive.ph/XIYG5