The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights

 (silasdata.com)

16 points | by silasyl 2 days ago ago

1 comments