Show HN: Maple – Sub-2-BPW Moe Pruning to Run Gemma 4 26B at 45 TPS on a 6GB GPU

1 comments

• peter_d_sherman 10 minutes ago ago

  Looks absolutely stellar!

  Another step forward for local AI / local LLM inferencing on (very!) resource-constrained consumer GPU hardware!