It's not necessary. Most distros contain all the packaging required to hardware-accelerate AI already, packages that need AI-specific tooling can specify it as a dependency and pull it in as-needed.
> Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source.
Perhaps something like https://www.redhat.com/en/products/ai/enterprise-linux-ai ?
It's not necessary. Most distros contain all the packaging required to hardware-accelerate AI already, packages that need AI-specific tooling can specify it as a dependency and pull it in as-needed.
> Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source.
We're kinda already past that: https://flathub.org/apps/com.jeffser.Alpaca