good to have a quick overview, though I am missing some kind of depth, like
>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.
Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.
Coming to the next missing part: use cases.
Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.
good to have a quick overview, though I am missing some kind of depth, like
>There are others — MLX-native runtimes, llama.cpp directly — but Ollama and LM Studio cover 95% of people reading this.
Sure, but... MLX native runtime have a lot of advantages right? and they are not necessarily more complicated like eg ollama. It's worth to mention them, too.
Coming to the next missing part: use cases.
Running it locally competes with dozens of freely available chat bots. And for most simple parts, seriously, you don't need that sophisticated payed AI service. But then: how do local model's perform exactly here: let's start with coding, image generation and more? Like stuff that I probably really want to run locally.
«The honest table». Right. Not interested in reading what you didn’t write.
Yeah, when I saw that I immediately rolled my eyes and closed that tab.
Whats the best coding model that fits on 16GB unified memory these days?
Entire article is vibeslopped
This is old, lm studio support has dropped quite a bit.
As of July the best seemed to be
* nativ
* omlx
* mtplx
clearly AI written (aka "slop"), stopped reading after a few paragraphs
Vibe slop article advertising a product