57 points | by kermatt 2 hours ago ago
8 comments
Why is this up front on HN? Did it get an update?
Discussed last year when it was announced https://news.ycombinator.com/item?id=44226978
There have been a few published rumors of Apple getting ready to release a new set of local models.
I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt
Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
Can the local model code at all? Eg as the predictor in Zed?
I'll ask my LLM to build me a framework, thank you.
Why would you do that, assuming that you're not coding yourself/using the framework?
Why is this up front on HN? Did it get an update?
Discussed last year when it was announced https://news.ycombinator.com/item?id=44226978
There have been a few published rumors of Apple getting ready to release a new set of local models.
I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt
Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
Can the local model code at all? Eg as the predictor in Zed?
I'll ask my LLM to build me a framework, thank you.
Why would you do that, assuming that you're not coding yourself/using the framework?