That line means that you don't need to create an account and get an API key from a provider (i.e. "asking for permission") to run inference. The main advantage is precisely that local AI runs on your terms, including how data is handled, and provably so, unlike cloud APIs where there's still an element of trust with the operator.
Do you really mean/want to say:
>...and without permission on any device.
I would be much more interested in a tool which only allows AI to run within the boundaries which I choose and only when I grant my permission.
That line means that you don't need to create an account and get an API key from a provider (i.e. "asking for permission") to run inference. The main advantage is precisely that local AI runs on your terms, including how data is handled, and provably so, unlike cloud APIs where there's still an element of trust with the operator.
(Disclaimer: I work on QVAC)
thoughts on mesh-llm?
The modular philosophy of the full stack is to give you the building blocks for exactly this also :)
Hey folks, I'm part of the QVAC team. Happy to answer any questions!