The "How" seems to have been stripped from the title... and that's the most important part. I believe every company in this space is going to require running sandboxes for their LLMs. Instead of requiring an LLM call a strict set of pre-configured tools, allowing it to write and execute whatever it needs opens up how powerful and impactful it can be.
I jokingly mentioned that I view my job as writing the perfect developer environment for the LLM. And it's true. Even though we're targeting a bunch of different profiles, not just developers, there's a common thread: we need to be able to integrate with whatever services they use. And how do you do that? Well you need to be able to interact with that service's API... And guess what's really good at writing code for interacting with APIs? LLMs!
And this is just the beginning for our sandboxes. There's a lot of interesting features we're planning on adding, and much of it is made possible through Firecracker.
Author here -
The "How" seems to have been stripped from the title... and that's the most important part. I believe every company in this space is going to require running sandboxes for their LLMs. Instead of requiring an LLM call a strict set of pre-configured tools, allowing it to write and execute whatever it needs opens up how powerful and impactful it can be.
I jokingly mentioned that I view my job as writing the perfect developer environment for the LLM. And it's true. Even though we're targeting a bunch of different profiles, not just developers, there's a common thread: we need to be able to integrate with whatever services they use. And how do you do that? Well you need to be able to interact with that service's API... And guess what's really good at writing code for interacting with APIs? LLMs!
And this is just the beginning for our sandboxes. There's a lot of interesting features we're planning on adding, and much of it is made possible through Firecracker.