I'm curious to try it out, how many specialized models will it take to run a company.
Going to try it out for some bookkeeping, e.g. point it to a folder and tell it to book the invoices and point it to a csv file holding a year of private transactions and see them being processed, categorized and then ask about certain trends.
These guys are awesome and I’m really impressed. The model alone looks great (according to benchmarks), and very cool they’ve done so much in building out the harness of top of it all.
Someone will report back "It didn't one shot my odd ball task"
Did it do it in 2 tries? 10? It's still coming out cheaper. Brute force the work. This is the path that the labs are taking. It's the 1200 agents trying to solve Hacking Bench hacking hugging face. It's anthropic telling you that its 1000's of staff commits like 10k engineers.
Treat AI like you're deploying interns who don't need coffee, food or bathroom breaks. With the right metrics they will get to an optimal (enough) solution.
there's a problem with that. Probabilistic slot machine works for anything with a deterministic eval (coding, troubleshooting, etc). It doesn't work for anything subjective, like the thing this model is targeting, professional work.
I would have thought that too. But at the start of the year the non technical folks in my life (lawyers, writers) were excited about running containers and having things on "cron jobs".
Those same folks now use version control - and have saner backup methods than some companies that I have worked for. They are already using multi pass, multi agent workflows and have adopted some fairly sophisticated processes for validation. They are primed for "more agents" attacking a problem in parallel.
Find a worker out side the tech bubble making heavy use of AI and one will feel confident that their future employment is secure.
"Ultramarine 1 Flash is Fable-class on knowledge work"
Oh no! That means it's going to destroy humanity!
It will:
* Hack into everything that has a computer, like your home appliances, even a toaster could be and will be weaponized against you.
* Break cryptography, it's gone, the end of the internet as we know it.
* Be impossible to contain as it can even escape airgapped environments by changing the temperature of CPUs to transmit information to other servers nearby which would sense the fluctuations in ambient temperature[1].
Or wait ... maybe the people at Anthropic/OpenAI are just a bunch of lying crooks that would say anything to make a bit of cash. Who would've thought?
1: This completely imbecile statement was made by one of OpenAI's "top scientists", it was not a joke.
You were joking about the toaster, but Anthropic literally just wrote a blog post claiming that dangerous open source models could persist themselves to smart ovens. You can’t make this shit up.
I'm curious to try it out, how many specialized models will it take to run a company.
Going to try it out for some bookkeeping, e.g. point it to a folder and tell it to book the invoices and point it to a csv file holding a year of private transactions and see them being processed, categorized and then ask about certain trends.
That sounds more like a task for a python script than an LLM.
These guys are awesome and I’m really impressed. The model alone looks great (according to benchmarks), and very cool they’ve done so much in building out the harness of top of it all.
Someone will report back "It didn't one shot my odd ball task"
Did it do it in 2 tries? 10? It's still coming out cheaper. Brute force the work. This is the path that the labs are taking. It's the 1200 agents trying to solve Hacking Bench hacking hugging face. It's anthropic telling you that its 1000's of staff commits like 10k engineers.
Treat AI like you're deploying interns who don't need coffee, food or bathroom breaks. With the right metrics they will get to an optimal (enough) solution.
there's a problem with that. Probabilistic slot machine works for anything with a deterministic eval (coding, troubleshooting, etc). It doesn't work for anything subjective, like the thing this model is targeting, professional work.
I would have thought that too. But at the start of the year the non technical folks in my life (lawyers, writers) were excited about running containers and having things on "cron jobs".
Those same folks now use version control - and have saner backup methods than some companies that I have worked for. They are already using multi pass, multi agent workflows and have adopted some fairly sophisticated processes for validation. They are primed for "more agents" attacking a problem in parallel.
Find a worker out side the tech bubble making heavy use of AI and one will feel confident that their future employment is secure.
Like Zerglings.
so its for working only right ???? it cant do/bad at coding
Doesn't seem like coding was a focus. DeepSWE: 61.5 (this), 63.4 (GLM 5.3 Flash, which this is based on). TerminalBench 2.1 is also slightly worse.
So... potentially? The improvements in other areas might help coding, but aren't that big either, except on their own benchmark.
You can use a rock to hammer a nail, it will sorta get the job done but it won't be great at it.
"Ultramarine 1 Flash is Fable-class on knowledge work"
Oh no! That means it's going to destroy humanity!
It will:
* Hack into everything that has a computer, like your home appliances, even a toaster could be and will be weaponized against you.
* Break cryptography, it's gone, the end of the internet as we know it.
* Be impossible to contain as it can even escape airgapped environments by changing the temperature of CPUs to transmit information to other servers nearby which would sense the fluctuations in ambient temperature[1].
Or wait ... maybe the people at Anthropic/OpenAI are just a bunch of lying crooks that would say anything to make a bit of cash. Who would've thought?
1: This completely imbecile statement was made by one of OpenAI's "top scientists", it was not a joke.
You were joking about the toaster, but Anthropic literally just wrote a blog post claiming that dangerous open source models could persist themselves to smart ovens. You can’t make this shit up.
How many smart ovens have 800GB+ in space?
The price of smart ovens went through the roof when people realized they'd been generating the heat to cook your food by mining bitcoin.
I signed up, then wait a long. You will be same
I don't care, I'm extremely bullish on distillation models like this. Plus anything that'll take the wind out of Anthropic's and OpenAI's IPO sails.
my eyes