Having built my company's MCP server, I have a deeper appreciation for how important well-defined tools can be. It is clear to me that tool availability and coordination is going to be a top (or THE top) focus in the near future, more important than the model itself.
If you ever look at how an LLM greps through a codebase, pulling small slices at a time to gather what it needs, you have a sense of how precise tools can broaden a model's capabilities. If I had today's Sonnet with tooling from 5 years in the future, I expect it would beat Fable 5.2 hands down - that's how dramatic the difference is.
Anthropic/OpenAI have really buried the lede about tooling, baking it into their harnesses and trying to force lock-in. We are still in the AOL days of the internet right now.
Benchmark for the end 2 end browser tasks…. The other options operate at a different level of abstraction where the actions space also reduce token usage and latency…
Whoa, this looks incredible.
Having built my company's MCP server, I have a deeper appreciation for how important well-defined tools can be. It is clear to me that tool availability and coordination is going to be a top (or THE top) focus in the near future, more important than the model itself.
If you ever look at how an LLM greps through a codebase, pulling small slices at a time to gather what it needs, you have a sense of how precise tools can broaden a model's capabilities. If I had today's Sonnet with tooling from 5 years in the future, I expect it would beat Fable 5.2 hands down - that's how dramatic the difference is.
Anthropic/OpenAI have really buried the lede about tooling, baking it into their harnesses and trying to force lock-in. We are still in the AOL days of the internet right now.
Hmm you should really benchmark against
https://github.com/browser-use/browser-harness https://github.com/anomalyco/browse https://github.com/vercel-labs/agent-browser
The answer is very likely not a MCP server. browse (anomalyco) is relatively new; but the other 2 are battle tested in production….
None of these do the same thing as the posted MCP. It’s about batching and diff/deltas to reduce token usage and latency.
Benchmark for the end 2 end browser tasks…. The other options operate at a different level of abstraction where the actions space also reduce token usage and latency…