A tangential observation: the video on the linked page wasn't what I expected. I thought Mistral was a european AI company, so I didnt expect the video to be filmed in San Francisco featuring three people who don't seem to be european.
I'm not against them being a global organization, that's wonderful. I was just surprised. I expected a parisian office and european accents.
Unfortunately Europeans are terrible customers for making money. They ask a lot of questions and they're very stingy with their wallets. Americans on the other hand ...
Have realized most people are idiots and are willing to give away their and resources for a piece of paper if it has George Washington's face on it. So they've kept putting it on every piece of paper they could find.
Serious people keep pointing out that this is unsustainable, and will lead to the collapse of American society in weeks/months/years, but they've been saying that for decades and so far that hasn't happened yet.
This is absolutely not why there are no leading AI, other important silicon tech, or relevant space companies in Europe. To some degree they exist but are all B-Tier in comparison to US/China. You'd be surprised just how lose money can sit in Europe, I guess. Just not the way it needs to be for this.
The financial structure of the EU is nowhere close to enabling these capital devouring endeavors based on lofty future bets. Operating at a loss for years and years is simply unacceptable in European markets and the EU is not authoritarian enough to randomly divert capital based on political orders like China because the EU doesn't try to be a superpower controlling a hemisphere.
Have you raised venture capital? I have. It’s fine.
You don’t get US-level (or even Israel/China/Singapore) seeds, but often you get a matching public investment. Germany has better matching funds, but we did alright in Belgium, and previously Portugal.
Let’s stop pretending the EU can ‘fix’ this. It’s cultural, we’re simply not risk takers (on average) because a “normal” job comes with great benefits. Most of us don’t struggle to survive and have to “pull ourselves by the bootstraps”. The social security safety net protects you.
That’s all fine. We’re fine. No, we won’t lead on AI productisation, but we have AMAZING fundamental research going on at unis. I hired 2 such people in PhD+job setups, that part is also working fine.
> Anthropic generated $4.8 billion in sales in the first quarter. Its quarterly revenue is now growing faster than Zoom did during the pandemic, and Google and Facebook in the run-up to their initial public offerings. It is set to turn an operating profit of $559 million in the June quarter.
~Any borderline-large European tech company will have an office on the US west coast, for sales if nothing else. And probably sales engineering. The timezone difference is eight to ten hours; there is really no way around it.
(I did work for one which had an office in Vancouver, instead; same tz.)
Another company like this is Blackmagic Design. Despite being overwhelmingly based in Australia, you'd think it was an American company based on office listing ordering on https://www.blackmagicdesign.com/company/offices and /company page.
...I had no idea Blackmagic was australian! Thats wild, but maybe explains why their tech is so prevalent here haha. Well that and its all pretty excellent and great value (at least in the indie scene I was a part of)
To the best of my knowledge, most of the founding team started their careers in the US ( meta,etc..) and their primary investors are US VCs. In that regard, they smartly benefit on both side : US funding and European brains
I’ve always thought the US Postal Service is such a technological marvel. They somehow manage to identify and route billions of pieces of mail and I have to imagine their tech is significantly more primitive than this. Not only that but US addresses are absurdly non-standardized, you can often write the same address multiple ways and have it deliver to the same location. I’m sure there’s plenty of published knowledge in this area, but whenever I see announcements about OCR it feels like this should be a solved problem if it’s been accomplished at the scale of USPS for many years.
My father once received a letter from Algeria, with 3 words on the envelope : his first name, "Créteil" (the town where he lived, ≈100k inhabitants), and "France". Of course, in the 70s there was no Internet nor central database to find him, yet the postal service managed to deliver the letter. He was a very active social worker, managed a youth football team, etc. which made him locally well-known by his first name.
Nowadays, many people can't find anyone or any place unless their phone helps them. And postmen never stop to chat. Such a letter would not pass through the technology process, and probably not through the human network.
I can say that at least where I live (Brisbane Australia's inner-ring suburbs) that's still the case: my postie is super friendly, loves my dog, and always has a couple of minutes to say hi!
And its great, because I live at a house number that is <number>A, and there is a <number>... but no <number>B or anything, which trips up a surprising amount of people/delivery drivers, so having a postie who cares helps
sadly, over here in the netherlands and I assume elsewhere, the job as a postman changed drastically when they privatized. room for the human element has been all but squeezed out for profits long ago.
I used to part time for the (Danish) mail service.
The only sorting that was done automatically was the post codes. That was enough to get the letter to the right post office. The rest was done by the mailmen/women early in the morning.
It was a lot of fun trying to figure out what was meant by some of the addresses. The older people in particular often knew the story of why certain places were sometimes addressed in certain ways, or could guess the addresses based on the names of the people living there.
There's a lot of weird edge cases with US addresses. Carmel by the sea doesn't have street numbers. Florida keys addresses are often just a mile marker. The mail gets delivered because a human on the route is familiar with them.
The USPS Remote Encoding Center in Salt Lake City examined 841,260,847 images of poorly written addresses in fiscal year 2025. [0]
Unfortunately the page does not have a base rate--the total number of mail pieces that were not prepared for automated processing. Total first class mail, which includes a lot of bills prepared for automation was 25.7 billion [1]. If 10% of that are non-automated, then .8 / 2.57 = .31 or a third of mail not prepared for automation is handled by "employees look at the image and type in address information"
I can't help you with any of those questions... but back in the 90s I use to be one of those employees that looked at the image on the screen and typed the address information in Salt Lake City.
Quantitatively, I don't know the stats, but qualitatively I can confirm it felt like a lot.
I’m not totally sure what your point is, but my response is that most OCR technology is reading “automated” (i.e. computer-printed) documents such as PDFs and things like that. So I think parsing the numbers by “automated” vs “non-automated” is not a very helpful way to think about the success of USPS OCR technology; the gross percentage of manual reviews compared to total mail volume is a much better way at looking at the success of their OCR. That’s my perspective anyway, but maybe commercial OCR is really optimized for reading handwriting and I’m just not aware of it. I’m not an expert in the area.
My response was to your thesis: "whenever I see announcements about OCR it feels like this should be a solved problem if it’s been accomplished at the scale of USPS for many years." I think the USPS has "solved" much of the problem by getting the most prolific generators of mail to conform with more basic tech than OCR, the bar code.
Much commercial mail (including first class non-junk mail) is physically presorted and bundled as it is dropped with USPS and has a bar code that states the routing needed. Stuff that has had OCR performed by computer or human gets a little sticker near the bottom with the barcode.
The barcode is applied by the sender; the Postal Service required use of the Intelligent Mail barcode to qualify for automation prices beginning January 28, 2013. Use of the barcode provides increased overall efficiency, including improved deliverability, and new services.
It's cheap at $4/1k, but I'm hesitant to even benchmark this one again since the previous versions were all "98% accurate based on internal benchmarks of 4 pdfs" and ended up falling short of almost everything else on the market [1].
Even in this one, they just report that OlmOCRBench and OmniDocBench have "known limitations" and that's why they report flagship numbers from their internal benchmark.
Little on differences other than bounding boxes and double the price compared to their previous OCR v3 model from December - https://mistral.ai/news/mistral-ocr-3/ - other benchmarks were used back then.
Tested with Malayalam, normal handwriting got accurate but a slight different style got detected as kannada. Have samples if required, which sarvam got done with 99% accuracy leaving one text error.
I am making (open) finetunes for malayalam and kannada (and bengali, gujarati, hebrew), and need someone to transcribe a few images for me. Could you contact me if you are interested in helping?
I'm curious what's been your experience with Sarvam outside of Indic languages - Indian English (perhaps mixed with romanised indic verbiage) and also documents with complex layouts (figures, tables, etc).
I've been quite curious but hesitant about Indian offerings, particularly because they seem to be priced a little higher than what I would think they should be (I could be wrong and simply be misrembering though).
Sarvam is exceptionally tuned for indic languages we have more than 20 languages and it perform well for all in ocr. Iam yet to test with other languages. No any models come close for indic languages like sarvam. I saw they recently dropped price per page to 0.5 inr which is much cheaper. The only downside is the zip file based delivery.
"A note on out-of-scope use. OCR 4 is a document-understanding model, not a decision-maker. It is not intended for medical diagnosis, legal advice or judgment, high-stakes financial decisions, safety-critical systems, real-time/latency-sensitive processing, or non-document inputs (raw audio, video, etc.). "
Can't wait for the "oh so innovative" manager who will suggest during the next meeting "Ok... but what if WE used it for high-stakes financial decisions on non-document inputs like a photo from my phone?"
I guarantee you somebody on HN is going to comment about this "idea" next week.
Why would anybody do that you would simply get terrible results compared to dozens of other more capable models. It's for converting to text not answering questions. Just seems like you need some sort of weird angle to bring out an anti AI stance
But anyways just a side note one way to help reduce these errors is if you pass in both the original image and the OCR'd text to the models that make the decisions
All AI companies are working on models with specialisms. Which are really good at one task.
Mistral is just a bit more forward about this. I guess because they don't need/want to "wow" an audience with generalist user-facing tools (chat) that seem to be experts in everything (but in reality quite often will be a lot of such specialist models chained together).
Here, what you want, is really just a few python scripts away. Voxtral to turn your spoken prompt into text, piped into mistral large 3 with extra system prompts that creates a prompt for ocr and paths to files. It could do this in a loop to actually find those files. which you throw at ocr3, is pased back to misteal large 3 to interpret and turn into decisions.
This is common. It's rather uncommon, really, to build something like this using only one model for everything.
Recently I tied OCR with Opus 4.8. (I know, not technically right tool for the job). All I needed to do was extract dates from receipts. It got about 20% of the dates wrong yet rated all as “high confidence”.
Should have probably tried a more OCR specific model
> All I needed to do was extract dates from receipts
Was this... not basically a solved problem like 30 years ago? I'm pretty sure the shareware OCR tool that came with a black and white scanner I had at one point would do better than 20% wrong.
I don't know about Opus but I can tell you with Gemini the subscription product OCR is apparently not done by the model. It used a separate old fashioned OCR tool and gives bad results in my tests.
But with Gemini the API the model does do the OCR resulting in much better accuracy.
How long have you been testing this? Have you noted a large improvement? I tested Opus for this quite a while ago (maybe 4.5? Whatever was out about a year ago), and it performed quite poorly on my use case.
I have put together an internal benchmark on 1000s of business documents with weird tables, structure, etc. that I run on every relevant model release. Opus 4.8 performs very very well. But it is obviously overkill for the task (and expensive at doing so). I just wanted to respond to the OP.
I'm assuming that the reason I didn't have good success rate is because it was not scanned documents, but photographs, and lighting conditions weren't always ideal. I think scanned business documents are a happy-case scenario in a way. (obv, you seem to run it against some complex documents, so that's impressive)
Opus 4.8 scanned hundreds of PDFs for me recently with the worst handwriting imaginable. 100% successful, other than one record where even I could not figure out what was written.
I do not believe this story, because of the message I just posted above.
That's not really productive lol, I'm glad it worked for you but these models are non-deterministic and 'YMMV' very much applies everywhere. I had it parse receipts (in fairness, in variable lightning), all taken from iPhone cameras in the past year. And yeah, not a great job, about 20% failed to get the date correct. (Not outrageously wrong, e.g 05/20/2026 becomes 05/23/2026.
I think until Fable, Claude's vision was significantly worse than GPT and Gemini in my personal experience. I eval almost every vision model since I work on screenshot to code conversion project: https://github.com/abi/screenshot-to-code.
I was processing 55 year old paper files, most of them severely degraded, with its predecessor model. I was very impressed! I also tried Abbyy Finereader but it didn't even come close in my experience.
I used Abbyy Finereader for several years. I loved it. I completed some large projects with it. Modern VLMs put classic FineReader to shame for processing low-resolution/degraded/non-standard text.
I'm personally using the small Qwen 3.5 models. If you have an OCR problem, Mistral OCR 4 is probably great. Open weights models that you can run on a laptop may also work great.
> On our internal multilingual evaluation, OCR 4 leads across all eight language groups — English, Western Europe, Eastern Europe, Middle Eastern, Chinese, East Asian, Southeast Asian, and specialized languages (Hindi, Japanese, Georgian, Bengali, Armenian, Hebrew, Greek, Gujarati, Tamil, Malayalam, Kannada, Telugu).
The initial version of this page called these "minor languages" (vs specialized language), which is telling. If you're a speaker of one of these: This is why you need a sovereign set of models. (Japanese government: Are you listening?)
Given this a test on some scans of magazines, generally pretty impressed with the results. Mags are generally pretty whacky layouts and it does a reasonable job working out what is where and pulling it together into a single coherent md file. The way it crops relevant pics and puts them into the doc is pretty nice.
Haven't compared it with any other high tech OCR estups, but it's way better than the jank that comes as standard with my scanner.
Does anyone know of OCR benchmarks that include hand-written documents? I'm currently using Gemini pro 3 for this, and error rates are quite good, but it's a little bit pricey, and I'd be interested in a cheaper model that could perform as well, but almost all the OCR benchmarks I'm aware of (and I believe all the ones included in this announcement) are about printed/typeset text.
It’s not the same service. Google’s vision OCR is pure text extraction, not layout. Pretty sure Google’s doc AI services that can identify headers vs body text is $10 per 1k pages.
That’s true, though worth beating a dead horse to say that traditional OCR won’t hallucinate sentences, perform unwanted translation, or change the meaning of whole paragraphs to something more “appropriate”.
Are there benchmarks for how this performs on charts, or maybe more accurately, plots? I've yet to find a model that can digitize a plot into X,Y points with some accuracy in my use case of digitizing old datasheets.
Yes, we've been using Transkribus for this extensively. My wife is a historian who spends quite a bit of time sorting through old letters and diaries, and it has been a considerable quality of life improvement.
Even if you are able to read someone's scratches, having a model to do the bulk lifting saves your eyes a lot of squinting. One thing that makes Transkribus useful for research vs a chat interface is that it can line up its interpretation alongside the original image so you can examine its work directly.
Yes, we have successfully used Mistral OCR for digitizing handwritten forms. You always have low percentage that need human review and adjustment, but overall Mistral has been highly accurate (their price is amazing, too).
In the sense that you can get similarity scores for individual characters referenced against a known database of characters written by various individuals. You can get stylometry scores out of small LLMs that do demographic segmentation based on writing style using the same methods.
They won't have the capacity to be fed an image of handwritten text and say "Ahh, this is a note written by Winston Churchill!". You could very easily use these models and your agent framework of choice, like Hermes, the Segment Anything models, and other foss tooling to build a dedicated, specialist handwriting recognition system. Or facial recognition, or fingerprint recognition, etc - these sorts of things can be done very procedurally, without a lot of interpretive AI.
Not well tested. It switched all U.S. (") double quotation marks to UK-style (') single quotation marks, ignoring the source document. Useless in the US.
I was just using infinity parser 2 (flash, to be fair) for pennies self-hosted to run through thousands of pages of documents with remarkable confidence. I decided to use https://huggingface.co/datasets/allenai/olmOCR-bench to determine what was the best OCR tool, yesterday, but I've got no idea what the best is now. What is the dominant OCR eval right now? Between Baidu and Mistral this morning, I wonder if there's a new tool to switch to..
Are there any open models focused on LPR (license plate recognition)?
I have found some old ones but curious if there are new ones being developed like this OCR model. I may even try it for the purpose and see if it does well.
Edit: I also asked Gemini 3.1 Pro to analyze the certificate and it looks good
It looks like you have shared an `about:certificate` URL containing a chain of three Base64-encoded X.509 TLS/SSL certificates. This specific chain is used to secure connections to *mistral.ai*.
Here is the decoded breakdown of the certificate chain you provided:
## Certificate Chain Overview
This is a standard three-tier certificate chain issued by Google Trust Services for the Mistral AI domain.
---
### 1. Leaf Certificate (End-Entity)
This is the specific certificate issued to the website to verify its identity and encrypt traffic.
After paying for Mistral and using it for a while I genuinely hated it. It's a productivity black hole and can't realistically compete with anyone. I chose it only because it was European, but no. I'd rather let my one year subscription go to waste than use anything 'Mistral'.
Sure, well for me it isn't. It has been awful for even toy tasks that opencode's free plan did without an issue. The general sentiment about it is that it is really bad. I wish I knew before paying.
interesting... I have never seen such a benchmark before, where it forces the model to use a json schema for parsing a document. Sounds a bit counter intuitive to me, but I'm not that deep in the field. I usually just "ask" the model for information that is inside an image pdf. I haven't run any sophisticated benchmarks though...
No, they don't force the model to use a json schema, they simply use the model to extract the data, and then they feed that OCR result into the pipeline further to evaluate the OCR results against the ground truth, and this is where JSON schema is used, and also another model (gpt4o).
The armies of people desperate to defend mistral, scouring the internet for any of the hundreds of negative posts made about it daily is pathetic. There's a reason it needs 'fanboys' and 'defenders'... it sucks. Id have loved to use a European alternative, but Europeans need to get serious and actually offer an alternative that has value other than "it's trash, but it has a Made in Europe badge".
A tangential observation: the video on the linked page wasn't what I expected. I thought Mistral was a european AI company, so I didnt expect the video to be filmed in San Francisco featuring three people who don't seem to be european.
I'm not against them being a global organization, that's wonderful. I was just surprised. I expected a parisian office and european accents.
Unfortunately Europeans are terrible customers for making money. They ask a lot of questions and they're very stingy with their wallets. Americans on the other hand ...
> Americans on the other hand ...
Have realized most people are idiots and are willing to give away their and resources for a piece of paper if it has George Washington's face on it. So they've kept putting it on every piece of paper they could find.
Serious people keep pointing out that this is unsustainable, and will lead to the collapse of American society in weeks/months/years, but they've been saying that for decades and so far that hasn't happened yet.
You're american?
He's a prince of whales.
If he's a prince of whales, then I'm the king of eel-gland.
This is absolutely not why there are no leading AI, other important silicon tech, or relevant space companies in Europe. To some degree they exist but are all B-Tier in comparison to US/China. You'd be surprised just how lose money can sit in Europe, I guess. Just not the way it needs to be for this.
The financial structure of the EU is nowhere close to enabling these capital devouring endeavors based on lofty future bets. Operating at a loss for years and years is simply unacceptable in European markets and the EU is not authoritarian enough to randomly divert capital based on political orders like China because the EU doesn't try to be a superpower controlling a hemisphere.
Have you raised venture capital? I have. It’s fine.
You don’t get US-level (or even Israel/China/Singapore) seeds, but often you get a matching public investment. Germany has better matching funds, but we did alright in Belgium, and previously Portugal.
Let’s stop pretending the EU can ‘fix’ this. It’s cultural, we’re simply not risk takers (on average) because a “normal” job comes with great benefits. Most of us don’t struggle to survive and have to “pull ourselves by the bootstraps”. The social security safety net protects you.
That’s all fine. We’re fine. No, we won’t lead on AI productisation, but we have AMAZING fundamental research going on at unis. I hired 2 such people in PhD+job setups, that part is also working fine.
Chill.
I think “Just not the way it needs to be for this.” is exactly the point.
Oh come on!
Mistral has a successful business model and is actually making money. Not sure opening and anthropic are doing that yet.
> Anthropic generated $4.8 billion in sales in the first quarter. Its quarterly revenue is now growing faster than Zoom did during the pandemic, and Google and Facebook in the run-up to their initial public offerings. It is set to turn an operating profit of $559 million in the June quarter.
~Any borderline-large European tech company will have an office on the US west coast, for sales if nothing else. And probably sales engineering. The timezone difference is eight to ten hours; there is really no way around it.
(I did work for one which had an office in Vancouver, instead; same tz.)
Mistral just hired as CMO a Seattle based former Amazon/Google VP¹ , so seems their US based presence is growing.
¹ The one locally famous for being sued by Amazon for non compete back when non compete were a thing: https://www.geekwire.com/2020/amazon-sues-former-aws-marketi...
And US users spend much more than their EU counterpart
Another company like this is Blackmagic Design. Despite being overwhelmingly based in Australia, you'd think it was an American company based on office listing ordering on https://www.blackmagicdesign.com/company/offices and /company page.
...I had no idea Blackmagic was australian! Thats wild, but maybe explains why their tech is so prevalent here haha. Well that and its all pretty excellent and great value (at least in the indie scene I was a part of)
To the best of my knowledge, most of the founding team started their careers in the US ( meta,etc..) and their primary investors are US VCs. In that regard, they smartly benefit on both side : US funding and European brains
Uhm... isnt mistral mostly funded by ASML? A dutch company?
No, it's just one of the investors/customers.
There is even like an american flag flying high in the background
Gotta pretend so they buy your stuff
I’ve always thought the US Postal Service is such a technological marvel. They somehow manage to identify and route billions of pieces of mail and I have to imagine their tech is significantly more primitive than this. Not only that but US addresses are absurdly non-standardized, you can often write the same address multiple ways and have it deliver to the same location. I’m sure there’s plenty of published knowledge in this area, but whenever I see announcements about OCR it feels like this should be a solved problem if it’s been accomplished at the scale of USPS for many years.
My father once received a letter from Algeria, with 3 words on the envelope : his first name, "Créteil" (the town where he lived, ≈100k inhabitants), and "France". Of course, in the 70s there was no Internet nor central database to find him, yet the postal service managed to deliver the letter. He was a very active social worker, managed a youth football team, etc. which made him locally well-known by his first name.
Nowadays, many people can't find anyone or any place unless their phone helps them. And postmen never stop to chat. Such a letter would not pass through the technology process, and probably not through the human network.
> And postmen never stop to chat
I can say that at least where I live (Brisbane Australia's inner-ring suburbs) that's still the case: my postie is super friendly, loves my dog, and always has a couple of minutes to say hi!
And its great, because I live at a house number that is <number>A, and there is a <number>... but no <number>B or anything, which trips up a surprising amount of people/delivery drivers, so having a postie who cares helps
sadly, over here in the netherlands and I assume elsewhere, the job as a postman changed drastically when they privatized. room for the human element has been all but squeezed out for profits long ago.
Since the 70s the world population has almost tripled.
I used to part time for the (Danish) mail service. The only sorting that was done automatically was the post codes. That was enough to get the letter to the right post office. The rest was done by the mailmen/women early in the morning. It was a lot of fun trying to figure out what was meant by some of the addresses. The older people in particular often knew the story of why certain places were sometimes addressed in certain ways, or could guess the addresses based on the names of the people living there.
Fun fact: one of Yann LeCun's first 'deep learning' projects was on OCR for postal codes (MNIST).
Great video by Tom Scott on this subject:
https://www.youtube.com/watch?v=XxCha4Kez9c
haha this was great!
There's a lot of weird edge cases with US addresses. Carmel by the sea doesn't have street numbers. Florida keys addresses are often just a mile marker. The mail gets delivered because a human on the route is familiar with them.
>... US addresses are absurdly non-standardized.
Laughs in Indian addresses.
IIRC the USPS was one of the first big budget orgs behind early OCR systems all the way back in 1965.
https://www.youtube.com/watch?v=V4LJs2ZoDR4
related https://www.bbc.com/news/uk-northern-ireland-33581277
USPS can also make a list of every address, that's not possible generally with freeform text
The USPS Remote Encoding Center in Salt Lake City examined 841,260,847 images of poorly written addresses in fiscal year 2025. [0]
Unfortunately the page does not have a base rate--the total number of mail pieces that were not prepared for automated processing. Total first class mail, which includes a lot of bills prepared for automation was 25.7 billion [1]. If 10% of that are non-automated, then .8 / 2.57 = .31 or a third of mail not prepared for automation is handled by "employees look at the image and type in address information"
0. https://facts.usps.com/remote-encoding-center-rec-decipherin...
1. https://about.usps.com/what/financials/10k-reports/fy2025.pd...
I can't help you with any of those questions... but back in the 90s I use to be one of those employees that looked at the image on the screen and typed the address information in Salt Lake City.
Quantitatively, I don't know the stats, but qualitatively I can confirm it felt like a lot.
I’m not totally sure what your point is, but my response is that most OCR technology is reading “automated” (i.e. computer-printed) documents such as PDFs and things like that. So I think parsing the numbers by “automated” vs “non-automated” is not a very helpful way to think about the success of USPS OCR technology; the gross percentage of manual reviews compared to total mail volume is a much better way at looking at the success of their OCR. That’s my perspective anyway, but maybe commercial OCR is really optimized for reading handwriting and I’m just not aware of it. I’m not an expert in the area.
My response was to your thesis: "whenever I see announcements about OCR it feels like this should be a solved problem if it’s been accomplished at the scale of USPS for many years." I think the USPS has "solved" much of the problem by getting the most prolific generators of mail to conform with more basic tech than OCR, the bar code.
Much commercial mail (including first class non-junk mail) is physically presorted and bundled as it is dropped with USPS and has a bar code that states the routing needed. Stuff that has had OCR performed by computer or human gets a little sticker near the bottom with the barcode.
The barcode is applied by the sender; the Postal Service required use of the Intelligent Mail barcode to qualify for automation prices beginning January 28, 2013. Use of the barcode provides increased overall efficiency, including improved deliverability, and new services.
https://en.wikipedia.org/wiki/Intelligent_Mail_barcode
Ah that is an interesting point!
Well I guess a lot of humans are involved as well, so that helps
Also the census, literally hundreds of millions of hand-written forms that have needed to be processed. Which was the foundation of MNIST!
It'll be interesting to see how this ranks against https://github.com/baidu/Unlimited-OCR
Right, just announced https://x.com/BaiduAI_News/status/2069322806748410291
It's cheap at $4/1k, but I'm hesitant to even benchmark this one again since the previous versions were all "98% accurate based on internal benchmarks of 4 pdfs" and ended up falling short of almost everything else on the market [1].
Even in this one, they just report that OlmOCRBench and OmniDocBench have "known limitations" and that's why they report flagship numbers from their internal benchmark.
https://getomni.ai/blog/benchmarking-open-source-models-for-...
True, same conclusion, but the few samples I tried showed some real improvements since dec 2025 version.
That's extremely cheap. I wonder how the companies making a living out of this will survive. They certainly don't charge $0.004 per scan.
All AI labs really need to stop using truncated y-axes for benchmark bar charts...
https://mistral.ai/_astro/cm-engish_ZhlvoT.webp?dpl=6a3a94bd...
No, they need to keep using truncated y-axes to increase the hype cycle.
Little on differences other than bounding boxes and double the price compared to their previous OCR v3 model from December - https://mistral.ai/news/mistral-ocr-3/ - other benchmarks were used back then.
Tested with Malayalam, normal handwriting got accurate but a slight different style got detected as kannada. Have samples if required, which sarvam got done with 99% accuracy leaving one text error.
I am making (open) finetunes for malayalam and kannada (and bengali, gujarati, hebrew), and need someone to transcribe a few images for me. Could you contact me if you are interested in helping?
I'm curious what's been your experience with Sarvam outside of Indic languages - Indian English (perhaps mixed with romanised indic verbiage) and also documents with complex layouts (figures, tables, etc).
I've been quite curious but hesitant about Indian offerings, particularly because they seem to be priced a little higher than what I would think they should be (I could be wrong and simply be misrembering though).
Sarvam is exceptionally tuned for indic languages we have more than 20 languages and it perform well for all in ocr. Iam yet to test with other languages. No any models come close for indic languages like sarvam. I saw they recently dropped price per page to 0.5 inr which is much cheaper. The only downside is the zip file based delivery.
"A note on out-of-scope use. OCR 4 is a document-understanding model, not a decision-maker. It is not intended for medical diagnosis, legal advice or judgment, high-stakes financial decisions, safety-critical systems, real-time/latency-sensitive processing, or non-document inputs (raw audio, video, etc.). "
Can't wait for the "oh so innovative" manager who will suggest during the next meeting "Ok... but what if WE used it for high-stakes financial decisions on non-document inputs like a photo from my phone?"
I guarantee you somebody on HN is going to comment about this "idea" next week.
Why would anybody do that you would simply get terrible results compared to dozens of other more capable models. It's for converting to text not answering questions. Just seems like you need some sort of weird angle to bring out an anti AI stance
I think his comment is referring to a scenario where a decision is made on financial numbers that are misrecognized. E.g. 9.0% actual is OCR’d as 90%
I don't think so
But anyways just a side note one way to help reduce these errors is if you pass in both the original image and the OCR'd text to the models that make the decisions
Guess you haven't met management yet. Clearly nobody should do that but that official warning is not going to stop them from trying.
All AI companies are working on models with specialisms. Which are really good at one task.
Mistral is just a bit more forward about this. I guess because they don't need/want to "wow" an audience with generalist user-facing tools (chat) that seem to be experts in everything (but in reality quite often will be a lot of such specialist models chained together).
Here, what you want, is really just a few python scripts away. Voxtral to turn your spoken prompt into text, piped into mistral large 3 with extra system prompts that creates a prompt for ocr and paths to files. It could do this in a loop to actually find those files. which you throw at ocr3, is pased back to misteal large 3 to interpret and turn into decisions.
This is common. It's rather uncommon, really, to build something like this using only one model for everything.
“I delegated critical financial decisions to my OCR software, and you won’t believe what happened next.”
Recently I tied OCR with Opus 4.8. (I know, not technically right tool for the job). All I needed to do was extract dates from receipts. It got about 20% of the dates wrong yet rated all as “high confidence”.
Should have probably tried a more OCR specific model
> All I needed to do was extract dates from receipts
Was this... not basically a solved problem like 30 years ago? I'm pretty sure the shareware OCR tool that came with a black and white scanner I had at one point would do better than 20% wrong.
I don't know about Opus but I can tell you with Gemini the subscription product OCR is apparently not done by the model. It used a separate old fashioned OCR tool and gives bad results in my tests.
But with Gemini the API the model does do the OCR resulting in much better accuracy.
Opus is very good at OCR. Way better than the small 1-4B VLMs. If Opus failed, most likely those smaller models will fail as well.
We use Qwen 7B parameter model for this in production. It works quite well.
How long have you been testing this? Have you noted a large improvement? I tested Opus for this quite a while ago (maybe 4.5? Whatever was out about a year ago), and it performed quite poorly on my use case.
I have put together an internal benchmark on 1000s of business documents with weird tables, structure, etc. that I run on every relevant model release. Opus 4.8 performs very very well. But it is obviously overkill for the task (and expensive at doing so). I just wanted to respond to the OP.
I'm assuming that the reason I didn't have good success rate is because it was not scanned documents, but photographs, and lighting conditions weren't always ideal. I think scanned business documents are a happy-case scenario in a way. (obv, you seem to run it against some complex documents, so that's impressive)
I’m curious what your findings are for the best model for your use case
I do not believe this story.
Opus 4.8 scanned hundreds of PDFs for me recently with the worst handwriting imaginable. 100% successful, other than one record where even I could not figure out what was written.
I do not believe this story, because of the message I just posted above.
That's not really productive lol, I'm glad it worked for you but these models are non-deterministic and 'YMMV' very much applies everywhere. I had it parse receipts (in fairness, in variable lightning), all taken from iPhone cameras in the past year. And yeah, not a great job, about 20% failed to get the date correct. (Not outrageously wrong, e.g 05/20/2026 becomes 05/23/2026.
YMMV, glad it worked for you.
Your experience appears in line with at least this leaderboard: https://arbitrhq.ai/leaderboards
Are you sure you weren't using Sonnet or a low-effort reasoning mode?
Yes, lol
I believe it. Makes me curious what your prompt was that got such a good result out of Opus.
I ordered it to not be lazy and to show me result 1 at a time rather than doing it in batch.
likely just opus being dumbed down to prepare for fable
The comparisons rank it against GPT and Gemini but not Claude. Is Claude's vision support simply not competitive when it comes to OCR tasks?
I think until Fable, Claude's vision was significantly worse than GPT and Gemini in my personal experience. I eval almost every vision model since I work on screenshot to code conversion project: https://github.com/abi/screenshot-to-code.
I was processing 55 year old paper files, most of them severely degraded, with its predecessor model. I was very impressed! I also tried Abbyy Finereader but it didn't even come close in my experience.
I used Abbyy Finereader for several years. I loved it. I completed some large projects with it. Modern VLMs put classic FineReader to shame for processing low-resolution/degraded/non-standard text.
I'm personally using the small Qwen 3.5 models. If you have an OCR problem, Mistral OCR 4 is probably great. Open weights models that you can run on a laptop may also work great.
This has been a niche where Mistral has actually been successful. Btw, Hindi and Japanese are bucketed in "Rare Languages," which is odd.
I read that as "languages under-represented in the training set".
> On our internal multilingual evaluation, OCR 4 leads across all eight language groups — English, Western Europe, Eastern Europe, Middle Eastern, Chinese, East Asian, Southeast Asian, and specialized languages (Hindi, Japanese, Georgian, Bengali, Armenian, Hebrew, Greek, Gujarati, Tamil, Malayalam, Kannada, Telugu).
The initial version of this page called these "minor languages" (vs specialized language), which is telling. If you're a speaker of one of these: This is why you need a sovereign set of models. (Japanese government: Are you listening?)
Given this a test on some scans of magazines, generally pretty impressed with the results. Mags are generally pretty whacky layouts and it does a reasonable job working out what is where and pulling it together into a single coherent md file. The way it crops relevant pics and puts them into the doc is pretty nice.
Haven't compared it with any other high tech OCR estups, but it's way better than the jank that comes as standard with my scanner.
This runs for free on CPU https://github.com/kouhxp/textsnap
Does anyone know of OCR benchmarks that include hand-written documents? I'm currently using Gemini pro 3 for this, and error rates are quite good, but it's a little bit pricey, and I'd be interested in a cheaper model that could perform as well, but almost all the OCR benchmarks I'm aware of (and I believe all the ones included in this announcement) are about printed/typeset text.
Way too expensive. Google vision OCR (which they failed to compare against), is $1.50 per 1k pages. Vs $4 from Mistral.
It’s not the same service. Google’s vision OCR is pure text extraction, not layout. Pretty sure Google’s doc AI services that can identify headers vs body text is $10 per 1k pages.
That’s true, though worth beating a dead horse to say that traditional OCR won’t hallucinate sentences, perform unwanted translation, or change the meaning of whole paragraphs to something more “appropriate”.
interesting - an equivalent Azure Document Intelligence service (scanning with layout) is 10$/1k
Are there benchmarks for how this performs on charts, or maybe more accurately, plots? I've yet to find a model that can digitize a plot into X,Y points with some accuracy in my use case of digitizing old datasheets.
Do these models (this one or its competitors) do handwriting recognition?
Yes, we've been using Transkribus for this extensively. My wife is a historian who spends quite a bit of time sorting through old letters and diaries, and it has been a considerable quality of life improvement.
Even if you are able to read someone's scratches, having a model to do the bulk lifting saves your eyes a lot of squinting. One thing that makes Transkribus useful for research vs a chat interface is that it can line up its interpretation alongside the original image so you can examine its work directly.
Yes, we have successfully used Mistral OCR for digitizing handwritten forms. You always have low percentage that need human review and adjustment, but overall Mistral has been highly accurate (their price is amazing, too).
In the sense that you can get similarity scores for individual characters referenced against a known database of characters written by various individuals. You can get stylometry scores out of small LLMs that do demographic segmentation based on writing style using the same methods.
They won't have the capacity to be fed an image of handwritten text and say "Ahh, this is a note written by Winston Churchill!". You could very easily use these models and your agent framework of choice, like Hermes, the Segment Anything models, and other foss tooling to build a dedicated, specialist handwriting recognition system. Or facial recognition, or fingerprint recognition, etc - these sorts of things can be done very procedurally, without a lot of interpretive AI.
I think OP meant converting handwriting to text, not identifying a person based on their handwriting style! (but that sounds quite interesting)
If you mean handwriting to text then yes
Yep that's what I mean, thanks :)
Not well tested. It switched all U.S. (") double quotation marks to UK-style (') single quotation marks, ignoring the source document. Useless in the US.
Mistral keeps reminding us that doesn´t just brew great coffee, they can build great AI too. Hats off to the team. Mistral O.C.R. (Only Cool Results)
1000 pages for $4? damn how does it compare to llama parse I wonder
I was just using infinity parser 2 (flash, to be fair) for pennies self-hosted to run through thousands of pages of documents with remarkable confidence. I decided to use https://huggingface.co/datasets/allenai/olmOCR-bench to determine what was the best OCR tool, yesterday, but I've got no idea what the best is now. What is the dominant OCR eval right now? Between Baidu and Mistral this morning, I wonder if there's a new tool to switch to..
(jerry from llamaindex here) we're gonna benchmark on ParseBench and report the results!
Or Apples local OCR/Vision models?
Naive question: is Claude no good at OCR? Was surprised to see that none of Anthropic's models were included in the benchmark comparisons.
I wonder how it does compare to reducto, pulse, extendai.
Is there a complete list of the languages they support, and benchmarks by language, instead of just "Rare Languages"?
Are there any open models focused on LPR (license plate recognition)?
I have found some old ones but curious if there are new ones being developed like this OCR model. I may even try it for the purpose and see if it does well.
Why the chart crimes?!
Is there something wrong with their certificate? Chromium is saying https isn't valid
Looks good to me on both brave (on android) and firefox (on windows 11). Lets see what ssl labs says (it is running now)
https://www.ssllabs.com/ssltest/analyze.html?d=mistral.ai&la...
Looks good so far, A+ on ipv4 as well as ipv6
Edit: I also asked Gemini 3.1 Pro to analyze the certificate and it looks good
It looks like you have shared an `about:certificate` URL containing a chain of three Base64-encoded X.509 TLS/SSL certificates. This specific chain is used to secure connections to *mistral.ai*.
Here is the decoded breakdown of the certificate chain you provided:
## Certificate Chain Overview
This is a standard three-tier certificate chain issued by Google Trust Services for the Mistral AI domain.
---
### 1. Leaf Certificate (End-Entity)
This is the specific certificate issued to the website to verify its identity and encrypt traffic.
* *Subject (Common Name):* `mistral.ai` * *Subject Alternative Names (SANs):* `mistral.ai`, `workers.mistral.ai` * *Issuer:* WE1 (Google Trust Services) * *Valid From:* June 13, 2026 * *Valid To:* September 11, 2026 * *Key Type:* Elliptic Curve (ECDSA)
### 2. Intermediate Certificate
This certificate acts as a bridge between the website's certificate and the trusted Root CA.
* *Subject:* WE1 (Google Trust Services) * *Issuer:* GTS Root R4 (Google Trust Services LLC) * *Valid From:* December 13, 2023 * *Valid To:* February 20, 2029 * *Key Type:* Elliptic Curve (ECDSA)
### 3. Root Certificate
This is the foundational trust anchor pre-installed in browsers and operating systems.
* *Subject:* GTS Root R4 (Google Trust Services LLC) * *Issuer:* GTS Root R4 (Self-signed) * *Valid From:* June 22, 2016 * *Valid To:* June 22, 2036 * *Key Type:* Elliptic Curve (ECDSA)
thanks I'm going to have to check whats going on with my setup then
Not opensource right?
The weights do not appear to be downloadable, "contact sales for self hosting"
starting y axis from 50 and 95 is a bit mileading
After paying for Mistral and using it for a while I genuinely hated it. It's a productivity black hole and can't realistically compete with anyone. I chose it only because it was European, but no. I'd rather let my one year subscription go to waste than use anything 'Mistral'.
Opposite advice. It's very useful to me for dev and general tasks.
Been using Claude in parallele, it's better not not that much, just 10x (or 100x ?) more expensive.
Sure, well for me it isn't. It has been awful for even toy tasks that opencode's free plan did without an issue. The general sentiment about it is that it is really bad. I wish I knew before paying.
Well, you lost 17 $. I'm not being sarcastic, that's not a lot for dev tasks.
Mistral's coding models aren't on par with current SOTA US and Chinese models if that's what you're referring to, but I rather like their OCR models.
I assume you mean for coding, for which I would agree. But for OCR Mistral is SOTA :)
I am not totally following this area but the link from a commenter from above suggests that it is not SOTA but on the lower end (but still good): https://getomni.ai/blog/benchmarking-open-source-models-for-...
interesting... I have never seen such a benchmark before, where it forces the model to use a json schema for parsing a document. Sounds a bit counter intuitive to me, but I'm not that deep in the field. I usually just "ask" the model for information that is inside an image pdf. I haven't run any sophisticated benchmarks though...
No, they don't force the model to use a json schema, they simply use the model to extract the data, and then they feed that OCR result into the pipeline further to evaluate the OCR results against the ground truth, and this is where JSON schema is used, and also another model (gpt4o).
aaahhh...
> After paying for Mistral and using it for a while I genuinely hated it
For OCR?
Codestral is pretty good for coding autocomplete. possibly better than even Cursor's
what did you use it for and when?
The armies of people desperate to defend mistral, scouring the internet for any of the hundreds of negative posts made about it daily is pathetic. There's a reason it needs 'fanboys' and 'defenders'... it sucks. Id have loved to use a European alternative, but Europeans need to get serious and actually offer an alternative that has value other than "it's trash, but it has a Made in Europe badge".
Same, I got a refund 3 days later. It is unusable.