Mistral OCR

Throughout history, advancements in information abstraction and retrieval have driven human progress. From hieroglyphs to papyri, the printing press to digitization, each leap has made human knowledge more accessible and actionable, fueling further innovation. 

Today, we’re at the precipice of the next big leap—to unlock the collective intelligence of all digitized information. Approximately 90% of the world’s organizational data is stored as documents, and to harness this potential, we are introducing Mistral OCR.

Mistral OCR is an Optical Character Recognition API that sets a new standard in document understanding. Unlike other models, Mistral OCR comprehends each element of documents—media, text, tables, equations—with unprecedented accuracy and cognition. It takes images and PDFs as input and extracts content in an ordered interleaved text and images.

As a result, Mistral OCR is an ideal model to use in combination with a RAG system taking multimodal documents (such as slides or complex PDFs) as input.

We have made Mistral OCR as the default model for document understanding across millions of users on Le Chat, and are releasing the API mistral-ocr-latest at 1000 pages / $ (and approximately double the pages per dollar with batch inference). The API is available today on our developer suite la Plateforme, and coming soon to our cloud and inference partners, as well as on-premises.

Highlights

1. State of the art understanding of complex documents

2. Natively multilingual and multimodal

3. Top-tier benchmarks

4. Fastest in its category

5. Doc-as-prompt, structured output

6. Selectively available to self-host for organizations dealing with highly sensitive or classified information

Let’s dive into each. 

State of the art understanding of complex documents

Below is an example of the model extracting text as well as imagery from a given PDF into a markdown file. You can access the notebook here. 

Tables + Figures

OCR result

Math

OCR result

Hindi

OCR result

Document

OCR result

Arabic

OCR result