Welcome the NVIDIA Llama Nemotron Nano VLM to Hugging Face Hub

TL;DR

NVIDIA Llama Nemotron Nano VL is a state-of-the-art 8B Vision Language Model (VLM) designed for intelligent document processing, offering high accuracy and multimodal understanding. Available on Hugging Face, it excels in extracting and understanding information from complex documents like invoices, receipts, contracts, and more. With its powerful OCR capabilities and efficient performance on the OCRBench v2 benchmark, this model delivers industry-leading accuracy for text and table extraction, as well as chart, diagram, and table parsing. Whether you’re automating financial document processing or improving business intelligence workflows, Llama Nemotron Nano VL is optimized for fast, scalable deployments.

Check out the tutorial below to start building your own intelligent document processing solutions with Llama Nemotron Nano VL! Users can also post-train the model further with their own datasets using NVIDIA NeMo.

Introduction to Llama Nemotron Nano VL

Llama Nemotron Nano VL, the latest addition to the NVIDIA Nemotron family of models, is a vision language model (VLM) designed to push the boundaries of intelligent document processing (IDP) and optical character recognition (OCR). With its high accuracy, low model footprint, and multimodal capabilities, Llama Nemotron Nano VL enables the seamless extraction and understanding of information from complex documents. This includes PDFs, images, tables, charts, formulas, and diagrams, making it an ideal solution for automating document workflows across various industries like finance, healthcare, legal, and government.

High-Accuracy OCR with Llama Nemotron Nano VL

Llama Nemotron Nano VL OCRBench v2 Performance:

Model Architecture and Innovations

Core Technologies

Strong Vision Foundation

C-RADIO is trained on multi-resolution data using multiple distillation techniques. Multiplicative noise was applied to our weights during training to improve generalization.