來源較早收集於 18m

PaddleOCR 3.5 新增 Transformers 後端支援 OCR 任務

閱讀原文: Hugging Face Blog
#ocr#document-parsing#computer-vision

解鎖將業界標準 OCR 工具整合至您現有基於 Transformers 的 AI 工作流程中的新途徑。

30 秒速覽

有什麼變化

整合 Transformers 後端以提升 OCR 效能

為什麼重要

此更新透過與業界標準框架對齊,使 PaddleOCR 更易於被廣大 AI 社群使用。它簡化了在現有基於 Transformers 的管線中部署 OCR 模型的工作。

下一步行動

複製最新的 PaddleOCR 儲存庫,並使用您現有的文件解析管線測試新的 Transformers 後端整合。

誰應關注:Developers & AI Engineers

關鍵要點

  • 整合 Transformers 後端以提升 OCR 效能
  • 增強複雜文件解析工作流程的能力
  • 與 Hugging Face 模型生態系統無縫相容

深度解析

背景與延伸:來自公開資料,非原文內容。引用 18 個來源。

增強重點摘要

  • PaddleOCR 3.5 introduces flexible inference engine switching, allowing developers to choose between PaddlePaddle's static graph, dynamic graph, or the newly integrated Transformers backend.
  • The update includes support for converting common office document formats like Word, Excel, and PowerPoint into Markdown, enhancing its utility for document processing workflows.
  • PaddleOCR 3.5 now enables the PaddleOCR-VL series, PP-StructureV3, and PP-DocTranslation to export parsed results directly into DOCX format, facilitating easier editing and viewing in Microsoft Word.
  • An official browser inference SDK, PaddleOCR.js, has been released, allowing the PP-OCRv5 model to run directly within web browsers, potentially enabling new client-side and edge computing applications.
  • The integration extends to 20 major PaddleOCR models, which now leverage the Transformers backend, signifying a substantial expansion of compatibility within the Hugging Face ecosystem.

競品分析

Primary Framework
PaddleOCR
PaddlePaddle
Tesseract OCR
C++/Python
EasyOCR
Python (CRAFT+CRNN)
KerasOCR
Keras/TensorFlow
DocTR
PyTorch
TrOCR
Hugging Face Transformers
Architecture
PaddleOCR
CRNN, DB, SVTR_LCNet, Transformer (v3.5+)
Tesseract OCR
LSTM-based (v4+)
EasyOCR
CRAFT (detection) + CRNN (recognition)
KerasOCR
Deep learning models
DocTR
Deep learning models
TrOCR
Vision Transformer encoder + Transformer decoder
Language Support
PaddleOCR
80+ languages, PP-OCRv5 supports 109 languages
Tesseract OCR
100+ languages
EasyOCR
80+ languages
KerasOCR
Limited
DocTR
Broad
TrOCR
Broad
Accuracy/Performance
PaddleOCR
High accuracy, fast, good for organized documents, receipts, scene text
Tesseract OCR
High precision for clean printed text, decent overall, fastest
EasyOCR
Good accuracy, fast, reliable for scene text, handles noise well
KerasOCR
High accuracy, strong for complex text
DocTR
Often wins in benchmarks, resilient to degraded images
TrOCR
Excels in handwriting recognition, line-level OCR
Key Strengths
PaddleOCR
Comprehensive toolkit (detection, recognition, document parsing, understanding), flexible backends, multilingual
Tesseract OCR
Widely used, robust for clean documents, extensive language support
EasyOCR
Easy to use, quick prototyping, good for diverse real-world applications
KerasOCR
User-friendly API, deep learning customization
DocTR
Strong generalist, good with degraded images
TrOCR
End-to-end, single model for image understanding and text generation
Weaknesses
PaddleOCR
Can struggle with dense documents and degraded scans (prior to v3.5 improvements)
Tesseract OCR
Struggles with complex layouts, handwriting, noise, distorted images
EasyOCR
Struggles with complex layouts, handwriting, specialized fonts
KerasOCR
Limited language support, customization complexity for beginners
DocTR
N/A
TrOCR
Operates at line level, not a generalist for all OCR categories

技術深入

  • Core Recognition Architecture: PaddleOCR's text recognition is fundamentally based on the CRNN (Convolutional Recurrent Neural Network) architecture. This involves a sequence of Convolutional Neural Networks (CNNs) for feature extraction, followed by Recurrent Neural Networks (RNNs), specifically two Bi-directional LSTMs, to process the sequential features. A Connectionist Temporal Classification (CTC) layer is then used for transcription and alignment.
  • PP-OCRv3 Components: The PP-OCRv3 system, a significant iteration, is modular, comprising three main parts: text detection, text classification, and text recognition. Text detection primarily utilizes the Differentiable Binarization (DB) algorithm. Text recognition is optimized with the SVTR_LCNet algorithm.
  • PaddleOCR-VL Model: The PaddleOCR-VL series, designed for advanced document parsing, is built around a 0.9B parameter Vision-Language Model (VLM). This VLM integrates a NaViT-style dynamic resolution visual encoder with the lightweight ERNIE-4.5-0.3B language model, enabling high accuracy across 109 languages and robust recognition of complex elements like tables, formulas, and charts.
  • Transformers Backend Integration: PaddleOCR 3.5 allows for flexible switching of inference engines, including PaddlePaddle's static graph, dynamic graph, or the Hugging Face Transformers backend. This integration means 20 major PaddleOCR models can now leverage the Transformers ecosystem for inference.
  • Deployment and Export: PaddleOCR supports exporting models to the ONNX framework for cross-platform deployment. Additionally, PaddleOCR 3.5 introduces the ability to export parsed results to DOCX format and offers a new browser-based SDK, PaddleOCR.js, for client-side execution of PP-OCRv5.

前景展望基於引用來源的 AI 分析

PaddleOCR's integration with the Hugging Face Transformers ecosystem will significantly broaden its adoption among AI developers.
By offering a Transformers backend and seamless compatibility, PaddleOCR becomes more accessible to the large community already familiar with Hugging Face tools, reducing the learning curve and integration effort.
The new document conversion and export features position PaddleOCR as a more comprehensive document intelligence solution, moving beyond basic OCR.
The ability to convert office formats to Markdown and export parsed results to DOCX indicates a strategic shift towards providing end-to-end document understanding and manipulation capabilities, rather than just text extraction.
The release of PaddleOCR.js for browser-based inference will catalyze the development of new edge computing and privacy-preserving OCR applications.
Running OCR models directly in the browser reduces reliance on server-side processing, enabling faster, more private, and offline OCR functionalities for web applications.

時間線

2020
Initial release of PaddleOCR
2024-10-18
Release of PaddleOCR v2.9, including PaddleX integration
2025-05-20
Official release of PaddleOCR 3.0, featuring PP-OCRv5 and PP-StructureV3
2025-08-21
Release of PaddleOCR 3.2.0, with significant model additions for PP-OCRv5 recognition
2025-10-16
Release of PaddleOCR 3.3.0, introducing PaddleOCR-VL and expanded multilingual support (109 languages)
2026-04-21
Release of PaddleOCR 3.5.0, integrating Transformers backend and new document processing features

AI 週報

閱讀本週精選 AI 大事摘要 →

AI 策展新聞聚合。所有內容版權歸原始發布者所有。
原始來源: Hugging Face Blog

這是摘要,不是原文。去看原站,或訂閱每週簡報。

每週電子報

每週一封,可隨時退訂。