๐คReddit r/MachineLearningโขStalecollected in 58m
ColQwen3.5-v3 Tops ViDoRe Leaderboard
๐กTop open model on ViDoRe: half params, beats larger rivals
โก 30-Second TL;DR
What Changed
#1 on MTEB ViDoRe at 75.67, half params of previous top model
Why It Matters
Enables efficient retrieval models for production with lower compute needs.
What To Do Next
Download from Hugging Face and test on MTEB ViDoRe benchmarks.
Who should care:Developers & AI Engineers
Key Points
- โข#1 on MTEB ViDoRe at 75.67, half params of previous top model
- โข13x fewer embedding dims, half memory footprint
- โขBeats 8B models on V3 English u@5 metric
- โขPublic eval files and training case study
๐ง Deep Insight
Web-grounded analysis with 5 cited sources.
๐ Enhanced Key Takeaways
- โขColQwen3.5-v3 is a late-interaction embedding model derived from Qwen3-VL vision-language models, building on the ColQwen series' prior ViDoRe performances like ColQwen3.0's nDCG@10 of 62.5 on ViDoRe V3 Industrial.
- โขIt surpasses Nemotron ColEmbed V2-8B (previously #1 at 63.42 NDCG@10 as of Feb 2026) by achieving 75.67 mean score, representing a ~19% relative improvement.
- โขThe model leverages techniques such as clustering-based sampling, hard-negative mining, cross-lingual translation, two-stage training, and model merging, similar to those in Nemotron ColEmbed V2.
๐ Competitor Analysisโธ Show
| Model | Parameters | ViDoRe V3 Score | Embedding Dims | Key Technique |
|---|---|---|---|---|
| ColQwen3.5-v3 | 4.5B | 75.67 (mean) | 13x fewer than prior #1 | Late interaction, colpali-engine |
| Nemotron ColEmbed V2-8B | 8B | 63.42 (NDCG@10) | Standard | Late interaction, model merging |
| ColQwen3.0 | Unspecified | 62.5 (nDCG@10 Industrial) | Standard | ColPali-based |
| Qwen3-VL-Embedding-8B | 8B | 77.8 (MMEB-V2) | Standard | Multimodal embedding |
๐ ๏ธ Technical Deep Dive
- โขBuilt on Qwen3-VL backbone (likely 4B variant), generating ~773 visual embeddings per ViDoRe V3 page image at ~1654x2339 resolution.
- โขEmploys late interaction retrieval, token-level processing, and optimizations for half memory footprint via reduced embedding dimensions.
- โขSupported by colpali-engine for visual document processing and vLLM inference on ROCm/CUDA; 9B variant also released under Apache 2.0.
- โขPrevious ColQwen iterations (2.5, 3.0) showed progressive gains on ViDoRe V3 Industrial: 53.7 to 62.5 nDCG@10.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
ColQwen3.5-v3 enables deployment of top ViDoRe performance on consumer GPUs
Its 4.5B parameters and half memory footprint compared to 8B competitors like Nemotron make high-accuracy visual retrieval feasible without enterprise hardware.
Late-interaction paradigms will dominate ViDoRe benchmarks
Multiple top models including ColQwen3.5-v3, Nemotron V2, and AMES use late interaction, outperforming pooled embeddings by 10-20% on nDCG metrics.
โณ Timeline
2026-01
Qwen3-VL-Embedding-8B tops MMEB-V2 at 77.8
2026-02
Nemotron ColEmbed V2-8B claims #1 on ViDoRe V3 at 63.42 NDCG@10
2026-03
ColQwen3.5-4.5B-v3 tops MTEB ViDoRe at 75.67 mean score
๐ Sources (5)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ