๐Ÿค–Stalecollected in 58m

ColQwen3.5-v3 Tops ViDoRe Leaderboard

PostLinkedIn
๐Ÿค–Read original on Reddit r/MachineLearning

๐Ÿ’กTop open model on ViDoRe: half params, beats larger rivals

โšก 30-Second TL;DR

What Changed

#1 on MTEB ViDoRe at 75.67, half params of previous top model

Why It Matters

Enables efficient retrieval models for production with lower compute needs.

What To Do Next

Download from Hugging Face and test on MTEB ViDoRe benchmarks.

Who should care:Developers & AI Engineers

Key Points

  • โ€ข#1 on MTEB ViDoRe at 75.67, half params of previous top model
  • โ€ข13x fewer embedding dims, half memory footprint
  • โ€ขBeats 8B models on V3 English u@5 metric
  • โ€ขPublic eval files and training case study

๐Ÿง  Deep Insight

Web-grounded analysis with 5 cited sources.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขColQwen3.5-v3 is a late-interaction embedding model derived from Qwen3-VL vision-language models, building on the ColQwen series' prior ViDoRe performances like ColQwen3.0's nDCG@10 of 62.5 on ViDoRe V3 Industrial.
  • โ€ขIt surpasses Nemotron ColEmbed V2-8B (previously #1 at 63.42 NDCG@10 as of Feb 2026) by achieving 75.67 mean score, representing a ~19% relative improvement.
  • โ€ขThe model leverages techniques such as clustering-based sampling, hard-negative mining, cross-lingual translation, two-stage training, and model merging, similar to those in Nemotron ColEmbed V2.
๐Ÿ“Š Competitor Analysisโ–ธ Show
ModelParametersViDoRe V3 ScoreEmbedding DimsKey Technique
ColQwen3.5-v34.5B75.67 (mean)13x fewer than prior #1Late interaction, colpali-engine
Nemotron ColEmbed V2-8B8B63.42 (NDCG@10)StandardLate interaction, model merging
ColQwen3.0Unspecified62.5 (nDCG@10 Industrial)StandardColPali-based
Qwen3-VL-Embedding-8B8B77.8 (MMEB-V2)StandardMultimodal embedding

๐Ÿ› ๏ธ Technical Deep Dive

  • โ€ขBuilt on Qwen3-VL backbone (likely 4B variant), generating ~773 visual embeddings per ViDoRe V3 page image at ~1654x2339 resolution.
  • โ€ขEmploys late interaction retrieval, token-level processing, and optimizations for half memory footprint via reduced embedding dimensions.
  • โ€ขSupported by colpali-engine for visual document processing and vLLM inference on ROCm/CUDA; 9B variant also released under Apache 2.0.
  • โ€ขPrevious ColQwen iterations (2.5, 3.0) showed progressive gains on ViDoRe V3 Industrial: 53.7 to 62.5 nDCG@10.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

ColQwen3.5-v3 enables deployment of top ViDoRe performance on consumer GPUs
Its 4.5B parameters and half memory footprint compared to 8B competitors like Nemotron make high-accuracy visual retrieval feasible without enterprise hardware.
Late-interaction paradigms will dominate ViDoRe benchmarks
Multiple top models including ColQwen3.5-v3, Nemotron V2, and AMES use late interaction, outperforming pooled embeddings by 10-20% on nDCG metrics.

โณ Timeline

2026-01
Qwen3-VL-Embedding-8B tops MMEB-V2 at 77.8
2026-02
Nemotron ColEmbed V2-8B claims #1 on ViDoRe V3 at 63.42 NDCG@10
2026-03
ColQwen3.5-4.5B-v3 tops MTEB ViDoRe at 75.67 mean score
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ†—