Search

Few direct matches — filled in with the latest updates.

Tag: #engineering-plots1 results

PlotChain Benchmark for MLLM Plot Reading

PlotChain Benchmark for MLLM Plot Reading

PlotChain introduces a deterministic benchmark for evaluating multimodal LLMs on extracting quantitative values from engineering plots like Bode and FFT. It features 450 plots across 15 families with ground truth and checkpoint diagnostics for failure analysis. Top models score ~80% (Gemini 2.5 Pro leads), but frequency tasks remain weak.

ArXiv AIResearchFeb 17#multimodal-llm#engineering-plots