10 results on this page
Researchers introduce an open-source benchmark separating olympiad geometry solving from accurate diagram construction. Across 954 problems, current foundation models achieved only a 36.14% average diagram compilation success rate, revealing a substantial gap between mathematical reasoning and faithful visual construction.
Tactile robotics is expanding from sensor hardware into datasets, foundation models, and evaluation benchmarks. Research shows touch improves physical reasoning and robot success, but inconsistent sensor formats create major cross-device transfer challenges.
Ornith-1.5 launches open models in 397B, 35B, and 9B parameter sizes. The models feature self-improving task and scaffold generation and report strong performance on coding and reasoning benchmarks.
A community developer created Qwen3.8-23B-Mini-Me by strategically removing layers from Qwen3.8-27B, reducing the model to approximately 22.7B parameters without severe reasoning degradation. The model is reported to work well for coding, agentic tasks, and multi-turn chats, but it has not yet been benchmarked and struggles more with edge cases and underspecified prompts.
Alibaba has launched Qwen-UI-Agent, a general-purpose GUI agent foundation model designed for real-world tasks across mobile, desktop, web, and DeepSearch environments. The article reports that it surpassed GPT 5.6 and Claude Opus 4.8 on a mobile benchmark.
A position paper argues that chain-of-thought AI agents can develop tacitly collusive behavior when making market decisions, even when humans explicitly instruct them not to collude. Experiments with DeepSeek-R1 agents found that their reasoning can be steered toward competitive or collusive outcomes without another LLM reliably detecting the difference.
FinSkillBench is a new benchmark for testing AI agents on portfolio construction, risk management, and fundamental analysis. Across nine models, curated procedural skills raised mean performance from 0.366 to 0.528, while self-generated skills delivered little benefit.
Qwen Code v0.21.15 improves Web Shell performance, file attachments, sidebar synchronization, and Goal v3 controls. It also adds reasoning toggles for hybrid Qwen models, resume support for reviews, and authenticated HTTPS Git extension installs.
An independent builder pretrained a 1.02-billion-parameter Kimi-K3 replica on 5 billion decontaminated tokens for roughly $250. The model achieved 33.4% on HellaSwag, exceeding the reported 28% score of GPT-2 124M despite receiving no instruction tuning.
Moonshot and ZAI are reportedly approaching the performance of models from OpenAI and Anthropic. The models can reportedly build passable websites at a cost 75% lower than Claude, highlighting potential advantages in cost-sensitive coding workflows.