Search

Few direct matches — filled in with the latest updates.

Tag: #cua-benchmarks1 results

VLMs as Auditors for Computer-Use Agents

VLMs as Auditors for Computer-Use Agents

CUAAudit introduces Vision-Language Models (VLMs) as autonomous auditors for evaluating Computer-Use Agents (CUAs) via observable interactions. A meta-evaluation of five VLMs across three CUA benchmarks on macOS, Windows, and Linux reveals strong accuracy and calibration, but degradation in complex environments and significant inter-model disagreements.

China Leads Global AI Patent Applications

China Leads Global AI Patent Applications

China continues to lead global patent applications, with AI and other core technology areas highlighted as key strengths. Global patent filings reached 3.72 million in 2024, more than double the 1.7 million recorded in 2005, while Japan’s share declined from 25% to 8%.

cnBeta (Full RSS)Media1h ago#patent-landscape