Tag: #distillation27 results
China's 2024 R&D hits $1.03T PPP, surpassing US first time in 60 years via funding surge, DS-V4 algo innovations, and distillation for efficiency. US eyes limited AI safety cooperation like info sharing and hotlines amid governance pushes. Combined paths reshape global AI competition dynamics.
Trump administration threatens action to protect US AI from Chinese 'distillation' copycats. Science adviser Michael Kratsios warns of unauthorized campaigns enabling China to match US models. Analysts predict weaker Chinese AI players could be weeded out within a year.
White House OSTP memo accuses China of industrial-scale distillation of US AI models. Commits to intelligence sharing with OpenAI, Anthropic, Google and exploring accountability. OpenAI flagged DeepSeek; Anthropic cited 24K fake accounts generating 16M+ tokens.
US Office of Science and Technology Policy memo raises concerns over large-scale capability extraction from frontier models via proxy accounts and jailbreaks. It targets industrialized distillation rather than open source directly. Governments may view model weights as strategic assets, impacting open model releases.
Fine-tuned Qwen3 models (0.6B-8B) outperform frontier LLMs like GPT-5, Gemini, Claude on 6/9 narrow tasks using open-weight teachers. Achieves high accuracy at low cost on single H100. Open-source code, models, and benchmarks available.
Anthropic accuses DeepSeek, Moonshot AI, and MiniMax of massive distillation attacks on Claude using fake accounts and proxies, extracting capabilities like agent reasoning, coding, and tool use via millions of interactions. They bypassed China access bans with hydra clusters. This intensifies US-China AI rivalry.
The US State Department has ordered a global warning about alleged AI technology thefts by DeepSeek and other Chinese firms. The alerts specifically target model distillation techniques. This escalates scrutiny on IP risks in AI development.
A White House memo authored by Michael Kratsios accuses firms, mainly in China, of mass theft of US AI models through wrongful distillation. The claim highlights intellectual property concerns in the AI sector. This development underscores escalating US-China tensions over AI technology.
Arbitrageurs profit by allocating inference across AI model providers, undercutting market prices without development risk. Empirical study on SWE-bench shows 40% net margins using GPT-5 mini and DeepSeek v3.2. Arbitrage lowers prices, aids small providers, but hurts large model revenues.
A new version of the distilled reasoning model combining Qwen3.5, Claude-4.6, and Opus is now available on Hugging Face. The community is excited and awaiting a 27B parameter version. Shared via r/LocalLLaMA Reddit post.