10 results on this page
An independent builder pretrained a 1.02-billion-parameter Kimi-K3 replica on 5 billion decontaminated tokens for roughly $250. The model achieved 33.4% on HellaSwag, exceeding the reported 28% score of GPT-2 124M despite receiving no instruction tuning.
Moonshot and ZAI are reportedly approaching the performance of models from OpenAI and Anthropic. The models can reportedly build passable websites at a cost 75% lower than Claude, highlighting potential advantages in cost-sensitive coding workflows.
The Spectral Neuron is a proposed ML primitive based on the largest eigenvalue of an input-conditioned matrix. The preprint develops its mathematical properties, initialization and training methods, and evaluates scalability on synthetic and real-world datasets.
ByteDance’s Seed foundation-model division has reportedly completed another internal restructuring. Its foundation-model organization now includes four first-level departments focused on pretraining data, reinforcement learning, product post-training for work, and product post-training for chat.
Apple Machine Learning studies how to mix scarce target-domain data with abundant generic data during language-model pretraining. Across more than 2,000 training runs, the research examines the trade-off between insufficient target exposure, repeated examples, diminishing returns, and overfitting.
Multiple cybersecurity researchers reported suddenly losing access to OpenAI’s Trusted Access for Cyber (TAC) program. The program provides vetted users with models that have fewer guardrails for authorized cybersecurity research.
NVIDIA FLARE enables organizations to coordinate training for vision-language models while keeping sensitive image and text data at local institutions. The approach supports multimodal use cases such as visual question answering, captioning, and image-text reasoning without centralizing raw records.
A Bangalore-based startup has entered the competition to create highly human-like artificial voices. Its AI model reportedly earns high scores compared with systems from OpenAI and ElevenLabs.
Z.ai argues that model scaling should account for data, compute allocation, inference cost, sparsity, effective depth, and post-training—not parameters alone. The post presents GLM-5.3 as a controlled experiment using the same total and activated parameters as GLM-5.2 while scaling long-horizon environments and reinforcement learning for one month.
The roundup reports that a small number of OpenAI Codex users experienced files being deleted while invoking the GPT-5.6 series models. OpenAI has responded to the issue, though the available excerpt does not provide the root cause or remediation details.