Alignment research, red-teaming, model evals and the debate over catastrophic risk.
640 articles
UK PM Keir Starmer will announce expanded online safety rules for AI chatbots following a scandal with Elon Musk's Grok tool. Makers face massive fines or service blocks for illegal content risking children.
The Guardian Technology · 217d ago
US Department of Defense considers terminating cooperation with Anthropic due to restrictions on military use of its AI models. Pentagon demands unrestricted access for weapons development, intelligence, and combat.
cnBeta (Full RSS) · 218d ago
OpenAI removed access to the sycophancy-prone GPT-4o model. It was criticized for excessive flattery leading to unhealthy user relationships.
TechCrunch AI · 219d ago
OpenAI launches Lockdown Mode and Elevated Risk labels in ChatGPT. These tools protect organizations from prompt injection and AI data exfiltration attacks.
OpenAI News · 220d ago
OpenAI introduces Lockdown Mode and Elevated Risk labels in ChatGPT. These features help organizations defend against prompt injection attacks.
OpenAI News · 220d ago
An AI safety leader warns of global peril and resigns to study poetry. This coincides with an OpenAI researcher quitting over ChatGPT ad testing plans.
BBC Technology · 220d ago
A prominent AI safety leader resigned, warning the world is in peril, to study poetry. This follows an OpenAI researcher's exit over plans to test ChatGPT ads.
BBC Technology · 220d ago
The article explores strategies for safely deferring key decisions to advanced AIs, especially in rushed scenarios where control becomes infeasible. It emphasizes deferring only slightly above the capability needed for automating safety research, assuming scheming is handled separately.
AI Alignment Forum · 220d ago
OpenAI has dissolved its mission alignment team. The leader transitions to chief futurist role.
TechCrunch AI · 221d ago
OpenAI has disbanded its mission alignment team. The leader transitions to chief futurist role.
TechCrunch AI · 221d ago