Automated trust-and-safety at scale: classifiers, deepfake detection and policy enforcement.
266 articles
Meta’s US settlement could encourage governments in other countries to seek similar concessions. Separate legal actions involving the company remain pending in Kenya, the Netherlands, and elsewhere, including a case alleging Facebook’s algorithm promoted posts targeting an Ethiopian academic.
The Guardian Technology · 22d ago
A lawsuit alleges that xAI trained Grok using both real and AI-generated child sexual abuse material. The allegations raise severe concerns about dataset governance, consent, safety controls, and potential legal exposure for AI model developers.
Ars Technica AI · 23d ago
Meta agreed to pay up to $18 billion over ten years and introduce additional protections for teenage users in a settlement with 29 state attorneys general. West Virginia Attorney General JB McCuskey called the agreement a potential blueprint for actions against TikTok, YouTube, and other platforms.
Bloomberg Technology · 24d ago
OpenAI banned a group of Russian ChatGPT accounts allegedly used to support a covert online influence operation. The accounts reportedly used AI-generated content to shape narratives and obscure the operators’ identities.
cnBeta (Full RSS) · 25d ago
ByteDance has added safeguards to its Seedance AI video platform after the Motion Picture Association and member studios raised copyright concerns. The new guardrails follow feedback from the MPA regarding videos generated with copyrighted characters.
TechNode · 31d ago
A Stanford-led study of 715 X users found that the platform’s recommendation algorithm may favor posts that conflict with users’ values and provoke stronger emotional reactions. Researchers described a feedback loop in which anger drives replies, and those intense interactions lead the system to recommend more similar content.
IT之家 · 31d ago
OpenAI is beginning to roll out a stricter teen mode for ChatGPT. The company will attempt to automatically enroll all young users in the new experience.
Engadget · 32d ago
Sony has filed a patent for large-language-model-powered accounts that simulate minors in online conversations. The system would identify suspicious users, monitor their behavior, and potentially warn or protect real players, although patent filing does not guarantee deployment.
IT之家 · 34d ago
The article examines how AI-generated short videos use familiar children’s characters in violent, sexualized, or bizarre scenarios to attract young viewers. Because recommendation systems amplify clicks and children have limited media literacy, these videos can normalize aggression, malicious humor, and inappropriate language while bypassing weak parental controls.
虎嗅 · 38d ago
WeChat is reportedly gray-testing an AI writing feature that helps users compose text for Moments posts. The development is contrasted with LinkedIn’s retreat from one-click AI rewriting after AI-generated content overwhelmed the platform.
虎嗅 · 40d ago
UK children are increasingly reporting explicit deepfake images made using their likenesses. Report Remove says digitally manipulated and AI-generated intimate imagery, including content made with nudification tools, has rapidly increased.
The Guardian Technology · 42d ago
A New Mexico court ordered Meta to pay $567 million over alleged harms to teenagers on Facebook and Instagram. The five-year ruling requires limits on teen usage, stricter messaging controls, AI chatbot safeguards, and improved child-abuse report handling.
IT之家 · 43d ago
TechRadar AI argues that Harry and Meghan are right to criticize Grok after the AI chatbot pushed back against Minnesota’s new law targeting abusive AI-generated deepfakes of children. The controversy highlights concerns that AI technology could enable predators unless stronger safeguards are enforced.
TechRadar AI · 44d ago
Researchers found AI-generated child sexual abuse imagery in Meta's ad library, including content posted after the company had been warned. The findings point to continuing weaknesses in Meta's systems for preventing and removing abusive AI-generated content.
Digital Trends · 44d ago
China’s National Radio and Television Administration reported removing more than 13,300 non-compliant AI-modified videos and handling over 30 accounts in July. The program targets AI-generated content that distorts classic works, history, cultural symbols, or children’s animations.
IT之家 · 46d ago
Microsoft CEO Satya Nadella publicly criticized Anthropic for imposing overly restrictive content guardrails on their Fable AI model. He argued that these excessive limitations hinder the model's utility as a creative tool.
cnBeta (Full RSS) · 64d ago
Meta has introduced a new safety feature designed to monitor and alert parents if their teens engage in discussions regarding self-harm with AI models. This update aims to enhance platform safety and provide proactive intervention for vulnerable users.
Engadget · 65d ago
Italy's communications authority, AGCOM, has fined Google Ireland €750,000 regarding gambling-related videos on YouTube. The ruling centers on whether a platform sharing advertising revenue with creators remains a neutral host.
The Next Web (TNW) · 65d ago
The UK regulator Ofcom has initiated a formal investigation into TikTok regarding its child safety practices. This follows a previous review that found the platform's measures for protecting minors to be insufficient.
BBC Technology · 65d ago
A new study reveals that major social media platforms like YouTube and X are inadvertently funneling users to services that generate nonconsensual sexually explicit deepfakes. These services offer image manipulation for as little as $1, highlighting a critical safety loophole in platform traffic moderation.
Wired AI · 67d ago
Discord admitted that an AI moderation bug incorrectly flagged harmless images as violations, resulting in over 8,000 wrongful account bans since May. The system mistakenly identified items like spreadsheets and chessboards as harmful content.
TechCrunch AI · 74d ago
Discord's automated safety system incorrectly banned over 8,000 accounts for posting images containing grids, such as chessboards or game textures. The company has since unbanned all affected users and acknowledged the technical failure in its content moderation pipeline.
The Verge · 74d ago
Reddit is implementing internal AI tools to detect and block stealth marketing content. These campaigns are designed to manipulate AI chatbots like ChatGPT and Gemini by artificially increasing brand mentions.
Bloomberg Technology · 75d ago
A new study reveals that AI writing tools consistently nudge social media posts toward specific viewpoints, even when instructed to maintain the original meaning. This highlights a significant challenge in AI alignment and the potential for unintended bias in automated content generation.
Digital Trends · 75d ago
The Indian government has issued a warning to Meta regarding child abuse-related advertisements appearing on Instagram and WhatsApp. Authorities are threatening regulatory action within one week.
cnBeta (Full RSS) · 75d ago
The Indian government has issued a formal notification to Meta Platforms Inc. requiring the immediate removal of sexual content involving children from its platforms, including Instagram.
Bloomberg Technology · 76d ago
The Indian government is summoning Meta executives following a BBC investigation that revealed Instagram was running paid ads promoting child sexual abuse material. The Ministry of Electronics and Information Technology is demanding a formal explanation.
The Next Web (TNW) · 77d ago
India's technology minister has ordered officials to summon Meta Platforms Inc. regarding the prevalence of child sexual abuse content on Instagram.
Bloomberg Technology · 78d ago
A new report reveals that safety features on popular social media apps are frequently ineffective. Teens are still able to access harmful content, interact with strangers, and bypass parental time restrictions.
New York Times Technology · 82d ago
Yahoo Japan has introduced a new feature that uses OpenAI's API to analyze and categorize user comments. The system visualizes the main discussion points of Yahoo Comments using AI-generated graphs.
ITmedia AI+ (日本) · 82d ago