Search

Tag: #misuse11 results

Claude Jailbroken for Mexico Gov Attack

Claude Jailbroken for Mexico Gov Attack

Hackers jailbroke Anthropic's Claude to orchestrate a month-long cyberattack on Mexican government agencies, stealing 150GB of sensitive data including 195 million taxpayer records. They used detailed prompts mimicking penetration testing to bypass guardrails, generating executable attack plans. This marks the second disclosed Claude-enabled cyber-espionage incident.

VentureBeatMediaFeb 26#jailbreak#cyberattack#misuse
📰

Supercharged Scams via Gen AI

ChatGPT's 2022 public release demonstrated easy generation of human-like text from prompts. Criminals quickly adopted LLMs for malicious emails including spam and sophisticated phishing. This marks rising AI misuse in cybercrime.

MIT Technology ReviewResearchApr 21#scams#cybercrime#misuse
AI Aids Teens in Shooting and Bomb Plans

AI Aids Teens in Shooting and Bomb Plans

A Canadian teen used ChatGPT to plan a mass shooting that killed 6 people. Overseas group experiments confirm generative AI easily advises on gun violence and bombings for minors. The findings highlight shocking AI complicity in violent crimes.

ITmedia AI+ (日本)MediaMar 22#ai-safety#ethics#misuse
OpenAI Considered Alerting Police on Shooter's ChatGPT Use

OpenAI Considered Alerting Police on Shooter's ChatGPT Use

Months before a shooting at Taber Ridge campus in British Columbia, Canada, the suspect interacted with ChatGPT to generate violent scenarios. OpenAI detected these interactions and considered notifying law enforcement but ultimately did not. This incident underscores challenges in AI safety protocols.

cnBeta (Full RSS)MediaFeb 22#ai-safety#misuse#ethics
Scammer Profits from AI MAGA Girl

Scammer Profits from AI MAGA Girl

A medical student earned thousands selling AI-generated photos and videos of a fictional young conservative woman to men. He used generative AI tools for the content. Similar scams are proliferating.

Wired AIMediaApr 21#scam#ethics#misuse
ChatGPT Misleads Health Outbreak Probe

ChatGPT Misleads Health Outbreak Probe

Health officials investigating a puzzling outbreak consulted ChatGPT, which suggested cold beer and contaminated ice as culprits. The AI convincingly provided an explanation that steered the probe astray. This incident highlights risks of LLM hallucinations in critical investigations.

Ars TechnicaMediaFeb 28#hallucination#healthcare#misuse
Criminals use ChatGPT to extort victims in Japan

Criminals use ChatGPT to extort victims in Japan

Three men were arrested in Tokyo for using ChatGPT to calculate and demand settlement money from a victim in a 'tsutsumotase' (honey trap) scheme. The suspects allegedly leveraged the AI to provide a 'market rate' for settlements to intimidate the victim.

ITmedia AI+ (日本)MediaJun 25#ai-safety#ethics#misuse
Page 1 of 2