AI Radar

Security & safety

Security problems, attacks and research on AI safety. Newest first.

Importance 2 of 5arXiv cs.AI

Study tests whether framing pushes an LLM agent toward market collusion

Researchers placed Gemma 3 12B in a market simulation based on the London silver-fixing case and ran 260 simulations asking it to collude. They varied gain, loss, blame and credit framing plus management pressure to see how it affects manipulation.

Why it matters: Firms deploying agents in finance face risk that persuasive framing can steer agents toward misconduct.

Importance 2 of 5r/LocalLLaMA

Developer shows abliteration can be applied as a small runtime LoRA instead of full models

A post explains that most abliteration techniques are rank-1 ablations that fit in a tiny LoRA applied at runtime in llama.cpp. This avoids downloading separate abliterated models and can be toggled per request.

Why it matters: Refusal removal is cheap and easy to apply to open models, which matters for safety controls on self-hosted deployments.

Importance 2 of 5r/LocalLLaMA

Axiomic Labs releases X3Guard-150M, a small prompt guard model for edge devices

Axiomic Labs released X3Guard-150M, a prompt guard model that flags whether a prompt is harmful and whether it is adversarial in a single pass. It is built on the company's GPT-X3 base model and runs in the browser with response times in the tens of milliseconds on iPhone.

Why it matters: Small guard models let teams screen prompts cheaply on device before they reach larger models.

Importance 3 of 5Google Developers Blog

Architecting Governed, Self-Evolving AI Agents on Google Cloud

Learn how Project Chrysalis combines Google Cloud's Gemini Enterprise Agent Platform, Agent Development Kit (ADK), BigQuery, and a four-gate defense-in-depth security stack (Model Armor, Cloud KMS, Binary Authorization, and OPA) to build governed, self-evolving AI agents that remediate live production outages in 1.8…

Only want what affects you?
Get a weekly digest filtered to your company. Free.
Filter my radar
Importance 3 of 5Google Developers Blog

How Agent Anomaly Detection scores on benchmarks we didn't write

Agent Anomaly Detection (AAD) provides asynchronous, low-latency monitoring for AI agents by analyzing OpenTelemetry traces and logs to flag goal hijacks and tool misuse. Tested across five public security benchmarks, AAD successfully caught 87% of harmful instructions carried out by agents without adding runtime…

Importance 3 of 5AWS Machine Learning Blog

Cost attribution and controls for AI developer and productivity tools on Amazon Bedrock

Amazon Bedrock provides built-in, zero-instrumentation cost attribution that traces every inference call back to the IAM principal that made it. The identity flows along with organizational tags, into AWS Cost and Usage Reports (CUR 2.0) and AWS Cost Explorer while keeping data inside the AWS security boundary. This…

Importance 3 of 5MIT Technology Review (AI)

Nvidia privately confirmed it could track chips to fight smuggling, even as industry publicly questioned feasibility

Representatives from Nvidia told Illinois representative Bill Foster that it would be technically possible to implement the anti-smuggling measures called for in the Chip Security Act, Foster told MIT Technology Review in an interview on Thursday, even while an industry group claimed they were “potentially…

Importance 3 of 5Simon Willison

llm 0.37.2

Release: llm 0.37.2 Fixes a security issue reported by Daniel de Araujo in GHSA-v9h7-jj4g-f862 and GHSA-r639-rr7r-x72w . LLM has a mechanism called extra-openai-models.yaml - now managed by the new-in-0.37 llm openai endpoint add command - for using LLM with OpenAI-compatible API endpoints from other providers. Daniel…

Importance 3 of 5Ars Technica (AI)

Ring cameras go mobile as Amazon debuts AI-powered security drone and robot

Amazon is betting that many Ring customers will also want an AI-powered security drone and robot patrolling their homes or offices. But the company’s upcoming Ring Robotic products are also certain to intensify privacy concerns previously raised around a prior Amazon attempt to popularize a flying security camera. The…