资讯

Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

📅 2026-11-18 ⏱️ 约 6 分钟阅读 ✍️ AI导航编辑部 🔗 arxiv.org
Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research
📝 内容摘要

Computer Science > Artificial Intelligence [Submitted on 16 Nov 2026] Title:Auditors Struggle to Catch Sabotage In

📌 核心要点

  • Computer Science > Artificial Intelligence
  • [Submitted on 16 Nov 2026]
  • Title:Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

Computer Science > Artificial Intelligence

[Submitted on 16 Nov 2026]

Title:Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

View PDF HTML (experimental)Abstract:As AI systems are increasingly used to automate AI R&D, misaligned systems could sabotage research intended to improve model safety and alignment. To stress-test defenses against such sabotage, we use a human expert as a proxy saboteur on AI safety research. We conduct a red-team/blue-team game where a human researcher runs AI safety experiments from scratch and auditors try to tell which were sabotaged and how. Given access to the full research transcript and the ability to run experiments, human auditors mostly fail to distinguish sabotaged from benign research: they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases. Despite not being allowed to run experiments, the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably. When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further. Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.

Additional Features

References & Citations

Loading...

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)

Connected Papers (What is Connected Papers?)

Litmaps (What is Litmaps?)

scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub (What is DagsHub?)

Gotit.pub (What is GotitPub?)

Hugging Face (What is Huggingface?)

ScienceCast (What is ScienceCast?)

Demos

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)

CORE Recommender (What is CORE?)

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

来源arxiv.org· 本文为编辑整理,仅供参考