Instant research discovery
Search and browse arXiv CS/AI/ML papers, enriched with AI-generated insights.
Generate novel research ideas grounded in real arXiv papers with Brainstorm.
PreviousNext
| Paper | Published | Area | Tags | Intel | Citations |
|---|---|---|---|---|---|
Search and browse arXiv CS/AI/ML papers, enriched with AI-generated insights.
Generate novel research ideas grounded in real arXiv papers with Brainstorm.
| Paper | Published | Area | Tags | Intel | Citations |
|---|---|---|---|---|---|
Search and browse arXiv CS/AI/ML papers, enriched with AI-generated insights.
Generate novel research ideas grounded in real arXiv papers with Brainstorm.
| Paper | Published | Area | Tags | Intel | Citations |
|---|---|---|---|---|---|
Showing 1-30 of 41 papers (page 1 of 2)路 46 ms
| Paper | Published | Area | Tags | Intel | Citations |
|---|---|---|---|---|---|
| Optimal Policies Tend to Seek Power Alexander Matt Turner, Andrew Critch, Logan Smith, Prasad Tadepalli Published: 2019-12-03Area: Formal/TheoreticalCitations: 97 Tags: ai-safety, formaltheoretical, theoretical | 2019-12-03 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (93%) | 97 |
| Deep Learning is Singular, and That's Good Daniel Murfet, Hui Li, Jesse Gell-Redman, Mingming Gong Published: 2020-10-22Area: Formal/TheoreticalCitations: 38 Tags: ai-safety, formaltheoretical, theoretical | 2020-10-22 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (95%) | 38 |
| Agent Incentives: A Causal Perspective Eric D. Langlois, Pedro A. Ortega, Ryan Carey, Shane Legg Published: 2021-02-02Area: Formal/TheoreticalCitations: 61 Tags: ai-safety, formaltheoretical, theoretical | 2021-02-02 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E6 / R3 (96%) | 61 |
| Consequences of Misaligned AI Dylan Hadfield-Menell, Simon Zhuang Published: 2021-02-07Area: Formal/TheoreticalCitations: 95 Tags: ai-safety, formaltheoretical, theoretical | 2021-02-07 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E6 / R3 (96%) | 95 |
| Parametrically Retargetable Decision-Makers Tend to Seek Power Alexander Matt Turner, Prasad Tadepalli Published: 2022-06-27Area: Formal/TheoreticalCitations: 21 Tags: ai-safety, formaltheoretical, theoretical | 2022-06-27 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E6 / R3 (96%) | 21 |
| On the Impossible Safety of Large AI Models El-Mahdi El-Mhamdi, John Stephan, L锚-Nguy锚n Hoang, Nirupam Gupta Published: 2022-09-30Area: Formal/TheoreticalCitations: 37 Tags: ai-safety, formaltheoretical, theoretical | 2022-09-30 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R4 (94%) | 37 |
| Power-seeking can be probable and predictive for trained agents Janos Kramar, Victoria Krakovna Published: 2023-04-13Area: Formal/TheoreticalCitations: 22 Tags: ai-safety, formaltheoretical, theoretical | 2023-04-13 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E6 / R3 (96%) | 22 |
| Fundamental Limitations of Alignment in Large Language Models Amnon Shashua, Noam Wies, Oshri Avnery, Yoav Levine Published: 2023-04-19Area: Formal/TheoreticalCitations: 178 Tags: adversarial-robustness, ai-safety, alignment-training, formaltheoretical, theoretical | 2023-04-19 | Formal/Theoretical | adversarial-robustness, ai-safety, alignment-training, formaltheoretical, theoretical | E4 / R2 (94%) | 178 |
| Intent-aligned AI systems deplete human agency: the need for agency foundations research in AI safety Ben Smith, Catalin Mitelut, Peter Vamplew Published: 2023-05-30Area: Formal/TheoreticalCitations: 7 Tags: ai-safety, formaltheoretical, theoretical | 2023-05-30 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (96%) | 7 |
| Provably safe systems: the only path to controllable AGI Max Tegmark, Steve Omohundro Published: 2023-09-05Area: Formal/TheoreticalCitations: 38 Tags: ai-safety, formaltheoretical, interpretability, position | 2023-09-05 | Formal/Theoretical | ai-safety, formaltheoretical, interpretability, position | E7 / R4 (96%) | 38 |
| Quantifying stability of non-power-seeking in artificial agents Evan Ryan Gunter, Victoria Krakovna, Yevgeny Liokumovich Published: 2024-01-07Area: Formal/TheoreticalCitations: 2 Tags: ai-safety, formaltheoretical, theoretical | 2024-01-07 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (94%) | 2 |
| Robust agents learn causal world models Jonathan Richens, Tom Everitt Published: 2024-02-16Area: Formal/TheoreticalCitations: 67 Tags: ai-safety, formaltheoretical, theoretical | 2024-02-16 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (96%) | 67 |
| The Shutdown Problem: An AI Engineering Puzzle for Decision Theorists Elliott Thornley Published: 2024-03-07Area: Formal/TheoreticalCitations: 18 Tags: ai-safety, formaltheoretical, theoretical | 2024-03-07 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E4 / R3 (94%) | 18 |
| Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems Alessandro Abate, Ben Goldhaber, Christian Szegedy, Clark Barrett Published: 2024-05-10Area: Formal/TheoreticalCitations: 102 Tags: ai-safety, formaltheoretical, position | 2024-05-10 | Formal/Theoretical | ai-safety, formaltheoretical, position | E5 / R4 (97%) | 102 |
| Human-AI Safety: A Descendant of Generative AI and Control Systems Safety Andrea Bajcsy, Jaime F. Fisac Published: 2024-05-16Area: Formal/TheoreticalCitations: 9 Tags: ai-safety, formaltheoretical, theoretical | 2024-05-16 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R4 (93%) | 9 |
| Information Theoretic Guarantees For Policy Alignment In Large Language Models Youssef Mroueh Published: 2024-06-09Area: Formal/TheoreticalCitations: 19 Tags: ai-safety, alignment-training, formaltheoretical, theoretical | 2024-06-09 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, theoretical | E5 / R3 (95%) | 19 |
| Compact Proofs of Model Performance via Mechanistic Interpretability Alex Gibson, Chun Hei Yip, Euan Ong, Jason Gross Published: 2024-06-17Area: Formal/TheoreticalCitations: 12 Tags: ai-safety, empirical, formaltheoretical, interpretability | 2024-06-17 | Formal/Theoretical | ai-safety, empirical, formaltheoretical, interpretability | E4 / R3 (92%) | 12 |
| The Computational Complexity of Circuit Discovery for Inner Interpretability Federico Adolfi, Martina G. Vilas, Todd Wareham Published: 2024-10-10Area: Formal/TheoreticalCitations: 14 Tags: ai-safety, formaltheoretical, interpretability, theoretical | 2024-10-10 | Formal/Theoretical | ai-safety, formaltheoretical, interpretability, theoretical | E6 / R3 (98%) | 14 |
| On Goodhart's Law, with an Application to Value Alignment El-Mahdi El-Mhamdi, L锚-Nguy锚n Hoang Published: 2024-10-12Area: Formal/TheoreticalCitations: 6 Tags: ai-safety, alignment-training, formaltheoretical, theoretical | 2024-10-12 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, theoretical | E5 / R3 (95%) | 6 |
| Can an AI Agent Safely Run a Government? Existence of Probably Approximately Aligned Policies Fr茅d茅ric Berdoz, Roger Wattenhofer Published: 2024-11-21Area: Formal/TheoreticalCitations: 1 Tags: ai-safety, formaltheoretical, theoretical | 2024-11-21 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (96%) | 1 |
| Measuring Goal-Directedness Francesco Belardinelli, James Fox, Matt MacDermott, Tom Everitt Published: 2024-12-06Area: Formal/TheoreticalCitations: 4 Tags: ai-safety, formaltheoretical, theoretical | 2024-12-06 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (95%) | 4 |
| You Are What You Eat: AI Alignment Requires Understanding How Data Shapes Structure and Generalisation Alexander Gietelink Oldenziel, Daniel Murfet, George Wang, Jesse Hoogland Published: 2025-02-08Area: Formal/TheoreticalCitations: 9 Tags: ai-safety, alignment-training, formaltheoretical, position | 2025-02-08 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, position | E5 / R4 (96%) | 9 |
| Intrinsic Barriers and Practical Pathways for Human-AI Alignment: An Agreement-Based Complexity Analysis Aran Nayebi Published: 2025-02-09Area: Formal/TheoreticalCitations: 4 Tags: ai-safety, alignment-training, formaltheoretical, theoretical | 2025-02-09 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, theoretical | E4 / R3 (93%) | 4 |
| Shh, don't say that! Domain Certification in LLMs Adel Bibi, Alasdair Paren, Bernard Ghanem, Cornelius Emde Published: 2025-02-26Area: Formal/TheoreticalCitations: 4 Tags: adversarial-robustness, ai-safety, formaltheoretical, theoretical | 2025-02-26 | Formal/Theoretical | adversarial-robustness, ai-safety, formaltheoretical, theoretical | E5 / R3 (93%) | 4 |
| AI in a vat: Fundamental limits of efficient world modelling for agent sandboxing and interpretability Alexander Boyd, Fernando Rosas, Manuel Baltieri Published: 2025-04-06Area: Formal/TheoreticalCitations: 2 Tags: ai-safety, formaltheoretical, interpretability, theoretical | 2025-04-06 | Formal/Theoretical | ai-safety, formaltheoretical, interpretability, theoretical | E6 / R3 (93%) | 2 |
| Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models Mohsen Bayati, William Overman Published: 2025-06-01Area: Formal/TheoreticalCitations: 3 Tags: ai-safety, formaltheoretical, theoretical | 2025-06-01 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (96%) | 3 |
| Will artificial agents pursue power by default? Christian Tarsney Published: 2025-06-02Area: Formal/TheoreticalCitations: 1 Tags: ai-safety, formaltheoretical, theoretical | 2025-06-02 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (92%) | 1 |
| The Limits of Predicting Agents from Behaviour Alexis Bellot, Jonathan Richens, Tom Everitt Published: 2025-06-03Area: Formal/TheoreticalCitations: 1 Tags: ai-safety, formaltheoretical, theoretical | 2025-06-03 | Formal/Theoretical | ai-safety, formaltheoretical, theoretical | E5 / R3 (93%) | 1 |
| Out of Control - Why Alignment Needs Formal Control Theory (and an Alignment Control Stack) Elija Perrier Published: 2025-06-21Area: Formal/TheoreticalCitations: 2 Tags: ai-safety, alignment-training, formaltheoretical, position | 2025-06-21 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, position | E4 / R2 (94%) | 2 |
| On the Impossibility of Separating Intelligence from Judgment: The Computational Intractability of Filtering for AI Alignment Frauke Kreuter, Greg Gluch, Guy N. Rothblum, Omer Reingold Published: 2025-07-09Area: Formal/TheoreticalCitations: 4 Tags: ai-safety, alignment-training, formaltheoretical, theoretical | 2025-07-09 | Formal/Theoretical | ai-safety, alignment-training, formaltheoretical, theoretical | E5 / R3 (97%) | 4 |