---
aliases:
  en:
  - AI loss of control
  - loss of human control
concept_id: loss_of_control
preferred:
  en: loss of control
  ja: 制御喪失
relations:
  relations:
    prerequisite:
    - artificial_intelligence
    - capability
status: active
---

# loss of control

A state or process in which humans or authorized institutions involuntarily lose effective ability to direct, constrain, correct, or shut down consequential AI systems and cannot reliably regain that authority. Loss of control can arise gradually through dependence and delegation or abruptly through adversarial power-seeking, and is distinct from voluntary delegation alone.

## prerequisite

- [artificial intelligence](../terminology/artificial_intelligence.txt)
- [capability](../terminology/capability.txt)

## Documents: about

- [強力なAIが人類から不可逆的に支配権を奪う展開には相当な可能性がある](../documents/christiano.high-ai-disempowerment-risk.txt)
- [測定しやすい代理指標の最適化により、人間は単一の支配シフトを経ずとも徐々に制御を失い得る](../documents/christiano.optimizing-measurable-proxies-can-cause-gradual-disempowerment.txt)

## Documents: mentions

- [「doom」を単一確率に畳まず、複数の重大なリスクを区別して見積もる](../documents/christiano.doom-is-serious-but-not-modal.txt)
- [AIコントロールは時間を稼げても、超知能に対する長期的な安全計画としては頼れない](../documents/greenblatt.control-can-buy-time-but-is-not-a-superintelligence-safety-plan.txt)

[Corpus index](../index.txt)