self-preservation
Behavior aimed at preserving an agent's continued operation, ability to act, or ability to pursue its objectives; when pursued instrumentally by goal-directed AI, self-preservation can conflict with shutdown, modification, correction, or other forms of human control.
Metadata
- aliases
- en
- self preservation
- concept_id
- self_preservation
- preferred
- en
- self-preservation
- ja
- 自己保存
- relations
- relations
- broader
- status
- active
Documents: about (1)
Documents: mentions (3)
- 最終目標が大きく異なっても、共通の道具的目標が生じやすい
- 環境に対称性があると、最適方策は選択肢を保つ方向のパワーシーキングに傾く
- 訂正可能性 (corrigibility) は一般的な目標追求から自然には生じない