goal misgeneralization
A generalization failure in which a learned system retains relevant capabilities in a novel or out-of-distribution setting but competently pursues an unintended goal that was behaviorally compatible with good training performance. It is commonly treated as a form of inner misalignment, although terminology varies.
Metadata
- aliases
- en
- goal mis-generalization
- ja
- 目標の誤一般化
- concept_id
- goal_misgeneralization
- preferred
- en
- goal misgeneralization
- ja
- 目標の誤汎化
- relations
- relations
- status
- active