outer misalignment

A failure in which the training objective, reward process, loss, or other specification does not adequately represent the designers' intended target, so optimizing it can produce undesirable outcomes even if the learned system faithfully pursues that specification.

Metadata

aliases
en
  • outer alignment failure
  • reward misspecification
concept_id
outer_misalignment
preferred
en
outer misalignment
ja
アウター・ミスアラインメント
relations
relations
broader
prerequisite
related
status
active

Documents: about (2)

broader (1)

narrower (1)

prerequisite (2)

prerequisite_of (1)

related (3)