first critical try

The first attempt to operate or rely on an AI system in a sufficiently high-stakes regime that failure of a relevant alignment or safety assumption could cause irreversible catastrophe, leaving no opportunity to learn from that failure and then retry. In AI-alignment discourse the relevant assumption may concern the system's motives or capabilities, or the theories and engineering used to make it safe. The concept does not imply that no useful evidence can be obtained from earlier, lower-stakes systems or experiments.