The sign law states that under sampler mismatch in RLVR—where rollouts are drawn with top-k/top-p truncation or at a temperature the learner does not apply—a constant advantage shift changes the entropy of a softmax policy, at first order and in expectation, with a sign fixed by the sampler.
