Hugging Face Journal Club: Score Centering Stabilizes Off-policy Reinforcement Learning
Score Centering stabilizes Off-policy RL for LLMs by correcting the policy gradient loss when the training and inference policies mismatch. The method uses a Top-K approximation for efficient computation.
Read article