Watch Regret to Inform You