Watch Bullets for Bandits