Panning tracks not reflected in headphones

When I plan a track left or right, it works fine in the outputs, but still shows up in both channels of the headphones. Is this expected behavior?