Stepping Backwards reverts change to the layer AND moves to prior layer selected

I am constantly stepping backwards. One of my biggest gripes with PS is when you select a layer, mark the layer some how (with a brush stroke for example), then step backwards, it does not stay on the layer you selected, instead reverts back to the layer you were on previously. Please Adobe, revert the change made to the layer, not the layer selected prior to the mark. That is two actions in my opinion and should be treated as such.
Is this a known issue? Something Adobe is currently fixing? Am I making any sense?