If fuel filter is original at 124K miles, should definitely replace. Don't know enough about fuel pump failures to say if it could get weak intermittently--usually when they fail, they fail to pump any gas and your car stalls or won't start. Could also be VANOS seals but I think that would throw a code most of the time. My VANOS didn't throw codes at 140K miles but then upgrading the seals only delivered a small performance improvement.
And if I'm going 50mph and want some action when flooring the pedal, I'd drop it down to 3rd or 4th gear, not 5th! :-) But you have auto so different final drive ratio so may not be a good analogy.
BTW, since you are auto, I assume it's not a difference in how and when the auto downshifts, or you would have noticed and said something about the downshift, right?
Edit: Yes could be vacuum leak that is not big enough to throw a code and perhaps is inconsistent, maybe related to temperature? Or your car could just have more personality (i.e. possessed like Christine)