Steering issues with engine down

[Capt. Tom]

Twice this season, I lost my port engine and both times attempted to limp back to my slip. When engaging starboard engine in forward and turning wheel to starboard, the bow goes to port even with increased throttle. When turning the wheel to port, the bow goes to port, the way it should.
When engaging starboard engine in reverse and turning wheel, the boat turns the way it should.
Any suggestions? I’m perplexed!