And port is red
You only have to remember one, the other is what's left
I used to do similar though, remember port is red, and port has 4 letters, as does left. I don't have to think about it any more, unless I've not flown for a while.
On the left/right confusion subject, it seems fairly common for left handers who were forced to write with their right hand to have problems with this.
I've never had any problems, although I do have to turn the map to keep my route going up the page... :o