You are correct in saying pressure goes from High to Low but remember the earth is spinning. So Coriolis force is acting upon the wind causing it to shift to the right.
So in the NH you will get a starboard drift and in the south you will get a port drift.
So if you put your back to the wind the low pressure will be to to the left.
Hope I have made this clear enough for you to understand.
Punk