Well let's pretend that the pressure inside and outside your PA28 is the same total pressure to keep things simple. The outside of the window is experiencing low static pressure due to the airflow across it (higher dynamic pressure), whereas inside there is only static pressure which is pushing the window outwards. So it is therefore harder to pull it inwards.