In some aircraft buckle tends to jam between wall and seat and therefore it is good not to have that part on the window side so that cabin tidy is faster to perform. Also the buckles may hit the trolleys if installed towards the aisle and that's not something that the cabin crew likes.