I think the CAA wants you not to wear contacts before you do a medical with them. Not sure.
If you wear contacts it takes some time before your eyes have returned to 'normal' and you can establish properly the refractive correction needed.
From my own experience it seems that the refractive error measured is usually smaller just after taking the contacts out.
FD