That is why you can 'hide' the encrypted folder so that it does not show even if the parent folder's option is set to show all files regardless. There are many techniques and all you have to do is do a simple google search for them. They cannot ask for the password if the folder does not exist and cannot be seen.