It is illegal to not have identification on you in France at any time
No, it is not. If you must provide a reason to prove your identity to the police, then you are given time (48 hours I think) to present your ID at a police station of your choice. Obviously, if you wish to access a restricted area then it is a reasonable, to establish who you are with ID, at the time.