You are wrong. Have a look at FCTM A320:
ALPHA floor is available, when the flight controls are in NORMAL LAW, from
liftoff to 100 ft R/A at landing. It is inhibited in some cases of engine failure
If you are below vmc there is not ample control available.