Back to the question
The answer is no
Calcium channel blockers, depending on your history, can be the recommended first line treatment for blood pressure.
They are widely used and well tolerated but all drugs have side effects.
The risk of not taking treatment which your doctor presumably thinks is necessary is death from strokes and heart attacks.
SO either take them or discuss with your doctor. Doing nothing will not prolong your flying career