Tee Emm, to appease your critics, those aerodromes with critical terrain profile usually impose restrictions for circle to land at night or require additional training.
Other than that as it's been said different strokes for different folks, don't do it if not comfortable. In the end that's what it is a VISUAL flight maneuver. You're fully accountable and responsible for the successful outcome of the mission "impossible"