Which type of aircraft were you on? BHX is CAT 3 unless it has been downgraded. A lot of aircraft using BHX will only be CAT 2, for instance, no Flybe aircraft are CAT 3 approved.
Actual visibility in fog can be worse than the RVR (runway visual range) so it is possible that it could look worse than required.