Because you need a full IR to fly IFR in class A airspace for example. Whether you are IMC or VMC is irrelevant. Don’t confuse the conditions you’re flying in (VMC or IMC), with the rules you’re using to fly the aircraft (VFR or IFR).
Edit: In fact, you can only fly IFR in Class A airspace. VFR is not allowed.