Level 4 means the CAA
thinks you can probably speak English but needs to check up on you every couple of years. Level 6 means the CAA knows you can speak English and aren't too likely to forget how to do so so no check up required. Well that's how I see it.
