Flying to and from Jersey is pretty straightforward and I wouldn't be put off by the Class A airspace/special VFR requirements. Occasional radar vectors are about as complex as it gets! It's a small island, so navigating your way around shouldn't be a problem.
Though I've always flown there in my own aicraft, I've found the Flying Club staff to be very, very friendly and helpful. I know they often conduct sightseeing tours for punters around the island, so I'm sure taking the controls with one of the instructors on board isn't going to be a problem if that's what you're after. Should take less than 15 minutes to circumnavigate the island.
As mentioned by Keef, fog can be a problem. Even when there's blue skies all around, a layer of low cloud can sometimes sit over the island all day.
Stay WELL CLEAR of the Cherbourg peninsula!