The "doctor killer" factor might be quite relevant, yes. Perhaps best to do some trips with a rented plane, first? That will allow you to hone your skills AND to make sure that this is really what you (and a partner, perhaps?) really want.
Also, be careful about sharing the plane with someone else. Even if good company for an evening out, that doesn't necessarily mean good company for spending several hours together, in a rather confined space.