This is most definitely NOT a silly question. The answer is yes, but you need to remember Rule 5. There's no problem with the bit about "being 500 ft from any person, vessel. building or structur", because you're landing and taking off. But the rules for being 1500 ft above the highest point in a congested area still apply, I think (not absolutely 100% certain of this). And I think these apply for take-off and landing too, except for licensed airfields. So even if your mate lives in a housing estate but has a huge back garden that's safe to land in, it's still probably illegal.
I haven't had time to look this up, and I'm telling you from memory, so perhaps someone can find the relevant bit in LASORS and tell us all for certain.