I wouldn't complain about having to let ATC know. I suspect it's so they know how many people to look for when something goes wrong.
That being said though, I've done the same flight probably 50 times to one location and probably only been asked for POB perhaps 50% of the time.
I have noticed that if I'm conducting a significant over-water flight or DRA they seem to always religiously ask.