Indeed, the logbooks belong to whoever owns the hardware. If an engine is sold, for example, the logbook is part of it.
As for the owner holding the logbooks, fine....just remember that someone has to keep them up to date. Hrs, landings, cycles have to be recorded. It's no use handing a logbook to a maintenance organisation with a pile of tech log pages attached and saying, "Just add them up, would you!"