Yes but if the missing mass has been converted to energy ie, hydrogen to helium,the excess mass converted to energy this has been spread around, entropy, but it will still be there surely.
It always seemed to be a better reason for time travel being impossible than the grandfather paradox.
