a large, well respected ETF would be to easily invest as way of diversifying a portfolio... and is considered a very very safe investment
but yes, if you want to guard against a potential economic apocolypse, or just want the feel of the metal between your fingers... buy 1oz coins from a local gold dealer and hide them around your house like easter eggs