As I understand it, that is what cameras like the go pro 360 do already.
Not really. They delete static elements (eg the camera support) from the image and fill in the picture behind using footage from a separate lens, much like how we avoid seeing our own nose most of the time.