Actually you would be suprised to hear of some well known apps which can be moved this way - just copy over its Program Files directory and next time you start it up, it re-creates all registry entries, ini files, etc.
Not every software writer is stupid, leaving DLLs all over the place.
But most are ..........
I have not programmed for Windoze for years, but I know that even today one can just compile into one single .exe and that is all one needs - for any 'conventional' application (not needing special low level drivers etc). Especially today when hard drives are huge and fast. The whole concept of DLLs is totally superfluous and is just a system maintenance nightmare.
I commission software from time to time and always specify a single .exe which uses a single obvious ini file and totally avoids the registry.