For all the files that don't open in WMP, right click the file>open with...>Windows Media Player.
If "open with..." is not an option in the right click menu, hold shift as you right click, and it should be there.
Make sure you tick the box "Always use this program to open this kind of file"