Probably the biggest headaches is video drivers.
Nvidia have supported Linux for a long time and provide good and up to date drivers for all their cards - be safe and stick with them.
Other companies' support is spotty and support spottier (though this is improving). Matrox for instance provide very basic drivers only (no 3D acceleration) and have yet to catch up with the 2.6 kernel.