They add weight. They are an addition to an a/c, hence costly to acquire and install. Today's iterations are generally not tunable, they cannot be optimized through a wide speed range, limited to generally, cruise.
They stress the wing, adding more weight to accomodate added root and spar strength. They can hit obstacles on the ground. Probably more reasons...