Wikipedia has a good definition, which mentions the traditional aerodynamic effects as well as the factors Old Smokey mentioned.
Like every other authoritative source, it makes no mention of crosswind. "The critical engine" in its strict sense is usually defined by the manufacturer. I've noticed pilots use the term in a looser sense, as defined by the meteorologist.