Turbulence from a previous large aircraft is usually apparent when there is little wind to move the disturbed air mass.
Another more frightening reason for the noise might be the close proximity of another aircraft.
I recall once becoming aware of a gradual increase in external noise. We were flying at around 40,000 feet in light cirrus at night. Suddenly the penny dropped, we were catching up the aircraft in front.