PANS-OPS Vol 1 Chapter 6, Section 1.3.1 says "Holding patterns shall be entered and flown at or below the airspeeds given". No specific guidance on when you should start slowing down, or when you should assume you are going to have to hold due to lack of onward clearance.
FAA are often clearer on such things.