I have first hand experience of what happens when a 40 ft yacht struck a submerged container in a reasonable swell - it sunk in under 3 minutes!
3 weeks with no contact is pretty dire - given that the prevailing current from their last known location is running south at 3-4 knots then the drift would place them well south of Forster at the time of the search.