"Lydd is a pig to get to unless you live in Ashford."
This is not true.
Detailed discussion of surface transport on these forums is tedious, so I will simply say that the road journeys from the major population centres of Maidstone and Canterbury are straightforward.
Don't take my word for it (or anybody elses on this board!)
Anyone who is interested can look at the drivetime software (yawn), or take the trip yourself as I have done.