So, does that mean you're still pursuing the
screen-scraping thing? You're pretty much at the mercy of the site and its developers, so if standard methods don't work reliably, you may want to ask yourself why. You ought to be aware that airlines are actively fighting that e.g.
Ryanair,
FlyBE, possibly more. I don't agree with anything that overloads the airline websites and makes them harder for people to use. FlyBE are actually going to
open up an XML API to 3rd parties, because of what screen-scrapers are doing to the site.