Yep, totally legal! It's not a scenario that requires any special case in Part A/CAP371 - FDP starts at the beginning of ASBY, if you never dispatched, that FDP remains! Simple!
If flights are been cancelled, with a Crewing hat on, I'd maybe want the flexibility of hanging onto the crew!