Yeah, it IS legal to depart from home base. Just inform your OCC you will be out of duty during the day. Remember then its about what ACTUALLY happens.
Maybe you manage to catch up the schedule. If not, get off when your duty limit is reached or use discretion to finish the day. They can then pax another crew in to take over if you don't finish the day.