It is permissible to dispatch the A320 (subject to your own MEL-Not all allow it!) with both thrust reversers inop.
In the reject case, the technique stipulated by the MEL is to retard the thrust levers to idle and not to select reverse (I guess to avoid the increased idle reverse thrust brings). If you haven't armed the speedbrake prior to T/O where does that leave you?