Just what you want. On a wild and wooly day, power going up and down like a whore's drawers, you're working overtime just to fly the thing, now you think it's it a great idea that you have to look at the N1s all the time to see what's going on with the thrust? No thanks. Give me moving throttles any day.
It's really not that difficult, and is honestly not an issue. You don't have to look at the N1s "all the time", just occasionally, as I'm sure you do even on types with moving levers. There are other cues on Airbus FBW types, such as the speed trend arrow, the N1/EPR command and trend indications, and seat of the pants to tell you about engine thrust.
Also the FBW helps you fly by holding the last attitude you commanded (within certain limits) so there is less to do; leaving you with more capacity.