Of course it's safe!
You said it yourself. You'll reach the originally calculated V1-speed earlier down the rwy, so if you abort at V1 you'll be able to stop earlier down the rwy as well.
Also, your climb performance will be better.
I don't understand what makes you having doubts about using the speeds calculated for the flex TO with TOGA thrust.
Regards,
Erasmus