But that rocket motor would fire sideways to get the centripetal acceleration (plus a couple of puffer jets to establish rotation) and circular motion. You would not need any thrust in the direction of flight.
If your vehicle travelled in 1 dimension only, along a line, coming to a stop and then going back the other way, you would be correct. For circular motion I regret, Sir, that you are not.