You must fly in accordance with the RFM. The RFM is linked to the aircraft's C of A. The C of A is only valid if the aircraft is flown iaw the RFM.
However, as Handysnaks says, the Ops manual can impose limitations additional to the RFM. The Ops Manual cannot raise or remove a limit imposed by the RFM