When you say that you're visual with the traffic, means exactly that. It means that you see the traffic (not on TCAS), it doesn't mean that you are canceling IFR. ATC still is responsible for traffic separation. Usually there is this confusion among pilots and ATC. Unless you ask to cancel it or the controller asks you if you can maintain own separation, you're still on an IFR flight plan although in VMC.