Every FI interview I have attended I have worn my FI clothes, including black NATO V neck jumper and tie, never had a problem. For me, it helped me feel the part and project the image I want. I left the gold bars at home though!
If you feel more confident/comfortable in a suit, then go for that. Ultimately the actual content of the interview is what matters, but first impression is important.