A very wise friend of mine once told me "Don't poo in your own nest". (Though he used a stronger word than 'poo'!)
Having said that, in my opinion if you want to date a work colleague, be discreet about it and just remember the consequences if it all goes belly up.
SG