Don't be put off. Vietnam is a wonderful place and gets better every year.
I lived there (Haiphong and Hanoi) for two and a half years until April 2002 and recently made a return visit.
Try to include Hanoi in your travels - one the best Asian cities. Excellent food, good hotels and reasonable prices. Don't miss Halong Bay
You will find a very warm and genuine welcome. Only in small towns was I asked "where do you come from?"
You need to be "street wise" in Ho Chi Minh. Take care there.
Check the weather. The north tends to follow the Hong Kong/South China weather pattern and the south the Thai/Cambodian systems.
If you would like any further information contact me by e-mail.
You will have a great time.