stick with what you're comfortable and don't let anyone tell you otherwise.. I'm also quite fresh with my 150 or so hours. I was pretty much also a VVFR pilot as you describe it.. as the time goes on you notice that your minimums start to adjust to your currency, basically the more you will fly the more comfortable you will be with lower vis and cloud base and higher winds..