Yeah, I would suggest that you find a new primary for beer. The problem is that beer is so aromatic from the hops, especially if you do pilsners and ales, that you will get that smell stuck in the plastic. Of course if you have stainless steel fermenters, you can just use those as SS doesn't keep smells.
I originally thought that I would just use the same one for both, but after a batch of India Pale Ale, which is a very hoppy beer, I could nto get the smell out no matter how long I let it soak with bleach, baking soda, etc. So I bought a few new primaries for wine and left that one for beer.