Yes, it could absolutely be the water. I've been using straight tap water for everything, start to finish. I will fix that.
In the failed first batch, I thoroughly degassed in the secondary (carboy), but it had no effect on the smell/taste.
My primary fermenter is a food grade, 6.5 gallon...