We have PVC pipes, and realised it was the attachment on the tap that was making the water dirty!