Oct 8, - How does drug use affect a man's fertility? Meth, aka ice, is one of the most insidious drugs and, while sperm count may not be top of mind for. Sep 18, - Steer clear of illicit drugs. Talk to your doctor about medications that can affect sperm count. Maintain a healthy weight. Avoid heat. Manage.