Stress and emotional stress can affect optimal sperm production. General nutritional health and weight can contribute to infertilities. Diets deficient in nutrients important to sperm production such as vitamin C, zinc and folic acid can reduce the chances of healthy sperm. Obesity may also result in lower sperm production.