Male Hypogonadism is the result of an abnormal hypothalamus or pituitary gland in the brain. Since these produce hormones that control the testicles and sperm production, infertility can be affected.