Researchers have found that while sexual prowess gradually diminishes with age, men should expect to be able to enjoy sex well into their later years. All men experience temporary periods of impotence at some time in their lives, and these need not cause alarm. A large number of men (10 million) suffer from more long-lasting impotence.