111202-0924 EST
There are many kinds of capacitors.
A paper, Mylar, Polypropylene, or oil filled and run conservatively will not likely fail in 50 years, and have very little change in capacitance. An electrolytic capacitor may dry out over time and loose capacitance. In recent years there have been some major failure problems in computers because of bad far-east electrolytic capacitors.
A mica capacitor could probably last 100s or 1000s of years and maintain stable capacitance. The durability of the package would be the major problem here.
I have some electronic (meaning 25 V to 450 V DC electrolytic) capacitors that are 50 years old that are still good, and many others that are not.
Many small motor starting or running capacitors are electrolytic.
See
http://electrochem.cwru.edu/encycl/art-c04-electr-cap.htm for a discussion on electrolytic capacitors.
.