Year-to-year fluctuations can be much more dramatic than the S&P 500's long-term average would suggest.