Research

The Noise in Short-Term Performance

By Wes Crill, PhD, Head of Investment Strategists and Vice President

Nov 22, 2021

3 Minute Read

Topic

Equity Investing Market Volatility Value Premium

As a parent of identical twins, I’m well versed in the phenomenon of two lookalike entities exhibiting vast dispersion in behavior at any given time. So, when I encounter substantial short-term performance differences between investment strategies in the same asset class, I am disinclined to infer one is better than the other without more information.¹ Indeed, even strategies with nearly identical construction rules and long-run average returns can deviate meaningfully through time. The lesson for investors is to remain cautious, as always, when interpreting past performance.

Matching Pairs

US small cap value research simulations rebalanced in different months provide perspective on the variation in outcomes arising from minute changes in methodology. Average monthly returns in Exhibit 1 reveal an 11 basis point range in long-run performance depending on the choice of rebalance month, despite identical stock selection criteria, a point we’ve used to highlight the need for caution when interpreting simulated outperformance. But even the simulations with the same long-run average returns have diverged markedly over shorter periods.

Exhibit 1

Family Ties

Average monthly returns for US small cap value simulations rebalanced annually in different months, January 1975–December 2020

Past performance, including simulated performance, is no guarantee of future results, and there is always the risk that a client may lose money.

Take, for example, the February and November versions, which would appear to be the investment version of monozygotic siblings with average returns identical to two decimal points, 1.53%. And yet, over short periods, these simulations can look more like distant cousins. Rolling one-year return differences, illustrated in Exhibit 2, have fluctuated wildly through time. The magnitude of the difference has averaged 2.80% and frequently exceeded 5%. Some of the return deviation spikes have coincided with periods of high cross-sectional dispersion in US stock returns—in fact, the correlation between the return spread of the small cap value simulations and US market cross-sectional dispersion has been 0.48.² Turbulent times in markets can magnify contributions from even slight differences in portfolio composition, and that has been true for this pair.

Exhibit 2

Perfect Strangers?

Rolling 12-month absolute return difference between US small cap value simulations rebalanced in February and November, December 1975–December 2020

Past performance, including simulated performance, is no guarantee of future results, and there is always the risk that a client may lose money.

Given the range of outcomes for such similarly constructed simulations, it should be no surprise we observe short-term dispersion between commercial small cap value indices, even ones with nearly identical names. Average calendar year returns for the MSCI USA Small Value Index (gross div.) and the MSCI US Small Value Index (gross div.) from 1998 through 2020 were close, at 10.04% vs. 9.97%, respectively. But calendar year observations illustrated in Exhibit 3 have on occasion revealed meaningful deviations in performance. The average annual magnitude of the return spread between these indices was 2.11%, maxing out at over 13% in the year 2000.

Exhibit 3

Family Matters

Calendar year returns for the MSCI USA Small Cap Value Index (gross div.) and the MSCI US Small Cap Value Index (gross div.), 1998–2020

Past performance is not a guarantee of future results.

Making a Short Story Long

Noise in returns limits the usefulness of short-term performance in manager evaluation. Because even minute, arbitrary differences between investments can drive huge differences in realized returns, eye-catching short-term relative performance observed in the past may offer little insight into expected value-add. Longer-term results, particularly when achieved across a suite of investment strategies, offer a more reliable evaluation framework. Investors should also consider the manager’s investment process—a robust process built on decades of expertise can add value that is observable without looking to noisy market returns.

Footnotes

¹If any of my children are reading this, I think you are all equally great.
²Based on monthly observations for trailing 12-month return spread and trailing 12-month average of monthly cross-sectional standard deviation of US stock returns from December 1975–December 2020. US stock sample formed each month using data from CRSP and includes all common US stocks (share codes 10 and 11) listed on the NYSE, AMEX, and NASDAQ exchanges with non-missing monthly return data.

appendix

Simulated strategy returns based on model/backtested performance. These are not live strategies managed by Dimensional Fund Advisors LP or any of its affiliates. The performance was achieved with the retroactive application of a model designed with the benefit of hindsight; it does not represent actual investment performance. Backtested model performance is hypothetical (it does not reflect trading in actual accounts) and is provided for informational purposes only. The securities held in the model may differ significantly from those held in client accounts. Model performance may not reflect the impact that economic and market factors might have had on the advisor’s decision making if the advisor were actually managing client money. These strategies were not available for investment in the time periods depicted. Actual management of these types of simulated strategies may result in lower returns than the backtested results achieved with the benefit of hindsight. Past performance (including hypothetical past performance) does not guarantee future or actual results. The simulated performance shown is “gross performance,” which includes the reinvestment of dividends but does not reflect the deduction of investment advisory fees and other expenses. A client’s investment returns will be reduced by the advisory fees or other expenses it may incur. For example, if a 1% annual advisory fee were deducted quarterly and a client’s annual return were 10% (based on quarterly returns of approximately 2.41% each) before the deduction of advisory fees, the deduction of advisory fees would result in an annual return of approximately 8.91% due, in part, to the compound effect of such fees.

Disclosures

Indices are not available for direct investment; therefore, their performance does not reflect the expenses associated with the management of an actual portfolio. MSCI data © MSCI 2021, all rights reserved. S&P 500 data © 2021 S&P Dow Jones Indices LLC, a division of S&P Global. Frank Russell Company is the source and owner of the trademarks, service marks and copyrights related to the Russell Indexes. CRSP and Compustat data provided by the Center for Research in Security Prices, University of Chicago.

FOR PROFESSIONAL USE ONLY. NOT FOR USE WITH RETAIL INVESTORS OR THE PUBLIC.

The information in this material is intended for the recipient’s background information and use only. It is provided in good faith and without any warranty or representation as to accuracy or completeness. Information and opinions presented in this material have been obtained or derived from sources believed by Dimensional to be reliable and Dimensional has reasonable grounds to believe that all factual information herein is true as at the date of this document. It does not constitute investment advice, recommendation, or an offer of any services or products for sale and is not intended to provide a sufficient basis on which to make an investment decision. It is the responsibility of any persons wishing to make a purchase to inform themselves of and observe all applicable laws and regulations. Unauthorized reproduction or transmitting of this material is strictly prohibited. Dimensional accepts no responsibility for loss arising from the use of the information contained herein.

“Dimensional” refers to the Dimensional separate but affiliated entities generally, rather than to one particular entity. These entities are Dimensional Fund Advisors LP, Dimensional Fund Advisors Ltd., DFA Australia Limited, Dimensional Fund Advisors Canada ULC, Dimensional Fund Advisors Pte. Ltd., Dimensional Ireland Limited, Dimensional Japan Ltd., and Dimensional Hong Kong Limited. Dimensional Hong Kong Limited is licensed by the Securities and Futures Commission to conduct Type 1 (dealing in securities) regulated activities only and does not provide asset management services.

WHERE ISSUED BY DIMENSIONAL IRELAND LIMITED
Issued by Dimensional Ireland Limited (Dimensional Ireland), with registered office 10 Earlsfort Terrace, Dublin 2, D02 T380, Ireland. Dimensional Ireland is regulated by the Central Bank of Ireland (Registration No. C185067). Directed only at professional clients within the meaning of Markets in Financial Instruments Directive (MiFID) (2014/65/EU). Information and opinions presented in this material have been obtained or derived from sources believed by Dimensional Ireland to be reliable, and Dimensional Ireland has reasonable grounds to believe that all factual information herein is true as at the date of this document.

Dimensional Ireland issues information and materials in English and may also issue information and materials in certain other languages. The recipient’s continued acceptance of information and materials from Dimensional Ireland will constitute the recipient’s consent to be provided with such information and materials, where relevant, in more than one language.

WHERE ISSUED BY DIMENSIONAL FUND ADVISORS LTD.
Issued by Dimensional Fund Advisors Ltd. (Dimensional UK), 20 Triton Street, Regent’s Place, London, NW1 3BF. Dimensional UK is authorised and regulated by the Financial Conduct Authority (FCA). Directed only at professional clients as defined by the rules of the FCA. Information and opinions presented in this material have been obtained or derived from sources believed by DFAL to be reliable, and Dimensional UK has reasonable grounds to believe that all factual information herein is true as at the date of this document.

Dimensional UK issues information and materials in English and may also issue information and materials in certain other languages. The recipient’s continued acceptance of information and materials from Dimensional UK will constitute the recipient’s consent to be provided with such information and materials, where relevant, in more than one language.

NOTICE TO INVESTORS IN SWITZERLAND: This is an advertising document.

RISKS
Investments involve risks. The investment return and principal value of an investment may fluctuate so that an investor’s shares, when redeemed, may be worth more or less than their original value. Past performance is not a guarantee of future results. There is no guarantee strategies will be successful.

Small cap securities are subject to greater volatility than those in other asset categories.