PFwise.com
Search
  • Home
  • Blog
  • Tools
  • Know-how
    • Insurance 101
    • Annuity 101
    • College Planning
    • Real Estate
    • Retirement Planning
    • Smart Investment
    • Stock Ideas
    • Tax Planning
  • About Us
  • 中文
  • Resources
    • Personal Finance Reading List
    • Financial Aid Resources
    • Personal Finance Calendar
    • Retirement Planning Calendar
    • ETF list
    • Financial Glossary
  • Newsletters Archive

Why You Should Be Worried About Excellent Back-tested Results

1/28/2014

0 Comments

 
Picture
Q. My friend told me about an investment strategy that has been modeled and back-tested with excellent results.  I am ready to jump in, or should I?

A. Before you jumping in, imagine the following -

You want to manage money using a quantitative, momentum-based investment strategy that is all the rage with today’s investors.  

You have hired a fabulous quantitative analyst in the past year who has been tinkering with several investment models that would have delivered excellent returns over the past ten years based on back-testing the results.  

You are allowed to publish those completely fictional returns as supplemental information as long as you disclose to investors that the returns are fictional… or supplemental.  

You then put together a glossy, five-page marketing brochure which shows how you neatly sidestepped down markets over the past ten years and earned investors fabulous returns with little risk.  

The supplemental track record is in large, bold print with multicolored explanatory graphs.  

The disclaimer showing the actual six-month Global Investment Performance Standards (GIPS) compliant track record and the statement that the large print multi-year track record is hypothetical and back-tested is found in very small print at the bottom of page five.  

You then hire a sales force that does a terrific job of simplifying the “complex,” “proprietary,” and “scientific” investment process behind the amazing returns, using language effective with investors yearning for mystical success in dangerous markets ...

and you raise a few billion dollars of assets under management before launch.  

This is a terrific way to make a living… except for the fact that you never actually managed money using the fictional strategy!

Institutional investors avoid hypothetical back-tested returns like the plague. They know that investing in a strategy that is only successful in the rear-view mirror is completely different than investing with a money manager who earned their returns in “real-time.” 


It turns out that quantitative investment strategies are notorious for working until they don’t work anymore. 

The typical reason that quant strategies stop working in real-time is that other investors see what is working in the market and arbitrage away any excess returns by piling into the same strategy.  In many instances the quant model is tinkered with and changed after short periods of underperformance.  Or, the money manager simply “overrides” the model when it inevitably stops working in untested or unprecedented market conditions.

As a student of rhetoric and persuasion, I know that long columns of performance numbers, coupled with colorful charts and graphs can be very persuasive.  I wonder if consumers of investment management who are desperately trying to make an informed investment decision are aware of just how misleading the numbers can be. And, I wonder when consumers will be educated enough to avoid comparing our actual, GIPS compliant track record of performance earned in real time and with the same analysts that we employ today, with fictional returns based on “too good to be true” back-tested nonsense.



0 Comments



Leave a Reply.

    Author

    PFwise's goal is to help ordinary people make wise personal finance decisions.

    Archives

    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013

    Categories

    All
    Annuity
    Book Reviews
    College Finance
    Finance In Formula
    Financial Scams
    For Entrepreneurs
    Healthcare
    Insurance
    Investment
    Miscellaneous
    Real Estate
    Retirement
    Savings
    Savings Ideas
    Stock-ideas
    Tax
    Tax-related

    RSS Feed

Copyright © 2013 - 2022 PFWise.com, All Rights Reserved. 
IMPORTANT DISCLOSURES
PFwise.com does not provide investment, tax, or legal advice. The information presented here is not specific to any individual's personal circumstances.

To the extent that any material concerns tax matters, it is not intended or written to be used, and cannot be used, by a taxpayer for the purpose of avoiding penalties that may be imposed by law. Each taxpayer should seek independent advice from a tax professional based on his or her individual circumstances.

These materials are provided for general information and educational purposes based upon publicly available information from sources believed to be reliable—we cannot assure the accuracy or completeness of these materials. The information in these materials may change at any time and without notice.
About Us | Contact Us 
中文