We need to be better than ‘optimal’

The dictionary definition of the word “optimal” is “best or most favourable”. While an investment strategy is hardly ever described as “the best” – perhaps for fear that this might sound somewhat hubristic or over-confident – it seems to be perfectly acceptable to describe a strategy as optimal, despite the same intended meaning.

So where did the over-use of optimal come from? Google’s chart of use over time shows that optimal was a word rarely used until around 1950, after which time its use grew exponentially. This supports the hypothesis that optimal entered the investment lexicon following the widespread adoption of mean-variance optimisation, which Harry Markowitz developed in the 1950s. Although the usage statistics for optimal have levelled off in recent years, the advent of robo-advice has given a fresh impetus for the use of mean-variance optimisation as a portfolio construction tool.

Mean-variance optimisation uses the expected returns, volatilities and correlations of a range of asset classes in order to arrive at an ‘efficient frontier’. Any strategy sitting on the efficient frontier maximises the expected return for a given level of volatility and is, therefore, described as efficient or optimal.

The problems with the term optimal as a descriptor of investment strategies are, therefore, intimately connected with the weaknesses of mean-variance optimisation as a portfolio construction tool. These include:

  • The use of volatility as the only measure of risk. As a result, volatility and risk have become synonymous, despite the fact that a highly volatile asset might be much less risky than one exhibiting low volatility if risk is viewed as the possibility of suffering a large drawdown or losing money in real terms, for example. This isn’t to say that volatility is useless as a measure of risk – far from it – simply that it shouldn’t be the only measure of risk.
  • Volatility and correlation inputs for a mean-variance optimisation process are typically backward-looking and assumed to be stable over time. The output based on such assumptions is, therefore, vulnerable to regime changes that materially alter correlation and volatility dynamics. Optimality based on backward-looking inputs is fragile when looking forward.
  • There are many possible approaches to setting the expected return assumptions that go into an optimisation, each with their own strengths and weaknesses. Different approaches can produce very different numbers but the high level of uncertainty in these assumptions is frequently ignored, with many of them often specified to an accuracy of two decimal places. Given the sensitivity of an optimisation to the input parameters and the high level of uncertainty inherent in the assumptions, to describe the output as optimal is misguided at best.

Mean-variance optimisation had not been invented when John Keynes wrote The General Theory of Employment, Interest and Money, yet the essence of the problem it has created is captured nicely in the following quote from the book: “Too large a proportion of recent mathematical economics are merely concoctions, as imprecise as the initial assumptions they rest on, which allow the author to lose sight of the complexities and interdependencies of the real world in a maze of pretentious and unhelpful symbols”.

This is not to say that mean-variance optimisation should be avoided altogether. With a clear-sighted recognition of its limitations, optimisation can be used sensibly as one input within a wide-ranging investment strategy discussion. Such a discussion would seek to address the many unquantifiable trade-offs investors face: the attractions of investing in less liquid assets vs. the opportunity cost of reduced flexibility; the costs and benefits of leverage; a desire to diversify vs. a preference for simplicity, among many others. This discussion should make use of a mix of quantitative and qualitative inputs, with expert judgement playing an important role.

Sponsored Content

Bias towards quantitative tools widespread

Many investors already follow such an approach when setting strategy and may consider this tirade largely unnecessary. However, a bias towards quantitative and precise numerical tools remains prevalent in the investment industry, as highlighted in Andrew Lo and Mark Mueller’s fascinating 2010 paper “Warning: Physics envy can be hazardous to your wealth”. Perhaps more worryingly, a few minutes spent on the websites of some well-known robo-advisers demonstrates that efficient frontiers and optimal portfolios are very much alive and kicking.

In today’s environment of heightened political uncertainty, with monetary stimulus of a type and on a scale never seen before, and with structural trends such as climate change, global ageing and technological disruption likely to change the investing environment radically, we need thoughtful, constructive debate like never before. An over-reliance on simplistic quantitative tools will lead to naïve portfolio construction, wrapped in a comfort blanket of “optimality”.

Instead, we need to face the radical complexity of the real world. Rather than aiming for some quantitative definition of optimality, we should seek the more humble and realistic aim of robustness under a range of plausible scenarios. Stress testing and scenario analysis – straightforward deterministic tools – provide a useful, powerful alternative to the relatively complex stochastic and optimisation tools that are more frequently used.

Optimality is an illusion – it’s time we removed it from the investment lexicon.

 

Phil Edwards is European director of strategic research at Mercer.

One response to “We need to be better than ‘optimal’”

  1. Nathan Fabian

    Thank you Phil for this thoughtful article. Do we need alternative theories of investment in order for your many tools approach to gain traction in the market?

Leave a Comment

The future belongs to investors who can adapt

The future belongs to investors who can adapt

Canada's HOOPP has officially adopted the total portfolio approach since the start of 2026. Unpacking the move, the fund's managing director and head of total portfolio group Jacky Lee writes that while the approach doesn't magically make the return better, the fact that it frees the investment team from outdated processes and gives investment leaders the flexibility to act is what gives it an edge.

Sort content by

Precarious world needs effective G20

General secretary of the International Trade Union Confederation, Sharan Burrow, spoke to the Lowy Institute for International Policy in Sydney, Australia on Thursday August 1 about the need for an effective G20 in a precarious world. Ladies and Gentlemen, The global economy is no more stable today than it was six years ago, and the

Towards sustainable stock exchanges

Wall Street is not normally synonymous with sustainability. But today, the United Nations Secretary-General Ban Ki-moon will ring the closing bell at the New York Stock Exchange to welcome NYSE Euronext into the Sustainable Stock Exchanges Initiative, joining NASDAQ OMX and leading emerging market exchanges from Turkey, South Africa, Egypt, Brazil and India. Why would

Asset-backed funding: desperate or innovative?

On one hand, the decision by one of the United Kingdom’s leading foods businesses, Dairy Crest, to plug its £84-million ($130-million) pension deficit with cheese smacks of desperation. Any proactive investment strategy to get the $1.2-billion pension fund back on track has been abandoned for a funding measure using unconventional sponsor assets to plug investment

Gloom at NAPF attests to investor adventure

One year on and the job of trustees gathered at the United Kingdom’s National Association of Pension Funds, NAPF, annual investment conference in Edinburgh hasn’t got any easier. As the search for optimism in a low-return world endures, the conference seems to be caught in a time loop. Compared to last year, deciding on the

The smoking gun at CalSTRS

For a pension fund that describes itself as “ponderous”, the $154-billion California State Teachers’ Retirement System, CalSTRS, has moved uncharacteristically swiftly in recent months. The second largest public pension fund in the United States, the plan for teachers and faculty is in the process of divesting its holdings in gun manufacturers following the massacre at

Will infrastructure ever find wings?

It’s difficult to ignore the clamour around infrastructure investment, the asset class of the moment. Lloyds TSB and the London Pensions Fund Authority recently joined founder members of the Pensions Infrastructure Platform, PIP, a government initiative to encourage pension funds to invest more in infrastructure. The Universities Superannuation Pension Scheme, USS, just increased its allocation

Previous