We need to be better than ‘optimal’

The dictionary definition of the word “optimal” is “best or most favourable”. While an investment strategy is hardly ever described as “the best” – perhaps for fear that this might sound somewhat hubristic or over-confident – it seems to be perfectly acceptable to describe a strategy as optimal, despite the same intended meaning.

So where did the over-use of optimal come from? Google’s chart of use over time shows that optimal was a word rarely used until around 1950, after which time its use grew exponentially. This supports the hypothesis that optimal entered the investment lexicon following the widespread adoption of mean-variance optimisation, which Harry Markowitz developed in the 1950s. Although the usage statistics for optimal have levelled off in recent years, the advent of robo-advice has given a fresh impetus for the use of mean-variance optimisation as a portfolio construction tool.

Mean-variance optimisation uses the expected returns, volatilities and correlations of a range of asset classes in order to arrive at an ‘efficient frontier’. Any strategy sitting on the efficient frontier maximises the expected return for a given level of volatility and is, therefore, described as efficient or optimal.

The problems with the term optimal as a descriptor of investment strategies are, therefore, intimately connected with the weaknesses of mean-variance optimisation as a portfolio construction tool. These include:

  • The use of volatility as the only measure of risk. As a result, volatility and risk have become synonymous, despite the fact that a highly volatile asset might be much less risky than one exhibiting low volatility if risk is viewed as the possibility of suffering a large drawdown or losing money in real terms, for example. This isn’t to say that volatility is useless as a measure of risk – far from it – simply that it shouldn’t be the only measure of risk.
  • Volatility and correlation inputs for a mean-variance optimisation process are typically backward-looking and assumed to be stable over time. The output based on such assumptions is, therefore, vulnerable to regime changes that materially alter correlation and volatility dynamics. Optimality based on backward-looking inputs is fragile when looking forward.
  • There are many possible approaches to setting the expected return assumptions that go into an optimisation, each with their own strengths and weaknesses. Different approaches can produce very different numbers but the high level of uncertainty in these assumptions is frequently ignored, with many of them often specified to an accuracy of two decimal places. Given the sensitivity of an optimisation to the input parameters and the high level of uncertainty inherent in the assumptions, to describe the output as optimal is misguided at best.

Mean-variance optimisation had not been invented when John Keynes wrote The General Theory of Employment, Interest and Money, yet the essence of the problem it has created is captured nicely in the following quote from the book: “Too large a proportion of recent mathematical economics are merely concoctions, as imprecise as the initial assumptions they rest on, which allow the author to lose sight of the complexities and interdependencies of the real world in a maze of pretentious and unhelpful symbols”.

This is not to say that mean-variance optimisation should be avoided altogether. With a clear-sighted recognition of its limitations, optimisation can be used sensibly as one input within a wide-ranging investment strategy discussion. Such a discussion would seek to address the many unquantifiable trade-offs investors face: the attractions of investing in less liquid assets vs. the opportunity cost of reduced flexibility; the costs and benefits of leverage; a desire to diversify vs. a preference for simplicity, among many others. This discussion should make use of a mix of quantitative and qualitative inputs, with expert judgement playing an important role.

Sponsored Content

Bias towards quantitative tools widespread

Many investors already follow such an approach when setting strategy and may consider this tirade largely unnecessary. However, a bias towards quantitative and precise numerical tools remains prevalent in the investment industry, as highlighted in Andrew Lo and Mark Mueller’s fascinating 2010 paper “Warning: Physics envy can be hazardous to your wealth”. Perhaps more worryingly, a few minutes spent on the websites of some well-known robo-advisers demonstrates that efficient frontiers and optimal portfolios are very much alive and kicking.

In today’s environment of heightened political uncertainty, with monetary stimulus of a type and on a scale never seen before, and with structural trends such as climate change, global ageing and technological disruption likely to change the investing environment radically, we need thoughtful, constructive debate like never before. An over-reliance on simplistic quantitative tools will lead to naïve portfolio construction, wrapped in a comfort blanket of “optimality”.

Instead, we need to face the radical complexity of the real world. Rather than aiming for some quantitative definition of optimality, we should seek the more humble and realistic aim of robustness under a range of plausible scenarios. Stress testing and scenario analysis – straightforward deterministic tools – provide a useful, powerful alternative to the relatively complex stochastic and optimisation tools that are more frequently used.

Optimality is an illusion – it’s time we removed it from the investment lexicon.

 

Phil Edwards is European director of strategic research at Mercer.

One response to “We need to be better than ‘optimal’”

  1. Nathan Fabian

    Thank you Phil for this thoughtful article. Do we need alternative theories of investment in order for your many tools approach to gain traction in the market?

Leave a Comment

The future belongs to investors who can adapt

The future belongs to investors who can adapt

Canada's HOOPP has officially adopted the total portfolio approach since the start of 2026. Unpacking the move, the fund's managing director and head of total portfolio group Jacky Lee writes that while the approach doesn't magically make the return better, the fact that it frees the investment team from outdated processes and gives investment leaders the flexibility to act is what gives it an edge.

Sort content by

SVB collapse reminds us long-term investors, too, can panic – but don’t

"A long-term investor sells when it wants to, not because it has to." This is an especially clear and succinct definition of long-term investing. Long-term investing is about how the institution behaves, not a fixed time period.

The ultimate trophy asset: When prestige is more important than returns

Forget returns. The Gulf SWFs vying for ownership of European football clubs are after amenity value, soft power influence and winning regional rivalries. The returns only come at the end when they sell these trophy assets… as long as there are enough billionaires in the world to buy them.

Opportunities in Chinese healthcare

Sam Radwan, an expert in China's healthcare sector, and co-founder of Enhance International a consultancy that advises Chinese insurers, discusses the driving forces behind the sector.

EU must overhaul pensions; fees to blame

It’s well and good for policy makers to insist on saving earlier and for longer, but when all is said and done, pension funds simply too often underperform capital markets, and this is, by and large, due to excessive fees and commissions. The EU needs to take a closer look, argues president of Better Finance, Axel Kleinlein.

Clearing the climate obstacles

In the wake of the Climate Action 100+ annual progress report, CEO of the PRI, Fiona Reynolds calls on corporate boards to step up. And the first action item is to either transform the industry associations they belong to that undermine climate action, or resign from them.

Is active investing doomed?

In what might be seen as a boon, or at-least a close escape from extinction, a review of academic literature finds that investors should not entirely rule out using active funds management. The academic evidence is not sufficient to write-off an active approach, says Geoff Warren, it just depends on the circumstances.

Previous