We need to be better than ‘optimal’

The dictionary definition of the word “optimal” is “best or most favourable”. While an investment strategy is hardly ever described as “the best” – perhaps for fear that this might sound somewhat hubristic or over-confident – it seems to be perfectly acceptable to describe a strategy as optimal, despite the same intended meaning.

So where did the over-use of optimal come from? Google’s chart of use over time shows that optimal was a word rarely used until around 1950, after which time its use grew exponentially. This supports the hypothesis that optimal entered the investment lexicon following the widespread adoption of mean-variance optimisation, which Harry Markowitz developed in the 1950s. Although the usage statistics for optimal have levelled off in recent years, the advent of robo-advice has given a fresh impetus for the use of mean-variance optimisation as a portfolio construction tool.

Mean-variance optimisation uses the expected returns, volatilities and correlations of a range of asset classes in order to arrive at an ‘efficient frontier’. Any strategy sitting on the efficient frontier maximises the expected return for a given level of volatility and is, therefore, described as efficient or optimal.

The problems with the term optimal as a descriptor of investment strategies are, therefore, intimately connected with the weaknesses of mean-variance optimisation as a portfolio construction tool. These include:

  • The use of volatility as the only measure of risk. As a result, volatility and risk have become synonymous, despite the fact that a highly volatile asset might be much less risky than one exhibiting low volatility if risk is viewed as the possibility of suffering a large drawdown or losing money in real terms, for example. This isn’t to say that volatility is useless as a measure of risk – far from it – simply that it shouldn’t be the only measure of risk.
  • Volatility and correlation inputs for a mean-variance optimisation process are typically backward-looking and assumed to be stable over time. The output based on such assumptions is, therefore, vulnerable to regime changes that materially alter correlation and volatility dynamics. Optimality based on backward-looking inputs is fragile when looking forward.
  • There are many possible approaches to setting the expected return assumptions that go into an optimisation, each with their own strengths and weaknesses. Different approaches can produce very different numbers but the high level of uncertainty in these assumptions is frequently ignored, with many of them often specified to an accuracy of two decimal places. Given the sensitivity of an optimisation to the input parameters and the high level of uncertainty inherent in the assumptions, to describe the output as optimal is misguided at best.

Mean-variance optimisation had not been invented when John Keynes wrote The General Theory of Employment, Interest and Money, yet the essence of the problem it has created is captured nicely in the following quote from the book: “Too large a proportion of recent mathematical economics are merely concoctions, as imprecise as the initial assumptions they rest on, which allow the author to lose sight of the complexities and interdependencies of the real world in a maze of pretentious and unhelpful symbols”.

This is not to say that mean-variance optimisation should be avoided altogether. With a clear-sighted recognition of its limitations, optimisation can be used sensibly as one input within a wide-ranging investment strategy discussion. Such a discussion would seek to address the many unquantifiable trade-offs investors face: the attractions of investing in less liquid assets vs. the opportunity cost of reduced flexibility; the costs and benefits of leverage; a desire to diversify vs. a preference for simplicity, among many others. This discussion should make use of a mix of quantitative and qualitative inputs, with expert judgement playing an important role.

Sponsored Content

Bias towards quantitative tools widespread

Many investors already follow such an approach when setting strategy and may consider this tirade largely unnecessary. However, a bias towards quantitative and precise numerical tools remains prevalent in the investment industry, as highlighted in Andrew Lo and Mark Mueller’s fascinating 2010 paper “Warning: Physics envy can be hazardous to your wealth”. Perhaps more worryingly, a few minutes spent on the websites of some well-known robo-advisers demonstrates that efficient frontiers and optimal portfolios are very much alive and kicking.

In today’s environment of heightened political uncertainty, with monetary stimulus of a type and on a scale never seen before, and with structural trends such as climate change, global ageing and technological disruption likely to change the investing environment radically, we need thoughtful, constructive debate like never before. An over-reliance on simplistic quantitative tools will lead to naïve portfolio construction, wrapped in a comfort blanket of “optimality”.

Instead, we need to face the radical complexity of the real world. Rather than aiming for some quantitative definition of optimality, we should seek the more humble and realistic aim of robustness under a range of plausible scenarios. Stress testing and scenario analysis – straightforward deterministic tools – provide a useful, powerful alternative to the relatively complex stochastic and optimisation tools that are more frequently used.

Optimality is an illusion – it’s time we removed it from the investment lexicon.

 

Phil Edwards is European director of strategic research at Mercer.

One response to “We need to be better than ‘optimal’”

  1. Nathan Fabian

    Thank you Phil for this thoughtful article. Do we need alternative theories of investment in order for your many tools approach to gain traction in the market?

Leave a Comment

The future belongs to investors who can adapt

The future belongs to investors who can adapt

Canada's HOOPP has officially adopted the total portfolio approach since the start of 2026. Unpacking the move, the fund's managing director and head of total portfolio group Jacky Lee writes that while the approach doesn't magically make the return better, the fact that it frees the investment team from outdated processes and gives investment leaders the flexibility to act is what gives it an edge.

Sort content by

Can we ‘circle’ our way out of this mess?

A circular economy keeps materials circulating in their highest value use. Co-founder of the Thinking Ahead Institute, Tim Hodgson, recently hosted a working group who debated whether it is a necessary – or even possible – component of the climate transition.

More funds consider TPA despite challenges

In January 2020, Roger Urwin laid down a call to action for asset owners and corporations to use the decade to drive greater wellbeing and wealth in the lives of their stakeholders. Now halfway through the decade, he reviews the state of play in this complicated picture.

Exploring the interconnectedness of biodiversity and climate change

Biodiversity loss is one of the top global risks in terms of its impact and likelihood, yet it is completely overshadowed by climate change and is not well understood. Anastassia Johnson, researcher at the Thinking Ahead Institute, explores the intersection of both issues and what investors should do about them.

A decade in need of a course correction

In January 2020 Roger Urwin laid down a call to action for asset owners and corporations to use the decade to drive greater wellbeing and wealth in the lives of their stakeholders. Now halfway through the decade, he reviews the state of play in this complicated picture.

Navigating today’s global challenges to reimagine tomorrow’s markets

Simultaneous global challenges such as inequality, environmental degradation, financial instability and fragile supply chains are challenging contemporary capitalism’s ability to cope. MFS Investment Management president Carol Geremia says it is time to consider a new approach to build resilience and ensure long-term sustainability in markets and societies.

Piecing together the impact investing puzzle

Ben Thornley, co-founder at Tideline, looks at how value creation practices bring a manager’s impact credentials into sharper focus, the strong positive correlation between impact and financial performance, and the role of allocators in incentivizing and enabling managers to deliver impact value.

Previous