Finishing Rich Despite A Low-Return Stock Market Environment

Since the bottom of the global financial crisis in July 2009, the S&P 500 has generally experienced a bull market. While there were challenging periods in 2018, 1Q 2020, and 2022, stock market investors have largely been well rewarded. However, Goldman Sachs warns that the good times might be coming to an end.

Goldman projects the S&P 500 to return just 3% annually over the next decade—a significant drop from the 13% average annual returns of the past 10 years and the historical 11% since 1930. Their analysis suggests a 72% probability that U.S. Treasuries will outperform the S&P, with a 33% chance the index may even trail inflation through 2034.

As the author of Buy This, Not That, a bestseller that encourages readers to think in terms of probabilities, I found Goldman’s perspective intriguing. My key assumption is simple: if you believe there’s at least a 70% chance you’re making the right decision, you should go ahead with it. This probabilistic approach applies to investing, major life choices, and financial planning, helping to minimize risk while maximizing opportunity.

The people at Goldman Sachs aren’t stupid. If they think there’s a 72% probability of the S&P 500 returning just 3% annually over the next decade, we should probably pay attention.

Why Such An Abysmal Stock Return Forecast?

Goldman Sachs believes the S&P 500 is too heavily concentrated in major tech companies like Apple, Microsoft, Nvidia, and Meta. Historically, when there’s such a high concentration, mean reversion tends to occur, causing performance to suffer.

The S&P 500 is currently trading at around 22 times forward earnings, much higher than the long-term average of around 17 times. If the market reverts to this trend, future returns are likely to be lower.

Goldman isn’t alone in forecasting weak stock returns. Vanguard shares a similar outlook, predicting just 3% to 5% annual returns for U.S. large-cap stocks over the next decade. They also suggest that better opportunities might exist in value stocks, small caps, REITs, and international markets.

On the other hand, J.P. Morgan projects U.S. stocks will return around 7.8% annually over the next 20 years, with bonds yielding about 5%. This would represent a 2.2% decline from the S&P 500’s historical 10% compound annual return since 1926.

Vanguard equity and REIT forecasts

How To Operate In A Low Stock Return Environment And Still Get Rich

Nobody can predict future stock market returns with certainty. Vanguard issued similar low-return forecasts at the onset of the pandemic, and they have been proven wrong for over four years.

However, as a Financial Samurai who values probabilities over absolutes, let’s consider the scenario where Goldman Sachs is correct. If the S&P 500 only returns 3% annually over the next decade, what strategies can we implement to outperform?

1) Diversify away from the S&P 500 into real estate and bonds

If the S&P 500 is projected to return just 3% annually over the next decade, diversifying into underperforming assets like bonds and real estate could offer better opportunities. Both asset classes have faced headwinds as the Federal Reserve raised interest rates 11 times since 2022.

With bond yields increasing again, these asset classes offer potential value. Furthermore, the significant wealth generated in the stock market since 2009 may prompt a rotation of capital into bonds and real estate as investors seek more stable returns.

If you already own real estate, consider remodeling your rental property to boost rental income. I undertook an extensive remodeling project from 2020-2022 that generates a 12% annual return. Additionally, explore expanding the property’s livable square footage. If you can remodel at a cost per square foot lower than the selling price per square foot, you stand to earn a strong return.

If you feel with greater than 70% certainty a 3% average annual stock market return will happen, you could invest your entire portfolio in Treasury bonds. The 10-year is yielding 4.2% and the 30-year is yielding 4.49%. These choices provide a guaranteed income stream, enabling you to withdraw at a rate higher than 3%, while preserving your principal for future generations.

Ultimately, your decision to invest in risk-free Treasury bonds will depend on your confidence in Goldman Sachs’ predictions for the stock market. It will also depend on your appetite for potentially higher returns.

2) Invest in private AI companies given big tech performance

With the S&P 500’s concentration in big tech—largely driven by AI-related growth—it makes sense to consider private AI companies for exposure to future innovation. AI has the potential to solve global labor shortages, drive productivity, and even contribute to breakthroughs in healthcare and other sectors.

Investing in private AI firms through an open-ended venture fund can capture the upside in a sector poised for long-term impact. A reasonable allocation—up to 20% of your investable capital—may ensure you benefit from the next wave of technological advances, especially as AI continues to disrupt industries.

Private companies are staying private longer, allowing more gains to accrue to private investors. Therefore, it is only logical to allocate a greater portion of your capital to private companies.

3) Invest Where You Have Favorable Odds

In 2012, after retiring from my job, I invested my six-figure severance package in the Dow Jones Industrial Average (DJIA) and S&P 500, despite feeling nervous about leaving the workforce.

My Citigroup financial advisor introduced me to structured notes, which are derivative products offering downside protection or upside boosts. One particular note provided 100% downside protection on the DJIA but required me to accept only a 0.5% dividend, compared to the DJIA’s 1.5% dividend yield.

The investment had a five-year duration, and the security of downside protection gave me the courage to invest everything at the time. Given the uncertainty in the market, I wouldn’t have invested my entire severance directly into the DJIA. But with just a 1% annual dividend trade-off for downside protection, I felt confident.

Here is an example of a structured note where you can lose up to 30% of your investment and still get 100% of your principal back. You also get a minimum fixed return amount of 15% + 100% participation on the upside after 15%.

Investing in an Open-Ended Venture Capital Fund

Today, I find favorable odds investing in an open-ended venture capital fund, where I can see its holdings. There’s often a 8-24 month lag between when a private company fundraises and when valuations increase.

By tracking news articles from reliable publications, I can spot signals when a company in the fund is about to raise capital at a much higher valuation. This provides an opportunity to invest at the previous round’s valuation, locking in a paper return once the new valuation is announced.

Take OpenAI as an example. In early October 2024, OpenAI raised $6.6 billion in venture capital, valuing the company at $157 billion—an 80% increase from its February 2024 valuation. During these discussions, you could have invested in an open-ended fund that owns OpenAI to capture the upside, since funds don’t revalue its assets until after an event is closed.

If a venture fund had 100% of its portfolio in OpenAI, an investor would be up roughly 60% in just eight months, accounting for dilution. While no fund will have such a concentrated portfolio, you can analyze other holdings in the fund, such as Anthropic, OpenAI’s smaller competitor, and extrapolate their potential future valuations.

The Information recently reported Anthropic is actually looking to raise at a valuation up to $40 billion, or 4X higher. Hence, I’m a buyer in the fund that still has Anthropic on its books at a $10 billion valuation.

4) Work Harder and Longer

Unfortunately, if the S&P 500 is only expected to deliver a 3% to 5% return, you may need to work harder and longer to achieve financial independence. It’s wise to recalculate your net worth targets based on this lower return rate. Project what your financial standing will be in 3, 5, 10, 15, and 20 years and adjust accordingly.

Alternatively, you could still aim to retire at your desired age, as it’s often better to retire early than to chase a higher net worth given time’s priceless value. However, this may require adjusting your spending or finding supplemental income sources to maintain your lifestyle.

From my experience since 2012, generating supplemental retirement income can be enjoyable. I’ve driven for Uber, coached high school tennis, provided private tennis lessons, consulted for tech companies, written books, and secured sponsors for Financial Samurai.

When you need more income in retirement, you’ll adapt by reducing expenses and discovering new earning opportunities.

5) Lower Your Safe Withdrawal Rate

In a low-return environment, lower your safe withdrawal rate if you’re retired. If Goldman Sachs and other investment forecasters are correct, this adjustment will increase your chances of not outliving your savings. Conversely, if they turn out to be wrong, you’ll simply have more to donate later.

It’s counterproductive to raise your withdrawal rate while stock market return forecasts decline. A dynamic safe withdrawal rate that adjusts with market conditions is more prudent.

Let’s conduct a thought exercise, which I know is not how the 4% Rule was formulated.

The historically recommended 4% withdrawal rate was introduced when the S&P 500 returned ~10% on average, meaning the withdrawal rate represented 40% of that return. Therefore, under similar logic, a safe withdrawal rate of around 1.2% would be more appropriate in a 3% return scenario (40% X 3%).

This may sound extreme, but so does predicting a mere 3% annual return for the next ten years. Let’s take the logic a step further.

If You’re Still Working and Planning to Retire

For those not yet retired, consider aiming for a net worth equal to 83 times (inverse of 1.2%) your annual living expenses. For example, if you spend $60,000 a year, your target net worth should be approximately $5 million to avoid the fear of running out of money in retirement.

I understand that an 83X multiple is unreasonable, and most will not reach that goal. However, this figure is only a target if you maintain your current investment strategy, don’t lengthen your working years, or don’t generate supplemental income after retirement. In addition, the S&P 500’s return average could also be higher than 3% on average, enabling you to lower your net worth target too.

Limited-time promotion: For those with over $250,000 in investable assets seeking a free financial checkup, you can schedule an appointment with an Empower financial professional here. If you complete your two video calls with the advisor before October 31, 2024, you’ll receive a complimentary $100 Visa gift card, with no obligation to sign up afterward. It’s always great to get a second opinion from someone who helps construct investment portfolios as a living.

6) Create and invest in your business

Instead of investing in the stock market with the potential for low single-digit returns, consider investing more in your own business or creating one of your own. If you can invest $100 into your business and generate more than $105 in net profits, that’s a better move if you agree with Goldman Sachs’ and Vanguard’s low stock market forecasts.

The reality is, many private business owners can earn significantly higher returns from their capital expenditures than the stock market. Often, they just don’t realize this because they aren’t comparing the various ways they could be deploying their capital. Or, they’re simply too frugal or risk averse.

Personally, I could allocate more funds towards advertising, PR, hiring writers, or developing new products to grow Financial Samurai and boost revenue. However, I do not because I’ve stubbornly focused on what I love since 2009—writing. Once this site starts feeling like a job or business, my interest in running it goes down.

I have peers who spend $500,000 a year on payroll, paying freelance teams to churn out SEO-optimized content to maximize earnings. That’s too soul-sucking for me, but it’s nice to know I have this option.

A Low Stock Return Environment Will Widen The Gap Between Winners And Losers

I invested through the “lost decade,” when the S&P 500 stagnated from March 2000 until November 2012. However, during that time, savvy investors could have capitalized on buying near the bottom and targeting specific stocks to realize substantial gains.

If we find ourselves in another prolonged period of poor stock market returns, the same principle will likely apply. There will be significant winners and dismal losers. The best stock pickers will have the opportunity to outperform the broader market. Unfortunately, the majority of active investors tend to underperform their respective index benchmarks.

Therefore, you will probably have to count more on your own hard work to get ahead. For me, dialing up the intensity is exactly what I plan to do now that both our kids are in school full-time. I’ve got until December 31, 2027 to regain our financial independence after blowing it up to buy our current house.

My Current Net Worth Structure

Currently, ~41% of my net worth is in real estate. This asset class offers stability, comfort, and consistent income, along with the shelter it provides. If mortgage rates follow a downward trend, it will create a favorable environment for real estate investments.

About 24% of my net worth is in public equities, with my allocation averaging around 30% since 2012. I’m not rushing to increase my stock investments given the potential for lower returns moving forward. I’m just nibbling with every 0.5% – 1% pullback.

What excites me most right now is investing in private AI companies. My firsthand experience shows how AI has significantly boosted my productivity and impacted job markets. Since I can’t get a job in AI, investing in this sector is the next best option.

A forecast of a mere 3% annual return for the stock market over the next decade seems doubtful. However, a repeat of a significant stock market correction, like the one we experienced in 2022, could easily sway more investors to believe in such gloomy predictions.

Having invested since 1995, I’ve come to accept that anything is possible regarding stock market returns. As a result, keep an open mind and hope for the best, but expect the worst.

What are your thoughts on Vanguard and Goldman Sachs’s dismal stock market return forecasts? What percentage chance do you think a 3% average annual return over the next decade will happen? How are you positioning your investments to potentially exceed these low expected returns?

Diversify Into Artificial Intelligence

More gains are accruing to private company investors as these companies remain private longer. As a result, it makes sense to allocate a greater percentage of your capital to private investments. One option to consider is the Fundrise venture capital product, which invests in private growth companies in the following five sectors:

Artificial Intelligence & Machine Learning

Modern Data Infrastructure

Development Operations (DevOps)

Financial Technology (FinTech)

Real Estate & Property Technology (PropTech)

In 20 years, I don’t want my kids wondering why I didn’t invest in AI or work in AI. The investment minimum is also only $10. Most venture capital funds have a $100,000+ minimum. You can see what Fundrise is holding before deciding to invest and how much.

I’ve invested $143,000 in Fundrise venture so far and Fundrise is a long-time sponsor of Financial Samurai.

If you want to achieve financial freedom sooner, join 60,000+ readers and sign up for my free weekly newsletter. Everything I write is based off firsthand experience because money is too important to be left up to pontification.

More articles ―