Investing in the energy transition: Time to look at whole-system value

Introduction

What Happened

In the past decade, renewable generation has surged, with solar and wind now accounting for a sizable share of new capacity installations worldwide. This growth has been driven by steep declines in technology costs, supportive policy frameworks such as feed‑in tariffs and renewable portfolio standards, and a growing corporate appetite for clean power. However, the variable nature of wind and solar—producing electricity only when the wind blows or the sun shines—has exposed the limitations of a grid that was originally designed around large, dispatchable fossil‑fuel plants.

As the share of intermittent renewables climbs, grid operators are confronting new challenges: sudden ramps in generation, periods of oversupply that push prices into negative territory, and heightened vulnerability to extreme weather events that can knock out transmission lines or generation assets. In many regions, the lack of adequate flexibility mechanisms has forced reliance on costly and carbon‑intensive peaking plants, undermining the emissions reductions that the transition promises.

Key Details

Addressing these challenges requires a holistic view of whole‑system value—considering not only the capital cost of new low‑carbon capacity but also the benefits of flexibility, reliability, and resilience that ancillary services provide. Energy storage, particularly lithium‑ion batteries, has emerged as a cornerstone technology, capable of absorbing excess solar output during midday and releasing it during evening peaks. By flattening the net load curve, storage reduces the need for fast‑ramping gas turbines and curtails emissions.

Demand‑response programs add another layer of flexibility by incentivizing industrial, commercial, and residential consumers to shift or shave load in response to price signals or grid constraints. Advanced metering infrastructure and automated control systems enable real‑time adjustments, turning demand into a dispatchable resource. Meanwhile, grid modernization—through smart‑grid sensors, high‑voltage direct‑current (HVDC) interconnectors, and digital twins—enhances visibility and control, allowing operators to manage congestion, integrate distributed energy resources, and maintain stability even as the generation mix becomes more decentralized.

Background

The momentum behind the energy transition is rooted in a confluence of factors. International agreements such as the Paris Accord have set ambitious climate goals, prompting governments to enact carbon pricing, renewable subsidies, and phase‑out schedules for coal and unabated gas. Simultaneously, technological breakthroughs have driven down the levelized cost of electricity (LCOE) for solar and wind to parity—or even advantage—over conventional generation in many markets.

Beyond policy and technology, societal shifts are reshaping demand patterns. The rapid adoption of electric vehicles (EVs) is creating new, flexible loads that can be timed to coincide with renewable generation peaks. Electrification of heating, industry, and even aviation is expanding the electricity market’s scope, while also presenting opportunities for sector coupling—using excess renewable electricity to produce green hydrogen or heat, thereby storing energy in alternative forms.

Why It Matters

Investing in whole‑system value is not merely an engineering exercise; it is a climate imperative. The power sector remains the largest source of global greenhouse‑gas emissions, accounting for roughly two‑thirds of total CO₂ output. Without adequate flexibility, the integration of renewables stalls, leading to higher curtailment rates and a slower decarbonization trajectory. Moreover, a resilient grid reduces the risk of blackouts, which can have cascading economic and social impacts, especially in vulnerable communities.

From an economic perspective, the benefits of flexibility and resilience translate into lower system costs over the long term. By minimizing reliance on expensive peaking plants, reducing curtailment, and deferring costly transmission upgrades, whole‑system investments can deliver higher returns for investors and lower electricity bills for consumers. They also create new job categories in battery manufacturing, software development, and grid services, supporting a just transition for workers displaced from fossil‑fuel industries.

What Happens Next

The path forward will be shaped by coordinated action across public and private sectors. Policymakers must design market rules that reward flexibility services—such as frequency regulation, capacity provision, and voltage support—so that storage operators and demand‑response aggregators can monetize their contributions. Funding mechanisms, including green bonds and climate‑aligned investment frameworks, should prioritize projects that demonstrate clear whole‑system value.

Utilities and grid operators will need to accelerate the deployment of digital infrastructure, adopt advanced forecasting tools, and embrace integrated planning that couples generation, transmission, and demand‑side resources. At the same time, continued research into emerging storage technologies—like flow batteries, solid‑state electrolytes, and long‑duration thermal storage—will expand the toolbox for managing variability over hours, days, and even weeks.

Conclusion