Thermodynamic computing doesn’t shortcut numerical weather prediction yet
Can thermodynamic computing make weather prediction quicker and cheaper? That was the question behind this piece of work, which builds on The NWP horseshoe. This is the short version of what I did and what I found.
The short answer. Thermodynamic computing can add value across numerical weather prediction (NWP), but not where weather prediction’s biggest cost lies. Bolted onto today’s systems, the gain is capped at tens of percent at best. Redesigning NWP methods around the hardware is different. My simulations suggest that could plausibly deliver order-of-magnitude gains, and ensemble nowcasting, the forecasting of the next few hours from radar, is the strongest candidate.
What thermodynamic computing is. A conventional chip spends energy suppressing noise. A thermodynamic chip uses it. It is built from parts that fluctuate randomly, with couplings that shape how they fluctuate. Left alone, the system settles into a predictable statistical state, and if the couplings are programmed well, that state is the answer. Several companies are building such hardware:
- Extropic builds probabilistic-bit sampling chips and has proposed a denoising architecture for generative models.
- Normal Computing builds analog chips that do Gaussian sampling and linear algebra by letting coupled circuits settle.
- Flucta, co-founded by one of the inventors of the probabilistic bit, is taking a full-stack route that starts on GPUs.
These devices are good at a narrow set of jobs: drawing random samples, Gaussian inference (including solving linear systems) and the step-by-step “denoising” behind diffusion models. They are no better than a GPU at ordinary deterministic arithmetic, which is what most of a weather model is.
How I tested it. I took each approach on the NWP horseshoe and broke it down into its primitives. A primitive is the small operation that, repeated millions of times, makes up the forecast. I scored each one on whether the hardware can do it and whether doing it faster would matter. The most promising ones I then tested in simulation, modelling the chip’s physics exactly with the same kind of maths used in Normal Computing’s thermox simulator. Where I could, I used real data:
- ECMWF ensemble forecasts from WeatherBench 2;
- Radar rainfall from five national networks, published with the open-source nowcasting library pysteps: Finland, Switzerland, the Netherlands, Belgium and Australia, seven events in all.
For nowcasting, my benchmark was STEPS, the ensemble method used operationally by several national weather services. Belgium’s version, for example, runs 48 members every five minutes.
Finding 1: there is value across the approaches, but only in the uncertainty layer. No single approach on the horseshoe is a natural fit. The fit runs across them, wherever an approach handles uncertainty:
- Data assimilation (combining observations with a forecast to estimate the current state). In an ensemble Kalman filter, a standard way of doing this, the small local calculations matched an ordinary digital solution after about 30 settling times of the chip, needing only about 6 bits of precision. The chip’s own noise could even stand in for the “inflation” such filters normally need tuning.
- Post-processing (statistically correcting a model’s output). On real ECMWF ensemble temperature forecasts, a chip-based calibration matched the digital result to within 0.3%.
- Stochastic physics and correlated noise fields. These work when posed scale by scale, and fail when posed on a fine grid all at once.
- Probabilistic machine learning and nowcasting. See below.
The most useful lesson was that “native” is not enough. What decides whether the chip helps is how well conditioned the problem is as posed to the chip. Posed one way, a task settled in a few dozen time steps; posed another, the same task needed hundreds of millions.
Finding 2: none of this touches the core constraint. The expensive part of weather prediction is the physics core, which steps the equations of motion forward on a grid. Going from 10 km to 1 km resolution costs roughly 10,000 times more compute, and nearly all of it is deterministic, high-precision grid arithmetic. Thermodynamic hardware has nothing to offer there. I also tested whether the chip could help the core indirectly, by giving a rough first answer to the large linear system that physics models solve every time step. The chip’s settling did help, cutting iterations about six-fold, but its thermal noise wiped out the gain unless the chip was run far above its noise floor. At that point it is no longer a thermodynamic computer.
Finding 3: dropped into today’s systems, the gain is capped at tens of percent. Speeding up one part of a pipeline only saves that part’s share of the total, and most uncertainty-handling steps are a modest share. At ECMWF, ensemble forecasting and data assimilation together dominate the compute budget. But the parts a thermodynamic chip could take over within them, the statistical and linear-algebra steps, are a much smaller slice. The physics runs those steps sit inside are the bulk. Nowcasting is the clearest test:
- On real radar, the chip’s noise was a like-for-like replacement for STEPS’s own: same accuracy, same reliability, out to an hour ahead.
- But generating that noise is only about 19% of a STEPS run. The rest is moving the rain field forward, splitting it into scales and correcting its intensity distribution. Even with the chip taking over related steps, a drop-in saves roughly 19–45%.
The state of the art has also moved against one obvious opportunity. Global AI forecasters such as GenCast made their ensembles by diffusion, a slow, many-step denoising process that thermodynamic hardware is built to accelerate. The leading systems since, WeatherNext 2 and 3, ECMWF’s AIFS ENS and NVIDIA’s FourCastNet 3, generate ensemble members in a single cheap pass. Diffusion survives mainly at kilometre scale, in systems like StormCast, which is where that particular opportunity remains.
Finding 4: redesigning NWP for the hardware could bring order-of-magnitude gains, especially in nowcasting. If bolting the chip on is capped, the alternative is to change the method so the chip does most of the work. I built a “chip-native” nowcaster on that principle:
- Compute the deterministic part of the forecast once, rather than once per ensemble member;
- Draw every member’s random perturbations from the chip, scale by scale;
- Let each scale evolve over time with the right memory, using a simple two-step rule (an AR(2) process) that STEPS also uses.
It took several rounds to get right, and some early results did not survive. A heavy-rain advantage that looked significant on Finnish data disappeared across other countries. Two fixes closed most of the remaining gap: band-limiting the chip’s noise to each scale, and giving each scale its two-step memory. Tested on 86 real nowcasts from five networks:
- Skill: it matched STEPS on the probability of heavy rain out to an hour ahead, and on general rain probability out to 30 minutes, while running four times as many ensemble members.
- Cost: in an optimised implementation, its digital work per ensemble member was about 18 times lower than STEPS.
- With an oscillator chip: a chip built from oscillating circuits, like Normal Computing’s original design, can also run the two-step time evolution itself. In my tests that kept the same skill and took the saving to about 33 times.
Two honest qualifications matter for anyone thinking about this commercially:
- Credit for the gain is shared. About four times of that saving comes from the redesign itself, which would also work on ordinary computers. The chip’s own contribution is the remaining factor of roughly four to eight.
- The real competitor is AI, not STEPS. Deep-learning nowcasters such as DGMR already produce an ensemble member in about a tenth of a second on a GPU. My energy model suggests the chip-native design could be a few times more efficient still: using published chip specifications (Extropic’s and magnetic probabilistic bits), the chip’s own energy is negligible. But that is a model, not a measurement.
Why this matters: the demand in nowcasting is for many more members than are run today. Probabilities of extreme rain are tail estimates, and tails need large ensembles. A Japan Meteorological Agency study of a severe flood, using a forecast-model ensemble rather than a nowcast, found that 1,000 members captured both the risk and the timing of record flooding, which 21 members could not. Cheap, calibrated ensemble members at radar update rates are exactly what a chip-native nowcaster would provide.
What I haven’t shown. Everything here is simulation and modelling:
- There was no real thermodynamic chip;
- There was no power-metered comparison against an optimised GPU nowcaster;
- The radar comparison rests on seven rain events, with summer convective storms under-represented;
- Running the time evolution on an oscillator chip would need hardware that lets each scale’s damping and frequency be tuned.
Those are the next tests. Some of the hardware may not be long in coming: Extropic expects early access to its first production chip in 2027.
The bottom line. Thermodynamic computing is not a shortcut through weather prediction’s central cost: the high-resolution physics stays digital. Added to existing systems, it is worth tens of percent at best. But NWP is full of uncertainty handling, and if methods are rebuilt so that the hardware does the sampling and the time evolution, order-of-magnitude savings look plausible. They come with STEPS-level skill and many more ensemble members. Ensemble nowcasting is the place to start: regional, run every few minutes, and hungry for exactly the large, cheap ensembles this hardware is built to produce.