Memory sitting next to the chip is a compromise everyone accepted as normal. SemiFive and Preferred Networks want it on top instead. If it works, more than a chip changes — the whole supply chain shifts.
According to DigiTimes, Korea's SemiFive and Japan's Preferred Networks are developing an inference chip that stacks DRAM directly above a logic die. Conventional 2.5D packaging puts the processor and HBM side by side on a shared interposer. Here memory moves upstairs: shorter path, fewer transitions, fewer watts.
Sounds obvious. In practice it hits two walls — heat and yields. A hot stack either throttles or ends up in the bin. That is exactly why 2.5D survived this long.
SemiFive is a Korean design house that builds custom silicon. Preferred Networks is a Japanese AI lab that has spent years building its own stack: models, frameworks, and the hardware underneath. One side knows how to get a design into silicon, the other knows where inference chokes without memory bandwidth.
An odd pairing, and a sensible one. Each brings what the other lacks.
HBM is the scarcest part of AI hardware. Only a handful of companies make it, the queue is booked out, and its price sets inference economics for everyone from startups to cloud giants. Any working alternative cools the market and reshuffles the memory game.
Second layer: packaging. 2.5D stopped being a secondary step long ago — it decides how many chips you can ship at all. Whoever offers a real alternative gets leverage comparable to the memory makers.
Third: geography. While everyone stares at Taiwan, Korea and Japan are assembling their own vertical. TSMC is not the lead actor here. That alone is news.
The report has no bandwidth figures, no timeline, no named customers. This is development, not a shipping product. Stacking DRAM on logic has been attempted before — the same two problems every time: heat and cost. If SemiFive and PFN don't solve thermal, the result is a handsome demo chip for a keynote, not an HBM replacement.
And one more: a single source. DigiTimes is an industry-grade leak outlet, but no second independent publication covers this work. For now it is a signal, not a fact.
Prediction: If the pair cracks thermal, the first public chip demo lands before HBM gets any cheaper.
Disclaimer: supply chain leak, not officially confirmed
Source: www.digitimes.com · post in Telegram