• Pizza-sized chips are the future of AI accelerators, researchers

    From TechnologyDaily@1337:1/100 to All on Wednesday, June 25, 2025 13:30:09
    Pizza-sized chips are the future of AI accelerators, researchers concur - but heat remains a huge problem

    Date:
    Wed, 25 Jun 2025 12:28:00 +0000

    Description:
    New study shows wafer-scale processors may outperform GPUs in both computing power and sustainability.

    FULL STORY ======================================================================AI energy demands could be lowered by large single-wafer chips Researchers say these can overcome the limitations faced by GPUs Cerebras and Tesla already use these huge chips, with special cooling systems to manage heat

    Engineers at the University of California Riverside are exploring a new approach to artificial intelligence hardware that could tackle both performance and sustainability.

    In a peer-reviewed paper, published in the journal Device , the team investigated the potential of wafer-scale accelerators - giant computer chips that operate on entire silicon wafers rather than the small chips used in todays GPUs.

    Wafer-scale technology represents a major leap forward, said Mihri Ozkan, a professor of electrical and computer engineering at UCR and lead author of
    the paper. It enables AI models with trillions of parameters to run faster
    and more efficiently than traditional systems. Like monorails

    These chips, like Cerebras Wafer-Scale Engine 3 (WSE-3), which weve covered previously , contain up to 4 trillion transistors and 900,000 AI-focused
    cores on a single unit. Another wafer-scale processor, Teslas Dojo D1, houses 1.25 trillion transistors and close to 9,000 cores per module.

    The processors remove the delays and energy losses common in systems where data travels between multiple chips.

    By keeping everything on one wafer, you avoid the delays and power losses
    from chip-to-chip communication, Ozkan said.

    Traditional GPUs are still important due to their lower cost and modularity, but as AI models grow in size and complexity, the chips begin to encounter performance and energy barriers.

    AI computing isnt just about speed anymore, Ozkan explained. Its about designing systems that can move massive amounts of data without overheating
    or consuming excessive electricity.

    Wafer-scale systems have important environmental benefits too. Cerebras
    WSE-3, for example, can perform up to 125 quadrillion operations per second, while using far less energy than GPU setups.

    Think of GPUs as busy highways - effective, but traffic jams waste energy, Ozkan said. Wafer-scale engines are more like monorails: direct, efficient, and less polluting.

    One major challenge still remains however - the age-old issue of heat. Wafer-scale chips can consume up to 10,000 watts of power, nearly all of
    which turns into heat, requiring advanced cooling systems to prevent overheating and maintain performance.

    Cerebras uses a glycol-based cooling loop built into the chip, while Tesla
    has a liquid system that spreads coolant evenly over the chips surface.

    Via Tech Xplore You may also like Gigantic AI CPU has almost one million cores, Cerebras has Nvidia in its sights Biggest rival to Nvidia demos million-core super AI inference chip that obliterates the DGX100 World's largest AI chip maker hit by crypto scam - Cerebras says token isn't real



    ======================================================================
    Link to news story: https://www.techradar.com/pro/pizza-sized-chips-are-the-future-of-ai-accelerat ors-researchers-concur-but-heat-remains-a-huge-problem


    --- Mystic BBS v1.12 A47 (Linux/64)
    * Origin: tqwNet Technology News (1337:1/100)