How are rising compute density and power demands for AI workloads changing data center design and infrastructure choices?

Most answers highlight a shift toward liquid cooling and modular or decentralized data centers to handle higher power and density, though some emphasize retrofitting existing sites or prioritizing power strategy.

10 answers

Answers

  • Christian Bhatia Ondaatje

    Co-Founder & CEO · Aranya Inc.

    Decentralized Sites

    Christian Bhatia Ondaatje says the trend toward a larger volume of smaller, decentralized sites seems evident and necessary to scale, since he sees no way to scale at the pace intelligence is being consumed other than through decentralized power and compute generation.

    FinStrat Management, Inc. · Watch on YouTube
  • John Furrier

    Co-Founder, CEO, Executive Editor, Cohost of theCUBE · Siliconangle & Thecube

    Smaller Modular Data Centers

    John Furrier says data centers are being built smaller and modular, citing 30 to 40 megawatt facilities that can be peered together.

    The answer starts at 11:25.

    theCUBE Podcast · Listen on Apple Podcasts
  • CJ Muse

    Senior Managing Director · Cantor Fitzgerald

    Power‑First Design

    CJ Muse says his team starts every project with a "power-first" principle, beginning with power availability, type and strategy at each site and building everything else from there, because being part of the Brookfield ecosystem lets them apply this strategy more effectively.

    The answer starts at 41:04.

    The Information's TITV · Listen on Apple Podcasts
  • John Hewitt

    Board Member · Innventure

    600 kW‑1 MW racks with two‑phase cooling

    John Hewitt says racks being designed and deployed are now 600 kilowatts and nearing a megawatt, and that two-phase cooling is the solution that works well, allowing a tighter envelope, freeing power, and removing water from the data center.

    SiliconANGLE theCUBE · Watch on YouTube
  • Shayle Kann

    Managing Partner, Frontier · Energy Impact Partners

    More liquid cooling

    Shayle Kann says the shift driven by higher-powered chips and heat limits is toward direct liquid cooling, since water is an effective way to cool high-power devices in limited space.

    The answer starts at 7:32.

    Catalyst with Shayle Kann · Listen on Apple Podcasts
  • Mike Maniscalco

    Chief Executive Officer · QumulusAI

    Retrofitting existing sites

    Mike Maniscalco says the fastest path to market is finding an existing data center and retrofitting it through modest upgrades to meet AI's higher power and cooling needs, because that takes months rather than building new infrastructure.

    The answer starts at 12:51.

    The Drill Down · Listen on Apple Podcasts
  • Edgar van Essen

    Managing Director / Partner · Switch Datacenters

    Liquid cooling

    Edgar van Essen says his company's data center designs are already liquid cooling ready and can be adapted at the last moment, because liquid cooling yields higher residual heat temperatures that his company trades for permits.

    The answer starts at 22:16.

    New Project Media (NPM) Interconnections · Listen on Apple Podcasts
  • Josh Humm

    Data Center Solutions Manager · Dynamic Lifecycle Innovations

    Adopting Liquid Cooling

    Josh Humm says the physical weight and liquid cooling of AI GPU servers stand out as a differentiator in ITAD, noting the density and power density create a unique challenge requiring specialized equipment to handle cooling abatement and units weighing 5,000 to 6,000 pounds.

    The answer starts at 2:12.

    The Data Center Frontier Show · Listen on Apple Podcasts
  • Uljan Sharka

    Chief Executive Officer · Domyn

    Decentralized edge compute

    Uljan Sharka says the next generation of AI clouds will decentralize supercomputers into small computers forming an "intelligence grid," with substations distributed at the edge near factories, research communities and towns, because 1 GW clusters would consume more energy than some countries.

    Sifted · Watch on YouTube
  • Samuel Rodriguez

    Senior Product Manager - Industrial Solutions · Chatsworth Products

    Adopt liquid cooling

    Samuel Rodriguez says the biggest driver in thermal management will be adoption of liquid cooling, driven by an IT roadmap of devices that require it or perform better with it, forcing changes in data center infrastructure.

    The Data Center Frontier Show · The Data Center Frontier Show · Listen at 8:39

More Cloud Computing questions

View all →