The Value Of Thinking And Creating On The Asymptote To Zero

The introduction of writing and agriculture were watershed events for humanity, and are forever interlinked. …

The post The Value Of Thinking And Creating On The Asymptote To Zero first appeared on The Next Platform.

The Value Of Thinking And Creating On The Asymptote To Zero was written by Timothy Prickett Morgan at The Next Platform.

The Balancing Act Of Training Generative AI

We learn a lot of lessons from the hyperscalers and HPC centers of the world, and one of them is that those who control their own software control their own fates. …

The post The Balancing Act Of Training Generative AI first appeared on The Next Platform.

The Balancing Act Of Training Generative AI was written by Timothy Prickett Morgan at The Next Platform.

Enterprises Are Not Going To Miss The Fourth Wave Of AI

IBM announced its Watsonx software development stack back in May, and today it is starting to ship it to customers.   …

The post Enterprises Are Not Going To Miss The Fourth Wave Of AI first appeared on The Next Platform.

Enterprises Are Not Going To Miss The Fourth Wave Of AI was written by Timothy Prickett Morgan at The Next Platform.

Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down

If Nvidia and AMD are licking their lips thinking about all of the GPUs they can sell to Microsoft to support its huge aspirations in generative AI – particularly when it comes to the OpenAI GPT large language model that is the centerpiece of all of the company’s future software and services – they had better think again. …

The post Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down first appeared on The Next Platform.

Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down was written by Timothy Prickett Morgan at The Next Platform.

NCSA Builds Out Delta Supercomputer With An AI Extension

The National Center for Supercomputing Applications at the University of Illinois just fired up its Delta system back in April 2022, and now it has just been given $10 million by the National Science Foundation to expand that machine with an AI partition, called DeltaAI appropriately enough, that is based on Nvidia’s “Hopper” H100 GPU accelerators. …

The post NCSA Builds Out Delta Supercomputer With An AI Extension first appeared on The Next Platform.

NCSA Builds Out Delta Supercomputer With An AI Extension was written by Timothy Prickett Morgan at The Next Platform.

Lining Up The “El Capitan” Supercomputer Against The AI Upstarts

The question is no longer whether or not the “El Capitan” supercomputer that has been in the process of being installed at Lawrence Livermore National Laboratory for the past week – with photographic evidence to prove it – will be the most powerful system in the world. …

The post Lining Up The “El Capitan” Supercomputer Against The AI Upstarts first appeared on The Next Platform.

Lining Up The “El Capitan” Supercomputer Against The AI Upstarts was written by Timothy Prickett Morgan at The Next Platform.

PCI-Express Must Match The Cadence Of Compute Engines And Networks

When system architects sit down to design their next platforms, they start by looking at a bunch of roadmaps from suppliers of CPUs, accelerators, memory, flash, network interface cards – and PCI-Express controllers and switches. …

The post PCI-Express Must Match The Cadence Of Compute Engines And Networks first appeared on The Next Platform.

PCI-Express Must Match The Cadence Of Compute Engines And Networks was written by Timothy Prickett Morgan at The Next Platform.

AI To The Rescue For Server And Storage Spending In Q1

Here’s a fun question and don’t cheat by asking ChatGPT. What is more valuable, an ounce of gold or an ounce of an Nvidia “Hopper” H100 GPU accelerator? …

The post AI To The Rescue For Server And Storage Spending In Q1 first appeared on The Next Platform.

AI To The Rescue For Server And Storage Spending In Q1 was written by Timothy Prickett Morgan at The Next Platform.

The $1 Billion And Higher Ante To Play The AI Game

If you want to get the attention of server makers and compute engine providers and especially if you are going to be building GPU-laden clusters with shiny new gear to drive AI training and possibly AI inference for large language models and recommendation engines, the first thing you need is $1 billion. …

The post The $1 Billion And Higher Ante To Play The AI Game first appeared on The Next Platform.

The $1 Billion And Higher Ante To Play The AI Game was written by Timothy Prickett Morgan at The Next Platform.

Argonne Aurora A21: All’s Well That Ends Better

When it comes to a lot of high performance computing systems we have seen over the decades, we are fond of saying that the hardware is the easy part. …

Argonne Aurora A21: All’s Well That Ends Better was written by Timothy Prickett Morgan at The Next Platform.

Cisco Guns For InfiniBand With Silicon One G200

It was a fortuitous coincidence that Nvidia was already working on massively parallel GPU compute engines for doing calculations in HPC simulations and models when the machine learning tipping point happened, and similarly, it was fortunate for InfiniBand that it had the advantage of high bandwidth, low latency, and remote direct memory access across GPUs at that same moment. …

Cisco Guns For InfiniBand With Silicon One G200 was written by Timothy Prickett Morgan at The Next Platform.

Ethernet Switching Still Booming As Routing Soldiers On

If the datacenter is the computer – and it certainly is for hundreds of companies comprising somewhere well north of half of server sales worldwide – then the Ethernet fabric, consisting of switches and routers, is the backplane of that computer. …

Ethernet Switching Still Booming As Routing Soldiers On was written by Timothy Prickett Morgan at The Next Platform.

Rest In Pieces: Servers And CXL

If you had to rank the level of hype around specific datacenter technologies, the top thing these days would be, without question, generative AI, probably followed by AI training and inference of all kinds and mixed precision computing in general. …

Rest In Pieces: Servers And CXL was written by Timothy Prickett Morgan at The Next Platform.

AMD Widens Server CPU Line To Take Bites Out Of Intel, Arm

The best defense is a good offense, and as it turns out, the best offense is also a good offense. …

AMD Widens Server CPU Line To Take Bites Out Of Intel, Arm was written by Timothy Prickett Morgan at The Next Platform.

The Third Time Charm Of AMD’s Instinct GPU

The great thing about the Cambrian explosion in compute that has been forced by the end of Dennard scaling of clock frequencies and Moore’s Law lowering in the cost of transistors is not only that we are getting an increasing diversity of highly tuned compute engines and broadening SKU stacks across those engines, but also that we are getting many different interpretations of the CPU, GPU, DPU, and FPGA themes. …

The Third Time Charm Of AMD’s Instinct GPU was written by Timothy Prickett Morgan at The Next Platform.

Intel Pits Its “Sapphire Rapids” Xeon SP Against AMD “Genoa” Epycs

Any performance comparisons across compute engines in use in a datacenter are always valid for a point in time since new CPUs, GPUs, FPGAs, and other ASICs are always coming into the market at different times. …

Intel Pits Its “Sapphire Rapids” Xeon SP Against AMD “Genoa” Epycs was written by Timothy Prickett Morgan at The Next Platform.

No Server Recession At Lenovo And Supermicro So Far

We think that server spending is a leading indicator of economic growth or decline, and we are tracking the public companies that peddle systems to try to get a sense of how they are doing to get a better sense of what enterprises, governments, academic institutions, and other organizations separate from the hyperscalers and cloud builders, the latter of which comprise around half of server shipments and slightly less than half of server spending. …

No Server Recession At Lenovo And Supermicro So Far was written by Timothy Prickett Morgan at The Next Platform.

Intel Downplays Hybrid CPU-GPU Engines, Merges NNP Into GPU

When Intel announced its “Falcon Shores” project to build a hybrid CPU-GPU compute engine back in February 2022 that allowed the independent scaling of CPU and GPU capacity within a single socket, it looked like the chip maker was preparing to take on rivals Nvidia and AMD head on with hybrid compute motors, which Intel calls XPUs, AMD calls APUs, and Nvidia doesn’t really have if you want to be strict about what its “superchips” are and what they are not. …

Intel Downplays Hybrid CPU-GPU Engines, Merges NNP Into GPU was written by Timothy Prickett Morgan at The Next Platform.

Talking Novel Architectures And El Capitan With Lawrence Livermore

The HPC gurus of the world may have started moving into the hyperscalers and cloud builders in recent years, but they don’t tend to work for vendors and they tend to stay in one place and lean in. …

Talking Novel Architectures And El Capitan With Lawrence Livermore was written by Timothy Prickett Morgan at The Next Platform.

Dell Gives A Second Opinion On Enterprise IT Spending

Like many of you, we are trying to find out what the heck is really going on in the global economy. …

Dell Gives A Second Opinion On Enterprise IT Spending was written by Timothy Prickett Morgan at The Next Platform.