Timothy Prickett Morgan

Author Archives: Timothy Prickett Morgan

Nvidia Gooses Grace-Hopper GPU Memory, Gangs Them Up For LLM

If large language models are the foundation of a new programming model, as Nvidia and many others believe it is, then the hybrid CPU-GPU compute engine is the new general purpose computing platform. …

The post Nvidia Gooses Grace-Hopper GPU Memory, Gangs Them Up For LLM first appeared on The Next Platform.

Nvidia Gooses Grace-Hopper GPU Memory, Gangs Them Up For LLM was written by Timothy Prickett Morgan at The Next Platform.

The Interplay Of GDP, Inflation, And IT Spending

Data changes behavior and behavior changes data. It is a phenomenon that is akin to the Observer Effect in physics in that you can’t observe something without changing its behavior. …

The post The Interplay Of GDP, Inflation, And IT Spending first appeared on The Next Platform.

The Interplay Of GDP, Inflation, And IT Spending was written by Timothy Prickett Morgan at The Next Platform.

Supermicro Sets Its Sights On $20 Billion Business

Only a few years ago, motherboard and system maker Supermicro set a target of breaking through $10 billion in sales, and thanks to the explosion in systems for training and inference for AI applications, it looks like the company is going to bust through that goal in its fiscal 2025 ending next June. …

The post Supermicro Sets Its Sights On $20 Billion Business first appeared on The Next Platform.

Supermicro Sets Its Sights On $20 Billion Business was written by Timothy Prickett Morgan at The Next Platform.

Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches

Not everybody can afford an Nvidia DGX AI server loaded up with the latest “Hopper” H100 GPU accelerators or even one of its many clones available from the OEMs and ODMs of the world. …

The post Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches first appeared on The Next Platform.

Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches was written by Timothy Prickett Morgan at The Next Platform.

GPU Shortages Will Prop Up The Clouds In More Ways Than One

For the last two quarters at least, the generic infrastructure server market – the one running databases, application servers, various web layers, and print and file serving workloads the world over – has been in a recession. …

The post GPU Shortages Will Prop Up The Clouds In More Ways Than One first appeared on The Next Platform.

GPU Shortages Will Prop Up The Clouds In More Ways Than One was written by Timothy Prickett Morgan at The Next Platform.

AMD Feels The Server Recession, Too, But Growth Is Looming Large

With a server recession underway and its latest Epyc CPUs and Instinct GPU accelerators still ramping, this was a predictably soft, but still not terrible in the scheme of things, quarter for AMD. …

The post AMD Feels The Server Recession, Too, But Growth Is Looming Large first appeared on The Next Platform.

AMD Feels The Server Recession, Too, But Growth Is Looming Large was written by Timothy Prickett Morgan at The Next Platform.

Unleashing An Open Source Torrent On CPUs And AI Engines

When you combine the forces of open source and the wide and deep semiconductor experience of legendary chip architect Jim Keller, something interesting is bound to happen. …

The post Unleashing An Open Source Torrent On CPUs And AI Engines first appeared on The Next Platform.

Unleashing An Open Source Torrent On CPUs And AI Engines was written by Timothy Prickett Morgan at The Next Platform.

Vast Data Intentionally Blurs The Line Between Storage And Database

Depending on how you look at it, a database is a kind of sophisticated storage system or storage is a kind of a reduction of a database. …

The post Vast Data Intentionally Blurs The Line Between Storage And Database first appeared on The Next Platform.

Vast Data Intentionally Blurs The Line Between Storage And Database was written by Timothy Prickett Morgan at The Next Platform.

Bookkeeping Helps Intel Recover From Server Recession A Little

Accounting is something of an art, and companies always save some accounting tricks – perfectly legitimate items that meet the discerning eye of financial standards – to goose their numbers when they really need it. …

The post Bookkeeping Helps Intel Recover From Server Recession A Little first appeared on The Next Platform.

Bookkeeping Helps Intel Recover From Server Recession A Little was written by Timothy Prickett Morgan at The Next Platform.

Micron Revs Up Bandwidth And Capacity On HBM3 Stacks

As we have seen with various kinds of high bandwidth, stacked DRAM memory to compute engines in the past decade, just adding this wide, fast, and expensive memory to a compute engine can radically improve the effective performance of the device. …

The post Micron Revs Up Bandwidth And Capacity On HBM3 Stacks first appeared on The Next Platform.

Micron Revs Up Bandwidth And Capacity On HBM3 Stacks was written by Timothy Prickett Morgan at The Next Platform.

In G42, Cerebras Finds The Deep Pockets And Partnership It Needs To Grow

When you are competing against the hyperscalers and cloud builders in the AI revolution, you need backers as well as customers that have deep-pockets and that can not only think big, but pay big. …

The post In G42, Cerebras Finds The Deep Pockets And Partnership It Needs To Grow first appeared on The Next Platform.

In G42, Cerebras Finds The Deep Pockets And Partnership It Needs To Grow was written by Timothy Prickett Morgan at The Next Platform.

Stampede3: A Smaller HPC System That Will Get More Work Done

All of the major HPC centers of the world, whether they are funded by straight science or nuclear weapons management, have enough need and enough money to have two classes of supercomputers. …

The post Stampede3: A Smaller HPC System That Will Get More Work Done first appeared on The Next Platform.

Stampede3: A Smaller HPC System That Will Get More Work Done was written by Timothy Prickett Morgan at The Next Platform.

AI Is A Modest – But Important – Slice Of TSMC’s Business

Given the exorbitant demand for compute and networking for running Ai workloads and the dominance of Taiwan Semiconductor Manufacturing Co in making the compute engine chips and providing the complex packaging for them, you would think that the world’s largest foundry would be making money hands over fist in the second quarter. …

The post AI Is A Modest – But Important – Slice Of TSMC’s Business first appeared on The Next Platform.

AI Is A Modest – But Important – Slice Of TSMC’s Business was written by Timothy Prickett Morgan at The Next Platform.

Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand

Here we go again. Some big hyperscalers and cloud builders and their ASIC and switch suppliers are unhappy about Ethernet, and rather than wait for the IEEE to address issues, they are taking matters in their own hands to create what will ultimately become an IEEE standard that moves Ethernet forward in a direction and speed of their choosing. …

The post Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand first appeared on The Next Platform.

Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand was written by Timothy Prickett Morgan at The Next Platform.

Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down

If Nvidia and AMD are licking their lips thinking about all of the GPUs they can sell to Microsoft to support its huge aspirations in generative AI – particularly when it comes to the OpenAI GPT large language model that is the centerpiece of all of the company’s future software and services – they had better think again. …

The post Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down first appeared on The Next Platform.

Microsoft’s Chiplet Cloud To Bring The Cost Of LLMs Way Down was written by Timothy Prickett Morgan at The Next Platform.

NCSA Builds Out Delta Supercomputer With An AI Extension

The National Center for Supercomputing Applications at the University of Illinois just fired up its Delta system back in April 2022, and now it has just been given $10 million by the National Science Foundation to expand that machine with an AI partition, called DeltaAI appropriately enough, that is based on Nvidia’s “Hopper” H100 GPU accelerators. …

The post NCSA Builds Out Delta Supercomputer With An AI Extension first appeared on The Next Platform.

NCSA Builds Out Delta Supercomputer With An AI Extension was written by Timothy Prickett Morgan at The Next Platform.

1 … 6 7 8 9 10 … 73