There is nothing quite like great hardware to motivate people to create and tune software to take full advantage of it during a boom time. …
The post AMD Is The Undisputed Datacenter GPU Performance Champ – For Now first appeared on The Next Platform.
AMD Is The Undisputed Datacenter GPU Performance Champ – For Now was written by Timothy Prickett Morgan at The Next Platform.
Note: We will be updating this story with more information once our contacts in China are awake:
China is using a domestic processor as the backbone for double the performance of the Tianhe-2 system, which topped the Top 500 starting in 2013 and running through late 2015 before being overshadowed by the Sunway system in recent years. …
The post What’s Inside China’s New Homegrown “Tianhe Xingyi” Supercomputer? first appeared on The Next Platform.
What’s Inside China’s New Homegrown “Tianhe Xingyi” Supercomputer? was written by Nicole Hemsoth Prickett at The Next Platform.
SPONSORED FEATURE: So, you’re finally ready to jump on the AI bandwagon. …
The post Accelerate time to insight for AI and HPC first appeared on The Next Platform.
Accelerate time to insight for AI and HPC was written by Martin Courtney at The Next Platform.
This week Nvidia shared details about upcoming updates to its platform for building, tuning, and deploying generative AI models. …
The post Finding NeMo Features for Fresh LLM Building Boost first appeared on The Next Platform.
Finding NeMo Features for Fresh LLM Building Boost was written by Nicole Hemsoth Prickett at The Next Platform.
COMMISSIONED: Innovation at the edge is happening at light speed. Everywhere you turn, organizations are seeking to shift their center of data processing gravity from central locations like head offices and datacenters to the outer limits of the operation – to factory floors, hospital wards, truck fleets and smart cities. …
The post A Platform For Securely Scaling Operations At The Edge first appeared on The Next Platform.
A Platform For Securely Scaling Operations At The Edge was written by Martin Courtney at The Next Platform.
In the history of computing, there has been an endless push and pull between the need for general-purpose versus fine-tuned custom systems and software. …
The post The Bespoke Supercomputing Architecture That Stood the Test of Time first appeared on The Next Platform.
The Bespoke Supercomputing Architecture That Stood the Test of Time was written by Nicole Hemsoth Prickett at The Next Platform.
Amazon Web Services may not be the first of the hyperscalers and cloud builders to create its own custom compute engines, but it has been hot on the heels of Google, which started using its homegrown TPU accelerators for AI workloads in 2015. …
The post How AWS Can Undercut Nvidia With Homegrown AI Compute Engines first appeared on The Next Platform.
How AWS Can Undercut Nvidia With Homegrown AI Compute Engines was written by Timothy Prickett Morgan at The Next Platform.
Server makers Dell, Hewlett Packard Enterprise, and Lenovo, who are the three largest original manufacturers of systems in the world, ranked in that order, are adding to the spectrum of interconnects they offer to their enterprise customers. …
The post If You Want To Sell AI To Enterprises, You Need To Sell Ethernet first appeared on The Next Platform.
If You Want To Sell AI To Enterprises, You Need To Sell Ethernet was written by Timothy Prickett Morgan at The Next Platform.
Many have waited years to hear someone like Prahlad Venkatapuram, Senior Director of Engineering at Meta, say what came out this week at the RISC-V Summit:
“We’ve identified that RISC-V is the way to go for us moving forward for all the products we have in the roadmap. …
The post Meta Sees Little Risk in RISC-V Custom Accelerators first appeared on The Next Platform.
Meta Sees Little Risk in RISC-V Custom Accelerators was written by Nicole Hemsoth Prickett at The Next Platform.
When we first talked to Voltron Data following their launch in early 2022, we had to take care to explain why Apache Arrow was worth paying attention to and why it might warrant the level of enterprise support the startup promised. …
The post Arrow Hits the Mark for Petabyte-Class Analytics Problems first appeared on The Next Platform.
Arrow Hits the Mark for Petabyte-Class Analytics Problems was written by Nicole Hemsoth Prickett at The Next Platform.
SPONSORED FEATURE: The face of modern networking is changing dramatically in parallel with the exponential increase in the volume of data traffic over the last several years. …
The post Redefining datacenter connectivity with open source networking first appeared on The Next Platform.
Redefining datacenter connectivity with open source networking was written by Martin Courtney at The Next Platform.
The ProLiant server business is down in the dumps, and the storage business is in a slump. …
The post With HPC Humming Along, HPE Awaits Its AI Boom first appeared on The Next Platform.
With HPC Humming Along, HPE Awaits Its AI Boom was written by Timothy Prickett Morgan at The Next Platform.
Since the advent of distributed computing, there has been a tension between the tight coherency of memory and its compute within a node – the base level of a unit of compute – and the looser coherency over the network across those nodes. …
The post AWS Taps Nvidia NVSwitch For Beefy AI GPU Nodes first appeared on The Next Platform.
AWS Taps Nvidia NVSwitch For Beefy AI GPU Nodes was written by Timothy Prickett Morgan at The Next Platform.
For more than a year, we have been expecting for Amazon Web Services to launch its Graviton4 processor for its homegrown servers at this year’s re:Invent, and lo and behold, chief executive officer Adam Selipsky rolled out the fourth generation in the Graviton CPU lineup – and the fifth iteration including last year’s overclocked Graviton3E processor aimed at HPC workloads – during his thrombosis-inducing keynote at the conference. …
The post AWS Adopts Arm V2 Cores For Expansive Graviton4 Server CPU first appeared on The Next Platform.
AWS Adopts Arm V2 Cores For Expansive Graviton4 Server CPU was written by Timothy Prickett Morgan at The Next Platform.
Over the past few years, the Arm architecture has made steady gains, particularly among the hyperscalers and cloud builders. …
The post HPC Pioneers Pave The Way For A Flood Of Arm Supercomputers first appeared on The Next Platform.
HPC Pioneers Pave The Way For A Flood Of Arm Supercomputers was written by Tobias Mann at The Next Platform.
If you are looking for an alternative to Nvidia GPUs for AI inference – and who isn’t these days with generative AI being the hottest thing since a volcanic eruption – then you might want to give Groq a call. …
The post Groq Says It Can Deploy 1 Million AI Inference Chips In Two Years first appeared on The Next Platform.
Groq Says It Can Deploy 1 Million AI Inference Chips In Two Years was written by Timothy Prickett Morgan at The Next Platform.
The exorbitant cost of GPU-accelerated systems for training and inference and latest to rush to find gold in mountains of corporate data are combining to exert tectonic forces on the datacenter landscape and push up a new Himalaya range – with Nvidia as its steepest and highest peak. …
The post Nvidia Proves The Enormous Potential For Generative AI first appeared on The Next Platform.
Nvidia Proves The Enormous Potential For Generative AI was written by Timothy Prickett Morgan at The Next Platform.
If you are in the traditional HPC community, it is not hard to be of two minds about the rise of AI and the mainstreaming of generative AI. …
The post Trying To Do More Real HPC In An Increasingly AI World first appeared on The Next Platform.
Trying To Do More Real HPC In An Increasingly AI World was written by Timothy Prickett Morgan at The Next Platform.
As Moore’s law continues to slow, delivering more powerful HPC and AI clusters means building larger, more power hungry facilities. …
The post Pushing The Limits Of HPC And AI Is Becoming A Sustainability Headache first appeared on The Next Platform.
Pushing The Limits Of HPC And AI Is Becoming A Sustainability Headache was written by Timothy Prickett Morgan at The Next Platform.
In a world where allocations of “Hopper” H100 GPUs coming out of Nvidia’s factories are going out well into 2024, and the allocations for the impending “Antares” MI300X and MI300A GPUs are probably long since spoken for, anyone trying to build a GPU cluster to power a large language model for training or inference has to think outside of the box. …
The post What To Do When You Can’t Get Nvidia H100 GPUs first appeared on The Next Platform.
What To Do When You Can’t Get Nvidia H100 GPUs was written by Timothy Prickett Morgan at The Next Platform.