If large language models are the foundation of a new programming model, as Nvidia and many others believe it is, then the hybrid CPU-GPU compute engine is the new general purpose computing platform. …
The post Nvidia Gooses Grace-Hopper GPU Memory, Gangs Them Up For LLM first appeared on The Next Platform.
Nvidia Gooses Grace-Hopper GPU Memory, Gangs Them Up For LLM was written by Timothy Prickett Morgan at The Next Platform.
Data changes behavior and behavior changes data. It is a phenomenon that is akin to the Observer Effect in physics in that you can’t observe something without changing its behavior. …
The post The Interplay Of GDP, Inflation, And IT Spending first appeared on The Next Platform.
The Interplay Of GDP, Inflation, And IT Spending was written by Timothy Prickett Morgan at The Next Platform.
The Department of Defense in the United States has established a generative AI task force to help oversee the process of adopting AI tools across the department while avoiding some of the pitfalls of such deoployments. …
The post US Defense Department Assembles Generative AI Task Force first appeared on The Next Platform.
US Defense Department Assembles Generative AI Task Force was written by Daniel Robinson at The Next Platform.
Only a few years ago, motherboard and system maker Supermicro set a target of breaking through $10 billion in sales, and thanks to the explosion in systems for training and inference for AI applications, it looks like the company is going to bust through that goal in its fiscal 2025 ending next June. …
The post Supermicro Sets Its Sights On $20 Billion Business first appeared on The Next Platform.
Supermicro Sets Its Sights On $20 Billion Business was written by Timothy Prickett Morgan at The Next Platform.
ADVERTORIAL: According to the 2023 Dataiku-sponsored IDC InfoBrief — Create More Business Value From Your Organizational Data — “Although [AI] adoption is rapidly expanding, project failure rates remain high. …
The post Three Common Reasons For Analytics And AI Project Failure first appeared on The Next Platform.
Three Common Reasons For Analytics And AI Project Failure was written by Martin Courtney at The Next Platform.
Not everybody can afford an Nvidia DGX AI server loaded up with the latest “Hopper” H100 GPU accelerators or even one of its many clones available from the OEMs and ODMs of the world. …
The post Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches first appeared on The Next Platform.
Crafting A DGX-Alike AI Server Out Of AMD GPUs And PCI Switches was written by Timothy Prickett Morgan at The Next Platform.
For the last two quarters at least, the generic infrastructure server market – the one running databases, application servers, various web layers, and print and file serving workloads the world over – has been in a recession. …
The post GPU Shortages Will Prop Up The Clouds In More Ways Than One first appeared on The Next Platform.
GPU Shortages Will Prop Up The Clouds In More Ways Than One was written by Timothy Prickett Morgan at The Next Platform.
With a server recession underway and its latest Epyc CPUs and Instinct GPU accelerators still ramping, this was a predictably soft, but still not terrible in the scheme of things, quarter for AMD. …
The post AMD Feels The Server Recession, Too, But Growth Is Looming Large first appeared on The Next Platform.
AMD Feels The Server Recession, Too, But Growth Is Looming Large was written by Timothy Prickett Morgan at The Next Platform.
Sponsored Feature: Meeting organizational sustainability requirements depends on so much more than optimizing electricity consumption and reducing an enterprise’s carbon footprint. …
The post Paving an intentional road to a sustainable IT future first appeared on The Next Platform.
Paving an intentional road to a sustainable IT future was written by Martin Courtney at The Next Platform.
When you combine the forces of open source and the wide and deep semiconductor experience of legendary chip architect Jim Keller, something interesting is bound to happen. …
The post Unleashing An Open Source Torrent On CPUs And AI Engines first appeared on The Next Platform.
Unleashing An Open Source Torrent On CPUs And AI Engines was written by Timothy Prickett Morgan at The Next Platform.
Depending on how you look at it, a database is a kind of sophisticated storage system or storage is a kind of a reduction of a database. …
The post Vast Data Intentionally Blurs The Line Between Storage And Database first appeared on The Next Platform.
Vast Data Intentionally Blurs The Line Between Storage And Database was written by Timothy Prickett Morgan at The Next Platform.
When we think about high performance computing, it is often in the context of liquid-cooled systems deployed in facilities specifically designed to accommodate their power and thermal requirements. …
The post Where To Park Your AI Cluster Is As Important As Procuring It first appeared on The Next Platform.
Where To Park Your AI Cluster Is As Important As Procuring It was written by Tobias Mann at The Next Platform.
Accounting is something of an art, and companies always save some accounting tricks – perfectly legitimate items that meet the discerning eye of financial standards – to goose their numbers when they really need it. …
The post Bookkeeping Helps Intel Recover From Server Recession A Little first appeared on The Next Platform.
Bookkeeping Helps Intel Recover From Server Recession A Little was written by Timothy Prickett Morgan at The Next Platform.
It is funny what courses were the most fun and most useful when we look back at college. …
The post H100 GPU Instance Pricing On AWS: Grin And Bear It first appeared on The Next Platform.
H100 GPU Instance Pricing On AWS: Grin And Bear It was written by Timothy Prickett Morgan at The Next Platform.
As we have seen with various kinds of high bandwidth, stacked DRAM memory to compute engines in the past decade, just adding this wide, fast, and expensive memory to a compute engine can radically improve the effective performance of the device. …
The post Micron Revs Up Bandwidth And Capacity On HBM3 Stacks first appeared on The Next Platform.
Micron Revs Up Bandwidth And Capacity On HBM3 Stacks was written by Timothy Prickett Morgan at The Next Platform.
When you are competing against the hyperscalers and cloud builders in the AI revolution, you need backers as well as customers that have deep-pockets and that can not only think big, but pay big. …
The post In G42, Cerebras Finds The Deep Pockets And Partnership It Needs To Grow first appeared on The Next Platform.
In G42, Cerebras Finds The Deep Pockets And Partnership It Needs To Grow was written by Timothy Prickett Morgan at The Next Platform.
All of the major HPC centers of the world, whether they are funded by straight science or nuclear weapons management, have enough need and enough money to have two classes of supercomputers. …
The post Stampede3: A Smaller HPC System That Will Get More Work Done first appeared on The Next Platform.
Stampede3: A Smaller HPC System That Will Get More Work Done was written by Timothy Prickett Morgan at The Next Platform.
Advertorial: There can be clear gaps and persistent friction points that hamper an organization’s ability to scale and deliver value, fast. …
The post How To Solve MLOPS Challenges And Scale first appeared on The Next Platform.
How To Solve MLOPS Challenges And Scale was written by Martin Courtney at The Next Platform.
Given the exorbitant demand for compute and networking for running Ai workloads and the dominance of Taiwan Semiconductor Manufacturing Co in making the compute engine chips and providing the complex packaging for them, you would think that the world’s largest foundry would be making money hands over fist in the second quarter. …
The post AI Is A Modest – But Important – Slice Of TSMC’s Business first appeared on The Next Platform.
AI Is A Modest – But Important – Slice Of TSMC’s Business was written by Timothy Prickett Morgan at The Next Platform.
Here we go again. Some big hyperscalers and cloud builders and their ASIC and switch suppliers are unhappy about Ethernet, and rather than wait for the IEEE to address issues, they are taking matters in their own hands to create what will ultimately become an IEEE standard that moves Ethernet forward in a direction and speed of their choosing. …
The post Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand first appeared on The Next Platform.
Ethernet Consortium Shoots For 1 Million Node Clusters That Beat InfiniBand was written by Timothy Prickett Morgan at The Next Platform.