COMMISSIONED As the AI era unfolds, I have been reflecting on my journey in the tech industry. …
AI Workloads Are Changing IT Demands At The Edge was written by Timothy Prickett Morgan at The Next Platform.
Sponsored Feature Arm is starting to fulfill its promise of transforming the nature of compute in the datacenter, and it is getting some big help from traditional chip makers as well as the hyperscalers and cloud builders that have massive computing requirements and who also need to drive efficiency up and costs down each and every year. …
Custom Arm CPUs Drive Many Different AI Approaches In The Datacenter was written by Timothy Prickett Morgan at The Next Platform.
For most of the history of high performance computing, a supercomputer was a freestanding, isolated machine that was designed to run some simulation or model and the only link it needed to the outside world was a relatively small one to show some visualization. …
The Back End AI Network Puts Pressure On The Front End was written by Timothy Prickett Morgan at The Next Platform.
Generative AI is still very much an emerging technology and it’s morphing and evolving rapidly, as is illustrated with the trend toward agentic AI, which we’ve written about previously. …
Cisco Puts Big AI Infrastructure Into Small Packages was written by Jeffrey Burt at The Next Platform.
COMMISSIONED In the fast-paced world of AI, GPUs are often hailed as the quiet powerhouse driving innovation. …
Stop Bottlenecking Your AI: Storage Hacks for Hungry GPUs was written by Timothy Prickett Morgan at The Next Platform.
There are lots of ways that we might build out the memory capacity and memory bandwidth of compute engines to drive AI and HPC workloads better than we have been able to do thus far. …
We Can’t Get Enough HBM, Or Stack It Up High Enough was written by Timothy Prickett Morgan at The Next Platform.
Think of it as the ultimate offload model.
One of the geniuses of the cloud – perhaps the central genius – is that a big company that would have a large IT budget, perhaps on the order of hundreds of millions of dollars per year, and that has a certain amount of expertise creates a much, much larger IT organization with billions of dollars – and with AI now tens of billions of dollars – in investments and rents out the vast majority of that capacity to third parties, who essentially allow that original cloud builder to get their own IT operations for close to free. …
You Are Paying The Clouds To Build Better AI Than They Will Rent You was written by Timothy Prickett Morgan at The Next Platform.
It is beginning to look like chip maker Intel hit the bottom in its products and foundry businesses in the second quarter of this year and that revenues are slowly – we won’t go so far as to say surely – improving. …
Intel Takes The Big Restructuring Hits As It Looks Ahead was written by Timothy Prickett Morgan at The Next Platform.
COMMISSIONED As enterprises increasingly adopt GenAI-powered AI agents, making high-quality data available for these software assistants will come into sharper focus. …
High Quality Data Is Key For Effective AI Agents was written by Timothy Prickett Morgan at The Next Platform.
The minute that search engine giant Google wanted to be a cloud, and the several years later that Google realized that companies were not ready to buy full-on platform services that masked the underlying hardware but wanted lower level infrastructure services that gave them more optionality as well as more responsibility, it was inevitable that Google Cloud would have to buy compute engines from Intel, AMD, and Nvidia for its server fleet. …
Google Covers Its Compute Engine Bases Because It Has To was written by Timothy Prickett Morgan at The Next Platform.
Lisu Su has turned in her first ten years at the helm of AMD, and what a hell of a run it has been. …
AMD Will Need Another Decade To Try To Pass Nvidia was written by Timothy Prickett Morgan at The Next Platform.
No matter how elegant and clever the design is for a compute engine, the difficulty and cost of moving existing – and sometimes very old – code from the device it currently runs on to that new compute engine is a very big barrier to adoption. …
HPC Gets A Reconfigurable Dataflow Engine To Take On CPUs And GPUs was written by Timothy Prickett Morgan at The Next Platform.
The third quarter earnings season starts this week for the hyperscaler and cloud giants, and it is fortuitous that the economists and IT analysts at Gartner have updated their forecast for IT spending for 2024 and added an jaw-dropping forecast for 2025 and hinted at a brave new world of massive datacenter spending out to 2028. …
System Spending Forecast Goes Through The Datacenter Roof was written by Timothy Prickett Morgan at The Next Platform.
It was only a few months ago when waferscale compute pioneer Cerebras Systems was bragging that a handful of its WSE-3 engines lashed together could run circles around Nvidia GPU instances based on Nvidia’s “Hopper” H100 GPUs when running the open source Llama 3.1 foundation model created by Meta Platforms. …
Cerebras Trains Llama Models To Leap Over GPUs was written by Timothy Prickett Morgan at The Next Platform.
Big Blue has reported its financial results for the third quarter of 2024, and the thing that stands out most is not the System z16 mainframes and Power10 midrange and big iron are getting a little long in the tooth ahead of new product cycles expected to start in 2025. …
IBM’s Red Hat Acquisition Will Pay For Itself By Early Next Year was written by Timothy Prickett Morgan at The Next Platform.
To AI or to not AI, that is not even a question in 2024. …
The Great Danes Get A Supercomputer For AI And Maybe HPC was written by Timothy Prickett Morgan at The Next Platform.
With the bottlenecks between compute engines, their memories, and their networking adapters growing larger with each passing generation of AI machinery, there has never been a more pressing need to shift away from copper and towards optics in datacenter systems. …
The Money Keeps Rolling In For Optical Interconnects was written by Timothy Prickett Morgan at The Next Platform.
As the last several years have shown, scaling up AI systems to train larger models with more parameters across more data is a very expensive proposition, and one that has made Nvidia fabulously rich. …
Unlocking The Future of AI Infrastructure: Breaking Through Bottlenecks For Profitability And Performance was written by Timothy Prickett Morgan at The Next Platform.
Every time Lisa Su, chief executive officer at AMD, announces a new Instinct GPU accelerator, the addressable market for AI acceleration in the datacenter seems to expand. …
The World Will Eat $2 Trillion In AI Servers, AI Will Eat The World Right Back was written by Timothy Prickett Morgan at The Next Platform.
With a near monopoly on advanced chip manufacturing and packaging, it is no wonder that during the AI boom that the world’s largest foundry is not only making money. …
No Slowdown At TSMC, Thanks To The AI Gold Rush was written by Timothy Prickett Morgan at The Next Platform.