It is not a coincidence that the companies that got the most “Hopper” H100 allocations from Nvidia in 2023 were also the hyperscalers and cloud builders, who in many cases wear both hats and who are as interested in renting out their GPU capacity for others to build AI models as they are in innovating in the development of large language models. …
How To Make More Money Renting A GPU Than Nvidia Makes Selling It was written by Timothy Prickett Morgan at The Next Platform.
A few years ago, it was hard to imagine how AMD would have survived without re-entering the datacenter with its CPU and GPU compute engines. …
AMD Firing On All Compute Engine Cylinders was written by Timothy Prickett Morgan at The Next Platform.
When it comes to solving data analytics problems at scale, it is tough to beat the hyperscalers. …
The Perfect AI Storage: Trino From Facebook And Iceberg From Netflix? was written by Timothy Prickett Morgan at The Next Platform.
The energy sector is undergoing a monumental shift as the power grid struggles to accommodate growing demand and the complexity of modern energy systems. …
Building The Power Grid Of Tomorrow was written by Timothy Prickett Morgan at The Next Platform.
Commissioned: Thanks to recent technological advancements, there are many different sources of electricity available which can help organizations address our growing demand for energy from power hungry devices such as electric vehicles while reducing their reliance on fossil fuels like petroleum, coal, and gas. …
The Cutting Edge In Power Grid Management was written by Timothy Prickett Morgan at The Next Platform.
It would be hard to pick a worse time to not have an XPU offload engine that can do lots of matrix math at mixed precision and that can ship in volume. …
Intel Hits Bottom In The Datacenter – Maybe was written by Timothy Prickett Morgan at The Next Platform.
It has been quite a week for Hashi Corp, the company behind the open source Hashi Stack of systems software for creating and running modern, distributed applications. …
IBM Buys HashiCorp To Control The Alternative To Red Hat Kubernetes was written by Timothy Prickett Morgan at The Next Platform.
Not many devices in the datacenter have been etched with the Intel 4 process, which is the chip maker’s spin on 7 nanometer extreme ultraviolet immersion lithography. …
Sandia Pushes The Neuromorphic AI Envelope With Hala Point “Supercomputer” was written by Timothy Prickett Morgan at The Next Platform.
Here is a paradox for you: Spending on infrastructure to support generative AI is apparently booming, as clearly evidenced by the skyrocketing revenues and profits of Nvidia. …
Sweetened IT Spending Forecast Is Not Precisely A GenAI Boom was written by Timothy Prickett Morgan at The Next Platform.
The Internet of Things (IoT) has shown significant growth and promise, with data generated by IoT devices alone expected to reach 73.1 zettabytes by 2025. …
AI At The Edge: From Theory To Practice was written by Timothy Prickett Morgan at The Next Platform.
With large language models, bigger is better (and faster) but better is also better. …
Meta’s Llama 3 AI Is Smart, But Who Is Going To Profit From It? was written by Timothy Prickett Morgan at The Next Platform.
Everyone is in a big hurry to get the latest and greatest GPU accelerators to build generative AI platforms. …
TSMC Will Have An AI Business Bigger Than All Of Intel Foundry was written by Timothy Prickett Morgan at The Next Platform.
We have a long-standing joke that dates from the early 2000s, when the hyperscalers – there were not yet cloud builders as we now know them – started having hundreds of millions of users and millions of servers and storage arrays to run applications for them at the same time there was the beginnings of consolidation among the OEMs who created the servers and storage used by nearly all enterprises, including dot-com startups. …
What Happens When Hyperscalers And Clouds Buy Most Servers And Storage? was written by Timothy Prickett Morgan at The Next Platform.
More than a decade ago, executives at Arm Ltd saw the energy costs in datacenters soaring and sensed an opportunity to extend the low-power architecture of its eponymous systems-on-a-chip that has dominated the mobile phone markets from the get-go and took over the embedded device market from PowerPC into enterprise servers. …
Power Efficiency, Customization Will Drive Arm’s Role In AI was written by Jeffrey Burt at The Next Platform.
How many cores is enough for server CPUs? All that we can get, and then some. …
Ampere Readies 256-Core CPU Beast, Awaits The AI Inference Wave was written by Timothy Prickett Morgan at The Next Platform.
Today is the ribbon-cutting ceremony for the “Venado” supercomputer, which was hinted at back in April 2021 when Nvidia announced its plans for its first datacenter-class Arm server CPU and which was talked about in some detail – but not really enough to suit our taste for speeds and feeds – back in May 2022 by the folks at Los Alamos National Laboratory where Venado is situated. …
Los Alamos Pushes The Memory Wall With “Venado” Supercomputer was written by Timothy Prickett Morgan at The Next Platform.
There was a time – and it doesn’t seem like that long ago – that the datacenter chip market was a big-money but relatively simple landscape, with CPUs from Intel and AMD and Arm looking to muscle its way in and GPUs mostly from Nvidia with some from AMD and Intel looking to muscle its way in. …
AWS Hedges Its Bets With Nvidia GPUs And Homegrown AI Chips was written by Jeffrey Burt at The Next Platform.
SPONSORED POST: Generative AI is the subject of significant interest from enterprises busy looking to use it to help them improve business processes and build innovative new applications and services which can attract new customers and grow revenue. …
Looking To Adopt Generative AI Within Your Organization? was written by Timothy Prickett Morgan at The Next Platform.
If you control your code base and you have only a handful of applications that run at massive scale – what some have called hyperscale – then you, too, can win the Chip Jackpot like Meta Platforms and a few dozen companies and governments in the world have. …
With MTIA v2 Chip, Meta Can Do AI Inference, But Not Training was written by Timothy Prickett Morgan at The Next Platform.
The steady rise of AI over the past several years – and the accelerated growth with the introduction generative AI since OpenAI’s launch of ChatGPT in November 2022 – has shifted Intel’s status as a challenger in a chip market that it long had dominated. …
Gelsinger: With Gaudi 3 and Xeon 6, AI Workloads Will Come Our Way was written by Jeffrey Burt at The Next Platform.