The hype around generative AI is making every industry vibrate at an increasingly high pitch in a way that we have not seen since the days of the Dot Com boom and sock puppets. …
With Huge Costs, Efficiency Is The Key To Mainstreaming Generative AI was written by Jeffrey Burt at The Next Platform.
When it comes to a lot of high performance computing systems we have seen over the decades, we are fond of saying that the hardware is the easy part. …
Argonne Aurora A21: All’s Well That Ends Better was written by Timothy Prickett Morgan at The Next Platform.
It was a fortuitous coincidence that Nvidia was already working on massively parallel GPU compute engines for doing calculations in HPC simulations and models when the machine learning tipping point happened, and similarly, it was fortunate for InfiniBand that it had the advantage of high bandwidth, low latency, and remote direct memory access across GPUs at that same moment. …
Cisco Guns For InfiniBand With Silicon One G200 was written by Timothy Prickett Morgan at The Next Platform.
To Andrew Davidson, senior vice president of products at MongoDB, the database business operates in an entirely different type of market than traditional software, where vendors might sell their products into one organization after another, eventually reaching a saturation point. …
Beefing Up A Cloudy NoSQL Database To Ride The AI Wave was written by Jeffrey Burt at The Next Platform.
When it comes to deploying Arm in the cloud, a lot of the talk of late has centered on things like efficiency, core density, or predictability of performance. …
Move Over X86, Amazon’s Arm HPC instances Are Live was written by Tobias Mann at The Next Platform.
If the datacenter is the computer – and it certainly is for hundreds of companies comprising somewhere well north of half of server sales worldwide – then the Ethernet fabric, consisting of switches and routers, is the backplane of that computer. …
Ethernet Switching Still Booming As Routing Soldiers On was written by Timothy Prickett Morgan at The Next Platform.
The expanded lineup of AMD’s 4th generation “Genoa” Epyc server chips – built atop “Zen 4” core and some with the chip maker’s L3-boosting 3D V-Cache – unveiled at a high-profile event in San Francisco this week is quickly making its way into the cloud. …
The Big Clouds Get First Dibs On AMD “Genoa” Chips was written by Jeffrey Burt at The Next Platform.
If you had to rank the level of hype around specific datacenter technologies, the top thing these days would be, without question, generative AI, probably followed by AI training and inference of all kinds and mixed precision computing in general. …
Rest In Pieces: Servers And CXL was written by Timothy Prickett Morgan at The Next Platform.
OpenStack, the venerable open source cloud controller born in 2010 out projects pulled together by Rackspace Hosting and NASA, continues to push on despite its death being predicted myriad times over the past several years. …
Reports Of OpenStack’s Death Greatly Exaggerated was written by Jeffrey Burt at The Next Platform.
The best defense is a good offense, and as it turns out, the best offense is also a good offense. …
AMD Widens Server CPU Line To Take Bites Out Of Intel, Arm was written by Timothy Prickett Morgan at The Next Platform.
The great thing about the Cambrian explosion in compute that has been forced by the end of Dennard scaling of clock frequencies and Moore’s Law lowering in the cost of transistors is not only that we are getting an increasing diversity of highly tuned compute engines and broadening SKU stacks across those engines, but also that we are getting many different interpretations of the CPU, GPU, DPU, and FPGA themes. …
The Third Time Charm Of AMD’s Instinct GPU was written by Timothy Prickett Morgan at The Next Platform.
Any performance comparisons across compute engines in use in a datacenter are always valid for a point in time since new CPUs, GPUs, FPGAs, and other ASICs are always coming into the market at different times. …
Intel Pits Its “Sapphire Rapids” Xeon SP Against AMD “Genoa” Epycs was written by Timothy Prickett Morgan at The Next Platform.
We think that server spending is a leading indicator of economic growth or decline, and we are tracking the public companies that peddle systems to try to get a sense of how they are doing to get a better sense of what enterprises, governments, academic institutions, and other organizations separate from the hyperscalers and cloud builders, the latter of which comprise around half of server shipments and slightly less than half of server spending. …
No Server Recession At Lenovo And Supermicro So Far was written by Timothy Prickett Morgan at The Next Platform.
When Intel announced its “Falcon Shores” project to build a hybrid CPU-GPU compute engine back in February 2022 that allowed the independent scaling of CPU and GPU capacity within a single socket, it looked like the chip maker was preparing to take on rivals Nvidia and AMD head on with hybrid compute motors, which Intel calls XPUs, AMD calls APUs, and Nvidia doesn’t really have if you want to be strict about what its “superchips” are and what they are not. …
Intel Downplays Hybrid CPU-GPU Engines, Merges NNP Into GPU was written by Timothy Prickett Morgan at The Next Platform.
The HPC gurus of the world may have started moving into the hyperscalers and cloud builders in recent years, but they don’t tend to work for vendors and they tend to stay in one place and lean in. …
Talking Novel Architectures And El Capitan With Lawrence Livermore was written by Timothy Prickett Morgan at The Next Platform.
Like many of you, we are trying to find out what the heck is really going on in the global economy. …
Dell Gives A Second Opinion On Enterprise IT Spending was written by Timothy Prickett Morgan at The Next Platform.
Just below the massive hyperscalers and cloud builders there is another set of dozens of datacenter operators who provide cloud and co-location services on a multinational basis to enterprises, governments, and academic institutions. …
More Power – And Cooling – To You was written by Timothy Prickett Morgan at The Next Platform.
There is perhaps no better logo for Hewlett Packard Enterprise than the box. …
The Balancing Act Of HPE’s Systems Business was written by Timothy Prickett Morgan at The Next Platform.
Whenever a compute engine maker also does motherboards as well as system designs, those companies that make motherboards (there are dozens who do) and create system designs (the original design manufacturers and the original – get a little bit nervous as well as a bit relieved. …
MGX: Nvidia Standardizes Multi-Generation Server Designs was written by Timothy Prickett Morgan at The Next Platform.
If you were hoping to get your hands on one of Nvidia’s “Grace” Arm-based CPUs, then you better be prepared to buy a pretty big machine. …
Nvidia’s Grace-Hopper Hybrid Systems Bring Huge Memory To Bear was written by Timothy Prickett Morgan at The Next Platform.