This week we have heard much about the inference side of the deep learning workload, with a range of startups emerging at the AI Hardware Summit. …
Google Rounds Out Insight into TPU Architecture and Inference was written by Nicole Hemsoth at .
When this is all done, Intel might have wished it had kept Renee James as president and chief executive officer, because Ampere, an Arm server chip startup that James has been running since this spring, wants a big piece of the Xeon datacenter business and it has the financial backing to start a price war that others can win and only Intel can lose. …
Arm Upstart Ampere Starts Chipping Away At Intel Xeons was written by Timothy Prickett Morgan at .
On the hardware side, the next frontier for deep learning innovation will be in getting the performance, efficiency, and accuracy needed for inference at scale. …
Self-Creating Neural Networks That Explain Themselves was written by Nicole Hemsoth at .
If there is one rule of computing, is that it gets increasingly more expensive and more difficult to scale up performance within a single device or a single server node. …
The Microserver, Redux And Reconsidered was written by Timothy Prickett Morgan at .
The revelations by Google’s Project Zero team earlier this year of the Spectre and Meltdown speculative execution vulnerabilities in most of processors that have powered servers and PCs for the past couple of decades shook the industry as Intel and other chip makers scrambled to mitigate the risk of the threats in the short term and then implement plans to incorporate the mitigation techniques into future versions of the silicon. …
Trading Off Security And Performance Thanks To Spectre And Meltdown was written by Jeffrey Burt at .
Fujitsu has given us a peek at the future A64FX Arm server processor that it has forged for the future “Post-K” supercomputer that is being built by the Japanese government for the RIKEN laboratory, arguably the hotbed of HPC in the Land of the Rising Sun. …
Slicing Into The Post-K Supercomputer’s Tofu D Interconnect was written by Timothy Prickett Morgan at .
Gentlemen (and women), start your inference engines.
One of the world’s largest buyers of systems is entering evaluation mode for deep learning accelerators to speed services based on trained models. …
Facebook Sounds Opening Bell for AI Inference Hardware Makers was written by Nicole Hemsoth at .
When it comes to machine learning, a lot of the attention in the past six years has focused on the training of neural networks and how the GPU accelerator radically improved the accuracy of networks, thanks to its large memory bandwidth and parallel compute capacity relative to CPUs. …
Nvidia Takes On The Inference Hordes With Turing GPUs was written by Timothy Prickett Morgan at .
At the dawn of the mainframe era, Thomas Watson is said to have remarked that perhaps only five such systems would ever be sold in the world and that perhaps, just one machine would be needed to solve the most intractable problems. …
The Cloud is Where Quantum Competition Gets Real was written by Nicole Hemsoth at .
Over the last several years we have seen many new hardware architectures emerge for deep learning training but this year, inference will have its turn in the spotlight. …
First Wave of Spiking Neural Network Hardware Hits was written by Nicole Hemsoth at .
Historically and traditionally, academic supercomputing centers have been very open about the architecture and setup of their HPC systems, and it makes sense if you think about it. …
Fishing For Insight Into The Ocean Economy With HPC And AI was written by Timothy Prickett Morgan at .
It doesn’t take a machine learning algorithm to predict that server makers are trying to cash in on the machine learning revolution at the major nexus points on the global Internet. …
Unifying Big Data And Machine Learning, Cisco Style was written by Timothy Prickett Morgan at .
It has been nearly five years since Michael Dell lined up $24 billion in cash to take the IT company that bears his name private, and it has been nearly four years since Dell announced its mammoth $67 billion deal to acquire enterprise storage maker EMC and its server virtualization minion, VMware. …
For Whom The Dell Toils was written by Timothy Prickett Morgan at .
There are times when tectonic forces are at work in the IT world. …
Are Hyperscalers And Clouds Builders Smashing Up An IT Pangea? was written by Timothy Prickett Morgan at .
As France, Japan, China, and the United States vie to build the world’s first exascale computer, application and technology developers and researchers in each country are up against major hurdles. …
Europe’s Advantage in the Race to Exascale was written by Nicole Hemsoth at .
If operating systems or server firmware had better isolation and workload scheduling software, the last decade of server virtualization in the datacenter might never had happened. …
Future Clouds Could Be Just Containers On Bare Metal was written by Timothy Prickett Morgan at .
At some point, every company that has equity, venture, or public investors, has to start being profitable. …
Nutanix Closes Big Deals, But Profits Still Elude was written by Timothy Prickett Morgan at .
Over the past two decades, VMware has built an enviable enterprise customer base of half a million unique customers for its technology to virtualize X86 servers. …
VMware Always Sees A Cloudy Future was written by Daniel Robinson at .
With Moore’s Law running out of steam, the chip design wizards at Intel are going off the board to tackle the exascale challenge, and have dreamed up a new architecture that could in one fell swoop kill off the general purpose processor as a concept and the X86 instruction set as the foundation of modern computing. …
Intel’s Exascale Dataflow Engine Drops X86 And Von Neuman was written by Timothy Prickett Morgan at .
Over the last few years we have detailed the explosion in new machine learning systems with the influx of novel architectures from deep learning chip startups to efforts from vendors and hyperscalers alike. …
One Deep Learning Benchmark to Rule Them All was written by Nicole Hemsoth at .