Technology Short Take 106

Welcome to Technology Short Take #106! It’s been quite a while (over a month) since the last Tech Short Take, as this one kept getting pushed back. Sorry about that, folks! Hopefully I’ve still managed to find useful and helpful links to include below. Enjoy!

Networking

Servers/Hardware

  • The Intel Management Engine (ME) has received a bit of attention as a potential security vulnerability; in this article, authors Maxim Goryachy and Mark Ermolov expose some new concerns around the Intel ME and its undocumented Manufacturing Mode.
  • Serve The Home takes a critical look at the Bloomberg Supermicro stories, debunking or at least calling into question many details of the Continue reading

ApproxJoin: approximate distributed joins

ApproxJoin: approximate distributed joins Le Quoc et al., SoCC’18

GitHub: https://ApproxJoin.github.io

The join is a fundamental data processing operation and has been heavily optimised in relational databases. When you’re working with large volumes of unstructured data though, say with a data processing framework such as Flink or Spark, joins become distributed and much more expensive. One of the reasons for this is the amount of data that needs to be moved over the network. In many use cases, approximate results would be acceptable, and as we’ve seen before, likely much faster and cheaper to compute. Approximate computing with joins is tricky though: if you sample datasets before the join you reduce data movement, but also sacrifice up to an order of magnitude in accuracy; if you sample results after the join you don’t save on any data movement and the process is slow.

This paper introduces an approximate distributed join technique, ApproxJoin, which is able to sample before data shuffling without loss of end result accuracy. Compared to unmodified Spark joins with the same sampling ratio it achieves a speedup of 9x while reducing the shuffled data volume by 82x.

The following charts show ApproxJoin’s latency Continue reading

Cisco-AWS marriage simplifies hybrid-cloud app development

Cisco and Amazon Web Services (AWS) will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure, and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS, combines Cisco, AWS and open-source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications on premises and across the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC. “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Cisco-AWS marriage simplifies hybrid-cloud app development

Cisco and Amazon Web Services (AWS) will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure, and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS, combines Cisco, AWS and open-source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications on premises and across the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC. “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Cisco-AWS marriage simplifies hybrid-cloud app development

Cisco and Amazon Web Services (AWS) will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure, and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS, combines Cisco, AWS and open-source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications on premises and across the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC. “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Cisco, Amazon marriage simplifies hybrid cloud app development

Cisco and Amazon Web Services will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS combines Cisco, AWS and open source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications across on-premises and the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC.  “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Cisco, Amazon marriage simplifies hybrid cloud app development

Cisco and Amazon Web Services will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS combines Cisco, AWS and open source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications across on-premises and the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC.  “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Cisco, Amazon marriage simplifies hybrid cloud app development

Cisco and Amazon Web Services will soon offer enterprise customers an integrated platform that promises to help them more simply build, secure and connect Kubernetes clusters across private data centers and the AWS cloud.The new package, Cisco Hybrid Solution for Kubernetes on AWS combines Cisco, AWS and open source technologies to simplify complexity and helps eliminate challenges for customers who use Kubernetes to enable deploying applications across on-premises and the AWS cloud in a secure, consistent manner said David Cope, senior director of Cisco Cloud Platform & Solutions Group (CPSG).[ Also see How to plan a software-defined data-center network and Efficient container use requires data-center software networking.] “The significance of Amazon teaming with Cisco means  more integration between product lines from AWS and Cisco, thus reducing the integration costs notably on the security and management fronts for joint customers," said Stephen Elliot, program vice president with IDC.  “It also provides customers with some ideas on how to migrate workloads from private to public clouds.”To read this article in full, please click here

Which cloud performs better, AWS, Azure or Google?

Most IT professionals select cloud providers based on price or proximity to users, but network performance should also be considered. Because as we see in a new report from ThousandEyes, the underlying network architecture of the big cloud providers can have a significant impact on performance. And performance varies widely among cloud service providers.In its first annual public cloud benchmark report, ThousandEyes compared the global network performance of the “big three” public cloud providers — Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure. The network management company looked at network performance (latency, packet loss, jitter) and connectivity architecture. It also measured user-to-cloud connectivity from 27 cities around the globe to 55 AWS, Azure, and GCP regions and measured the inter-AZ and inter-region connectivity within all three cloud provider networks. In addition, they measured inter-region connectivity between all 55 regions on a multi-cloud basis.To read this article in full, please click here

Which cloud performs better, AWS, Azure or Google?

Most IT professionals select cloud providers based on price or proximity to users, but network performance should also be considered. Because as we see in a new report from ThousandEyes, the underlying network architecture of the big cloud providers can have a significant impact on performance. And performance varies widely among cloud service providers.In its first annual public cloud benchmark report, ThousandEyes compared the global network performance of the “big three” public cloud providers — Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure. The network management company looked at network performance (latency, packet loss, jitter) and connectivity architecture. It also measured user-to-cloud connectivity from 27 cities around the globe to 55 AWS, Azure, and GCP regions and measured the inter-AZ and inter-region connectivity within all three cloud provider networks. In addition, they measured inter-region connectivity between all 55 regions on a multi-cloud basis.To read this article in full, please click here

The network matters for public cloud performance

Most IT professionals select cloud providers based on price or proximity to users, but network performance should also be considered. Because as we see in a new report from ThousandEyes, the underlying network architecture of the big cloud providers can have a significant impact on performance. And performance varies widely among cloud service providers.In its first annual public cloud benchmark report, ThousandEyes compared the global network performance of the “big three” public cloud providers — Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure. The network management company looked at network performance (latency, packet loss, jitter) and connectivity architecture. It also measured user-to-cloud connectivity from 27 cities around the globe to 55 AWS, Azure, and GCP regions and measured the inter-AZ and inter-region connectivity within all three cloud provider networks. In addition, they measured inter-region connectivity between all 55 regions on a multi-cloud basis.To read this article in full, please click here

Network Troubleshooting Webinar on Safari Books

I just redid my slides for the network troubleshooting seminar I teach on Safari Books from time to time. This new set of slides should make for a better webinar. The outline now covers—

Segment 1: Foundations
Length: 50 minutes

  • MTTR, MTBM, MTBM
  • Resiliency in terms of troubleshooting
  • Positive feedback loops
  • Automated processes and fragility
  • The troubleshooting process
  • Avoiding the narrows
  • Using models to dive deeper
  • Using abstraction to counter the combinatorial explosion
  • When abstractions leak
  • What, how, and why models

10 Minute Break

Segment 2: Process
Length: 50 minutes

  • The theory of half split, as seen from search trees
  • Putting it together: a simple troubleshooting loop and the half-split
  • Using manipulability theory to prove it
  • Observations on observations

10 Minute Break

Segment 3: Examples
Length: 50 minutes

  • The EIGRP case
  • The BGP case
  • IS-IS and BFD

10 minute final Question and Answer Period

You can register here. Note the name of the seminar is changing, so the URL might change, as well.