Identifying impactful service system problems via log analysis

Identifying impactful service system problems via log analysis He et al., ESEC/FSE’18

If something is going wrong in your system, chances are you’ve got two main sources to help you detect and resolve the issue: logs and metrics. You’re unlikely to be able to get to the bottom of a problem using metrics alone (though you might well detect one that way), so that leaves logs as the primary diagnosis tool. The online service at Microsoft used as the main case study in the paper produces dozens of Terabytes of logs every day.

Logs play a crucial role in the diagnosis of modern cloud-based online service systems. Clearly, manual problem diagnosis is very time-consuming and error-prone due to the increasing scale and complexity of large-scale systems.

Log3C analyses logs to look for indications of impactful problems, using correlated KPIs as a guide. It finds these needles in the haystack with an average precision of 0.877 and an average recall of 0.883. A distributed version of Log3C has been deployed and used in production at Microsoft for several years, both to support a massive online service (we are not told which one), and integrated into “Product B” where Continue reading

How to pick an off-site data-backup method

Everyone agrees that backups should be sent off site, but not everyone agrees on how that should be accomplished. The decision about which method to use will affect your recovery-time objective (RTO), recovery-point objective (RPO), risk level, and cost – so it’s rather important.To read this article in full, please click here(Insider Story)

Sponsored Post: pMD, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

Who's Hiring?

  • pMD is a fast­ growing, highly rated health care technology company that has been recognized as a Best Place to Work by SF Business Times, Modern Healthcare, and Inc. Senior DevOps Engineer: Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast. You will bring best practices for automating the provisioning and patching of servers, replicating and versioning configuration changes, monitoring and alerting, deploying application and data store updates, and high availability / disaster recovery. Please apply here.

  • Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O(1), not O(n). Apply here.

  • Need excellent people? Advertise your job here! 

Fun and Informative Events

  • Advertise your event here!

Cool Products and Services


  • InMemory.Net provides a Dot Net native in memory database for analysing large amounts of data. It runs natively on .Net, and provides a native .Net, COM & ODBC apis for integration. It also has an easy to use Continue reading

The Importance of Container Visibility

Containers are unlike any other compute infrastructure. Prior to containers, compute infrastructure was composed of a set of brittle technologies that often took weeks to deploy. Containers made the automation of workload deployment mainstream, and brought workload deployment down to minutes, if not seconds.

Now, to be perfectly clear, containers themselves aren’t some sort of magical automation sauce that changed everything. Containers are something of a totem for IT operations automation, for a few different reasons.

Unlike the Virtual Machines (VMs) that preceded them, containers don’t require a full operating system for every workload. A single operating system can host hundreds or even thousands of containers, moving the necessary per-workload RAM requirement from several gigabytes to a few dozen megabytes. Similarly, containerized workloads share certain basic functions – libraries, for instance – from the host operating system, which can make maintaining key aspects of the container operating environment easier. When you update the underlying host, you update all the containers running on it.

Unlike VMs, however, containers are feature poor. For example, they have no resiliency: traditional vMotion-like workload migration doesn’t exist, and we’re only just now – several years after containers went mainstream – starting to get decent persistent Continue reading

On the ‘net: ATM

Asynchronous Transfer Mode, or ATM, was widely seen as a compromise technology that would provide the best circuit and packet switching in a single technology. Data would be input into the network in the form of either packets or circuits. The data would then be broken up into fixed sized cells, which would then be switched based on a fixed label-based header. This would allow hardware to switch the cells in a way that is like circuit switching, while retaining many of the advantages of a circuit switched network. In fact, ATM allowed for both circuit- and packet-switched paths to be both be used in the same network. @ECI’s LighTALK

IDG Contributor Network: Enterprise systems to monetize and bill for new IoT services

Enterprises adopt IoT solutions for two primary reasons. First, they want to lower their companies’ operating and capital costs. These types of IoT solutions including factory automation, remote asset monitoring, fleet management, and smart metering help enterprises improve their bottom lines by focusing on all sorts of cost reduction.Second, enterprises want to add IoT to the products they sell to their customers. This allows enterprises to bundle new connectivity-based services with their core products, thereby increasing revenue and differentiating their offerings. Examples of these types of IoT solutions include in-vehicle infotainment, connected welding equipment, connected commercial-grade power tools, and many more.To read this article in full, please click here

Cisco bets $660M on silicon-photonics firm Luxtera

Cisco says it is buying optical-semiconductor firm Luxtera for $660 million and will build its silicon photonics into future enterprise data-center, webscale, and service-provider networking gear.This photonic technology is essential to keep up with projected massive increases in IP traffic volume over the next four years, according to Cisco's networking chief."Optics is a fundamental technology to enable this future. Coupled with our silicon and optics innovation, Luxtera will allow our customers to build the biggest, fastest and most efficient networks in the world," said David Goeckeler, executive vice president and general manager, Networking and Security Business at CiscoTo read this article in full, please click here

Cisco bets $660M on silicon-photonics firm Luxtera

Cisco says it is buying optical-semiconductor firm Luxtera for $660 million and will build its silicon photonics into future enterprise data-center, webscale, and service-provider networking gear.This photonic technology is essential to keep up with projected massive increases in IP traffic volume over the next four years, according to Cisco's networking chief."Optics is a fundamental technology to enable this future. Coupled with our silicon and optics innovation, Luxtera will allow our customers to build the biggest, fastest and most efficient networks in the world," said David Goeckeler, executive vice president and general manager, Networking and Security Business at CiscoTo read this article in full, please click here

1 … 1,145 1,146 1,147 1,148 1,149 … 3,616