How Cloudflare analyzes 1M DNS queries per second

On Friday, we announced DNS analytics for all Cloudflare customers. Because of our scale –– by the time you’ve finished reading this, Cloudflare DNS will have handled millions of DNS queries –– we had to be creative in our implementation. In this post, we’ll describe the systems that make up DNS Analytics which help us comb through trillions of these logs each month.

How logs come in from the edge

Cloudflare already has a data pipeline for HTTP logs. We wanted to utilize what we could of that system for the new DNS analytics. Every time one of our edge services gets an HTTP request, it generates a structured log message in the Cap’n Proto format and sends it to a local multiplexer service. Given the volume of the data, we chose not to record the full DNS message payload, only telemetry data we are interested in such as response code, size, or query name, which has allowed us to keep only ~150 bytes on average per message. It is then fused with processing metadata such as timing information and exceptions triggered during query processing. The benefit of fusing data and metadata at the edge is that we can spread Continue reading

You really should know what the Andrew File System is

When I saw that the creators of the Andrew File System (AFS) had been named recipients of the $35K ACM Software System Award, I said to myself "That's cool, I remember AFS from the days of companies like Sun Microsystems... just please don't ask me to explain what the heck it is."Don't ask my colleagues either. A quick walking-around-the-office survey of a half dozen of them turned up mostly blank stares at the mention of the Andrew File System, a technology developed in the early 1980s and named after Andrew Carnegie and Andrew Mellon. But as the Association for Computing Machinery's award would indicate, AFS is indeed worth knowing about as a foundational technology that paved the way for widely used cloud computing techniques and applications.To read this article in full or to leave a comment, please click here

You really should know what the Andrew File System is

When I saw that the creators of the Andrew File System (AFS) had been named recipients of the $35K ACM Software System Award, I said to myself "That's cool, I remember AFS from the days of companies like Sun Microsystems... just please don't ask me to explain what the heck it is."Don't ask my colleagues either. A quick walking-around-the-office survey of a half dozen of them turned up mostly blank stares at the mention of the Andrew File System, a technology developed in the early 1980s and named after Andrew Carnegie and Andrew Mellon. But as the Association for Computing Machinery's award would indicate, AFS is indeed worth knowing about as a foundational technology that paved the way for widely used cloud computing techniques and applications.To read this article in full or to leave a comment, please click here

The next 5 years in AI will be frenetic, says Intel’s new AI chief

Research into artificial intelligence is going gangbusters, and the frenetic pace won't let up for about five years -- after which the industry will concentrate around a handful of core technologies and leaders, the head of Intel's new AI division predicts.Intel is keen to be among them. In March, it formed an Artificial Intelligence Products Group headed by Naveen Rao. He previously was CEO of Nervana Systems, a deep-learning startup Intel acquired in 2016. Rao sees the industry moving at breakneck speed."It's incredible," he said. "You go three weeks without reading a paper and you're behind. It's just amazing."It wasn't so long ago that artificial intelligence research was solely the domain of university research labs, but tech companies have stormed into the space in the last couple of years and sent technical hurdles tumbling.To read this article in full or to leave a comment, please click here

21% off 32GB Centon Electronics Sport USB DataStick – Deal Alert

Centon is offering their 32GB Sport USB 2.0 flash drive for just $1.37 more than their 8GB model with the current deal on Amazon. The Sport DataStick features a rugged rubberized casing and is designed to be waterproof up to 1.5M with a leakproof cap. If you're looking to pick up some inexpensive storage, see the discounted Centon Electronics Sport 32GB USB DataStick now on Amazon. To read this article in full or to leave a comment, please click here

Google I/O 2017: AI, IoT and VR/AR predictions

Google I/O 2017, Google’s other annual developer conference, begins next week (May 17). It is the other developer conference because Google filled the Moscone Center with 10,000 enterprise cloud developers at its Cloud Next conference last March. Compared that to the 7,000 attendees at Google I/O 2016. The two conferences explain two different developer audiences and Google’s cloud growth ambitions.The list of code labs at Google I/O 2017 confirms this: accessibility, ads, Android, Android devices, Google Assistant, Firebase, IoT, location & maps, machine learning & AI, Flutter, mobile web, Google Play, virtual reality. Though many developers attending I/O will attend both conferences, this is a much different schedule than Cloud Next.To read this article in full or to leave a comment, please click here

Comparing the performance of popular public DNS providers

ThousandEyes, a network intelligence company with the ability to monitor performance from hundreds of vantage points across the Internet, has insight into a variety of services across the globe, including public DNS service providers.  In this article we’ll dive into our results from testing 10 of the most popular public DNS resolvers, with the goal of helping you make informed conclusions about your choice of provider. We observed a wide range of performance across different services, both globally and from region to region.

The Domain Name System (DNS) is the internet’s system for converting alphabetic web addresses into numeric IP addresses. If a given service’s DNS records are unavailable, the service is effectively down and inaccessible to everyone.  DNS can also have a substantial impact on page load time and web page performance. While it’s just the first step of many in the page load process (see the below image), any increase in DNS lookup time will directly increase load times. DNS lookup time, in turn, is directly affected by latency to the DNS server.

To read this article in full, please click here

Comparing the performance of popular public DNS providers

ThousandEyes, a network intelligence company with the ability to monitor performance from hundreds of vantage points across the Internet, has insight into a variety of services across the globe, including public DNS service providers.  In this article we’ll dive into our results from testing 10 of the most popular public DNS resolvers, with the goal of helping you make informed conclusions about your choice of provider. We observed a wide range of performance across different services, both globally and from region to region.

The Domain Name System (DNS) is the internet’s system for converting alphabetic web addresses into numeric IP addresses. If a given service’s DNS records are unavailable, the service is effectively down and inaccessible to everyone.  DNS can also have a substantial impact on page load time and web page performance. While it’s just the first step of many in the page load process (see the below image), any increase in DNS lookup time will directly increase load times. DNS lookup time, in turn, is directly affected by latency to the DNS server.

To read this article in full or to leave a comment, please click here

Comparing the performance of popular public DNS providers

ThousandEyes, a network intelligence company with the ability to monitor performance from hundreds of vantage points across the Internet, has insight into a variety of services across the globe, including public DNS service providers.  In this article we’ll dive into our results from testing 10 of the most popular public DNS resolvers, with the goal of helping you make informed conclusions about your choice of provider. We observed a wide range of performance across different services, both globally and from region to region.

The Domain Name System (DNS) is the internet’s system for converting alphabetic web addresses into numeric IP addresses. If a given service’s DNS records are unavailable, the service is effectively down and inaccessible to everyone.  DNS can also have a substantial impact on page load time and web page performance. While it’s just the first step of many in the page load process (see the below image), any increase in DNS lookup time will directly increase load times. DNS lookup time, in turn, is directly affected by latency to the DNS server.

To read this article in full or to leave a comment, please click here

Comparing the performance of popular public DNS providers

ThousandEyes, a network intelligence company with the ability to monitor performance from hundreds of vantage points across the Internet, has insight into a variety of services across the globe, including public DNS service providers.  In this article we’ll dive into our results from testing 10 of the most popular public DNS resolvers, with the goal of helping you make informed conclusions about your choice of provider. We observed a wide range of performance across different services, both globally and from region to region.The Domain Name System (DNS) is the internet’s system for converting alphabetic web addresses into numeric IP addresses. If a given service’s DNS records are unavailable, the service is effectively down and inaccessible to everyone.  DNS can also have a substantial impact on page load time and web page performance. While it’s just the first step of many in the page load process (see the below image), any increase in DNS lookup time will directly increase load times. DNS lookup time, in turn, is directly affected by latency to the DNS server.To read this article in full or to leave a comment, please click here

Comparing the performance of popular public DNS providers

ThousandEyes, a network intelligence company with the ability to monitor performance from hundreds of vantage points across the Internet, has insight into a variety of services across the globe, including public DNS service providers.  In this article we’ll dive into our results from testing 10 of the most popular public DNS resolvers, with the goal of helping you make informed conclusions about your choice of provider. We observed a wide range of performance across different services, both globally and from region to region.The Domain Name System (DNS) is the internet’s system for converting alphabetic web addresses into numeric IP addresses. If a given service’s DNS records are unavailable, the service is effectively down and inaccessible to everyone.  DNS can also have a substantial impact on page load time and web page performance. While it’s just the first step of many in the page load process (see the below image), any increase in DNS lookup time will directly increase load times. DNS lookup time, in turn, is directly affected by latency to the DNS server.To read this article in full or to leave a comment, please click here

Worth Reading: Value constrains us

I only take part in a few services, and I’m not consistently active on any of them. Despite however many followers I might have on a given platform, the world doesn’t care what I have to say on those services so much that my contributions especially matter. Therefore, stepping back isn’t harming anyone, nor is it disappointing someone that I’m not saying something or participating in every conversation that I might. No one notices. —Ethan Banks

The post Worth Reading: Value constrains us appeared first on rule 11 reader.

IDG Contributor Network: Artificial intelligence tool fixes password weakness

Flaws in passwords can be eliminated with artificial intelligence (AI), say researchers. This includes identifying common words that hackers know, too. The mending is accomplished with AI-garnered analysis of existing insecure passwords, coupled with feedback to the user based on that. It makes password creation more reliable, say scientists from Carnegie Mellon University and the University of Chicago.+ Also on Network World: Vendors approve of NIST password draft + The group says it’s no good simply telling users their password isn’t secure when they attempt to create one—like the current password strength meters do using colored graphs. The meter should tell the creator what’s wrong with the secret word and advise how to conjure up a better one.To read this article in full or to leave a comment, please click here

IDG Contributor Network: Artificial intelligence tool fixes password weakness

Flaws in passwords can be eliminated with artificial intelligence (AI), say researchers. This includes identifying common words that hackers know, too. The mending is accomplished with AI-garnered analysis of existing insecure passwords, coupled with feedback to the user based on that. It makes password creation more reliable, say scientists from Carnegie Mellon University and the University of Chicago.+ Also on Network World: Vendors approve of NIST password draft + The group says it’s no good simply telling users their password isn’t secure when they attempt to create one—like the current password strength meters do using colored graphs. The meter should tell the creator what’s wrong with the secret word and advise how to conjure up a better one.To read this article in full or to leave a comment, please click here

Nvidia’s new Volta-based DGX-1 supercomputer puts 400 servers in a box

You won't need to buy a rack of 400 servers if you have one high-powered Nvidia DGX-1 supercomputer with a Volta GPU sitting on your desktop.The DGX-1 supercomputer -- which looks like a regular rack server -- gets most of its computing power from eight Tesla V100 GPUs.The GPU, the first one based on the brand-new Volta architecture, was introduced at the company's GPU Technology Conference in San Jose, California, on Wednesday."It comes out of the box, plug it in and go to work," said Nvidia's CEO Jen-Hsun Huang during a keynote speech.But the DGX-1 with Tesla V100 computer is expensive. At US$149,000, it's worth some people's life savings. But Huang encouraged people to order it, saying the box will ship in the third quarter.To read this article in full or to leave a comment, please click here

Nvidia’s new Volta-based DGX-1 supercomputer puts 400 servers in a box

You won't need to buy a rack of 400 servers if you have one high-powered Nvidia DGX-1 supercomputer with a Volta GPU sitting on your desktop.The DGX-1 supercomputer -- which looks like a regular rack server -- gets most of its computing power from eight Tesla V100 GPUs.The GPU, the first one based on the brand-new Volta architecture, was introduced at the company's GPU Technology Conference in San Jose, California, on Wednesday."It comes out of the box, plug it in and go to work," said Nvidia's CEO Jen-Hsun Huang during a keynote speech.But the DGX-1 with Tesla V100 computer is expensive. At US$149,000, it's worth some people's life savings. But Huang encouraged people to order it, saying the box will ship in the third quarter.To read this article in full or to leave a comment, please click here

Microsoft’s new tools help devs manage cloud deployments on the go

Microsoft is making it easier for developers to manage their cloud deployments on the go, using a new mobile app and browser-based command line.On Wednesday, the company unveiled Azure Cloud Shell, which lets developers spin up a full-fledged terminal environment inside Microsoft’s cloud and comes with a set of preconfigured tools for managing deployments. Each user will have persistent file storage in their Cloud Shell, hosted in Microsoft Azure.Cloud Shells are accessible through the Microsoft Azure web portal, as well as the Azure mobile app for iOS and Android, which was just released Wednesday. That app also provides users with the ability to monitor the workloads they have running in Microsoft’s public cloud and perform basic management like stopping and restarting virtual machines.To read this article in full or to leave a comment, please click here

1 … 1,996 1,997 1,998 1,999 2,000 … 3,763