Crawler Hints supports Microsoft’s IndexNow in helping users find new content

Crawler Hints supports Microsoft’s IndexNow in helping users find new content
Crawler Hints supports Microsoft’s IndexNow in helping users find new content

The web is constantly changing. Whether it’s news or updates to your social feed, it’s a constant flow of information. As a user, that’s great. But have you ever stopped to think how search engines deal with all the change?

It turns out, they “index” the web on a regular basis — sending bots out, to constantly crawl webpages, looking for changes. Today, bot traffic accounts for about 30% of total traffic on the Internet, and given how foundational search is to using the Internet, it should come as no surprise that search engine bots make up a large proportion of that what might come as a surprise is how inefficient the model is, though: we estimate that over 50% of crawler traffic is wasted effort.

This has a huge impact. There’s all the additional capacity that owners of websites need to bake into their site to absorb the bots crawling all over it. There’s the transmission of the data. There’s the CPU cost of running the bots. And when you’re running at the scale of the Internet, all of this has a pretty big environmental footprint.

Part of the problem, though, is nobody had really stopped to ask: maybe Continue reading

Authority and Responsibility

Congratulations on your promotion! You’re now a manager or leader for your team. You now have to make sure everyone is getting their things done. That also means lots of reports and meetings with your manager about what’s happening and all the new rules that have to be followed in the future. Doesn’t this all sound nice?

In truth we all want to be able to help out as much as possible. Sometimes that means putting in extra work. For many it also means being promoted to a position of responsibility in a company leading a team or group of teams. That means you will have some new responsibilities and also some new authority. But what’s the difference? And why is one more foundational than the other?

Respect My Authority

Authority is “power to influence or command thought, opinion, or behavior”. It means you have the ability to tell people what to do. You give orders and they are followed. You tell your team the direction that you want things to go and it happens. If it doesn’t there are consequences. When you tell someone they are the boss this is what they usually picture.

Responsibility is “the quality of Continue reading

Heavy Networking 642: 10Mbps Single Pair Ethernet

Single pair Ethernet. That’s right. Ethernet over a single twisted pair, rather than the four you’re used to. Or two if you’ve got a little gray in your beard. Now, single pair Ethernet isn’t fast in the way we network engineers would normally think of fast. SPE runs at 10 megabits per second. But in the use cases SPE was designed for, 10Mbps is very fast indeed. To tell us all about single pair Ethernet is Peter Jones. Although Peter wears many hats in the networking industry, today he comes to the microphone as the chairperson of the Ethernet Alliance.

Heavy Networking 642: 10Mbps Single Pair Ethernet

Single pair Ethernet. That’s right. Ethernet over a single twisted pair, rather than the four you’re used to. Or two if you’ve got a little gray in your beard. Now, single pair Ethernet isn’t fast in the way we network engineers would normally think of fast. SPE runs at 10 megabits per second. But in the use cases SPE was designed for, 10Mbps is very fast indeed. To tell us all about single pair Ethernet is Peter Jones. Although Peter wears many hats in the networking industry, today he comes to the microphone as the chairperson of the Ethernet Alliance.

The post Heavy Networking 642: 10Mbps Single Pair Ethernet appeared first on Packet Pushers.

Technology Short Take 158

Welcome to Technology Short Take #158! What do I have in store for you this time around? Well, you’ll have to read the whole article to find out for sure, but I have links to articles on…well, lots of different topics! DNS, BGP, hardware-based security, Kubernetes, Linux—they’re all in here. Hopefully I’ve managed to find something useful for someone.

Networking

Servers/Hardware

Security

Is Kubernetes the Next Fault Domain?

Keith McClellan Keith McClellan is director, partner solutions engineering, at Cockroach Labs These days, most application architecture is distributed by default: connected microservices running in containers in a cloud environment. Organizations large and small now deploy thousands of containers every day — a complexity of scale that is almost incomprehensible. The vast majority of organizations depend upon Kubernetes (K8s) to orchestrate, automate and manage all these workloads. So what happens, then, when something happens with Kubernetes? A fault domain is the area of a distributed system that suffers the impact when a critical piece of infrastructure or network service experiences problems. Has Kubernetes become the next fault domain? Contemplating the disaster of a Kubernetes-related application failure is the stuff of DevOps nightmares. But in disaster, there is also opportunity: Kubernetes has the potential to help us have a common operating experience across data centers, cloud regions and even clouds by becoming the fault domain we design our high availability (HA) applications to survive. Kubernetes as Common Operating System Many distributed applications need to be distributed as close to users as possible, so let’s say we want to build a three-region cluster. Without Kubernetes, even in a single cloud, that means Continue reading

What are virtual routers and how can they lead to virtual data centers?

OK, you’re a CIO and when you go down to the data center, you see racks of routers, each with a maze of cabling.  When you hear “virtual routers” you think of all of that gone, replaced by mystical router instances floating about somewhere in the ether, and you smile.Or you’re a CFO who gets a bill for hundreds of branch routers, each picking your pocket on service charges and maybe software licenses.  You hear “virtual routers” and think of all those little hands going out of your pocket, and you smile.To read this article in full, please click here

What are virtual routers and how can they lead to virtual data centers?

OK, you’re a CIO and when you go down to the data center, you see racks of routers, each with a maze of cabling.  When you hear “virtual routers” you think of all of that gone, replaced by mystical router instances floating about somewhere in the ether, and you smile.Or you’re a CFO who gets a bill for hundreds of branch routers, each picking your pocket on service charges and maybe software licenses.  You hear “virtual routers” and think of all those little hands going out of your pocket, and you smile.To read this article in full, please click here

What are virtual routers and how can they lead to virtual data centers?

OK, you’re a CIO and when you go down to the data center, you see racks of routers, each with a maze of cabling.  When you hear “virtual routers” you think of all of that gone, replaced by mystical router instances floating about somewhere in the ether, and you smile.Or you’re a CFO who gets a bill for hundreds of branch routers, each picking your pocket on service charges and maybe software licenses.  You hear “virtual routers” and think of all those little hands going out of your pocket, and you smile.To read this article in full, please click here

Cisco embraces multi-cloud networking software

As large enterprises spread by deploying distributed data centers and on-prem or public-cloud services, their ability to control and manage applications and workloads utilizing that infrastructure is becoming more difficult.An emerging technology called multi-cloud networking software (MCNS) is coming together from a variety of vendors—Cisco, Arista, VMware, and F5 among them—to address many of these challenges. [ Get regularly scheduled insights by signing up for Network World newsletters. ] In a recent report Gartner said MCNS technology enables consistent networking policy, network security, governance, and network visibility across multiple cloud environments via a single point of management.To read this article in full, please click here

2022 attacks! An August reading list to go “Shields Up”

2022 attacks! An August reading list to go “Shields Up”
2022 attacks! An August reading list to go “Shields Up”

In 2022, cybersecurity is a must-have for those who don’t want to take chances on getting caught in a cyberattack with difficult to deal consequences. And with a war in Europe (Ukraine) still going on, cyberwar also doesn’t show signs of stopping in a time when there never were so many people online, 4.95 billion in early 2022, 62.5% of the world’s total population (estimates say it grew around 4% during 2021 and 7.3% in 2020).

Throughout the year we, at Cloudflare, have been making new announcements of products, solutions and initiatives that highlight the way we have been preventing, mitigating and constantly learning, over the years, with several thousands of small and big cyberattacks. Right now, we block an average of 124 billion cyber threats per day. The more we deal with attacks, the more we know how to stop them, and the easier it gets to find and deal with new threats — and for customers to forget we’re there, protecting them.

In 2022, we have been onboarding many customers while they’re being attacked, something we know well from the past (Wikimedia/Wikipedia or Eurovision are just two case-studies of many, Continue reading

1 … 456 457 458 459 460 … 3,841