Announcing Pub/Sub: Programmable MQTT-based Messaging

One of the underlying questions that drives Platform Week is “how do we enable developers to build full stack applications on Cloudflare?”. With Workers as a serverless environment for easily deploying distributed-by-default applications, KV and Durable Objects for caching and coordination, and R2 as our zero-egress cost object store, we’ve continued to discuss what else we need to build to help developers both build new apps and/or bring existing ones over to Cloudflare’s Developer Platform.

With that in mind, we’re excited to announce the private beta of Cloudflare Pub/Sub, a programmable message bus built on the ubiquitous and industry-standard MQTT protocol supported by tens of millions of existing devices today.

In a nutshell, Pub/Sub allows you to:

• Publish event, telemetry or sensor data from any MQTT capable client (and in the future, other client-facing protocols)
• Write code that can filter, aggregate and/or modify messages as they’re published to the broker using Cloudflare Workers, and before they’re distributed to subscribers, without the need to ferry messages to a single “cloud region”
• Push events from applications in other clouds, or from on-prem, with Pub/Sub acting as a programmable event router or a hook into persistent data storage (such as R2 or Continue reading

How we built config staging and versioning with HTTP applications

Last December, we announced a closed beta of a new product, HTTP Applications, giving customers the ability to better control their L7 Cloudflare configuration with versioning and staging capabilities. Today, we are expanding this beta to all enterprise customers who want to participate. In this post, I will talk about some of the improvements that have landed and go into more detail about how this product works.

HTTP Applications

A quick recap of what HTTP Applications are and what they can do. For a deeper dive on how to use them see the previous blog post.

As previously mentioned: HTTP Applications are a way to manage configuration by use case, rather than by hostname. Each HTTP Application has a purpose, whether that is handling the configuration of your marketing website or an internal application. Each HTTP Application consists of a set of versions where each represents a snapshot of settings for managing traffic — Page Rules, Firewall Rules, cache settings, etc.  Each version of configuration inside the HTTP Application is independent of the others, and when a new version is created, it is initialized as a copy of the version that preceded it.

An HTTP Application can be represented with Continue reading

Introducing Custom Domains for Workers

Today, we’re happy to announce Custom Domains for Workers. Custom Domains allow you to hook up a domain to your Worker, without having to fuss about certificates, origin servers or DNS – it just works. Let’s take a look at how we built Custom Domains and how you can use them.

The magic of Cloudflare DNS

Under the hood, we’re leveraging Cloudflare DNS to register your Worker as the origin for your domain. All you need to do is head to your Worker, go to the Triggers tab, and click Add Custom Domain. Cloudflare will handle creating the DNS record and issuing a certificate on your behalf. In seconds, your domain will point to your Worker, and all you need to worry about is writing your code. We’ll also help guide you through the process of creating these new records and replace any existing ones. We built this with a straightforward ethos in mind: we should be clear and transparent about actions we’re taking, and make it easy to understand.

We’ve made a few welcome changes when you’re using a Custom Domain on your Worker. First off, when you send a request to any path on that Custom Domain, your Continue reading

Introducing Pages Plugins

Last November, we announced that Pages is now a full-stack development platform with our open beta integration with Cloudflare Workers. Using file-based routing, you can drop your Pages Functions into a /functions folder and deploy them alongside your static assets to add dynamic functionality to your site. However, throughout this beta period, we observed the types of projects users have been building, noticed some common patterns, and identified ways to make these users more efficient.

There are certain functionalities that are shared between projects; for example, validating authorization headers, creating an API server, reporting errors, and integrating with third-party vendors to track aspects like performance. The frequent need for these patterns across projects made us wonder, “What if we could provide the ready-made code for developers to add to their existing project?”

Introducing Pages Plugins!

What’s a Pages Plugin?

With Pages Functions, we introduced file-based routing, so users could avoid writing their own routing logic, significantly reducing the amount of boilerplate code a typical application requires. Pages Plugins aims to offer a similar experience!

A Pages Plugin is a reusable – and customizable – chunk of runtime code that can be incorporated anywhere within your Pages application. A Continue reading

Our growing Developer Platform partner ecosystem

Deploying an application to the cloud requires a robust network, ample storage, and compute power. But that only covers the architecture, it doesn’t include all the other tools and services necessary to build, deploy, and support your applications. It’s easy to get bogged down in researching whether everything you want to use works together, and that takes time away from actually developing and building.

Cloudflare is focused on building a modern cloud with a developer-first experience. That developer experience includes creating an ecosystem filled with the tools and services developers need.

Deciding to build an application starts with the planning and design elements. What programming languages, frameworks, or runtimes will be used? The answer to that question can influence the architecture and hosting decisions. Choosing a runtime may lock you into using specific vendors. Our goal is to provide flexibility and eliminate the friction involved when wanting to migrate on to (or off) Cloudflare.

You can’t forget the tools necessary for configuration and interoperability. This can include areas such as authentication and infrastructure management. You have multiple pieces of your application that need to talk with one another to ensure a secure and seamless experience. We support and build standards Continue reading

Magic NAT: everywhere, unbounded, and lower cost

Network Address Translation (NAT) is one of the most common and versatile network functions, used by everything from your home router to the largest ISPs. Today, we’re delighted to introduce a new approach to NAT that solves the problems of traditional hardware and virtual solutions. Magic NAT is free from capacity constraints, available everywhere through our global Anycast architecture, and operates across any network (physical or cloud). For Internet connectivity providers, Magic NAT for Carriers operates across high volumes of traffic, removing the complexity and cost associated with NATing thousands or millions of connections.

What does NAT do?

The main function of NAT is in its name:  NAT is responsible for translating the network address in the header of an IP packet from one address to another - for example, translating the private IP 192.168.0.1 to the publicly routable IP 192.0.2.1. Organizations use NAT to grant Internet connectivity from private networks, enable routing within private networks with overlapping IP space, and preserve limited IP resources by mapping thousands of connections to a single IP. These use cases are typically accomplished with a hardware appliance within a physical network or a managed service delivered by Continue reading

Introducing Workers Analytics Engine

Today we’re excited to introduce Workers Analytics Engine, a new way to get telemetry about anything using Cloudflare Workers. Workers Analytics Engine provides time series analytics built for the serverless era.

Workers Analytics Engine uses the same technology that powers Cloudflare’s analytics for millions of customers, who generate 10s of millions of events per second. This unique architecture provides significant benefits over traditional metrics systems – and even enables our customers to build analytics for their customers.

Why use Workers Analytics Engine

Workers Analytics Engine can be used to get telemetry about just about anything.

Our initial motivation for building Workers Analytics Engine was to help internal teams at Cloudflare better understand what’s happening in their Workers. For example, one early internal customer is our R2 storage product. The R2 team is using the Analytics Engine to measure how many reads and writes happen in R2, how many users make these requests, how many bytes are transferred, how long the operations take, and so forth.

After seeing quick adoption from internal teams at Cloudflare, we realized that many customers could benefit from using this product.

For example, Workers Analytics Engine can also be used to build custom security rules. You Continue reading

Western Digital unveils 26TB hard drives, 15TB enterprise SSD

Western Digital introduced new high-capacity and high-performance products this week during its What’s Next event in San Francisco.First up, WD announced it is sampling conventional 22TB and shingled 26TB hard disk drives to cloud service providers, with widescale availability expected this summer. The drives, named Ultrastar DC HC570 for the 22TB version and DC HC670 for the 26TB version, are what WD calls UltraSMR disk drives. It's a means of packing greater amounts of data onto a disk platter.  Western Digital WD’s previous high-end drive was the 20TB Ultrastar DC HC560. It packed 2.2TB per platter and came with nine platters. The two new drives managed to pack a tenth platter into a 3.5 drive form factor. All of these drives are helium-filled to reduce friction of the spinning platters and feature Western Digital’s triple-stage actuator (TSA) with multiple independent read/write heads.To read this article in full, please click here

Western Digital unveils 26TB hard drives, 15TB enterprise SSD

Western Digital introduced new high-capacity and high-performance products this week during its What’s Next event in San Francisco.First up, WD announced it is sampling conventional 22TB and shingled 26TB hard disk drives to cloud service providers, with widescale availability expected this summer. The drives, named Ultrastar DC HC570 for the 22TB version and DC HC670 for the 26TB version, are what WD calls UltraSMR disk drives. It's a means of packing greater amounts of data onto a disk platter.  Western Digital WD’s previous high-end drive was the 20TB Ultrastar DC HC560. It packed 2.2TB per platter and came with nine platters. The two new drives managed to pack a tenth platter into a 3.5 drive form factor. All of these drives are helium-filled to reduce friction of the spinning platters and feature Western Digital’s triple-stage actuator (TSA) with multiple independent read/write heads.To read this article in full, please click here

Nokia launches SaaS services to tackle energy consumption and home device management

Nokia has announced two new Software-as-a-Service (SaaS) offerings, aimed at helping communication service providers (CSPs) and enterprise customers reduce energy consumption across their networks and automate device management control for smart home devices.The first, dubbed Nokia Analytics Virtualization and Automation (AVA) for Energy SaaS, uses artificial intelligence to monitor network traffic and help reduce the amount of connectivity resources used during periods of low demand. It also looks to spot network anomalies and benchmark the energy efficiency of passive infrastructure, such as batteries and power supplies. Nokia says AVA for Energy SaaS can help CSPs achieve up to five-fold energy savings.To read this article in full, please click here

Is Fibre Channel Still a Thing?

Here’s another “do these things ever disappear?” question from Enrique Vallejo:

Regarding storage, is Fibre Channel still a thing in 2022, or most people employ SATA over Ethernet and NVMe over fabrics?

TL&DR: Yes. So is COBOL.

To understand why some people still use Fibre Channel, we have to start with an observation made by Howard Marks: “Storage is different.” It’s OK to drop a packet in transit. It’s NOT OK to lose data at rest.

Is Fibre Channel Still a Thing?

Here’s another “do these things ever disappear?” question from Enrique Vallejo:

Regarding storage, is Fibre Channel still a thing in 2022, or most people employ SATA over Ethernet and NVMe over fabrics?

TL&DR: Yes. So is COBOL.

To understand why some people still use Fibre Channel, we have to start with an observation made by Howard Marks: “Storage is different.” It’s OK to drop a packet in transit. It’s NOT OK to lose data at rest.

Cisco issues alert for defective memory sticks in its servers

Cisco is urging customers to replace flawed memory sticks in some of its Unified Computing System (UCS) servers before they fail.The problem is caused by a manufacturing error in 24 dual in-line memory modules (DIMM) that exhibit persistent correctable memory errors that if left in place could knock the servers offline. The problem is found in 16GB, 32GB, and 64GB memory DIMMs. [ Get regularly scheduled insights by signing up for Network World newsletters. ] Cisco describes the flaws as manufacturing deviations that affect memory modules used to make up the DIMMs. All of the problem parts were manufactured during the middle-to-end of 2020, according to a Cisco alert.To read this article in full, please click here

Cisco issues alert for defective memory sticks in its servers

Cisco is urging customers to replace flawed memory sticks in some of its Unified Computing System (UCS) servers before they fail.The problem is caused by a manufacturing error in 24 dual in-line memory modules (DIMM) that exhibit persistent correctable memory errors that if left in place could knock the servers offline. The problem is found in 16GB, 32GB, and 64GB memory DIMMs. [ Get regularly scheduled insights by signing up for Network World newsletters. ] Cisco describes the flaws as manufacturing deviations that affect memory modules used to make up the DIMMs. All of the problem parts were manufactured during the middle-to-end of 2020, according to a Cisco alert.To read this article in full, please click here

Google Stands Up Exascale TPUv4 Pods On The Cloud

It is Google I/O 2022 this week, among many other things, and we were hoping for an architectural deep dive on the TPUv4 matrix math engines that Google hinted about at last year’s I/O event. …

Google Stands Up Exascale TPUv4 Pods On The Cloud was written by Timothy Prickett Morgan at The Next Platform.

Red Hat debuts edge features for Linux, Kubernetes platform security

Red Hat, one of the open source software world's biggest players, rolled out a raft of new features for its flagship enterprise Linux distribution — several of which were focused on edge computing — this week at its annual Summit gathering,The Red Hat Edge initiative is a project designed to streamline the processes of deploying and managing edge infrastructure, and, under its banner, the company announced several new features like automation technology via Ansible and advanced cluster management for Kubernetes, among others.To read this article in full, please click here

Red Hat debuts edge features for Linux, Kubernetes platform security

Red Hat, one of the open source software world's biggest players, rolled out a raft of new features for its flagship enterprise Linux distribution — several of which were focused on edge computing — this week at its annual Summit gathering,The Red Hat Edge initiative is a project designed to streamline the processes of deploying and managing edge infrastructure, and, under its banner, the company announced several new features like automation technology via Ansible and advanced cluster management for Kubernetes, among others.To read this article in full, please click here

Hedge 129: Open Source Mentoring

Mentoring is a topic we return to time and again—because it’s one of the most important things we can talk about in terms of building your people skills, your knowledge, and your career. On this episode of the Hedge, Guedis Cardenas joins Tom Ammon and Russ White to talk about open source mentoring. We discuss how this is different than “regular” mentoring, and how it’s the same. Join us as we talk about one of the most important career and personal growth things you can do.

download

Juniper’s enterprise networking business on a roll

Enterprise networking has never been so prominent for Juniper Networks as it is right now.For the first time in Juniper’s history, its enterprise networking business was the largest of its three core divisions – cloud, service provider and enterprise – in the first quarter of 2022. Enterprise networking revenue grew 18% year-over-year in Q1 to $433 million, while Q1 cloud and service provider revenue came in at $307 million and $428 million, respectively.A variety of things came together to make that happen – everything from pent-up demand and pandemic-delayed network refresh cycles to enterprise digital transformation and an influx of spending to support hybrid workers, said Manoj Leelanivas, Juniper Networks' chief operating officer, in an interview ahead of the company’s Global Summit event this week. To read this article in full, please click here

Juniper’s enterprise networking business on a roll

Enterprise networking has never been so prominent for Juniper Networks as it is right now.For the first time in Juniper’s history, its enterprise networking business was the largest of its three core divisions – cloud, service provider and enterprise – in the first quarter of 2022. Enterprise networking revenue grew 18% year-over-year in Q1 to $433 million, while Q1 cloud and service provider revenue came in at $307 million and $428 million, respectively.A variety of things came together to make that happen – everything from pent-up demand and pandemic-delayed network refresh cycles to enterprise digital transformation and an influx of spending to support hybrid workers, said Manoj Leelanivas, Juniper Networks' chief operating officer, in an interview ahead of the company’s Global Summit event this week. To read this article in full, please click here