Noria: dynamic, partially-stateful data-flow for high-performance web applications
Noria: dynamic, partially-stateful data-flow for high-performance web applications Gjengset, Schwarzkopf et al., OSDI’18
I have way more margin notes for this paper than I typically do, and that’s a reflection of my struggle to figure out what kind of thing we’re dealing with here. Noria doesn’t want to fit neatly into any existing box!
We’ve seen streaming data-flow engines that maintain state and offer SQL interfaces and even transactions (e.g. Apache Flink, and data Artisan’s Streaming Ledger for Flink). The primary model here is data-flow, and SQL is bolted on as an interface to the state. The title of this paper sets me off thinking along those lines, but from the end user perspective, Noria looks and feels more like a database. The SQL interface is primary, not ancillary, and it maintains relational data in base tables (using RocksDB as the storage engine). Noria makes intelligent use of data-flow beneath the SQL interface (i.e., dataflow is not exposed as an end-user programming model) in order to maintain a set of (semi-)materialized views. Noria itself figures out the most efficient data-flows to maintain those views, and how to update the data-flow graphs in the face of Continue reading

SDxCentral Weekly Wrap for Oct. 26, 2018. Nokia to Slash Thousands of Jobs Amid 5G Transformation
When it comes to hybrid cloud, “we are thinking about how to do that better,” said Google CEO Sundar Pichai.
One expert thinks these deals are being made at the behest of Japanese operators and won't resonate much outside of Japan.
As technology domains shift to support agile-based methodologies, DevOps processes, and programmability, the network must undergo this same transformative shift.
AWS cloud revenues are slightly down, but they're at an annualized run rate above $26 billion, compared to about $18 billion this time last year.
The cosmetic company’s digital business includes 35 brands across 140 countries. Prior to deploying Catchpoint, it didn’t have a way to diagnose network issues and sought a consolidated view of this business.
Microsoft completes GitHub purchase; Verizon names its fifth 5G city; Nokia and Samsung extend patent license agreement.