In this article, we describe how we orchestrate Kafka, Dataflow and BigQuery together to ingest and transform a large stream of events. When adding scale and latency constraints, reconciling and reordering them becomes a challenge, here is how we tackle it.

In digital advertising, day-to-day operations generate a lot of events we need to track in order to transparently report campaign’s performances. These events come from:
- Users’ interactions with the ads, sent by the browser. These events are called tracking events and can be standard (start, complete, pause, resume, etc.) or custom events coming from interactive creatives built with Teads Studio. We receive about 10 billion tracking events a day.
- Events coming from our back-ends, regarding ad auctions’ details for the most part (real-time bidding processes). We generate more than 60 billion of these events daily, before sampling, and should double this number in 2018.
In the article we focus on tracking events as they are on the most critical path of our business.


Nokia wins a 50-percent share of the multi-vendor deal with China Mobile. The two companies are also working together on software-defined networking for China Mobile to expand its cloud offering.
The trials will begin in New York City and Salt Lake City using mmWave spectrum, software-defined radios, edge cloud, and advanced optical networking.
The white paper helps companies meet industrial Internet of Things security goals and prioritize spending.
The South Korean operator plans to talk about 5G trials at the 5G New Horizon Symposium in Austin, Texas, next month.
The cloud-native software company said it will price 37 million Class A shares between $14 and $16 per share.

Analyst firm Redmonk found that many projects remain heavily reliant on the companies that initially donated code, though Kubernetes remains an exception.