Data delivery and orchestration at Foursquare scale - good and bad practices, and lessons learned


Best Practicies & Success Stories

Date and time

Monday, 16. October 2023., 17:00


Hall C



Thousands of ETL delivery jobs. Hundreds of clusters.Computational infrastructure hitting AWS region limits, legacy technology meeting bleeding edge improvements, throttled AWS API calls, tight SLAs, ... Squeezing the last drop from Airflow, Luigi and other orchestration tools to meet the demands.On top of that, three acquisitions, three different tech stacks being merged into one...This is a talk about bad choices made, good decisions implemented, but above all, about what has been learned along the way.

Lecture details

Level of difficulty: General
Desirable listeners function: Software Developer or Architect , Data Engineer , Data Architect
Group of activity: Best Practicies & Success Stories

About speaker


The conference is organized by the Croatian Association of Oracle users & Croatian Java Users Association. 

Like us on Facebook

We post news, photos and other interesting facts on official JavaCro Facebook Page.

Follow us on Twitter

Keep up to date with all the news on Twitter!

Platinasti Pokrovitelj

Zlatni pokrovitelj

Srebreni pokrovitelji

Medijski pokrovitelji