Data delivery and orchestration at Foursquare scale - good and bad practices, and lessons learned

Track

Best Practicies & Success Stories

Datum i vrijeme

ponedjeljak, 16. listopad 2023., 17:00

Dvorana

Dvorana C

Trajanje

45'

Thousands of ETL delivery jobs. Hundreds of clusters.Computational infrastructure hitting AWS region limits, legacy technology meeting bleeding edge improvements, throttled AWS API calls, tight SLAs, ... Squeezing the last drop from Airflow, Luigi and other orchestration tools to meet the demands.On top of that, three acquisitions, three different tech stacks being merged into one...This is a talk about bad choices made, good decisions implemented, but above all, about what has been learned along the way.

Detalji o predavanju

Razina težine: Općenito
Poželjna funkcija slušatelja: Razvojni inženjer ili softverski arhitekt , Data Engineer , Data Architect
Grupa aktivnosti: Best Practicies & Success Stories

O predavaču

Organizatori

Konferenciju organiziraju Hrvatska udruga Oracle korisnika i Hrvatska udruga Java korisnika. 

Prati nas na Facebooku

Novosti, fotografije i zanimljivosti objavljujemo na službenoj Facebook stranici JavaCro konferencije.

Prati nas na Twitteru

Sve novosti i zanimljivosti vezane uz JavaCro objavljujemo i na Twitteru!

Platinasti Pokrovitelj

Zlatni pokrovitelj

Srebreni pokrovitelji

Medijski pokrovitelji