You are viewing content from a past/completed QCon Plus - November 2020

Track Overview

Modern Data Engineering

In the "old" days, data engineering was all about getting data from a transactional data store to a data warehouse, whereby it enabled business analysts to create reports and gain insights. In this track we’ll explore the ways in which data engineering has changed in the last few years and has become key to the success of products and companies - new requirements breed new solutions. Data & data engineering are used to power mission critical production applications, create powerful network effects, predict user behavior and drive cutting-edge AI. Come to this track to learn about recent advances in the theory and practice of data engineering.


From this track

Session

Serverless Search for My Blog With Java, Quarkus, & AWS Lambda

Tuesday Nov 17 / 01:00PM EST

A Serverless app? With Java?! Absolutely!We’ll discuss when Serverless is a great fit (and when it isn’t!) and why you don’t need to leave the Java platform when going Serverless. Based on the real-world example of a Serverless blog search, you’ll learn how Quarkus and...

Gunnar Morling

Open Source Software Engineer @RedHat

Session

Designing IoT Data Pipelines for Deep Observability

Tuesday Nov 17 / 01:50PM EST

Millions of IoT devices emitting trillions of events per day enable us to track the health of the Tesla fleet. From a data engineering perspective, it's a challenging scale, but what makes it unique is how naturally fragile the data pipeline is. The physical world is full of chaos: what if...

Shrijeet Paliwal

Sr. Staff Software Engineer @Tesla

Session

Building Latency Sensitive User Facing Analytics via Apache Pinot

Tuesday Nov 17 / 02:40PM EST

Real-time analytics has become the need of the hour for modern Internet companies. The ability to derive internal insights around business metrics, user growth & adoption as well as security incidents from all the raw logs is crucial for day to day operation. Even more critical is enabling...

Chinmay Soman

PMC Member/Commiter @SamzaStream

PANEL DISCUSSION

Modern Data Engineering Panel

Tuesday Nov 17 / 03:30PM EST

Data Engineering is a vast field that concerns itself with efficient access to data based on the needs of a business. Though data is the prized entity from which a company extracts insights, data doesn't exist in a void. It first needs to be stored somewhere and then an API needs to be...

Shrijeet Paliwal

Sr. Staff Software Engineer @Tesla

Chinmay Soman

PMC Member/Commiter @SamzaStream

Chris Riccomini

Distinguished Engineer @WePay


Speakers from this track

Gunnar Morling

Open Source Software Engineer @RedHat

Gunnar Morling is a software engineer and open-source enthusiast by heart. He is leading the Debezium project, a tool for change data capture (CDC). He is a Java Champion, the spec lead for Bean Validation 2.0 (JSR 380) and has founded multiple open source projects such as Deptective and...

Read more
Find Gunnar Morling at:

Shrijeet Paliwal

Sr. Staff Software Engineer @Tesla

Shrijeet is a founding member of data platform team at Tesla, tasked to build a scalable, self-served, cost-efficient data platform that caters everything data at Tesla. He has his hands all the way from improving server provisioning & automation to writing multi-petabyte time series storage....

Read more

Chinmay Soman

PMC Member/Commiter @SamzaStream

Chinmay Soman has been working in the distributed systems domain for the past 10+ years. He started out in IBM where he worked on distributed file systems and replication technologies. He then joined the Data Infrastructure team in LinkedIn and worked on open source technologies such as Voldemort...

Read more
Find Chinmay Soman at:

Chris Riccomini

Distinguished Engineer @WePay

Chris Riccomini is a software engineer, startup investor, and advisor with more than a decade of experience at major tech companies such as PayPal, LinkedIn, and WePay. He has been involved in open source throughout his career and is the author of Apache Samza. He's recently written The...

Read more
Find Chris Riccomini at:

Track Date

Tuesday Nov 17 / 12:00PM EST

Share

Register

Register for QCon Plus
May 10 - 20, 2022

Register

Track Host

Sid Anand

Chief Architect @Datazoom, PMC @ApacheAirflow

Sid Anand currently serves as the Chief Architect for Datazoom. Prior to joining Datazoom, Sid served as PayPal's Chief Data Engineer, focusing on ways to realize the value of data. Prior to joining PayPal, he held several positions including Agari's Data Architect, a Technical Lead in...

Read more
Find Sid Anand at:

Less than

22

weeks until QCon Plus May 2022

Level-up on the emerging software trends and practices you need to know about.

Deep-dive with world-class software leaders at QCon Plus (Nov 1-12, 2021).

Save your spot for $499 before January 10th

Register