You are viewing content from a past/completed QCon - November 2020
Interactive Session

Modern Data Engineering Panel

Data Engineering is a vast field that concerns itself with efficient access to data based on the needs of a business. Though data is the prized entity from which a company extracts insights, data doesn't exist in a void. It first needs to be stored somewhere and then an API needs to be provided such that a client can access this data. Therein lie the opportunity and the challenge. We have seen an explosion in technologies in the field of data engineering (OLTP DBs, OLAP DBs, Data Streams, Big Data Processing, Search Engines, Graph Processing and Graph Serving Engines, Caches, Block and Object Stores, etc.... ). When you consider the myriad ways these puzzle pieces can be put together to build a modern data engineering stack, you soon find that no 2 stacks resemble one another. 

What does a data engineer need to know in order to be successful in today's world? What are some best practices, pitfalls, and ways to think about building a low cost-of-ownership, high-quality data platform? What technologies are non-starters and why? What technologies are hidden gems? Finally, what should the industry think about and what is coming next? Join our panel of experts as we explore these questions in order to shed light on these areas. 


Shrijeet Paliwal

Sr. Staff Software Engineer @Tesla
Shrijeet is a founding member of data platform team at Tesla, tasked to build a scalable, self-served, cost-efficient data platform that caters everything data at Tesla. He has his hands all the way from improving server provisioning & automation to writing multi-petabyte time series storage.... Read more


Chinmay Soman

PMC Member/Commiter @SamzaStream
Chinmay Soman has been working in the distributed systems domain for the past 10+ years. He started out in IBM where he worked on distributed file systems and replication technologies. He then joined the Data Infrastructure team in LinkedIn and worked on open source technologies such as Voldemort... Read more Find Chinmay Soman at:


Chris Riccomini

Distinguished Engineer @WePay
Software engineer. WePay, LinkedIn, PayPal. Co-author Apache Samza. Committer/PMC Apache Airflow. Read more Find Chris Riccomini at:

Build your learning journey and level-up on the skills most in-demand in 2021. Attend QCon Plus (May 17-28, 2021).

Save your spot for $599 before May 28th