Abstract

How to build a sustainable data engineering pipeline for a small/medium or even large enterprise? What are the essential elements to build a working data engineering process? During this session you will get the chance to learn and discuss what components and steps are needed to build a small project with Streamlit and Apache Airflow in Python able to scale into production systems and even in an enterprise setting.

An example of a project created during PythonBiellaGroup evening sessions will also be shown.