Skip to content
All roadmaps

Data Engineer roadmap

Build reliable data pipelines: SQL, Python, Spark, orchestration and warehouses.

Interview questions for this role
0% complete0 done · 0 skipped · ~245h left
  1. 1

    Foundations

    SQL and Python first.

    • SQL including joins and window functions

      basic~40h

      Why it matters: SQL is tested in every data engineering interview.

    • Python for data

      basic~40h

      Why it matters: Pipelines and glue code are written in Python.

    • Linux and Git

      basic~15h

      Why it matters: Jobs run on servers and ship through version control.

    Milestone: Can you load a CSV into a database with Python and answer business questions in SQL?

  2. 2

    Core

    Modelling, ETL and big data.

    • Data modelling and warehousing

      intermediate~25h

      Why it matters: Star schemas and normalisation decide analytics quality.

    • Apache Spark

      intermediate~40h

      Why it matters: Spark is the standard for large-scale processing.

    • Orchestration with Airflow

      intermediate~25h

      Why it matters: Scheduling, retries and dependencies make pipelines reliable.

    Milestone: Can you build a scheduled pipeline that loads, transforms and validates data daily?

  3. 3

    Job-ready

    Cloud and streaming.

    Milestone: Can you design an end-to-end batch plus streaming pipeline on one cloud?