Senior Data Engineer | Databricks | Microsoft Fabric NEW

Careerwise

We’re looking for an experienced Senior Data Engineer to join an innovative AI & Data team, building modern, scalable data platforms that power analytics, reporting, and AI/ML initiatives.

Location: Hybrid (2days in office) – London | Woking | South Cerney | Fareham
Employment Type: Permanent

Key Responsibilities:

• 8-12+ years of Data Engineering experience.
• Strong hands-on expertise with Databricks, PySpark, SQL, and Python.
• Experience designing Lakehouse architectures using Medallion Architecture.
• Deep knowledge of Delta Live Tables, Unity Catalog, Delta Sharing, and Databricks Workflows.
• Familiarity with newer Databricks capabilities such as Lakeflow Connect, Lakebase, Metric Views, and Genie.
• Experience with Microsoft Fabric and the broader Azure ecosystem.
• Strong data warehousing expertise, including Star Schema, Fact & Dimension modelling, SCD, and CDC.
• Proficient with Azure DevOps, Git, and CI/CD pipelines.
• Experience delivering scalable data platforms that support BI, analytics, and machine learning workloads

Required Skills:

• Databricks & Apache Spark (PySpark)
• Python & SQL
• Microsoft Fabric (preferred)
• Delta Live Tables, Unity Catalog, Delta Sharing, Workflows
• Medallion Architecture & Lakehouse concepts
• Data Warehouse design (Star Schema, Fact & Dimension Modelling, SCD, CDC)
• Azure DevOps, Git & CI/CD Pipelines
• Pandas and Databricks Notebooks

Nice to Have:
Azure Certifications (AZ-900, DP-203, DP-500)
Databricks Lakehouse Data Engineer Associate/Professional Certifications