Data Engineer NEW

Oliver James Associates Ltd.
Data Engineer – Data Migration Programme London (Hybrid) Contract – up to £500/d (outside IR35)

Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client – a fast-scaling European digital infrastructure provider with 100+ sites across the continent – is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.

You’ll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform – working closely with the Data Workstream Lead, business SMEs, and application teams.

What you’ll be doing:

• Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling
• Implementing source-to-target mappings and transformation logic for the migration
• Owning data validation, reconciliation, and defect resolution through migration test cycles
• Building reusable migration frameworks – ingestion pipelines, validation routines, error-handling
• Supporting CI/CD, Git-based release processes via Azure DevOps

What you’ll bring:

• Extensive data engineering/integration/migration experience
• Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines
• Strong SQL – profiling, transformation, validation, reconciliation
• PySpark/Spark SQL notebook experience (Databricks or Fabric)
• Proven experience on a data migration project end-to-end (extraction through reconciliation)
• Microsoft Fabric experience is a bonus, not a requirement – strong Azure Databricks/Synapse background welcomed

Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.