Data Engineer (AWS) NEW

SmartSourcing Ltd

Data Engineer (AWS) 12-month FTC, Canary Wharf, London

One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension.

This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts.

What you ll do:

• Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.
• Spend most of your time on hands-on technical work with support for learning and professional development.
• Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.
• Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.
• Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.
• Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
• Apply Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
• Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).
• Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions.

What you ll need:

• Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)
• An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)
• Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)
• Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
• Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
• Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences

SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all.