Senior Data Engineer

Role: Senior Data Engineer Duration: 6 Months (Initial) IR35 Status: Outside IR35 Location: Remote (but ideally North West based) We are looking for a driven, hands-on Senior Data Engineer to take ownership of developing our Azure-based data platform. You will build end-to-end ingestion, transformation, and modelling pipelines that deliver reliable, high-quality data for analytics.

Key Deliverables

• Pipeline Engineering: Design, build, and optimise scalable Azure data pipelines using Azure Data Lake, Synapse Analytics, and Logic Apps.
• Framework Development: Build metadata-driven, reusable ingestion frameworks for structured, semi-structured, and unstructured data using Azure Synapse and Python.
• Data Transformation: Develop robust transformation pipelines using SQL and Spark within Azure Synapse, utilizing Delta Lake for incremental loading, versioning, and schema evolution.
• D365 Finance Integration: Own the integration between the data platform and our D365 ERP system to secure consistent, daily processing of financial store sales data.
• Engineering Standards: Embed strong data quality, validation, lineage, error handling, automated testing, and CI/CD deployment workflows.
• Collaborative Delivery: Partner with senior engineers, finance analysts, and external providers to translate integration requirements into scalable, well-documented cloud-native solutions.

What We Are Looking For

• 3+ years of professional Data Engineering experience within a cloud or enterprise environment.
• Deep Azure Expertise: Hands-on mastery of Azure Synapse, Azure Data Factory (ADF), and Azure Data Lake.
• Strong Coding Skills: Advanced SQL, Python, and PySpark skills for complex transformations, automation, and query optimisation.
• Modern Data Architecture: Solid understanding of Delta Lake concepts and scalable cloud data design.
• Integration Experience: Proven history of connecting APIs, cloud platforms, and file-based systems; D365 or ERP data integration experience is a massive plus.
• DevOps Practice: Familiarity with Git, Azure DevOps, CI/CD pipelines, and data quality testing frameworks

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates