Lead Data Engineer

Lead Data Engineer Leeds- Hybrid working £85,000-£90,000 Robert Walters are delighted to be partnering with an 8 figure turnover business based in Leeds, they’re going through a period of transformation at the minute and will be looking to bring in a Lead Data Engineer to be at the forefront of it this greenfield project. They’re seeking someone with Fabric experience but Azure/AWS experience would be a huge advantage.

Lead Data Engineer duties:

• Lead the end-to-end design and development of a new, cloud-based data platform, with a focus on scalability, performance, and security to support business-wide data initiatives.
• Act as the subject matter expert for Microsoft Fabric, shaping its implementation and integration within the organisation’s cloud environment (currently AWS, with potential future migration to Azure).
• Define and implement best-in-class data engineering practices for ingestion, transformation, storage, and orchestration, ensuring the foundation is robust for future analytics, reporting, and AI/ML initiatives.
• Collaborate closely with cross-functional stakeholders including data analysts, data scientists, and business leaders to gather requirements and translate them into scalable data solutions.
• Architect and build scalable data pipelines and ETL/ELT processes, leveraging modern cloud-native tools and services within AWS and/or Azure ecosystems.
• Drive data modelling, data governance, and data quality standards, ensuring the platform is compliant with security and regulatory requirements.
• Provide technical leadership and mentorship to a growing data engineering team, establishing coding standards, development workflows, and peer review processes.
• Work closely with Cloud Architects and DevOps teams to design secure, reliable, and cost-effective infrastructure for the new data platform.
• Continuously evaluate emerging technologies and tools within the Microsoft Fabric ecosystem and broader cloud data landscape to drive ongoing improvement and innovation.
• Lead migration and integration strategies, should the organisation choose to transition from AWS to Azure, ensuring minimal disruption and data integrity throughout.

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates