Lead Data Engineer ( Databricks ) London – Hybrid – RemotePermanent£100,000 – £130,000 plus up to 20% bonus based on performance and commercial contribution
We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.
You’ll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.
Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.Architect robust, scalable data platforms using the medallion architecture.Translate business requirements into scalable workflows, advising on data governance, quality, and security.Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.Guide teams in implementing best practices across engineering, DevOps, and model deployment.Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.Lead a team of data engineers, fostering a collaborative and growth-oriented environment.Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.
8+ years in data engineering, with at least 2+ in a technical leadership role~ Proven experience designing and leading Databricks-based data platforms~ Deep understanding of the medallion architecture , data lakehouse design, and transformation workflows~ Hands-on expertise with DLT , Unity Catalog , and model deployment frameworks~ Experience in agile delivery environments and cross-functional teams~ Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets
Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)Familiarity with platform and DevOps collaboration , especially on AWS or AzureCertifications in Databricks or cloud platforms (AWS/Azure)Be the go-to technical leader on projects with real-world business impactCareer progression into Delivery Lead , Practice Lead , or Pre-Sales SpecialistCompetitive compensation and strong bonus structure, aligned with delivery and commercial impact
To find out more about this high profile Lead Data Engineering position, click apply….