
Principal Data Engineer in TECHNOLOGY DATA SERVICES
at Bank of England
Posted a day ago
No clicks
- Compensation
- £72,320 – £81,360 GBP
- City
- Not specified
- Country
- United Kingdom
Currency: £ (GBP)
Principal Data Engineer will design, implement, and support scalable data pipelines on the Bank's cloud data platform, leading innovative data-centric products and predictive analytics. You will act as a technical leader and advisor, shaping how data is designed, governed, and used across technology, governance, and business areas, while ensuring security, compliance, and cost efficiency. The role includes setting engineering standards, mentoring senior engineers, and driving cross-bank initiatives and platform modernisation. Based in Leeds with flexible working options and occasional travel to London.
Location: Leeds, United Kingdom
Principal Data Engineer, Technology Directorate
Permanent
Full Time
Location - Leeds
Flexible Working Options
This role is open to flexible working patterns, these may include:
- Job share
- Flexible start and end time to each day
- Ability to adapt calendar as needed, this could be to fit in the school run, gym, or appointments
- A 50% in-office attendance requirement can be spread across the month to accommodate diverse working patterns, such as the flexibility to purchase a weekly train ticket for certain weeks
- Compressed hours (subject to approval and policy within the team)
- Working from abroad policy (subject to approval and policy within the team)
A Day in the Role:
Your day starts with aligning across programmes and teams, ensuring the Bank’s data initiatives are moving in the right strategic direction. Apart from focusing on your individual tasks, you also concentrate on the bigger picture - identifying risks, guiding priorities, and shaping how teams work together.
Throughout the day, you act as a technical leader and strategic advisor, helping define how the organisation designs, governs, and uses data. You work with senior stakeholders across technology, governance, and business areas to ensure the platform remains trusted, scalable, efficient, and compliant.
A key part of your role is setting standards and enabling others: guiding engineering approaches, mentoring senior colleagues, and helping teams adopt consistent patterns that raise quality and accelerate delivery across the organisation.
You also contribute to cross‑Bank initiatives — from modernisation programmes to long‑term platform strategy — influencing decisions that shape how the Bank manages and uses data in the future.
By the end of the day, your impact is measured not in code delivered, but in clarity provided, decisions unblocked, teams strengthened, and strategic direction reinforced.
Opportunities in Leeds
We’re excited to be growing our presence in Leeds, a city we’ve been connected to for nearly 200 years! Our modern, accessible office in the City Centre offers a supportive, flexible working environment. The majority of roles, including this one, are now available in Leeds, giving you the chance to build a meaningful career outside of London while contributing to our mission from a dynamic and growing location. You’ll work collaboratively with London-based colleagues in a hybrid model, with regular opportunities to travel into the London office to meet and connect together in person.
Want to learn more? Discover what makes our Leeds office such a dynamic place to work by visiting our Leeds page for more details.
About Us
We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable! We continuously evolve our offerings, using modern cloud-based technologies, and foster strong partnerships to help our colleagues in the Bank navigate the complexities of a data-driven world and achieve their strategic objectives.
Job Description
The use of data within Central Banking is evolving. The combination of data being collected at scale and significant advances in data technology has created the need to expand our Data Engineering team in Data Services. We are building the Bank’s strategic cloud data platform to host products that solve real-world problems while putting customers at the centre. The Principal Data Engineer will play a pivotal role in designing, implementing, and supporting data pipelines on the Bank’s data platform. You will lead innovative, data-centric products and predictive analysis work while developing automated solutions that continuously improve data engineering across the Bank. Your technical leadership will establish a centre of excellence, ensure regulatory compliance, and deliver smart, customer-focused designs.
Role Requirements
- Design, develop, test, and deploy scalable, cost-effective, and secure distributed architectures using Azure services such as Azure Data Factory and Azure Databricks.
- Collaborate with cross-functional teams to translate business and technical requirements into innovative, automated solutions.
- Continuously innovate and evolve data ingestion and transformation framework design and implementation to meet modern data platform needs while providing comprehensive guidelines for customers.
- Manage the technical relationship with one or more Azure Data product groups, identifying common solution patterns and developing reusable frameworks.
- Lead the identification of dependencies and produce detailed design documents for data pipeline solutions.
- Leverage subject-matter expertise to drive project and release plans with key stakeholders including SMEs and Product Owners.
- Participate in organisation-wide projects and steering committees while devising strategies for containerisation, orchestration, and API management.
- Design robust data replication architectures and implement methods to integrate AI and ML into platform and backend solutions in line with responsible AI principles.
- Collaborate with the data governance team to enforce a comprehensive data catalogue, maintain detailed dataset descriptions, and ensure adherence to security and privacy regulations.
- Work with Cloud teams and key stakeholders to optimise cloud costs using FinOps principles and enforce data platform-centric FinOps policies.
- Provide mentorship and coaching to data engineers on modern tools and technologies in Azure, data pipeline management, coding practices, design principles, and implementation patterns.
Minimum Criteria
- Extensive experience in data engineering on an Azure data platform, with a strong background in modernization and large-scale migration projects. Proven ability to coach and mentor others effectively in a senior capacity
- Demonstrable experience designing and managing metadata-driven frameworks using Azure Data Factory and Azure Databricks.
- Competence in and hands-on experience managing Databricks environments and developing lakehouse architectures with a focus on automation, performance tuning, cost optimisation, and system reliability.
- Proven proficiency in programming languages such as Python, T-SQL, and PySpark, with practical knowledge of test-driven development.
- Demonstrated capability in building secure, scalable data solutions on Azure with an in-depth understanding of data security and regulatory compliance, using tools like Microsoft Purview and Unity Catalog.
Essential Criteria
- Proven ability to coach and mentor others effectively in a senior capacity, showcasing leadership skills.
- Excellent communication and collaboration skills with a track record of building and managing teams effectively.
- In-depth knowledge of data engineering practices and tools, including strategic decision-making within cloud environments.
- Strong problem-solving and adaptability to manage complex and dynamic projects.
Desirable Criteria
- Excellent leadership and communication skills with a proven track record in mentoring teams and driving data modernisation initiatives.
- Experience working with advanced containerisation and orchestration tools such as Azure Container Instances or Kubernetes.
- Prior experience designing and implementing AI/ML driven solutions within data platforms.
- Relevant certifications such as Azure Data Engineer Associate, Azure Solutions Architect, or equivalent industry credentials.
- Advanced academic qualifications or industry accolades that complement practical experience in data engineering and cloud technologies.
- Experience in DevOps practices using Azure DevOps and GitHub Actions, designing automated CI/CD pipelines and implementing Infrastructure as Code(terraform, ARM templates, or Azure Bicep)
- Currently a non-contributory, career average pension giving you a guaranteed retirement benefit of 1/80th of your annual salary for every year worked. There is the option to increase your pension (to 1/65th) or decrease (to 1/105th) in exchange for salary through our flexible benefits programme each year. The Bank has the discretion to vary standard accrual rates and dial up and dial down rates at any time and to withdraw dial up and dial down options at any time.
- A discretionary performance award based on a current award pool.
- An 8% benefits allowance with the option to take as salary or purchase a wide range of flexible benefits.
- 26 days’ annual leave with option to buy up to 12 additional days through flexible benefits.
- Private medical insurance and income protection.
The Bank of England welcomes applications from all candidates, but as a UK Visas and Immigration (UKVI) approved sponsor, we have a responsibility to comply with the Immigration Rules and guidance. As such, our ability to employ individuals who require sponsorship for immigration purposes is limited. The Bank cannot guarantee that you and / or the role you are applying for will be eligible for sponsorship and that any application made to UKVI will be successful. Eligibility will therefore be considered on a case by case basis.

