Data Engineering Specialist

Data Engineering Specialist

===============================

Job Req ID: 51781

Posting Date: 6 Oct 2025

Function: Security

Unit: Business

Location:

Orion Building B62-MH, Ipswich, United Kingdom

Salary: Competitive Salary +Benefits

Recruiter: Krystle James

Career Grade: D

Internal Closing Date: 16/10/25

Security isn’t always the first thing that comes to mind when you think of BT, but when it comes to keeping everyone safely connected, We Are The Protectors. We deal with thousands of cyber-attacks every day, so that millions of people can safely go about their daily lives and run their businesses. We deliver vital work at scale, with real breadth and impact. We connect for good.

You'll be joining a specialist security team that is a trusted partner to governments worldwide, protecting critical national infrastructure and committed to the safety and security of our nation and global communities. Our mission focused work is innovative, inspiring and technologically challenging in a way that makes every day different and stimulating. We provide the opportunity to work on rare projects, with exciting tools and brilliant people. Everyone has access to unparalleled professional and personal development opportunities and your contribution is always valued.

Why this job matters

We are seeking a highly experienced Data Engineering Specialist to join our team and drive the delivery of brilliant data solutions for our customers. This is a senior-level role requiring deep technical expertise, strategic thinking, and leadership in designing and implementing scalable data platforms.

You will work with extremely large data volumes, across real-time and batch processing pipelines, integrating data from diverse sources into on-premise and AWS cloud platforms. Your work will be pivotal in shaping the data landscape of the BT Group, enabling actionable insights and supporting our data-driven strategies.

This job role can be based in Ipswich, Cheltenham or Manchester. Onsite (5 days office based). Monday-Friday 37.5 hours per week. You will need to be eligible to obtain DV Clearance before starting this role. You will need to have lived in the UK for 10+ years to be eligible.

What you’ll be doing

As a Data Engineering Specialist, you will:

Design, code, test, and deploy robust data ingestion and transformation processes, ensuring data security and privacy.

Lead the development of architecture and design patterns for processing and storing high-volume datasets.

Drive complex projects, applying advanced technical knowledge to solve open-ended and ambiguous problems.

Champion Agile delivery practices, ensuring consistent quality and timely delivery.

Define and monitor key data quality indicators, enhancing visibility into pipeline and infrastructure health.

Essential Skills

Programming

Infrastructure Design

System Integration

Decision Making

Troubleshooting

What we'd like to see on your CV

We’re looking for expertise in:

Operating Systems: Linux

Big Data Technologies: Apache Spark, Kafka, NiFi, HBase, Airflow

Programming Languages: Python, Scala, C++

Data Platforms: AWS (S3, Glue, Redshift, EMR), On-premise Hadoop/K8s ecosystems

Databases \& Query Languages: Hive, HBase, SQL, NoSQL

Data Formats: JSON, Parquet, Avro, CSV

Version Control \& CI/CD: Git, Jenkins, Terraform, Artifactory

Monitoring \& Logging: Prometheus, Grafana, ELK Stack

Benefits

Competitive salary

BT Pension scheme, minimum 5% Employee contribution, BT contribution 10%

On-call allowance (Depending on role requirements)

25 days annual leave (not including bank holidays), increasing with service

Huge range of flexible benefits including cycle to work, healthcare, season ticket loan

World-class training and development opportunities

From January 2025, equal family leave: receive 18 weeks at full pay, 8 weeks at half pay and 26 weeks at the statutory rate. It’s for all parents, no matter how your family is made up.

Enhanced women’s health support: including help with menopause symptoms, cancer screenings, period care and more.

24/7 private virtual GP appointments for UK colleagues

2 weeks paid carer’s leave

World-class training and development opportunities

Option to join BT Shares Saving schemes.

Discounted broadband, mobile and TV packages

Access to 100’s of retail discounts including the BT shop

#LI-Onsite

Security is one of the fastest growing parts of our global organisation. We are protecting our networks from more than 6,500 cyber attacks each day, investing over £40m in research each year - and in employing nearly 3,000 people, we’re also the largest private cyber employer in the UK. With incredible opportunities to learn, develop and grow your skills, we’ll invest in you, nurture your potential and shape your future – whatever your background or experience.

In today’s world, safe and secure digital connections have never been more vital. You’ll be joining a global company operating at the forefront of the information age: BT employs 90,000 people in 180 countries. With huge scale, we’re capable of achieving great things, striving to be personal, simple, and brilliant for our customers whilst creating an inclusive working environment where people from all backgrounds can succeed. Play your part. Make a difference. We are the Protectors.

A FEW POINTS TO NOTE:

Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us.

DON'T MEET EVERY SINGLE REQUIREMENT?

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.