Data Engineer
Azure, Databricks, Python, Azure Data Factory
London - Hybrid
(2 days in the office)
£60,000 to £70,000
+ bonus and benefits
We are working with a leading Lloyd's and London Market insurer who are continuing to invest heavily in their cloud data platform. This role sits within a specialist data engineering team responsible for building and evolving Markel's Azure based data architecture.
You will work on a modern Azure data stack including Databricks, Azure Data Factory, Synapse and Data Lake, helping to design and develop scalable data pipelines that support underwriting, analytics and wider business reporting.
This is an excellent opportunity for a Data Engineer with a few years of Azure experience who is looking to deepen their cloud engineering capability within a highly collaborative and technically strong team.
Responsibilities
Design and develop cloud based data solutions using Azure technologies including Databricks, Azure Data Factory, Synapse and ADLS
Build and optimise data pipelines using Python, SQL and Spark
Support the ingestion and transformation of data from multiple global systems into the Azure data platform
Work closely with data engineers, architects and product owners to deliver new data capabilities
Contribute to CI/CD pipelines and DevOps practices within the data engineering environment
Collaborate with stakeholders across the business to understand and deliver data requirements
Requirements
Experience working as a Data Engineer within an Azure environment
Strong SQL and Python development skills
Exposure to Databricks, Azure Data Factory, Synapse or Azure Data Lake
Experience building ETL or ELT pipelines and working with large datasets
Familiarity with DevOps practices such as Git and CI/CD
Strong communication skills and experience working within Agile teams
Experience within Financial Services or the London Market insurance sector would be advantageous but is not essential.
This role would suit an ambitious Data Engineer with around four to five years' experience who is looking to work with modern Azure technologies and continue developing their technical skillset in a supportive team environment.
Contact Alex: alexh@pioneer-search.com or apply below for immediate consideration