Contract Data Engineer (Databricks) – AI Applications
6 Months – Inside IR35
We are seeking an experienced
Data Engineer
to join a multidisciplinary team delivering
AI-powered client-facing applications
. The role will focus on building and optimising data pipelines and platforms that enable advanced analytics and AI capabilities.
You will work within an
Agile/Scrum delivery team
, collaborating with engineers, analysts, and product stakeholders to support the development of scalable, high-quality data solutions.
The role is
primarily remote
, with
occasional travel to London
as required.
Key Responsibilities
Design and build
scalable data pipelines and data engineering solutions
to support AI-driven applications.
Develop and optimise data workflows using
Databricks
.
Automate processes and operational tasks using
PowerShell
.
Support data ingestion, transformation, and integration across multiple sources.
Work closely with data scientists and developers to enable
AI and analytics capabilities
.
Contribute actively to
Agile/Scrum ceremonies
and collaborative delivery practices.
Ensure high standards of
data quality, reliability, and performance
.
Essential Skills \& Experience
Strong experience working as a
Data Engineer
.
Hands-on experience with
Databricks
.
Proficiency in
PowerShell scripting and automation
.
Strong SQL and experience building
ETL/ELT data pipelines
.
Experience working in
Agile/Scrum delivery teams
.
Experience with
cloud data platforms (Azure preferred)
.
Desirable Skills
Experience with
Excel automation and VBA
.
Experience supporting
AI / machine learning data pipelines
.
Familiarity with
CI/CD for data platforms
.
Personal Attributes
Strong
team player
with collaborative working style.
Comfortable working in
fast-paced Agile environments
.
Strong problem-solving and communication skills.
Delivery-focused and proactive.
Contract:
6 months
IR35:
Inside IR35
Location:
Mostly remote with occasional travel to London