Lead Data Engineer – Dublin (Hybrid)
💶
€605 per day \| 12-Month Contract (View to Extend)
We’re partnering with a
global payments leader
in Dublin who’s building next-generation data platforms to help financial institutions detect and prevent money laundering and fraud.
They’re now seeking a
Lead Data Engineer
to design and evolve a high-performance
Databricks + AWS lakehouse
, enabling advanced analytics and financial crime detection across global systems.
This is a hands-on leadership role for someone who can architect robust data pipelines, optimise performance at scale, and mentor other engineers — all within a collaborative, forward-thinking environment.
🚀
What You’ll Do
Design, build, and optimise
Spark / PySpark pipelines
on
Databricks
(batch + streaming)
Define and enforce
Medallion architecture standards
(bronze/silver/gold), schema governance, and data quality SLAs
Architect secure, scalable
AWS data infrastructure
(S3, Glue, Lake Formation, IAM, Lambda, Step Functions)
Implement orchestration workflows with
Airflow, Databricks Workflows
, and
Step Functions
Drive
CI/CD and infrastructure-as-code
using
Terraform / CloudFormation
Champion data lineage, metadata, and governance using
Unity Catalog, Glue
, or similar tools
Mentor data engineers and lead design sessions, promoting clean code, performance tuning, and cost efficiency
Collaborate with data science, compliance, and product teams to translate analytical needs into scalable data solutions
🧠
What We’re Looking For
7+ years’ experience in
data engineering
Expert in
Databricks, Spark, Python, and SQL
Strong AWS data ecosystem experience (
S3, Glue, Lake Formation, IAM, VPC
)
Proficiency with
Airflow
and
Databricks Workflows
for orchestration
Experience implementing
CI/CD pipelines
,
infrastructure as code
, and
data governance
frameworks
Knowledge of
Apache NiFi
,
Snowflake
, or
Delta Lake
is highly beneficial
Excellent communication and leadership skills, with a pragmatic and delivery-focused mindset
Background in
financial services
,
telecom
, or
insurance
preferred
🌍
Why Join
Hybrid role – 2/3 days onsite in Dublin
Competitive daily rate (€605)
12-month contract with potential to extend
Exposure to cutting-edge data engineering projects in financial crime prevention
Join a collaborative, technically strong global engineering team