About the Role
We are looking for an experienced
Lead / Data Engineering Architect
to design, build, and scale modern data platforms on
Microsoft Azure
. This role is ideal for someone who has deep expertise in
Azure Databricks
,
Azure Data Factory
, and other Azure data services—and who enjoys both hands-on development and architectural leadership.
Key Responsibilities
Data Architecture \& Design
Design scalable, secure, and high-performance data architectures on Azure.
Define data ingestion, transformation, modelling, and orchestration frameworks.
Ensure solutions follow best practices for data governance, quality, lineage, metadata, and CI/CD.
Hands-On Engineering
Build and optimize data pipelines using
Azure Databricks
(PySpark),
Azure Data Factory
,
Delta Lake
, and Azure Storage (ADLS Gen2).
Develop reusable data frameworks, ETL/ELT components, and automation scripts.
Optimize Spark jobs, cluster configuration, and cost.
Stakeholder Management
Translate business goals into technical designs.
Present architecture recommendations, roadmaps, and implementation plans to senior stakeholders.
Required Skills \& Experience
5+ years
of data engineering experience;
Strong hands-on experience with:
Azure Databricks
(PySpark, Delta Lake)
Azure Data Factory
Azure Data Lake Storage (ADLS)
Azure SQL / Synapse
Azure Functions, Azure DevOps CI/CD
Proven track record designing and implementing large-scale data pipelines (batch \& streaming).
Strong understanding of data modelling, distributed computing, and cloud-native architecture.
Experience with Git, CI/CD, Terraform/Bicep is a plus.
Experience in building Lakehouse architecture preferred