Job Overview:
We are searching for a skilled Databricks Developer with 4–6 years of experience in data engineering and big data development. The role focuses on developing, optimizing, and maintaining data pipelines on Databricks using Apache Spark, supporting lakehouse architectures, and delivering high-quality datasets for analytics and downstream consumption.
Key Responsibilities:
Develop, optimize, and maintain data pipelines using Databricks and Apache Spark (PySpark)
Build and manage Delta Lake tables for reliable and scalable data storage
Implement data transformations using Spark SQL and PySpark
Develop and schedule pipelines using Databricks Workflows (Jobs)
Apply data quality, performance tuning, and optimization best practices
Work closely with data engineers, analysts, and business teams
Monitor, troubleshoot, and support Databricks production workloads
Requirements:
4–6 years of experience in data engineering or Databricks development
Strong hands-on experience with Databricks and Apache Spark (PySpark)
Good understanding of Delta Lake and lakehouse architecture
Strong SQL and Python skills for data processing and transformation
Experience with performance tuning and troubleshooting in Databricks
EA License No: 24S2188
EA Personnel No: R23116335
EA Personnel Name: Poh Sook Hooi
Job Type: Full-time
Pay: $8,000.00 - $10,000.00 per month
Education:
Bachelor's or equivalent (Required)
Experience:
Databases: 4 years (Required)
Work Location: In person