Contract: 12 months renewable
Location: Changi, Singapore
Role Summary:
We are seeking a dynamic and results-oriented Data Engineer with 3–5 years of experience in building scalable data pipelines, implementing data quality frameworks, and working across cloud platforms like GCP and AWS. The ideal candidate will have hands-on expertise in Apache Spark, Python, Scala, and BigQuery, and a strong background in both batch and real-time data processing.
Job Responsibilities:
Design, develop, and maintain scalable ETL pipelines using Apache Spark, Python, and Scala.
Implement data quality frameworks using tools like Great Expectations and BigQuery.
Lead data ingestion and harmonization efforts across enterprise systems (e.g., SAP ECC, MDG, Dynamics 365).
Collaborate with cross-functional teams to align data architecture with business needs.
Optimize performance of large-scale data workflows and troubleshoot issues in big data environments.
Orchestrate data pipelines using Apache Airflow or Cloud Composer.
Conduct performance tuning and ensure reliability of data applications.
Requirements:
1+ years of experience in Big Data technologies (Apache Spark, Hadoop, Hive).
Strong programming skills in Python and Scala.
Experience with cloud platforms: Google Cloud Platform (GCP) and AWS.
Proficiency in SQL and BigQuery.
Hands-on experience with data orchestration tools (Apache Airflow).
Familiarity with data quality frameworks
Bachelor's degree in IT, Computer Science, Engineering or related field