Our client, one of Asia-Pacific’s leading organizations is looking for:
Data Engineer
Responsibilities:
Design and implement enterprise-scale data architectures, including data lakes, warehouses, and real-time streaming platforms.
Develop and maintain ETL/ELT pipelines that efficiently process large volumes of structured and unstructured data from diverse sources.
Hands-on development of Databricks notebooks using PySpark, Python, and SQL for ETL automation.
Create and optimise PySpark scripts for efficient data extraction, transformation, and loading from large datasets.
Implement custom data manipulation, validation, and error handling solutions to enhance ETL robustness.
Lead code reviews, establish best practices, and drive adoption of modern data engineering tools and methodologies.
Monitor and optimise data pipeline performance, implementing solutions for scalability and cost-effectiveness.
Conduct testing, debugging, and troubleshooting of data transformation processes. Verify data integrity throughout pipeline stages and resolve complex technical issues.
Requirements:
Bachelor's Degree in Computer Science, Engineering, Data Science, or related field
AWS cloud platform expertise (Redshift, S3, Glue, EMR, Kinesis, Lambda)
Databricks platform proficiency with PySpark, Python, and SQL implementation
Data warehouse design and implementation (Amazon Redshift, Snowflake on AWS)
ETL/ELT migration project experience and pipeline development
Real-time streaming technologies (Kinesis Data Streams, Kafka)
Data exchange platforms and API integration (AWS Data Exchange, Partner APIs)
-
Interested applicants can also email CV at asmita@nsearchglobal.com (for faster processing, please state the exact job / position title applied “Data Engineer”
Only shortlisted candidates will be notified.
-
EA License Number: 10C3636
EA Personnel Name: Asmita Chauhan
EA Personnel Registration Number: R1980706
By applying for this role, you have read and acknowledge the Data Privacy statement - http://www.nsearchglobal.com/data-protection-notice/