Responsibilities
Design, develop, and maintain robust, scalable, and reliable data pipelines and ETL/ELT processes.
Write and optimize scalable data processing jobs using Spark (preferably PySpark) within the AWS Glue environment.
Develop and maintain data transformation logic using dbt to create clean, reliable datasets for analytics.
Build and manage data workflows and orchestration using AWS MWAA (Managed Workflows for Apache Airflow).
Develop, test, and debug complex Airflow DAGs to schedule and monitor Spark jobs, dbt runs, and other data pipeline tasks.
Write and optimize complex SQL queries for data extraction, transformation, and analysis using services like Amazon Athena.
Manage access control and security for data resources using AWS IAM policies and roles.
Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver appropriate solutions.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure data quality and integrity.
Contribute to the documentation of data processes, pipelines, and architecture.
Requirements
At least 2.5 years of hands-on experience in a Data Engineering role.
Solid understanding of core data engineering concepts, modern data warehousing, and ETL/ELT principles.
Proficiency in writing and optimizing distributed data processing jobs using Spark (PySpark highly preferred).
Proven experience with core AWS data services, including S3, Glue, Athena, MWAA, and IAM.
Hands-on experience with data transformation tools, specifically dbt.
Proficiency in Python and writing efficient, maintainable, and debuggable Airflow DAGs.
Strong SQL skills with the ability to write complex queries and perform performance tuning.
Excellent analytical and problem-solving skills.
Strong communication skills and the ability to work effectively in a collaborative team environment.
(Preferred) Knowledge or hands-on experience with Infrastructure as Code (IaC) tools, particularly Terraform.
Open-minded and willing to work in an international team
Good at speaking English
Having the following skill/experience/certification is a bonus
Data Engineering certifications from Microsoft, IBM, and Cloudera.
Data Management Association International (DAMA) or Certified Data Management Professional (CDMP) certification.
Benefits
:
Salary: Up to 50M
An international, professional, young, but innovative and dynamic environment, working closely with international experts and joining conferences and workshops on exciting new technologies.
Full benefits for employees according to the Vietnam Labor Laws: social and health insurance
Holidays based on the Vietnamese labor law + paid vacations
Opportunity to be on-site in the US
Add1
: 12th Floor, Technopark tower, Vinhomes Ocean Park, Gia Lam, Hanoi
Add2:
HL building, Duy Tan, Cau Giay, Hanoi