👨🏻‍💻 postech.work

Data Engineer

Unison Group • 🌐 In Person

In Person Posted 1 week ago

Job Description

Key Responsibilities:

Migration \& Technical Implementation:

Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP)

Collaborate with AWS teams to develop comprehensive migration strategies and implementation plans

Re-architect existing Python scripts and UiPath automation workflows for AWS SageMaker or Glue scripts

Design and implement robust data pipelines and ETL processes within AWS environment

Migrate Tableau dashboards to AWS QuickSight whilst maintaining full functionality

Establish data connections from multiple sources (HRPS, Gateway, SharePoint, Microsoft Lists, FormSG, MS Access)

Ensure seamless transition with zero disruption to existing data operations

Documentation \& Knowledge Transfer:

Create comprehensive documentation for all new AWS processes and workflows

Develop training materials and conduct knowledge transfer sessions for end users

Support HR officers in accessing and utilising dashboards in the new AWS environment

Conduct thorough testing and validation of migrated systems

Required Skills:

AWS Services

Extensive experience with AWS services (SageMaker, QuickSight, Athena, Lambda, data pipelines)

Experience using AWS services in Python and Command Line Interface

Proficiency in serverless architecture design and Lambda function development

Infrastructure as Code (IaaC)

Experience in Infrastructure-as-Code (eg. CloudFormation, YAML, JSON infrastructure scripts)

Lambda function provisioning and management through IaaC templates

Integration of serverless components with traditional infrastructure resources

Programming and Automation Skills

Proficiency in Python programming and UiPath automation

Experience developing and deploying Lambda functions for data processing and automation

Understanding of event-driven architecture and serverless computing patterns

Data Visualisation and Analytics

Strong background in Tableau and QuickSight dashboard development

Experience with ETL processes and data pipeline design

Knowledge of serverless data processing workflows using Lambda

DevOps and Collaboration

Experience working with DevOps stack (eg. Ship-hats, GitLab, Nexus Repo etc)

Understanding of CI/CD pipelines for both application code and infrastructure deployment

Experience with infrastructure change management including security groups and network ACLs

Technical writing and documentation skills

Get job updates in your inbox

Subscribe to our newsletter and stay updated with the best job opportunities.