Core Responsibilities
Platform Architecture \& Development
-
Design and implement data platform components, ensuring high availability, scalability, and performance.
-
Evaluate and integrate appropriate technology stacks, frameworks, and AWS cloud services for data ingestion, storage, and processing.
Data Platform Operations \& Automation
-
Build and optimize ETL/ELT pipelines for structured and unstructured data using tools like AWS Glue, Informatica IDMC, Spark, and Python.
-
Automate workflows using Airflow to reduce manual interventions and improve operational efficiency.
-
Manage Tech debt effectively by using available resources \& time.
Governance \& Compliance
-
Implement automation for role-based access controls, audit logging, and data masking to meet regulatory and security requirements.
-
Collaborate with governance teams to embed metadata, lineage, and data quality controls across the platform.
Release \& Change Management
-
Participate in CAB meetings, assess IT changes, and manage risk for platform upgrades and deployments.
-
Maintain documentation for runbooks, SOPs, and escalation paths.
Performance Tuning \& Monitoring
-
Develop monitoring models for legacy and modern platforms.
-
Conduct root cause analysis for data ingestion failures and optimize platform performance.
Collaboration \& Leadership
-
Provide technical guidance and coaching to engineering teams.
-
Partner with product owners and architects to align platform capabilities with business needs.
Required Skills \& Tools
Cloud Platforms: AWS (mandatory), Azure or Ali Cloud (plus).
Data Technologies: Spark, Redshift, Glue, Cloud Watch, Informatica IDMC, Kafka, DMS.
Programming: Python, Airflow, Glue Workflow, SQL.
DevOps \& CI/CD: Jenkins, Git, containerization (Docker/Kubernetes).
Governance Tools: Starburst(Good to have), Apache Ranger, Microsoft Purview.
Soft Skills: Strong stakeholder management, communication, and ability to work in Agile environments.
Qualifications:
8-10 years of experience in data/platform management or data engineering roles, in the financial services industry,
Minimum 2-3 years of experience in insurance industry is strongly preferred.
Fluent in English and Cantonese, with strong communication and stakeholder management skills.
Hands-on experience with cloud platforms (AWS, Ali Cloud, Azure) and data platform engineering.
Familiarity with Cloud Operations \& Practices.
Please apply or share your CV to s.yeung@gravitasgroup.com