👨🏻‍💻 postech.work

Senior Data Engineer

Nityo Infotech • 🌐 In Person

In Person Posted 1 day, 13 hours ago

Job Description

Lead the migration of legacy Informatica PowerCenter workflows to Azure Databricks, rewriting logic in Python.

Reverse engineer complex PowerCenter pipelines with embedded SQL to understand and replicate business logic.

Perform detailed pipeline inspections and troubleshoot data quality issues, field mapping discrepancies, and transformation errors.

Analyze and reconcile differences between business logic and program logic to ensure accurate data outcomes.

Collaborate with business users to resolve data-related problems and clarify requirements.

Design, build, and maintain scalable data pipelines for ingestion, transformation, and curation.

Implement secure data exchange using APIs, SSL encryption, and authentication protocols.

Apply strong analytical thinking to identify root causes, optimize performance, and drive continuous improvement.

Participate in global meetings and calls during evening hours (2–3 times weekly).

Required Skills \& Qualifications:

Extensive experience with Informatica PowerCenter, including legacy workflow analysis and migration.

Strong proficiency in Azure Databricks and Python for modern data engineering.

Advanced SQL skills, especially in parsing and translating embedded logic.

Proven ability to troubleshoot data quality issues and resolve mapping and logic conflicts.

Strong analytical skills with a keen eye for detail and data integrity.

Deep understanding of data ingestion, transformation, and curation processes.

Familiarity with network security, SSL, APIs, and application authentication.

Excellent communication skills and experience in business-facing roles.

Ability to work independently and solve complex technical challenges.

Experience in the insurance domain is a plus.

Based in or willing to relocate to Hong Kong preferred.

Get job updates in your inbox

Subscribe to our newsletter and stay updated with the best job opportunities.