Freelancing Opportunity
Job Description – Data Migration QA Engineer (Informatica → dbt/Redshift)
Overview
We are mid-migration from a legacy Informatica + SQL Server warehouse to a modern dbt + Airflow stack on Amazon Redshift. With hundreds of tables scheduled for cutover by February, we are seeking experienced Data QA Engineers who can rapidly validate model parity, ensure data fidelity, and keep migration timelines on track.
Role Summary
You will join the migration strike team to validate that each new Redshift/dbt model matches its SQL Server source. This is a fast-paced, limited-duration assignment focused on speed, accuracy, and strong QA coverage. You will define a pragmatic validation strategy, implement lightweight automation, and deliver clear sign-offs for each migrated table.
Key Responsibilities
Build a repeatable validation playbook: row counts, aggregates, column-level checks, sampled record diffs.
Design, develop, and execute test cases for data migration validation.
Implement lightweight automation using dbt tests, SQL scripts, Python notebooks, or data-diff tools.
Collaborate with engineers to understand legacy logic, identify discrepancies, and drive timely remediation.
Track daily/weekly validation throughput, defects, and sign-off readiness via shared dashboards.
Maintain a defect log ensuring visibility of issues, owners, and resolution status.
Document exceptions, nuances, and validation evidence for analytics and operational trust.
Delivery Expectations
Week 1: Onboard, align on schedule, finalize validation checklist, certify 1–2 TaskFlows.
Week 2: Scale to 2–4 TaskFlows using reusable SQL/dbt templates and automation.
Week 3+: Maintain 3–5 TaskFlow validations weekly with daily coverage and defect reporting.
Required Qualifications
7+ years in Data QA, Analytics Engineering, or Data Engineering with migration validation experience.
Expert SQL on SQL Server and Amazon Redshift.
Strong ability to design, automate, and execute data accuracy, completeness, and integrity tests.
Proven experience with reconciliation playbooks under tight timelines.
Experience with dbt tests, SQL automation, Python tooling, and pragmatic validation frameworks.
Familiarity with reconciliation/data-diff tools (e.g., Datafold, Elementary, Great Expectations, custom scripts).
Strong organizational and communication skills for managing high-volume QA pipelines.
Comfortable working remotely with at least 4 hours overlap with Central Time.
Knowledge of AWS services: S3, Redshift, IAM, CloudWatch.
Tools You May Use
Validation: SQL scripts, dbt tests, dbt-expectations, Great Expectations, Elementary, data-diff utilities.
Automation \& Tracking: Git-based CI checks, Python notebooks, Sheets/Notion/Jira dashboards.
Job Types: Part-time, Freelance
Contract length: 12 months
Pay: ₹30,000.00 - ₹40,000.00 per month
Benefits:
Work from home
Experience:
total work: 7 years (Required)
Shift availability:
Night Shift (Required)
Overnight Shift (Required)
Work Location: Remote