Senior Data Test Lead – MDM, Customer Data & ETL (AWS Glue)

Required Qualifications

• 8–12 years total experience with 5+ years in Data Testing/QA, including MDM and Customer Data programs.
• Strong hands-on testing experience with MDM (Reltio/Informatica/Semarchy/Custom), particularly Customer 360 capabilities (match/merge, survivorship, hierarchies).
• Proven testing of ETL pipelines, preferably AWS Glue (PySpark), with exposure to Airflow/MWAA and S3/Athena/Redshift.
• Proficiency in SQL (advanced joins, window functions), Python/PySpark for data assertions, and file formats (Parquet/Avro/JSON/CSV).
• Experience with data reconciliation, DQ frameworks, lineage, and metadata-driven testing.
• Strong knowledge of data privacy/security (PII masking, consent, GDPR/CCPA principles).
• Excellent communication and stakeholder management; able to present testing approach and results to senior leadership.

Preferred Qualifications

• Domain experience in BFSI (KYC/AML, onboarding, regulatory reporting, customer hierarchies).
• Familiarity with Great Expectations, Deequ, OpenLineage/Marquez, or similar DQ/lineage tools.
• Experience with cloud data platforms (AWS preferred; Azure/GCP nice to have).
• Knowledge of performance testing for data jobs and cost-aware testing (e.g., DPU/cost budgets).
• Exposure to DataOps practices and IaC (Terraform/CloudFormation) for test env setup.

Core Competencies

• Data Quality Mindset: deep understanding of accuracy, completeness, consistency, timeliness.
• Analytical Rigor: designs measurable test oracles; uses statistics/profiling to detect anomalies.
• Automation First: builds maintainable, parameterized test suites integrated with CI/CD.
• Risk-Based Testing: prioritizes tests for high-impact entities, transformations, and SLAs.
• Clear Communication: converts complex data rules into crisp test conditions and reports.

Tools & Tech Stack

• AWS: Glue (PySpark), S3, Athena, Redshift, MWAA (Airflow), Lambda, CloudWatch
• Testing/DQ: Great Expectations / Deequ (or in-house frameworks), pytest, dbt tests*
• Data: SQL, Python, PySpark; Parquet/Avro/JSON
• Workflow/CI: Airflow/MWAA, Git, GitHub Actions/CodePipeline/Azure DevOps
• MDM: Reltio / Informatica MDM / Semarchy (any)
• Observability: CloudWatch, OpenLineage/Marquez*, custom dashboards
  *as applicable to your environment