Consultant

Key Responsibilities

• Test Automation Architecture & Strategy Data pipelines (batch and streaming)
  
  

APIs and backend services

• Data Testing Framework Engineering SQL based assertions and reconciliation
  
  

Schema validation and evolution checks

• Break Systems Proactively (Destructive Testing Mindset) Schema drift and backward incompatibility
  
  

Late arriving data and partial failures

• ETL and Streaming Validation at Scale Row, aggregate, and hash based reconciliation
  
  

Incremental and backfill validation

• Data Quality & Observability Integration Great Expectations, Soda
  
  

Accuracy, completeness, uniqueness, timeliness

• CI/CD & DataOps Enforcement Pre merge gates and release blockers
  
  

Selective and parallel test execution

• Test Data Management Synthetic data generation
  
  

Masking and anonymization

• Performance & Reliability Testing Pipeline and query performance benchmarks
  
  

Concurrency and stress testing

• Security & Compliance Validation PII or PHI exposure
  
  

Encryption and access control

• Cross Functional Quality Leadership Work with data engineers, platform teams, and architects to embed quality early
  
  

Challenge poor design decisions that impact reliability

• Incident Analysis & Prevention Analyze production data issues and failure patterns
  
  

Reduce flaky tests and false alarms

Mandatory Skills

• Programming & Framework Development
• Data Engineering Ecosystem
• Data Quality & Observability
• Streaming Systems
• CI/CD & DevOps
• Cloud & Infrastructure
  
  

Desired Skills Experience with API contract testing and tools like PACT

Basic UI automation for end to end validation

Exposure to data mesh or data product architectures

Experience

9+ years in automation or quality engineering

5+ years building frameworks for data platforms at scale