Data Quality Engineer

The Data Quality Engineer serves as the guardian of system integrity and data accuracy across the entire pipeline infrastructure. This position encompasses comprehensive testing responsibilities, from unit testing individual components to validating end-to-end system functionality and data correctness. The engineer will develop sophisticated testing frameworks that ensure both technical reliability and data integrity at scale. The role requires a methodical approach to quality assurance combined with deep understanding of data validation techniques. The successful candidate will establish quality gates throughout the development lifecycle and implement real-time monitoring systems to detect anomalies before they impact operations.

Key Responsibilities
• Develop automated testing for all pipeline components
• Implement end-to-end system and integration testing
• Create data validation and integrity frameworks
• Design performance and load testing procedures
• Build real-time quality monitoring systems
• Test features before production deployment
• Investigate and resolve data discrepancies