NTT DATA - Frisco, TX
posted about 2 months ago
As a QA Data Engineer at NTT DATA, you will play a crucial role in ensuring the quality and reliability of our data pipelines within an agile development environment. Your primary responsibilities will include designing, developing, and maintaining comprehensive test plans and test cases tailored for scalable data pipelines. You will implement automated testing solutions utilizing Python and PySpark on our cloud-native Lakehouse data platform, ensuring that our data processes are efficient and robust. Writing efficient SQL queries will be essential for validating data extraction, transformation, and loading processes, which are critical to maintaining data integrity. Collaboration is key in this role, as you will work closely with product management and analysts to understand data requirements and ensure that quality assurance standards are met. You will also be tasked with optimizing and troubleshooting data pipelines to enhance performance and reliability. Following DevOps principles, you will utilize CI/CD practices to deploy and operate automated testing frameworks, contributing to a culture of continuous improvement and innovation. Your expertise in quality assurance will be vital in ensuring data quality and integrity through comprehensive testing and validation processes. This position offers the opportunity to work in a dynamic environment where your contributions will directly impact the success of our data initiatives and the overall business objectives of NTT DATA.