Cybertec - Wilmington, DE

posted 2 months ago

Full-time
Remote - Wilmington, DE
Professional, Scientific, and Technical Services

About the position

The QA Automation Specialist will play a crucial role in ensuring the quality and reliability of data pipelines through test automation. This position is fully remote and is expected to last between 6 to 12 months, with the possibility of extension. The specialist will be responsible for building and enhancing the test automation framework, which is essential for validating data integrity and performance across various data storage solutions, including Redshift and S3. In this role, the QA Engineer will leverage their expertise in QA best practices within an agile environment to create and execute tests using a variety of testing tools, both open-source and commercial. The position requires a strong understanding of programming and scripting languages, particularly Python, SQL, and related technologies such as PySpark and Spark SQL. The specialist will collaborate closely with a cross-functional team that includes business analysts, developers, testers, and project managers to contribute to the development of an automated testing framework. The QA Engineer will be tasked with expanding the functionality of existing testing frameworks and developing new automated testing solutions. This includes testing various aspects of the assigned software from functional, regression, and integration perspectives. The role demands a proactive approach to validate data stored in Redshift and S3, ensuring that it meets the required standards and formats, such as Parquet. Overall, this position is vital for maintaining the integrity and performance of data pipelines, which are critical for data-driven decision-making within the organization.

Responsibilities

  • Building and enhancing the test automation framework.
  • Creating and executing tests utilizing testing tools and other open-source and commercial tools.
  • Collaborating with a cross-functional team of business analysts, developers, testers, and project managers.
  • Expanding the functionality of existing testing frameworks and building new automated testing frameworks.
  • Testing various aspects of assigned software from a functional, regression, and integration standpoint.
  • Programming in Python, PySpark, Pandas, and Spark SQL to validate data in Redshift and S3.

Requirements

  • Experience in QA automation and test framework development.
  • Strong understanding of QA best practices in an agile environment.
  • Proficiency in programming/scripting languages such as Python and SQL.
  • Experience with data pipeline test automation, including ETL, ELT, Datalake, and data warehouse technologies.
  • Ability to write SQL queries for data verification.
  • Ability to write Python queries for data verification.
  • Experience with functional, regression, and integration testing.

Nice-to-haves

  • Experience with additional programming languages or testing tools.
  • Familiarity with cloud data storage solutions and data formats like Parquet.
  • Knowledge of data validation techniques and best practices.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service