Amaze Systems - Dallas, TX

posted 5 days ago

Full-time
Dallas, TX

About the position

The ETL Data Engineer role is focused on developing and maintaining data integration processes, ensuring data quality and reliability through comprehensive testing and validation. The position requires collaboration with cross-functional teams to implement best practices in ETL and data management, utilizing big data technologies and Agile methodologies.

Responsibilities

  • Design, implement, and execute comprehensive testing for data quality and reliability.
  • Develop a comprehensive code base and business rules for testing and validation of data based on User Stories.
  • Utilize testing frameworks to ensure data integrity and performance.
  • Implement data integration and ETL best practices to enhance data quality.
  • Work with CI/CD pipelines to streamline deployment processes.
  • Collaborate with teams using Agile/Scrum methodologies to deliver data solutions.
  • Leverage big data technologies such as Hadoop, Spark, and Hive for data processing.

Requirements

  • 4 to 8 years of experience as a development data engineer or similar role with a strong ETL background.
  • Proven experience in designing and executing data quality tests.
  • Familiarity with testing frameworks and methodologies.
  • Knowledge of data integration and ETL best practices.
  • Experience with CI/CD pipelines for continuous integration and deployment.
  • Familiarity with Agile/Scrum development methodologies.
  • Experience with big data technologies including Hadoop, Spark, and Hive.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service