Amazon - Austin, TX

posted 20 days ago

Full-time - Mid Level
Austin, TX
Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers

About the position

The Sr Data Engineer position at OpsTech Solutions (OTS) involves designing and building foundational data infrastructure components that empower product teams with critical business metrics. The role focuses on developing systems and tools for data ingestion from diverse sources, enabling seamless data publishing, subscription, and self-service analytics for reporting. Additionally, the engineer will participate in automating data governance and quality monitoring processes, supporting data needs for AI/ML and generative AI capabilities.

Responsibilities

  • Design and build foundational data infrastructure components for OTS product teams.
  • Develop systems and tools to ingest data from diverse data sources.
  • Enable seamless data publish, subscribe, and self-service analytics for business metrics reporting.
  • Participate in automation of data governance and data quality monitoring processes.
  • Support data needs for AI/ML and generative AI capabilities.
  • Build and operate a highly scalable data mesh infrastructure.

Requirements

  • 5+ years of data engineering experience.
  • Experience with data modeling, warehousing, and building ETL pipelines.
  • Experience with SQL.
  • Experience in at least one modern scripting or programming language (Python, Java, Scala, or NodeJS).
  • Experience mentoring team members on best practices.

Nice-to-haves

  • Experience with big data technologies such as Hadoop, Hive, Spark, EMR.
  • Experience operating large data warehouses.
  • Experience developing on AWS EMR, Glue, Airflow.

Benefits

  • Diverse and inclusive workplace
  • Equal opportunity employer
  • Accommodations for individuals with disabilities
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service