Amazon - Austin, TX

posted 20 days ago

Full-time
Austin, TX
Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers

About the position

The Data Engineer position at OpsTech Solutions (OTS) involves designing and building foundational data infrastructure components that empower product teams with critical business metrics. The role focuses on developing systems and tools for data ingestion and processing, enabling seamless data access and self-service analytics, while also supporting automation of data governance and quality monitoring processes.

Responsibilities

  • Design and build foundational data infrastructure components for OTS product teams.
  • Develop systems and tools to ingest and process data from diverse sources and data lakes.
  • Enable seamless data publish and subscribe mechanisms for self-service analytics.
  • Participate in the automation of data governance processes and data quality monitoring.
  • Support data needs for AI/ML capabilities.
  • Build and operate a highly scalable data mesh infrastructure and data lake.

Requirements

  • 3+ years of data engineering experience.
  • Experience with data modeling, warehousing, and building ETL pipelines.

Nice-to-haves

  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
  • Experience with non-relational databases/data stores such as object storage, document or key-value stores, graph databases, and column-family databases.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service