Big Data Developer

Sai Software SolutionsColumbus, OH
197d

About The Position

The position involves building distributed, scalable, and reliable data pipelines that can ingest and process data at scale and in real-time. The candidate will be responsible for creating metrics and applying business logic using various programming languages and tools. This role requires modeling, designing, developing, coding, testing, debugging, documenting, and deploying applications to production through standard processes. Additionally, the candidate will harmonize, transform, and move data from a raw format to consumable, curated views, and analyze, design, develop, and test applications. The role also includes contributing to the maturation of Data Engineering practices, which may involve providing training and mentoring to others. A strong sense of teamwork and alignment with State Auto's cultural values is essential.

Requirements

  • Strong hands-on experience in Spark, Scala, R, Python, and/or Java
  • Programming experience with the Hadoop ecosystem of applications
  • Functional understanding of distributed data processing systems architecture (Data Lake / Big Data / Hadoop / Spark / HIVE, etc.)
  • Experience with the Amazon Big Data ecosystem (EMR, Kinesis, Aurora)

Responsibilities

  • Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time
  • Create metrics and apply business logic using Spark, Scala, R, Python, and/or Java
  • Model, design, develop, code, test, debug, document and deploy applications to production through standard processes
  • Harmonize, transform, and move data from a raw format to consumable, curated views
  • Analyze, design, develop, and test applications
  • Contribute to the maturation of Data Engineering practices, which may include providing training and mentoring to others
  • Live the State Auto cultural values with a strong sense of teamwork
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service