Data Engineer with Hadoop and Spark

Amaze Systems - Atlanta, GA

Full-time

Atlanta, GA

About the position

The Data Engineer position focuses on developing batch and streaming solutions using Big Data technologies such as Spark, Hadoop, and Kafka. The role requires strong programming skills and experience with real-time data ingestion, making it essential for candidates to be familiar with Agile methodologies.

Responsibilities

• Develop batch and streaming solutions using various Big Data technology.
• Have hands-on knowledge of Spark (Scala preferred), Hadoop, Kafka, etc.
• Strong programming knowledge in Java, Scala, or Python.
• Experience working with real-time or near real-time ingestion.
• Familiarity with Streaming tools like NiFi is an added advantage.
• Work within Agile/Scrum methodologies.

Requirements

• Hands-on knowledge of Spark (Scala preferred), Hadoop, Kafka.
• Strong programming skills in Java, Scala, or Python.
• Experience with real-time or near real-time data ingestion.
• Familiarity with Agile/Scrum methodologies.

Nice-to-haves

• Experience with Streaming tools like NiFi.