Sr Python Developer/Engineer with Pyspark

Automation Technologies

Full-time

Professional, Scientific, and Technical Services

About the position

The Sr Python Developer/Engineer with PySpark will be responsible for developing and operationalizing data processing tasks using PySpark in a retail environment. This role requires expert knowledge of Python coding and familiarity with the end-to-end Software Development Life Cycle (SDLC) process. The position emphasizes the importance of big data and streaming concepts, as well as experience with Azure or Hadoop.

Responsibilities

• Develop data processing tasks using PySpark, including reading data from external sources, merging data, and performing data enrichment.
• Load processed data into target destinations.
• Deploy and operationalize code effectively.
• Understand and apply big data and streaming concepts in development.
• Collaborate with teams to enhance supply chain and planning processes in a retail environment.

Requirements

• Expert knowledge of Python coding.
• Deep experience with PySpark and data processing tasks.
• Familiarity with the end-to-end SDLC process in Python.
• Knowledge of Azure or Hadoop.
• Understanding of Microservice architecture.
• Experience in developing computationally intensive algorithms.

Nice-to-haves

• Knowledge of supply chain and planning domain in a retail environment.

Benefits

• Equal opportunity employer
• Inclusive workplace for female, minority, disability, and veterans.