LEAD DATA ENGINEER - SOLUTIONS ARCHITECT

Inherent Technologies - Phoenix, AZ

Full-time

Phoenix, AZ

Professional, Scientific, and Technical Services

About the position

The Lead Data Engineer - Solutions Architect is responsible for leading data engineering initiatives, focusing on migration and solution architecture. This role requires extensive experience in data engineering, particularly with cloud services, and involves collaboration with architects to develop effective data engineering solutions.

Responsibilities

• Lead data engineering initiatives and projects.
• Oversee migration processes and solution architecture.
• Collaborate with architects to solve problems and provide data engineering solutions.
• Produce architecture solutions using Composer and Spark.
• Manage large-scale batch processing with cloud services.

Requirements

• 10+ years of data engineering experience.
• Previous experience leading migration and solution architecture.
• 3+ years of experience with Apache Airflow and/or Composer.
• 3+ years of experience with DataProc and/or Spark.
• Experience with Google Cloud Platform.
• 5+ years of experience with CI/CD.
• Familiarity with databases and SQL.
• Familiarity with at least one OOP language, preferably Java.
• Familiarity with Google Cloud Platform, GKE, and Cloud IAM.