Sr AWS Lead Data Engineer - Santa Clara, CA (Onsite) - Full Time

Avtech Solutions - Santa Clarita, CA

Full-time - Senior

Santa Clarita, CA

Professional, Scientific, and Technical Services

About the position

The Sr AWS Lead Data Engineer will be responsible for leading data engineering efforts utilizing AWS and big data technologies. This role requires extensive experience in programming, cloud platforms, and data lake technologies, along with a strong understanding of development best practices. The position is based in Santa Clara, CA and is a full-time onsite role.

Responsibilities

• Lead data engineering projects utilizing AWS and big data technologies.
• Implement and maintain data lake technologies such as Iceberg, Delta, and Huidi.
• Develop and enforce best practices for CI/CD, unit testing, and integration testing.
• Extract data from various source systems including REST APIs and databases using JDBC, ODBC, and SFTP.
• Collaborate with cross-functional teams to design and optimize data pipelines.

Requirements

• Master's or Bachelor's degree in Computer Science or Information Systems, or equivalent experience.
• 8+ years of relevant experience in data engineering and programming (Python, SQL).
• 5+ years of experience with big data technologies and cloud platforms (Spark, AWS).
• 5+ years of experience with data lake technologies (Iceberg, Delta, Huidi).
• 5+ years of experience in development best practices (CI/CD, unit testing, integration testing).
• 5+ years of experience in data extraction from source systems.

Nice-to-haves

• 2+ years of experience with Kubernetes and Docker.