Senior Data Engineer with AWS

$120,022 - $131,076/Yr

Intellyk - Santa Clara, CA

posted 2 months ago

Full-time - Senior
Santa Clara, CA
Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer position at Intellyk involves working with AWS and big data technologies to develop and maintain data solutions. The role requires extensive experience in programming, data lake technologies, and development best practices, with a focus on delivering high-quality data engineering solutions in a collaborative environment.

Responsibilities

  • Develop and maintain data pipelines using AWS and big data technologies.
  • Implement data lake solutions using technologies like Iceberg, Delta, and Huidi.
  • Ensure best practices in development, including CI/CD, unit testing, and integration testing.
  • Extract data from various source systems using REST APIs, JDBC, ODBC, and SFTP servers.
  • Collaborate with cross-functional teams to design and optimize data solutions.

Requirements

  • Master's or Bachelor's degree in Computer Science or Information Systems, or equivalent experience.
  • 8+ years of relevant experience in data engineering and programming (Python, SQL).
  • 5+ years of experience with big data technologies and cloud platforms (AWS, Spark).
  • 5+ years of experience with data lake technologies (Iceberg, Delta, Huidi).
  • 5+ years of experience in development best practices (CI/CD, unit testing, integration testing).
  • 5+ years of experience in data extraction from source systems.

Nice-to-haves

  • 2+ years of experience with Kubernetes and Docker.

Benefits

  • Competitive salary range of $120,022 - $131,076 per year.
  • Full-time employment with a stable work environment.
Job Description Matching

Match and compare your resume to any job description

Start Matching
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service