GCP Lead Data Engineer

Infinity Ag Solutions - Ontario, CA

Full-time

Ontario, CA

Printing and Related Support Activities

About the position

The GCP Lead Data Engineer is responsible for designing and implementing data solutions on the Google Cloud Platform. This role requires extensive experience in data engineering, particularly in optimizing performance for large OLTP applications. The engineer will leverage various GCP managed services and technologies to build scalable and efficient data pipelines, ensuring effective data management and processing.

Responsibilities

• Design and implement data solutions on Google Cloud Platform (GCP).
• Optimize performance for large OLTP applications.
• Utilize GCP managed data services such as DataProc, Dataflow, BigQuery, and Cloud Spanner.
• Work with relational and NoSQL databases.
• Implement data streaming technologies like Kafka and Spark-streaming.
• Apply Infrastructure as Code (IaC) practices using Terraform.
• Develop and scale JAVA REST services using Spring framework.
• Provide technical solutions for cloud infrastructure.

Requirements

• 10+ years of experience in data engineering.
• 4+ years of experience as a Google Cloud Platform (GCP) developer.
• Experience with GCP managed data services including DataProc, Dataflow, BigQuery, Cloud Spanner, and Cloud SQL.
• Proficiency in SQL, Spanner, and PostgreSQL databases.
• Experience with relational and NoSQL databases.
• Knowledge of data streaming technologies such as Kafka and Spark-streaming.
• Familiarity with Infrastructure as Code (IaC) practices and Terraform.
• Strong knowledge of Java microservices and Spring Boot.
• Good communication and problem-solving skills.