Data Engineer Google Cloud Platform GEN AI

Conch Technologies - New York, NY

Full-time - Mid Level

New York, NY

Administrative and Support Services

About the position

The Google Cloud Platform Data Engineer role at Conch Technologies Inc involves designing and implementing data solutions using Google Cloud services and Gen AI technologies. The position requires strong programming skills, particularly in Python, and experience with machine learning and data pipeline engineering. The engineer will collaborate with cross-functional teams to optimize data processes and ensure data quality and integrity.

Responsibilities

• Engineer ingestion and processing pipelines on Google Cloud Platform using Python libraries, Java, BigQuery, and Composer.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Implement data quality checks and monitoring processes to ensure data accuracy and integrity.
• Troubleshoot and debug issues in data pipelines and provide timely resolutions.
• Stay updated with industry best practices and emerging technologies in data engineering.

Requirements

• 5+ years of hands-on experience in a programming language such as Python, Java, or Scala.
• Strong expertise in AWS and Google Cloud Platform cloud services, with a focus on data solutions.
• Advanced knowledge of SQL and experience with relational databases and data warehouses.
• Experience in prompt engineering and machine learning.
• Strong programming skills in Python or Java.
• Knowledge of Airflow and vector databases.