AI Machine Learning Data Engineer

Conch Technologies - New York, NY

Full-time

New York, NY

Administrative and Support Services

About the position

The Google Cloud Platform Data Engineer position at Conch Technologies Inc involves developing and managing data solutions on Google Cloud Platform. The role requires expertise in machine learning, data engineering, and cloud technologies, with a focus on building efficient data pipelines and ensuring data quality. The position is contract-based and requires onsite presence from day one in either Orlando, FL or New York, NY.

Responsibilities

• Engineer ingestion and processing pipelines on Google Cloud Platform using Python libraries, Java, BigQuery, and Composer.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Implement data quality checks and monitoring processes to ensure data accuracy and integrity.
• Troubleshoot and debug issues in data pipelines and provide timely resolutions.
• Stay updated with industry best practices and emerging technologies in data engineering.

Requirements

• 5+ years of hands-on experience in a programming language such as Python, Java, or Scala.
• Strong expertise in AWS and Google Cloud Platform cloud services, with a focus on data solutions.
• Advanced knowledge of SQL and experience with relational databases and data warehouses.
• Experience in prompt engineering and machine learning.
• Strong programming skills in Python or Java.
• Knowledge of Langchain, llama models, and vector databases.