Bigdata Data Engineer ( Google Cloud Platform )

Conch Technologies - Orlando, FL

Full-time - Mid Level

Orlando, FL

Administrative and Support Services

About the position

The Google Cloud Platform Data Engineer position at Conch Technologies Inc involves designing and implementing data solutions on Google Cloud Platform. The role requires extensive experience in data engineering, machine learning, and cloud technologies, focusing on optimizing data pipelines and ensuring data quality and integrity.

Responsibilities

• Engineer ingestion and processing pipelines on Google Cloud Platform using Python libraries, Java, BigQuery, and Composer.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Implement data quality checks and monitoring processes to ensure data accuracy and integrity.
• Troubleshoot and debug issues in data pipelines and provide timely resolutions.
• Stay updated with industry best practices and emerging technologies in data engineering.

Requirements

• 7-12 years of experience in data engineering roles.
• Strong expertise in AWS and Google Cloud Platform cloud services, with a focus on data solutions.
• 5+ years of hands-on experience in a programming language such as Python, Java, or Scala.
• Advanced knowledge of SQL and experience with relational databases and data warehouses.
• Experience in prompt engineering and machine learning.
• Strong programming skills in Python or Java.
• Knowledge of Langchain, llama models, and vector databases.
• Experience with Airflow and cloud-based data technologies.