GCP Data Engineer

HCL Technologies - Greensboro, NC

Full-time

Remote - Greensboro, NC

Professional, Scientific, and Technical Services

About the position

The Google Cloud Platform Data Engineer is responsible for designing, building, and optimizing data pipelines to support data processing and analytics. This role requires extensive experience with various Google Cloud services and programming languages to automate processes and develop applications.

Responsibilities

• Design and build data pipelines using Google Cloud services.
• Optimize existing data pipelines for performance and efficiency.
• Implement process automation and application development.
• Utilize tools such as Google Cloud Composer, DataFlow, and DataProc clusters.
• Work with Apache Beam, Hadoop, and BigQuery for data processing.
• Manage database change data capture (CDC) ingestion.

Requirements

• Minimum 5 years of experience in data engineering.
• Proficiency in Google Cloud services, including Cloud Composer, DataFlow, and DataProc.
• Strong programming skills in Java, Python, Unix, and PLSQL.
• Hands-on experience with database CDC ingestion.