GCP Data engineer

E-Solutions Group - Dallas, TX

Full-time

Dallas, TX

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The GCP Data Engineer role involves leading the migration of Teradata databases to Google Cloud Platform (GCP) and developing microservices to enhance data infrastructure. The position requires a strong background in data engineering and cloud technologies, focusing on optimizing data solutions and ensuring data integrity during migration processes.

Responsibilities

• Lead the migration of Teradata databases to GCP, ensuring data integrity, security, and minimal downtime.
• Develop and implement data migration strategies, including ETL processes, data validation, and performance tuning.
• Collaborate with cross-functional teams to understand data requirements and ensure successful data migration.
• Design, develop, and maintain data pipelines and ETL processes using GCP services such as Dataflow, BigQuery, and Pub/Sub.
• Optimize and automate data workflows to ensure high performance and scalability.
• Implement data quality checks and monitoring to ensure accuracy and reliability of data.
• Design and develop microservices architecture to support data processing and integration.
• Implement RESTful APIs and other interfaces to enable seamless data access and integration with other systems.
• Ensure microservices are scalable, secure, and efficient.
• Work closely with data analysts, data scientists, and other stakeholders to understand data needs and deliver high-quality solutions.
• Provide technical guidance and mentorship to junior data engineers and team members.
• Document data engineering processes, best practices, and technical specifications.

Requirements

• Minimum 8+ years of experience in data engineering and cloud technologies.
• Strong background in Teradata migration to Google Cloud Platform (GCP).
• Expertise in developing microservices and data pipelines.
• Proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.