Google Cloud Platform Data Engineer

Global It Con Llc. - Saint Louis, MO

Full-time

Remote - Saint Louis, MO

About the position

We are seeking an experienced Google Cloud Platform Data Engineer to join our team for a long-term project. The ideal candidate will have extensive experience in designing, implementing, and managing large-scale data systems on Google Cloud Platform and other cloud infrastructures. This position offers the flexibility of remote work, but candidates should be able to collaborate effectively across time zones.

Responsibilities

• Design, develop, and manage data pipelines using Google Cloud Platform services such as BigQuery, Cloud Composer, Cloud Spanner, and Cloud Storage.
• Implement and manage message-driven architectures using Pub/Sub.
• Develop automation solutions using Ansible and Terraform for infrastructure and configuration management.
• Work on data integration and migration strategies, including setting up and managing Kafka, Teradata, and AWS environments.
• Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
• Ensure the performance, scalability, and security of data solutions in cloud environments.
• Perform data modeling, data integration, and data pipeline optimization to enable efficient data processing and analysis.
• Utilize Python for scripting, data manipulation, and workflow automation.

Requirements

• Expertise with Google Cloud Platform services: BigQuery, Cloud Composer, Cloud Spanner, Cloud Storage, Pub/Sub.
• Strong hands-on experience with Python for automation and data processing.
• Proficiency in infrastructure automation tools such as Ansible and Terraform.
• Experience working with Kafka for real-time data streaming.
• Knowledge of data warehousing solutions, including Teradata.
• Familiarity with AWS cloud services.
• Solid understanding of CI/CD processes and version control systems.
• Strong SQL skills for querying, analyzing, and processing large datasets.

Nice-to-haves

• Experience in managing multi-cloud environments.
• Familiarity with other data integration tools and frameworks.
• Ability to troubleshoot and resolve complex data and infrastructure-related issues.