GCP AI Engineer

E-Solutions Group - Scottsdale, AZ

Full-time

Scottsdale, AZ

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The GCP AI Engineer role focuses on the operationalization of data warehouses, data lakes, and analytics platforms on Google Cloud Platform (GCP). The position involves creating frameworks for machine learning and large language model operations, ensuring compliance with AI governance, and monitoring data lake performance. The engineer will collaborate with cross-functional teams to gather requirements and provide technical support to ensure the availability and performance of ETL/ELT jobs.

Responsibilities

• Create a framework for ML and LLM operations.
• Develop processes for AI compliance governance framework.
• Monitor the Data Lake and engage support teams as needed.
• Create reports for usage data, billing, and SLA tracking.
• Collaborate with business and cross-functional teams to gather and document requirements.
• Provide support for the availability and performance of ETL/ELT jobs.
• Offer technical assistance and cross-training to team members.
• Identify continuous improvement opportunities with business partners.

Requirements

• Solid experience in Data Engineering with a focus on Data Warehousing and Data Analytics.
• Strong hands-on expertise in Python.
• Knowledge of GCP Vertex AI.
• Experience with leading public cloud platforms.
• Experience in designing and building scalable data pipelines for extraction, transformation, and loading.
• Hands-on experience with GCP Cloud data implementation projects including Dataflow, DataProc, Cloud Composer, BigQuery, Cloud Storage, GKE, and Airflow.
• Strong experience in Data Governance and Metadata Management.
• Ability to work independently and solve problems while updating stakeholders.
• Experience in analyzing, designing, developing, and deploying solutions based on business requirements.
• Strong understanding of relational and dimensional data modeling.
• Experience with DevOps and CI/CD technologies.
• Excellent written and verbal communication skills, including technical documentation and communication with senior business managers and executives.