gcp ai vertex data engineer

$104,000 - $115,440/Yr

Randstad - Phoenix, AZ

posted 23 days ago

Full-time - Mid Level
Phoenix, AZ
Administrative and Support Services

About the position

The GCP AI Vertex Data Engineer role focuses on developing and operationalizing data solutions on Google Cloud Platform (GCP). The position requires strong expertise in Python, SQL, and data engineering practices, particularly in the context of data warehousing and analytics. The engineer will work on creating frameworks for machine learning operations and ensuring compliance with AI governance, while also collaborating with cross-functional teams to meet business requirements.

Responsibilities

  • Create a framework for ML and LLM Ops.
  • Develop processes and flow for AI Compliance Governance framework.
  • Monitor the Data Lake and engage appropriate support teams as needed.
  • Create reports to monitor usage data for billing and SLA tracking.
  • Work with business and cross-functional teams to gather and document requirements.
  • Provide support to ensure the availability and performance of ETL/ELT jobs.
  • Provide technical assistance and cross-training to business and internal team members.
  • Collaborate with business partners for continuous improvement opportunities.

Requirements

  • 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.
  • Strong hands-on expertise in Python and SQL.
  • Solid experience with GCP and Vertex AI.
  • Experience in designing and building scalable data pipelines for extraction, transformation, and loading.
  • Hands-on experience with GCP Cloud data implementation projects including Dataflow, DataProc, Cloud Composer, BigQuery, Cloud Storage, GKE, and Airflow.
  • At least 5 years of experience in Data Governance and Metadata Management.
  • Strong understanding of relational and dimensional data modeling.
  • Experience in DevOps and CI/CD related technologies.
  • Excellent written and verbal communication skills, including technical documentation.

Benefits

  • Health insurance
  • Incentive and recognition program
  • 401K contribution
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service