gcp ai vertex data engineer

$104,000 - $115,440/Yr

Unclassified - Phoenix, AZ

posted 24 days ago

Full-time - Mid Level
Phoenix, AZ

About the position

The GCP AI Vertex Data Engineer role focuses on developing and operationalizing data solutions on Google Cloud Platform (GCP). The position requires strong expertise in data engineering, particularly in data warehousing and analytics, with a significant emphasis on Python and SQL. The engineer will work on creating frameworks for machine learning operations and ensuring compliance with AI governance, while also collaborating with cross-functional teams to meet business requirements.

Responsibilities

  • Create a framework for ML and LLM Ops.
  • Work on processes and flow of AI Compliance Governance framework.
  • Monitor the Data Lake and engage appropriate support teams as needed.
  • Create reports to monitor usage data for billing and SLA tracking.
  • Gather and document requirements with business and cross-functional teams.
  • Provide support to ensure the availability and performance of ETL/ELT jobs.
  • Provide technical assistance and cross-training to business and internal team members.
  • Collaborate with business partners for continuous improvement opportunities.

Requirements

  • 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.
  • Strong hands-on Python expertise.
  • Experience with GCP and Vertex AI.
  • 6 years of experience with one of the leading public clouds.
  • Experience in design and build of scalable data pipelines for extraction, transformation, and loading.
  • 6 years of hands-on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, BigQuery, Cloud Storage, GKE, Airflow, etc.).
  • At least 5 years of experience in Data Governance and Metadata Management.
  • Ability to work independently and solve problems while updating stakeholders.
  • Strong understanding of relational and dimensional data modeling.
  • Experience in DevOps and CI/CD related technologies.
  • Excellent written and verbal communication skills, including technical documentation.

Benefits

  • Health insurance
  • Incentive and recognition program
  • 401K contribution
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service