Data Engineer

North Highland - Oklahoma City, OK

Full-time - Mid Level

Oklahoma City, OK

1,001-5,000 employees

Professional, Scientific, and Technical Services

About the position

North Highland is seeking a Data Engineer with a strong technical background and practical business experience to design and implement data infrastructure for a conversational analytics project in a Google Cloud Platform (GCP) environment. The role involves delivering data solutions in client environments while collaborating with cross-functional teams to ensure effective communication and project success.

Responsibilities

• Design and implement scalable data pipelines in GCP for processing large volumes of conversational data
• Build and maintain data lakes and data warehouses using GCP services such as BigQuery and Cloud Storage
• Develop ETL processes to integrate data from various sources, including speech-to-text APIs and natural language processing tools
• Implement real-time data streaming solutions using tools like Cloud Pub/Sub and Dataflow
• Optimize data models and query structures for improved performance and cost-efficiency in BigQuery
• Collaborate with AI / machine learning engineers to prepare data for AI/ML model training and deployment
• Ensure data quality, security, and compliance with data governance policies
• Implement logging and monitoring solutions for data pipelines and infrastructure

Requirements

• 5+ years of experience in a Data Engineering role, with at least 2 years working on GCP
• Strong expertise in building and optimizing big data pipelines and architectures in cloud environments
• Proficiency in SQL and experience with BigQuery
• Experience with GCP data services such as Dataflow, Dataproc, and Cloud Composer
• Knowledge of data modeling, data warehousing, and dimensional modeling techniques
• Familiarity with NoSQL databases and data lakes
• Experience with stream processing technologies like Apache Beam or Kafka
• Strong programming skills in Python or Java

Benefits

• PTO
• Medical
• Dental
• Vision
• STD/LTD
• Life Insurance
• FSA/HSA
• 401(k)
• Commuter benefits
• Legal assistance