Virtue Corporate Group - Irving, TX

posted 2 months ago

Full-time - Senior
Irving, TX
Publishing Industries

About the position

We are seeking a highly skilled Senior GCP Data Engineer with extensive experience in Java to join our team in Irving, TX. This position requires a minimum of 12 years of experience in the IT field, with a strong focus on Google Cloud Platform (GCP) technologies. The ideal candidate will have a deep understanding of GCP Data Flow, Big Query, Pub-Sub, and data analytics, as well as proficiency in SQL queries and KAFKA. Additionally, the candidate should possess strong programming skills in Python and be adept at tuning Spark jobs to optimize performance. In this role, you will be responsible for designing, developing, and maintaining data processing pipelines on GCP. You will work closely with data scientists and analysts to ensure that data is accessible and usable for analytics and reporting purposes. Your expertise in GCP and data engineering will be crucial in driving the success of our data initiatives and ensuring that our data infrastructure is robust and scalable. The position requires a hands-on approach to problem-solving and the ability to work collaboratively in a fast-paced environment. You will be expected to mentor junior engineers and contribute to the overall growth of the team. This is a long-term contract position with a duration of 36 months, and the client will validate the I-94 for work authorization purposes.

Responsibilities

  • Design, develop, and maintain data processing pipelines on GCP.
  • Collaborate with data scientists and analysts to ensure data accessibility and usability.
  • Optimize Spark jobs for performance tuning.
  • Implement and manage GCP Data Flow, Big Query, Pub-Sub, and KAFKA solutions.
  • Write and optimize SQL queries for data retrieval and analysis.
  • Mentor junior engineers and contribute to team growth.

Requirements

  • 12+ years of experience in IT.
  • Strong experience in GCP Data Flow with Java.
  • Proficiency in Big Query, Pub-Sub, and data analytics.
  • Strong SQL query skills.
  • Experience with KAFKA and data streaming technologies.
  • Strong experience in Spark, with the ability to tune Spark jobs.
  • Proficient in Python programming.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service