Transdev - Paramus, NJ

posted about 1 month ago

Full-time - Manager
Paramus, NJ
5,001-10,000 employees
Transit and Ground Passenger Transportation

About the position

As the Manager of Data Engineering at Veolia North America, you will lead a team of data engineers responsible for developing and managing data systems. This role involves strategic oversight of data integration, system development, and team management to ensure the delivery of efficient and effective data solutions. You will collaborate with various stakeholders to align data engineering goals with organizational objectives while driving innovation in data management and analytics solutions.

Responsibilities

  • Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing.
  • Lead strategic planning for key service development of our data lake core stack such as data ingestion, pipeline optimization, data transformation, orchestration etc.
  • Manage a team of data engineers, providing mentorship and career development.
  • Collaborate with various stakeholders to align data engineering goals with organizational objectives.
  • Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes.
  • Ensure data security and compliance with relevant data protection regulations.
  • Drive innovation in data management and analytics solutions.
  • Work in an Agile environment that focuses on collaboration and teamwork.
  • Oversee the development and maintenance of data infrastructure.
  • Monitor production job schedule and correct job failures in a timely manner.

Requirements

  • MS degree in Computer Science or computer related field from an accredited institution.
  • 7+ years proven experience as a Data Engineer or similar role.
  • 7+ years of strong experience building, running and maintaining datalake(s) and warehouse(s) in a cloud environment.
  • Strong leadership skills with a track record of team development.
  • More than 4 years of experience developing with Python.
  • 4+ years performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
  • 4+ years SQL development experience.
  • Experience with data modeling.
  • 4+ years bash scripting experience.
  • Strong experience with Git, CI/CD (preferably GitLab), Docker and Terraform.
  • Experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
  • Strong experience with GCP services.
  • Experience designing and building data pipelines using tools like Apache Beam, CDAP (Data Fusion) or other ETLs.
  • Knowledge with CDC design patterns and their challenges.
  • Experience with DAG workflows orchestration such as Apache Airflow.
  • Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
  • Experience designing and developing APIs is a plus (i.e using FastAPI, Flask).

Nice-to-haves

  • Google Cloud Data Engineer certification (nice to have).
  • Terraform Associate Certification (nice to have).

Benefits

  • Vision insurance
  • Paid time off
  • 401(k) plan
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service