Ian Martin - New York, NY

posted about 2 months ago

Full-time - Senior
Remote - New York, NY
Truck Transportation

About the position

The Lead Data Engineer position is a full-time, permanent role primarily focused on leading the design and optimization of data pipelines within a non-profit organization that values innovation and customer service. This role offers a unique opportunity to work in a hybrid environment, allowing for mostly remote work with occasional travel to the headquarters once a quarter. The organization is dedicated to cultivating excellence and is looking for skilled technical professionals to contribute to meaningful and impactful projects. As a Lead Data Engineer, you will be part of a team that emphasizes learning and growth, providing a platform to build skills alongside industry leaders. The organization prides itself on fostering a workplace that encourages challenge, achievement, and personal development. In this role, you will be responsible for directing the development of data models that reflect critical business processes and shaping the data architecture strategy across various cloud platforms, including Azure, AWS, and Google Cloud. You will also orchestrate Agile/SCRUM frameworks to ensure efficient project delivery and guide collaboration with data scientists and engineering teams, mentoring them for continuous growth. Establishing and enforcing data quality standards and governance policies will be a key part of your responsibilities, along with monitoring and refining data infrastructure performance to resolve bottlenecks in cloud and Big Data environments. Staying updated with emerging data engineering technologies and methodologies will be essential to your success in this position.

Responsibilities

  • Lead the design and optimization of data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks.
  • Direct the development of data models to mirror critical business processes.
  • Shape and enhance data architecture strategy across cloud platforms (Azure, AWS, Google Cloud).
  • Orchestrate Agile/SCRUM frameworks to drive efficient project delivery.
  • Guide collaboration with data scientists and engineering groups, mentoring teams for continuous growth.
  • Establish and enforce data quality standards and governance policies.
  • Monitor and refine data infrastructure performance, resolving bottlenecks in cloud and Big Data environments.
  • Stay at the forefront of emerging data engineering technologies and methodologies.

Requirements

  • Bachelor's Degree in Computer Science, Data Science, Information Technology, or related fields.
  • 10+ years of progressive experience in data engineering.
  • Extensive experience with SQL Server, Oracle, or other RDBMS.
  • Advanced proficiency in SQL and Python.
  • Proven leadership in data modeling and architecture.
  • Expertise with cloud data platforms (Azure, AWS, Google Cloud) and Big Data technologies like Spark.
  • Senior-level experience with Agile and SCRUM methodologies.

Benefits

  • Flexible pay rate
  • Hybrid work environment
  • Opportunity for professional growth and development
  • Workplace that values diversity and inclusion
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service