Staff Data Engineer

$152,000 - $179,000/Yr

National Grid

posted 2 months ago

Full-time - Mid Level
Remote
Utilities

About the position

As a Staff Data Engineer at National Grid, you will play a pivotal role in our Product Engineering department, focusing on making critical data accessible to our business teams. This position is available in various locations including Waltham, MA, Brooklyn, NY, Hicksville, NY, or Syracuse, NY, and is open to candidates residing in nearby states such as Connecticut, New Jersey, New Hampshire, Pennsylvania, Rhode Island, Vermont, or Maine. Your work will be centered around building end-to-end data pipelines that adhere to rigorous engineering standards and coding practices, ensuring that the data delivered is of the highest quality and readily accessible to support business operations. In this role, you will lead a Data Engineering team, developing, testing, documenting, and supporting scalable data pipelines. You will be responsible for building new data integrations, including APIs, to accommodate the increasing volume and complexity of data. Your contributions will also extend to modernizing our architecture and tools, enhancing our output, scalability, and speed. You will collaborate closely with analytics and business teams to refine data models that enhance business intelligence tools, thereby promoting data-driven decision-making across the organization. Your responsibilities will include designing and developing data integrations and a data quality framework, writing unit, integration, and functional tests, and documenting your work. You will also design, implement, and automate the deployment of distributed systems for collecting and processing streaming events from multiple sources. Additionally, you will perform data analysis to troubleshoot and resolve data-related issues, while guiding and mentoring junior engineers on coding best practices and optimization techniques.

Responsibilities

  • Lead the Data Engineering Team to develop, test, document, and support scalable data pipelines.
  • Build out new data integrations including APIs to support continuing increases in data volume and complexity.
  • Build and implement scalable solutions that align with data governance standards and architectural roadmaps for data integrations, data storage, reporting, and analytic solutions.
  • Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
  • Design and develop data integrations and a data quality framework. Write unit/integration/functional tests and document work.
  • Design, implement, and automate deployment of our distributed system for collecting and processing streaming events from multiple sources.
  • Perform data analysis needed to troubleshoot data-related issues and aid in the resolution of data issues.
  • Guide and mentor junior engineers on coding best practices and optimization.

Requirements

  • 4-year college degree or equivalent combination of education and experience in Computer Science, Mathematics, Statistics, or related technical field.
  • 8 years of relevant work experience in analytics, data engineering, business intelligence, or related field.
  • Skilled in object-oriented programming, particularly in Python.
  • Strong experience in Python, PySpark, and SQL.
  • Strong experience in Databricks and Snowflake.
  • Experience developing integrations across multiple systems and APIs.
  • Experience with or knowledge of Agile software development methodologies.
  • Experience with cloud-based databases, specifically Azure technologies (e.g., Azure data lake, ADF, Azure DevOps, and Azure Functions).
  • Experience using SQL queries as well as writing and perfecting SQL queries in a business environment with large-scale, complex datasets.
  • Experience with data warehouse technologies.
  • Experience creating ETL and/or ELT jobs.

Benefits

  • Collaborative, team-oriented culture
  • Flexible work schedule options
  • Hybrid work structure allowing remote or office work as needed
  • Career path with advancement opportunities
  • Competitive salary based on experience and location
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service