National Grid - Syracuse, NY
posted 2 months ago
As a Staff Data Engineer at National Grid, you will play a pivotal role in our Product Engineering department, focusing on making critical data accessible to our business teams. This position is available in various locations including Waltham, MA, Brooklyn, NY, Hicksville, NY, or Syracuse, NY, and is open to candidates residing in Connecticut, New Jersey, New Hampshire, Pennsylvania, Rhode Island, Vermont, or Maine. Your work will be centered around building end-to-end data pipelines that adhere to rigorous engineering standards and coding practices, ensuring that the data delivered is of the highest quality. You will also be instrumental in modernizing our architecture and tools, which will enhance our output, scalability, and speed. In this role, you will design and develop highly scalable and extensible data pipelines that facilitate the collection, storage, distribution, modeling, and analysis of large datasets from various channels. You will lead the Data Engineering team in developing, testing, documenting, and supporting scalable data pipelines. Additionally, you will build new data integrations, including APIs, to accommodate the increasing volume and complexity of data. Collaboration with analytics and business teams will be essential to improve data models that feed business intelligence tools, thereby increasing data accessibility and promoting data-driven decision-making across the organization. Your responsibilities will also include designing and implementing a data quality framework, writing unit/integration/functional tests, and documenting your work. You will automate the deployment of our distributed system for collecting and processing streaming events from multiple sources, and perform data analysis to troubleshoot and resolve data-related issues. As a mentor, you will guide junior engineers on coding best practices and optimization, fostering a culture of learning and excellence within the team.