The Judge Group - Philadelphia, PA
posted 2 months ago
As a Senior Data Engineer, you will be an integral part of our software development team, focusing on the creation and implementation of strategies and solutions for ingesting, storing, and distributing big data. This role requires a deep understanding of Big Data technologies, including but not limited to Hadoop, PySpark, Hive, JSON, and SQL. You will be responsible for developing products, tools, and software features that leverage these technologies to meet the needs of our clients and enhance our data capabilities. In this position, you will innovate and drive the development of data strategies and roadmaps that align with our technology organization’s project portfolio and business strategy. You will also be tasked with establishing enterprise standards for data domains and solutions, ensuring simplified integration and streamlined operational and analytical uses. Your role will involve leveraging innovative technologies to renovate and transform existing core data assets, which include SQL-based, NoSQL-based, and Cloud-based data platforms. You will define high-level migration plans to bridge the gaps between current and future states, typically in alignment with budgeting and capital planning processes. Additionally, you will lead the analysis of the technology environment to identify critical deficiencies and recommend solutions for improvement. Mentoring team members in data principles, patterns, processes, and practices will also be a key aspect of your responsibilities. You will promote the reuse of data assets and manage the data catalog for reference, ensuring that our data resources are utilized effectively. Your role will also involve drafting and reviewing architectural diagrams, interface specifications, and other design documents. You will proactively lead activities that create deliverables guiding the direction, development, and delivery of technological responses to targeted business outcomes. This includes providing facilitation, analysis, and design tasks necessary for developing an enterprise's data and information architecture, with a focus on treating data as a valuable asset for the organization. You will develop target-state guidance, including reusable standards, design patterns, and guidelines, to evolve the technical infrastructure related to data and information across the enterprise.