Data Engineer Level 3

The Judge Group - New York, NY

Full-time

Onsite - New York, NY

Administrative and Support Services

About the position

The Data Engineer role focuses on driving digital innovation by leveraging advanced technologies to enhance and transform core data assets across various platforms, including SQL, NoSQL, and Cloud environments. The position involves developing migration plans, conducting analyses, and implementing data strategies to optimize efficiency and quality.

Responsibilities

• Develop high-level migration plans to bridge gaps between current and future states.
• Present cost/benefit analyses to leadership to inform architectural decisions.
• Analyze the technology environment to identify critical deficiencies and recommend improvements.
• Interpret data and analyze results using statistical techniques.
• Develop and implement data analyses, data collection systems, and strategies to optimize statistical efficiency and quality.
• Acquire data from primary or secondary sources and maintain databases.
• Promote the reuse of data assets, including managing the data catalog for reference.

Requirements

• Experience with Azure or GCP data platforms, with a willingness to learn and work in both.
• Strong Databricks experience in Azure or GCP environments.
• Proficiency in acquiring data from primary or secondary sources and maintaining databases.
• Ability to lead the analysis of the technology environment to detect deficiencies and recommend solutions.
• Strong Python coding skills, with the capability to understand and build complex, reusable frameworks.