Data Engineer Azure

Brains Workgroup - Woodbridge Township, NJ

Full-time - Mid Level

Woodbridge Township, NJ

About the position

The Data Engineer Consultant position at a major bank in Iselin, NJ, involves designing, modeling, and developing Enterprise Data Warehouse solutions. The role requires hands-on experience with SQL and ETL tools, as well as participation in testing and migration efforts for a Cloud Data Platform. The consultant will work independently in a fast-paced environment, collaborating with stakeholders and providing guidance to less experienced staff.

Responsibilities

• Design, model, and develop Enterprise Data Warehouse solutions.
• Coordinate and execute SIT and UAT testing for Enterprise Data Warehouse solutions.
• Write SQL queries and programming including stored procedures and reverse engineer existing processes.
• Leverage SQL, programming languages (Python or similar), and ETL tools (Azure Data Factory, Data Bricks, Talend, SSIS) to develop data pipeline solutions.
• Contribute to an enterprise-wide Cloud Data Platform migration.
• Participate in the improvement of DevOps initiatives.
• Perform physical modeling and metadata analysis efforts.
• Provide database design guidance and troubleshoot problems with DBAs.
• Support ongoing data management efforts in Development, QA, and Production environments.
• Guide less experienced staff in resolving escalated issues and complex problems.
• Develop new documentation and ensure quality, security, and compliance requirements are met.

Requirements

• 6+ years of experience in development of high-availability, high volume transactional processing systems.
• Hands-on experience designing, modeling, and developing Enterprise Data Warehouse solutions.
• Proficient in writing SQL queries and programming including stored procedures.
• Experience coordinating and executing SIT and UAT testing for Enterprise Data Warehouse solutions.
• Proficient in data analysis and complex problem resolution.
• Experience with systems required to effectively process large volumes of both real-time and batch transactions.

Nice-to-haves

• Experience with Azure Cloud platform.
• Experience with Azure Data Factory or similar ETL tool.
• Experience with Azure Data Bricks.
• Knowledge of columnar Data Warehouse solutions like Snowflake, RedShift, Vertica, Greenplum.
• Experience in the capital markets industry.
• Snowflake development experience.
• SQL Server development experience.

Benefits

• Hybrid work model (3 days on-site)
• Potential for long-term contract extensions or option to hire