Motion Recruitment - Woodbridge Township, NJ
posted 2 months ago
Full-time - Mid Level
Woodbridge Township, NJ
Administrative and Support Services
About the position
The Big Data Engineer position at a leading Financial Services Company involves working with advanced technologies such as Hadoop, Spark, and SQL to develop and implement data solutions. This long-term contract role focuses on application development, ETL processes, and production support within a global technology team. The engineer will collaborate with various teams to ensure the deployment and automation of data processes, while adhering to company policies and ITIL standards.
Responsibilities
- Design and develop ETL processes to move data from various sources including Flat files, JSON, and Oracle.
- Write complex stored procedures and data loads using T-SQL.
- Deploy database components from lower environments to UAT/Production environments.
- Provide production support for the Data Engineering team.
- Coordinate with Infrastructure, Network Security, and Support teams across Market Surveillance technology.
- Monitor batch jobs and ensure application availability.
- Ensure compliance with company policies regarding third-party solutions and Information Security.
Requirements
- 8+ years of application development and implementation experience using Spark, Hadoop, Hive, Python/Scala.
- Strong experience in T-SQL development including complex stored procedures and data loads.
- Experience in writing AUTOSYS JIL commands.
- 3+ years of experience with Agile tools.
- A BS/BA degree or higher in Information Technology, Computer Science, or Mathematics.
Nice-to-haves
- 3+ years of experience designing and implementing process solutions for automation.
- 3+ years of build-deploy automation and configuration experience.
- 3+ years of advanced SQL and data development experience.
- 1+ year of experience with DevOps environments.
- An industry-standard technology certification.
Benefits
- Competitive benefit package for long-term contract employees.
