Big Data Engineer - Hadoop, Spark, SQL

$122,470 - $137,987/Yr

Motion Recruitment - Woodbridge Township, NJ

Full-time - Mid Level

Woodbridge Township, NJ

Administrative and Support Services

About the position

The Big Data Engineer position at Motion Recruitment Partners involves working with a leading financial services company to develop and implement data solutions using technologies such as Hadoop, Spark, and SQL. This role is crucial for supporting the Data Engineering team and ensuring the availability and performance of applications. The position is hybrid and offers a long-term contract opportunity with a competitive benefits package.

Responsibilities

• Develop and implement data solutions using Spark, Hadoop, and Hive.
• Design and develop ETL processes to move data from various sources including flat files, JSON, and Oracle.
• Write complex T-SQL for stored procedures, data loads, and views.
• Deploy database components from lower environments to UAT/Production environments.
• Provide production support for the Data Engineering team.
• Coordinate with various teams including Infrastructure and Network Security.
• Monitor batch jobs and ensure application availability.
• Ensure compliance with company policies regarding third-party solutions and Information Security.

Requirements

• 8+ years of application development and implementation experience using Spark, Hadoop, Hive, Python/Scala.
• Strong experience in T-SQL development including complex stored procedures and data loads.
• Experience in writing AUTOSYS JIL commands.
• 3+ years of experience with Agile tools.
• A BS/BA degree or higher in Information Technology, Computer Science, or Mathematics.

Nice-to-haves

• 3+ years of experience designing and implementing process solutions for automation.
• 3+ years of build-deploy automation and configuration experience.
• 3+ years of advanced SQL and data development experience.
• 1+ year of experience with DevOps environments.
• An industry-standard technology certification.

Benefits

• Medical Insurance - Four medical plans to choose from for you and your family
• Dental & Orthodontia Benefits
• Vision Benefits
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
• Hospital Indemnity Insurance
• 401(k) including match with pre and post-tax options
• Paid Sick Time Leave
• Legal and Identity Protection Plans
• Pre-tax Commuter Benefit
• 529 College Saver Plan