Senior Data Engineer

Eagle Eye Technologies - Charlotte, NC

Full-time - Senior

Charlotte, NC

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer role involves designing and developing data integration workflows, optimizing data processes, and ensuring compliance with regulatory reporting requirements. The position requires extensive experience in data engineering, particularly with technologies such as Spark, Python, and Scala, and emphasizes collaboration with cross-functional teams to implement data governance and lineage solutions.

Responsibilities

• Design and develop data integration workflows using PySpark.
• Optimize data processes in SQL Server and manage database performance.
• Utilize Autosys for job scheduling and monitoring.
• Collaborate with cross-functional teams to implement data governance and lineage solutions.
• Develop and maintain stored procedures and perform ETL operations.
• Leverage Spark and object storage technologies for big data solutions.
• Ensure compliance with regulatory reporting requirements.

Requirements

• Bachelor's degree in computer science, Information Technology, or a related field.
• 12+ years of experience in data engineering, with a focus on Spark, Python, and Scala.
• Strong knowledge of Unix/Linux operating systems.
• Proficiency in developing stored procedures and ETL processes.
• Understanding of data governance frameworks and metadata management.
• Familiarity with GL, finance, and regulatory reporting is a plus.
• Excellent problem-solving and communication skills.

Nice-to-haves

• Familiarity with GL, finance, and regulatory reporting.

Benefits

• Capgemini will pay expenses for non-local candidates to meet and greet prior to starting their assignment.