Senior Lead Data Engineer (Python, Spark, Aws)

$234,700 - $267,900/Yr

Capital One - Goochland, VA

Full-time - Senior

Goochland, VA

Credit Intermediation and Related Activities

About the position

The Senior Lead Data Engineer at Capital One is responsible for driving major transformations within the organization by leveraging data and emerging technologies. This role involves collaborating with Agile teams to design, develop, and implement technical solutions, while leading a team of developers in machine learning and distributed systems. The position focuses on foundational data capabilities, including migrating batch workloads to enhance governance and observability, and requires expertise in big data analytics and cloud computing.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Lead a team of developers with experience in machine learning and distributed microservices.
• Utilize programming languages such as Java, Scala, Python, and work with RDBMS and NoSQL databases.
• Share knowledge of tech trends and mentor other engineering community members.
• Collaborate with digital product managers to deliver cloud-based solutions.
• Perform unit tests and conduct code reviews to ensure high-quality code.

Requirements

• Bachelor's Degree
• At least 6 years of experience in application development
• At least 2 years of experience in big data technologies
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice-to-haves

• Master's Degree
• 9+ years of experience in application development including Python, SQL, Scala, or Java
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 5+ years of experience with distributed data/computing tools
• 4+ years of experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation
• 4+ years of data warehousing experience
• 4+ years of experience with UNIX/Linux
• 2+ years of experience with Agile engineering practices

Benefits

• Comprehensive health benefits
• Financial benefits including performance-based incentives
• Support for total well-being
• Diversity and inclusion initiatives