Senior Data Engineer (Python, AWS, Spark)

Capital One • Norfolk, VA

435d • $165,100 - $188,500

About The Position

As a Senior Data Engineer at Capital One, you will play a crucial role in building and pioneering technology solutions that address complex business challenges. This position involves collaborating with Agile teams to design, develop, and implement technical solutions using a variety of programming languages and cloud technologies. You will be at the forefront of driving transformation within the company, working with a team of experienced developers to deliver robust cloud-based solutions that empower millions of customers.

Requirements

• Bachelor's Degree
• At least 3 years of experience in application development (Internship experience does not apply)
• At least 1 year of experience in big data technologies.

Nice To Haves

• 5+ years of experience in application development including Python, SQL, Scala, or Java
• 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 3+ years experience with Distributed data/computing tools (Lake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 2+ year experience working on real-time data and streaming applications
• 2+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 2+ years of data warehousing experience (Redshift or Snowflake, Databricks)
• 3+ years of experience with UNIX/Linux including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Utilize programming languages like Java, Scala, Python, and work with Open Source RDBMS and NoSQL databases.
• Work with cloud-based data warehousing services such as Redshift and Snowflake.
• Participate in technology communities and mentor other engineering team members.
• Deliver cloud-based solutions that enhance customer experiences and financial empowerment.
• Perform unit tests and conduct code reviews to ensure high-quality code.

Benefits

• Comprehensive health benefits
• Financial benefits including performance-based incentives
• Inclusive workplace culture
• Opportunities for professional development and learning

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Credit Intermediation and Related Activities
• Education Level: Bachelor's degree