Senior Data Engineer (Python, AWS, Python BDD Frameworks)

Capital One - Norfolk, VA

Full-time - Mid Level

Norfolk, VA

Credit Intermediation and Related Activities

About the position

The Senior Data Engineer at Capital One is responsible for designing, developing, testing, and implementing technical solutions in a collaborative Agile environment. This role focuses on marrying data with emerging technologies to solve complex business problems and drive transformation within the company. The engineer will work with a team experienced in machine learning and distributed microservices, utilizing various programming languages and cloud-based data warehousing services.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in machine learning and distributed microservices.
• Utilize programming languages like Java, Scala, Python, and Open Source RDBMS and NoSQL databases.
• Stay updated on tech trends and mentor other engineering community members.
• Collaborate with digital product managers to deliver cloud-based solutions.
• Perform unit tests and conduct code reviews to ensure code quality.

Requirements

• Bachelor's Degree
• At least 3 years of experience in application development
• At least 1 year of experience in big data technologies

Nice-to-haves

• 5+ years of experience in application development including Python, SQL, Scala, or Java
• 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 3+ years experience with Distributed computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 2+ years experience working on real-time data and streaming applications
• 2+ years experience working with testing frameworks (Pytest, Behave)
• 2+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 2+ years of data warehousing experience (Redshift or Snowflake)
• 3+ years of experience with UNIX/Linux including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices

Benefits

• Comprehensive health benefits
• Financial benefits
• Inclusive set of benefits supporting total well-being