Lead Data Engineer, (Enterprise Platforms Technology)

Capital One - West McLean, VA

Full-time - Mid Level

West McLean, VA

Credit Intermediation and Related Activities

About the position

The Lead Data Engineer at Capital One will play a crucial role in driving technological transformation within the organization. This position involves collaborating with Agile teams to design, develop, and implement technical solutions using a variety of programming languages and cloud-based services. The role emphasizes the integration of data with emerging technologies to solve complex business problems in a fast-paced environment.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions.
• Work with developers experienced in machine learning, distributed microservices, and full stack systems.
• Utilize programming languages such as Java, Scala, Python, and work with RDBMS and NoSQL databases.
• Engage with cloud-based data warehousing services like Redshift and Snowflake.
• Stay updated on tech trends, experiment with new technologies, and mentor other engineers.
• Collaborate with digital product managers to deliver cloud-based solutions that enhance user experiences.
• Perform unit tests and conduct code reviews to ensure high-quality code.

Requirements

• Bachelor's Degree
• At least 4 years of experience in application development (excluding internship experience)
• At least 2 years of experience in big data technologies
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Nice-to-haves

• 7+ years of experience in application development with Python, Spark or PySpark
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi)
• 4+ years of experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 4+ years of data warehousing experience (Redshift or Snowflake)
• 4+ years of experience with UNIX/Linux including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices

Benefits

• Comprehensive health benefits
• Financial benefits
• Inclusive benefits supporting total well-being