Lead Data Engineer (AWS, Azure, GCP)

Captech Ventures - Herndon, VA

Full-time - Mid Level

Herndon, VA

Professional, Scientific, and Technical Services

About the position

CapTech is seeking Data Engineering consultants to help clients build and maintain advanced data systems that integrate data from various sources. The role involves designing, implementing, and maintaining modern data pipelines using cloud technologies, while collaborating with clients and internal teams to deliver optimal data engineering solutions.

Responsibilities

• Act as a trusted advisor to customers on best practices and methodologies for data engineering solutions.
• Design, implement, and maintain modern data pipelines using appropriate cloud technologies.
• Collaborate with product owners and business SMEs to analyze customer requirements and provide sustainable engineered solutions.
• Provide technical leadership and ensure alignment of technical solutions with customer needs.
• Stay updated with the latest cloud technologies and share knowledge with stakeholders.

Requirements

• 5+ years of experience delivering data engineering solutions on cloud platforms.
• 5+ years of experience building and operating highly available distributed systems for data extraction, ingestion, and processing large data sets.
• Advanced proficiency with at least one ETL/Data Orchestration technology (e.g., Azure Data Factory, SSIS, Informatica).
• Experience with cloud-based data warehousing and data lake solutions (e.g., Snowflake, Redshift, Databricks).
• 5+ years of experience with SQL or NoSQL databases (e.g., PostgreSQL, MySQL, SQL Server).
• Expertise in SQL, database design, and data structure (star, snowflake schemas).
• 5+ years of experience with at least one programming language (e.g., Python, Java, R).
• Familiarity with DevOps tools (e.g., git, Jenkins, CI/CD).
• Fundamental understanding of big data, open source, and data streaming concepts.

Nice-to-haves

• Cloud certification on any platform is a plus.
• Experience providing technical leadership and mentoring other engineers in the data engineering space.

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex - hybrid workforce support
• Learning & Development programs
• Modern Health mental health platform
• Carrot Fertility coverage
• Fringe stipend program for lifestyle benefits
• Employee Resource Groups for diversity and inclusion
• Philanthropic Partnerships opportunities
• 401(k) Matching with no vesting period