Lead Data Engineer (AWS, Azure, GCP)

Captech - Philadelphia, PA

Full-time - Mid Level

Philadelphia, PA

Repair and Maintenance

About the position

CapTech is seeking Data Engineering consultants to enable clients to build and maintain advanced data systems that integrate data from various sources for informed decision-making. The role involves designing, implementing, and maintaining modern data pipelines using cloud technologies, while collaborating with product owners and business stakeholders to deliver optimal solutions. The position emphasizes technical leadership, staying current with cloud technologies, and sharing knowledge within a collaborative environment.

Responsibilities

• Act as a trusted advisor to customers on best practices, methodologies, and technologies for data engineering solutions.
• Design, implement, and maintain modern data pipelines utilizing appropriate cloud technologies.
• Collaborate with product owners and business SMEs to analyze customer requirements and provide sustainable engineered solutions.
• Provide technical leadership and ensure alignment of technical solutions with customer needs across teams.
• Stay updated with the latest cloud technologies and share knowledge with stakeholders.

Requirements

• 5+ years of experience delivering data engineering solutions on cloud platforms.
• Experience building and operating highly available distributed systems for data extraction, ingestion, and processing large data sets.
• Advanced proficiency with at least one ETL/Data Orchestration technology (e.g., Azure Data Factory, SSIS, Informatica).
• Experience with cloud-based data warehousing and data lake solutions (e.g., Snowflake, Redshift, Databricks).
• 5+ years of experience with SQL or NoSQL databases (e.g., PostgreSQL, MySQL, SQL Server).
• Expertise in SQL, database design, and data structure (star, snowflake schemas).
• 5+ years of experience with at least one programming language (e.g., Python, Java, R).
• Familiarity with DevOps tools (e.g., git, Jenkins, CI/CD).
• Fundamental understanding of big data, open source, and data streaming concepts.
• Experience providing technical leadership and mentoring other engineers in data engineering.

Nice-to-haves

• Cloud certification on any platform.

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex - hybrid workforce support
• Learning & Development programs
• Modern Health mental health platform
• Carrot Fertility coverage
• Fringe stipend program for lifestyle benefits
• Employee Resource Groups for diversity and inclusion
• Philanthropic Partnerships for community engagement
• 401(k) Matching with no vesting period