Lead Data Engineer (AWS, Azure, GCP)

Captech Ventures - Chicago, IL

Full-time - Mid Level

Chicago, IL

Professional, Scientific, and Technical Services

About the position

The Lead Data Engineer at CapTech is responsible for designing, implementing, and maintaining advanced data systems that integrate data from various sources to support decision-making processes. This role involves leveraging cloud technologies to build data pipelines and provide technical leadership while collaborating with clients and internal teams. The position emphasizes problem-solving, creativity, and staying current with the latest cloud technologies to deliver optimal data engineering solutions.

Responsibilities

• Be a trusted advisor to customers on best practices, methodologies, and technologies for data engineering solutions.
• Design, implement, and maintain modern data pipelines using appropriate cloud technologies.
• Partner with product owners and business SMEs to analyze customer requirements and provide sustainable engineered solutions.
• Provide technical leadership and collaborate within and across teams to align technical solutions with customer needs.
• Stay current with the latest cloud technologies and share knowledge with stakeholders.

Requirements

• 5+ years of experience delivering data engineering solutions on cloud platforms (AWS, Azure, GCP).
• Experience building and operating highly available distributed systems for data extraction, ingestion, and processing large datasets.
• Advanced proficiency with at least one ETL/Data Orchestration technology (e.g., Azure Data Factory, SSIS, Informatica).
• Experience with cloud-based data warehousing and data lake solutions (e.g., Snowflake, Redshift, Databricks).
• 5+ years of experience with SQL or NoSQL databases (e.g., PostgreSQL, MySQL, SQL Server).
• Expertise in SQL, database design, and data structure (star, snowflake schemas).
• 5+ years of experience with at least one programming language (e.g., Python, Java, R).
• Familiarity with DevOps tools (e.g., git, Jenkins, CI/CD).
• Fundamental understanding of big data, open source, and data streaming concepts.
• Experience providing technical leadership and mentoring other engineers.

Nice-to-haves

• Cloud certification on any platform.

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex - hybrid workforce support
• Learning & Development programs
• Modern Health mental health platform
• Carrot Fertility coverage
• Fringe stipend program for lifestyle benefits
• Employee Resource Groups for diversity and inclusion
• Philanthropic Partnerships opportunities
• 401(k) Matching with no vesting period