Lead Data Engineer (AWS, Azure, GCP)

Captech Ventures - Chicago, IL

Full-time - Mid Level

Chicago, IL

Professional, Scientific, and Technical Services

About the position

CapTech is seeking Data Engineering consultants to enable clients to build and maintain advanced data systems that integrate data from various sources. The role involves designing, implementing, and maintaining modern data pipelines using cloud technologies, while collaborating with clients and internal teams to deliver optimal data engineering solutions.

Responsibilities

• Act as a trusted advisor to customers on best practices, methodologies, and technologies for data engineering solutions.
• Design, implement, and maintain modern data pipelines utilizing appropriate cloud technologies.
• Collaborate with product owners and business SMEs to analyze customer requirements and provide sustainable engineered solutions.
• Provide technical leadership and ensure alignment of technical solutions with customer needs.
• Stay current with the latest cloud technologies and share knowledge with stakeholders.

Requirements

• 5+ years of experience delivering data engineering solutions on cloud platforms.
• 5+ years of experience building and operating highly available distributed systems for data extraction, ingestion, and processing large data sets.
• Advanced proficiency with at least one ETL/Data Orchestration technology (e.g., Azure Data Factory, SSIS, Informatica).
• Experience with cloud-based data warehousing and data lake solutions (e.g., Snowflake, Redshift, Databricks).
• 5+ years of experience with SQL or NoSQL databases (e.g., PostgreSQL, MySQL, SQL Server).
• Expertise in SQL, database design, and data structure (star, snowflake schemas).
• 5+ years of experience with at least one programming language (e.g., Python, Java, R).
• Familiarity with DevOps tools (e.g., git, Jenkins, CI/CD).
• Fundamental understanding of big data, open source, and data streaming concepts.

Nice-to-haves

• Cloud certification on any platform is a plus.

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex - hybrid workforce support
• Learning & Development programs
• Modern Health mental health platform
• Carrot Fertility coverage
• Fringe stipend program for lifestyle benefits
• Employee Resource Groups for diversity and inclusion
• Philanthropic Partnerships for community engagement
• 401(k) Matching with no vesting period