Data Engineer (AWS, Azure, GCP)

Captech Ventures - Middle City West, PA

Full-time - Entry Level

Middle City West, PA

Professional, Scientific, and Technical Services

About the position

The Data Engineer - Cloud position at CapTech involves enabling clients to build and maintain advanced data systems that integrate data from various sources. The role focuses on developing data pipelines and preparing data for use by data scientists and analysts, leveraging cloud infrastructure to deliver scalable solutions. The position emphasizes collaboration, problem-solving, and providing creative solutions to meet client needs.

Responsibilities

• Developing data pipelines and other data products using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Advising clients on specific technologies and methodologies for utilizing cloud resources to efficiently ingest and process data quickly
• Utilizing engineering best practices to solve complex data problems
• Collaborating with end users, development staff, and business analysts to maximize the value of client data across the organization
• Articulating architectural differences between solution methods and the advantages/disadvantages of each

Requirements

• Experience delivering solutions on a major cloud platform
• Ability to think strategically and relate architectural decisions/recommendations to business needs and client culture
• Experience in the design and implementation of data architecture solutions
• A wide range of production database experience, usually including substantial SQL expertise, database administration, and scripting data pipelines
• Ability to assess and utilize traditional and modern architectural components based on business needs
• Demonstrable ability to deliver production data pipelines and other data products

Nice-to-haves

• Experience with SQL, Python, Java, R, C# / C++ / C
• Familiarity with SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle
• Experience with DevOps tools like git, docker, subversion, Kubernetes, Jenkins
• Knowledge of technologies such as Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
• Certifications like AWS Cloud Practitioner, Microsoft Azure Data Fundamentals, Google Associate Cloud Engineer

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex - Employee-first mentality supporting a hybrid workforce
• Learning & Development programs offering certification and tuition support
• Modern Health - mental health and well-being platform
• Carrot Fertility - inclusive fertility and family-forming coverage
• Fringe - company paid stipend program for personalized lifestyle benefits
• Employee Resource Groups promoting diversity and inclusion
• Philanthropic Partnerships for community engagement
• 401(k) Matching with no vesting period