SENIOR DATA ENGINEER- REMOTE

$120,000 - $140,000/Yr

Compass Group - Charlotte, NC

Full-time - Mid Level

Remote - Charlotte, NC

10,001+ employees

Merchant Wholesalers, Nondurable Goods

About the position

The Senior Data Engineer at Compass Technology plays a critical role in developing and maintaining data ingestion pipelines that support the company's diverse customer base and enhance business operations. This position focuses on designing scalable data infrastructure, ensuring data integrity, and optimizing performance, utilizing advanced technologies and methodologies in data engineering.

Responsibilities

• Design, build, test, and implement scalable data pipelines using Python and SQL.
• Maintain and optimize the performance of the Snowflake data warehouse, including data ingestion and query optimization.
• Extract data from APIs using Python and AWS Lambda, and automate workflows with AWS Airflow.
• Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
• Collaborate with other data engineers and architects to develop new pipelines and/or optimize existing ones.
• Maintain code via CI/CD processes as defined in the Azure DevOps platform.

Requirements

• 7+ years of experience in Data Engineering roles, focusing on building and implementing scalable data pipelines for data ingestion.
• Expertise in Snowflake, including data ingestion and performance optimization.
• Strong SQL skills for writing efficient queries and optimizing existing ones.
• Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc.
• Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc.
• Highly self-motivated and detail-oriented with strong communication skills.
• Familiarity with ETL/ELT processes.

Nice-to-haves

• Experience with Fivetran and DBT is a plus.

Benefits

• Medical
• Dental
• Vision
• Life Insurance/AD
• Disability Insurance
• Retirement Plan
• Paid Time Off
• Holiday Time Off (varies by site/state)
• Associate Shopping Program
• Health and Wellness Programs
• Discount Marketplace
• Identity Theft Protection
• Pet Insurance
• Commuter Benefits
• Employee Assistance Program
• Flexible Spending Accounts (FSAs)