Senior Data Engineer

Vdart - Atlanta, GA

Full-time - Senior

Atlanta, GA

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer position is a contract role focused on designing, building, and deploying efficient data pipelines and data products. The role requires strong expertise in Azure services, Databricks, SQL, and Snowflake, and involves leading a team of data engineers in an Onshore-Offshore model while collaborating with customer SMEs. The ideal candidate will have a strong focus on automation and data quality, and will work closely with various stakeholders to meet data needs.

Responsibilities

• Design, build and deploy efficient & reliable data pipelines to move and transform data
• Optimize existing pipelines and maintain all source-related data pipelines
• Support on-call shift as needed to support the team
• Build and deploy extensive data quality checks to ensure high quality of data
• Build high-performance scalable data warehouses and data products
• Partner with leadership, engineers, product managers, and data scientists to understand data needs
• Improve existing data movement frameworks and add more features
• Focus on automation
• Utilize expert level SQL skills
• Engage in data modeling
• Implement CI/CD pipeline and DevOps practices
• Apply Agile fundamentals
• Prior use of Jira and GitLab

Requirements

• 10+ years of experience in data engineering
• 2 years of experience with Azure Services, Azure Data Factory, GitLab, Snowflake
• 5 years of experience with Azure DataBricks, Python, SQL
• 5 years of experience in Data Modeling, Data Analysis, Test Automation