Azure Data Engineer

Techno Talent Group - Conshohocken, PA

Full-time

Conshohocken, PA

Professional, Scientific, and Technical Services

About the position

The Azure Data Engineer will design, develop, and maintain data pipelines and ETL/ELT processes to support data-driven initiatives, particularly in healthcare or research environments. This role requires a strong technical background in data engineering and cloud technologies, specifically Azure, to implement complex data projects effectively.

Responsibilities

• Build and optimize ETL/ELT processes using Azure and Databricks.
• Collaborate with stakeholders to understand data requirements and translate them into effective ETL/ELT solutions.
• Implement and maintain cloud-based data platforms and services, leveraging Azure technologies.
• Design and deploy data solutions using Azure SQL Database for advanced analytics and machine learning.
• Monitor performance of data pipelines and troubleshoot issues to improve efficiency and reliability.

Requirements

• 10+ years of experience in data engineering or database management.
• 5+ years of experience with Azure services, including Azure Data Factory, Databricks, and Synapse.
• 5+ years of SQL skills for database management and query optimization.
• 3+ years of programming skills in Python.
• 5+ years of experience with data modeling, ETL processes, and data warehousing.

Nice-to-haves

• Experience with PySpark and SparkQL.
• Familiarity with big data technologies and frameworks.