Data Engineer, Darden School of Business

University of Virginia - Charlottesville, VA

Full-time - Mid Level

Charlottesville, VA

Educational Services

About the position

The University of Virginia Darden School of Business is seeking a skilled Data Engineer to join its Strategic IT Data & Analytics team. This role is essential for building and maintaining the data infrastructure, focusing on the efficient extraction, loading, and transformation (ELT) of data from various sources into cloud data environments. The position offers a collaborative work environment with opportunities for remote work, requiring onsite presence for one week each quarter.

Responsibilities

• Develop and implement efficient and scalable metadata-driven data pipelines using cloud-based ELT pipelines.
• Collaborate with cross-functional teams to understand data requirements and ensure smooth integration of data sources.
• Build models, data integration workflows, and data transformation processes to support data analysis, reporting, and visualization.
• Develop, orchestrate, and maintain data pipelines and data processing workflows, ensuring data quality, reliability, and performance.
• Develop and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering artifacts.
• Identify and address performance bottlenecks and data quality issues in collaboration with the data operations team.
• Monitor and troubleshoot data pipelines to ensure high availability, scalability, and optimal performance.
• Develop and maintain integrations between the cloud data platform and the enterprise data governance platform.
• Assist in implementing data governance and security measures to ensure compliance with data protection regulations and industry best practices.
• Stay current with emerging trends, design patterns, and technologies in data engineering and cloud-based data processing.

Requirements

• Bachelor's degree in Computer Science, MIS, Computer Engineering, Business Administration or related discipline.
• At least five years of professional work experience, with relevant experience considered in lieu of a degree.
• Certification as Databricks Data Engineer Associate or Professional, or progress to complete certification within six months of joining.
• Proven work experience as a Data Engineer or in a similar role, focusing on developing and implementing data pipelines and ETL/ELT processes.
• Strong proficiency in working with Databricks and Unit.

Nice-to-haves

• Master's degree in a related field.