Data Engineer III, Business Analytics

Pediatric Associates - Plantation, FL

Full-time - Mid Level

Remote - Plantation, FL

Ambulatory Health Care Services

About the position

The Data Engineer III, Business Analytics at Pediatric Associates is a pivotal role responsible for designing, building, and supporting a cutting-edge Data & Analytics technology platform aimed at enhancing value-based healthcare, population health management, and enterprise analytics. This position involves working with a cloud-based big data platform on Microsoft Azure, utilizing MS SQL Server stacks, and employing modern data engineering design patterns and tools. The Data Engineer will play a crucial role in ensuring the integrity and efficiency of data processes that support various analytics solutions, including data visualization, advanced analytics, data science, and machine learning. In this role, the Data Engineer will design, build, and maintain scalable and automated data pipelines that facilitate data ingestion, integration, and processing. This includes working with critical MS SQL databases and ensuring their health through regular database administration activities. The engineer will also support data pipelines with a scalable distributed architecture, utilizing technologies such as Azure Data Factory and Databricks for data processing. The position requires a strong understanding of best practices in data management, including master data, reference data, metadata, data quality, and lineage. The Data Engineer will engage with cross-functional stakeholders to identify pain points and business requirements, designing data solutions that adhere to best practices and modern architecture. This role also involves leading other Data Engineers, guiding them on best practices for the enterprise data platform, and architecting solutions that enhance the functionality of the data platform. The ideal candidate will have a strong background in data engineering, with a focus on creating robust, enterprise-grade data pipelines and a deep understanding of cloud-based data solutions.

Responsibilities

• Design and build scalable, automated data pipelines for data ingestion, visualization, advanced analytics, data science, and machine learning solutions.
• Support critical MS SQL databases and maintain their health through database administration activities.
• Manage data pipelines with a scalable distributed architecture, including data ingestion, integration, and processing using Azure Data Factory and Databricks.
• Build cloud data solutions using SQL, Python, Data Lake, Cloud Data Warehouse, and RDBMS.
• Implement best practices in managing data, including master data, reference data, metadata, data quality, and lineage.
• Deploy, automate, maintain, and manage cloud-based production systems to ensure availability, performance, scalability, and security.
• Engage with cross-functional stakeholders to identify pain points and design data solutions.
• Own end-to-end design and development, testing, and release of components using Databricks and Microsoft Azure.
• Lead and guide other Data Engineers on best practices for the enterprise data platform.
• Architect and deploy features and functionality within the enterprise data platform.

Requirements

• Minimum BA or BS degree in Computer Science, Information Systems, or related field required; MS in Business Analytics or related discipline preferred.
• Minimum 6 years of experience in creating enterprise-grade data engineering pipelines using SQL, Python, Apache Spark, ETL, ELT, and Azure Cloud Services; 8-10 years preferred.
• Minimum 5 years of experience in managing MS SQL server databases.
• Strong proficiency in SQL and data analysis required.
• Experience in distributed data processing techniques using Apache Spark, Hadoop, Hive, Kafka, and big data ecosystem technologies preferred.
• Experience in data modeling and design for data warehouse, relational databases, and NoSQL data stores preferred.

Nice-to-haves

• Healthcare industry experience highly desired.