The Judge Group - Los Angeles, CA
posted 2 months ago
As a Healthcare Cloud Data Engineer, you will be responsible for developing and maintaining scalable data pipelines, data lakes, and warehouses within cloud environments. Your primary focus will be on securely and efficiently handling healthcare data. You will work extensively with tools like Azure Data Factory (ADF) for orchestrating data workflows and Databricks for big data processing and analytics. Your role will ensure that the healthcare organization's data architecture supports real-time data processing, machine learning models, and business intelligence (BI) tools, while ensuring compliance with healthcare regulations. In this position, you will design and implement cloud-based data infrastructure tailored to healthcare organizations, focusing on scalability, security, and performance. You will build and maintain data lakes and data warehouses for healthcare data, ensuring support for both structured and unstructured data. Additionally, you will develop data pipelines using Azure Data Factory (ADF) for ingesting, transforming, and loading (ETL) data from various sources such as Payer modules, Electronic Health Records (EHR), clinical systems, and external healthcare data sources. You will also implement Databricks for large-scale data processing, data engineering, and machine learning workloads, enabling real-time data analytics and advanced insights. Your responsibilities will include building and maintaining automated data pipelines using ADF for moving and transforming healthcare data between cloud storage, databases, and analytics platforms. You will monitor, optimize, and troubleshoot data pipelines for performance, reliability, and scalability, ensuring that the data architecture meets the needs of the organization.