About the position
The Data Engineer will play a crucial role in implementing components of the Clinical Recruitment Platform (CRP) and establishing a comprehensive patient database. This position involves working collaboratively with cross-functional teams to develop products and ensure the effective management of data assets, while also addressing complex analytical challenges and improving existing products.
Responsibilities
- Implement components of the Clinical Recruitment Platform (CRP)
- Establish and maintain a comprehensive patient database
- Design processes and governance to manage data assets
- Collaborate with cross-functional teams including digital scrum teams and IT
- Identify, assess, and resolve complex analytical problems
- Respond to end-user needs and meet Service Level Agreements
- Develop, test, iterate, deploy, and improve current products
- Own deliverable timelines to ensure stable recruitment operations
Requirements
- Experience with cloud-based platforms (Azure preferred)
- Proficiency in Snowflake SQL/Spark for data engineering pipelines
- Understanding of deployment practices using containerization (Kubernetes, Docker)
- Experience in Python and SQL
- Strong critical thinking, communication, and problem-solving skills
- Experience building automated data pipelines
- Experience performing data analysis and exploration
- Experience in an agile delivery environment
- Understanding of DevOps best practices and CI/CD (Jenkins)
- Experience in a multi-developer environment using version control (Git)
- Experience with big data frameworks (Hadoop, Spark) - Azure Data Bricks preferred
