Databricks Developer

$106,808 - $146,536/Yr

Concept Software & Services - Morris Plains, NJ

Full-time - Senior

Remote - Morris Plains, NJ

Professional, Scientific, and Technical Services

About the position

The Databricks Developer role at Concept Software & Services Inc involves developing solutions using Databricks and Snowflake for the US Health Services Vertical. This position requires a strong background in data engineering and cloud technologies, particularly in the context of clinical data management.

Responsibilities

• Develop DataBricks and Snowflake solutions for Clinical Data Mart
• Implement CI/CD pipelines using Jenkins
• Utilize Spark RDD, Data Frames, Spark SQL, and Py-Spark for data processing
• Work with AWS Cloud and DevOps practices
• Collaborate with team members to ensure project success

Requirements

• Bachelor's degree in a relevant field
• 10 years of experience with DataBricks
• 8 years of experience with Snowflake
• Strong knowledge of Spark technologies including RDD, Data Frames, Spark SQL, and Py-Spark
• Experience with AWS Cloud and DevOps practices
• Proficiency in Jenkins for CI/CD pipelines
• Familiarity with Terraform for infrastructure as code

Benefits

• Hybrid work environment
• Competitive hourly pay ranging from $51.35 to $70.45