Databricks Architect

ZipRecruiter - Raritan, NJ

Full-time - Senior

Raritan, NJ

About the position

This position requires a highly experienced technical professional with over 15 years of expertise in data governance and data warehousing. The role focuses on setting up and deploying DataBricks as a Service model, along with hands-on experience in cloud data lakes. The candidate will be responsible for designing and implementing data warehousing technologies and scaling big data workloads efficiently. Additionally, the role involves supporting enterprise customers by creating reference architectures and integrating Databricks with third-party applications.

Responsibilities

• Set up DataBricks as a Service model for production deployment.
• Design and implement data governance solutions and data warehousing technologies.
• Scale big data workloads to be performant and cost-effective using technologies like Delta Lake.
• Support enterprise customers by authoring reference architectures and demo applications.
• Integrate Databricks with third-party applications to enhance customer architectures.
• Design and implement architectures within public clouds such as AWS, Azure, or GCP.

Requirements

• 15+ years of experience in a technical role with a focus on data governance and data warehousing.
• Hands-on experience with cloud data lakes.
• Experience in designing and implementing data warehousing technologies.
• Deep expertise in scaling big data workloads effectively.
• Proficiency in using Delta Lake and other big data technologies.
• Strong communication skills.