Databricks Administrator (25874)

$114,400 - $131,040/Yr

Computer Enterprises - Cincinnati, OH

Full-time - Mid Level

Cincinnati, OH

Professional, Scientific, and Technical Services

About the position

The Lead Databricks Administrator will play a crucial role in managing and administering the Databricks platform at Computer Enterprises, Inc. (CEI). This position is primarily focused on providing problem resolution for referred incidents, with a workload that is typically 20% project work and 80% incident management. The administrator will be responsible for the support of the Databricks platform and associated tools, ensuring that the team meets Service Level Agreement (SLA) targets and adheres to security standards. The role involves investigating and analyzing new technical possibilities, tools, and techniques that can reduce complexity and enhance the efficiency of the delivery process, ultimately increasing business value. In addition to managing the Databricks platform, the administrator will have complete ownership of 2-3 technologies, which includes maintaining, upgrading, training, and mentoring team members. The role requires collaboration with internal customers to resolve Databricks issues and the ability to diagnose standard deployments to determine root causes of problems. The ideal candidate will have a strong background in Databricks and integration with Azure technologies, as well as experience with Unity Catalog and other Databricks tools such as Databricks Workflows, Delta Sharing, Serverless, and SQL Warehouses. A solid understanding of Terraform as Infrastructure as Code (IaaC) and experience with cloud cost monitoring are also essential for this position.

Responsibilities

• Provide problem resolution for referred incidents related to the Databricks platform.
• Administer and manage the internally developed Databricks platform.
• Engage in project work and incident management, with a focus on support for the Databricks platform and associated tools.
• Investigate and analyze new technical possibilities, tools, and techniques to enhance delivery processes and business value.
• Meet Service Level Agreement (SLA) targets and ensure team targets are met collaboratively.
• Plan and approve all changes to Production systems in accordance with the Change Management process.
• Take complete ownership of 2-3 technologies, including maintenance, upgrades, training, and mentoring.
• Work with internal customers to resolve Databricks issues and diagnose standard deployments to determine root causes.

Requirements

• 3 or more years' experience providing 2nd and/or 3rd line support in a fast-paced environment.
• Ability to solve problems and work to tight deadlines.
• Strong interpersonal and communication skills, with the ability to communicate with core infrastructure teams and non-technical business units.
• 2+ years of experience with Databricks and integration with other Azure technologies.
• 6+ months of experience with Unity Catalog and other Databricks tools such as Databricks Workflows, Delta Sharing, Serverless, and SQL Warehouses.
• 1+ years of solid experience with development of Terraform as Infrastructure as Code (IaaC).
• 1+ years of experience in Terraform Cloud, Azure Functions, Github, CI/CD deployments preferred.
• Experience with cloud cost monitoring and tagging resources in a defined hierarchy.
• Experience in troubleshooting data pipelines in Spark.
• Experience in Azure Security and Databricks architecture is preferred.

Nice-to-haves

• Experience with performance tuning in Spark.
• Familiarity with Azure Functions and CI/CD deployments.

Benefits

• Competitive hourly pay ranging from $55 to $63.
• Opportunity to work in a collaborative environment.
• Gain experience with cutting-edge technologies in data management.