Lead Databricks Administrator

Kforce - Cincinnati, OH

Full-time - Mid Level

Cincinnati, OH

Administrative and Support Services

About the position

Kforce has a client in Cincinnati, OH that is seeking a Lead Databricks Administrator to join their team on a 6-month contract to hire basis. The Lead Databricks Administrator will provide problem resolution for referred incidents and will be responsible for the administration and management of the internally developed Databricks platform. This role is typically divided into 20% project work and 80% incident management, focusing on the support of the Databricks platform and associated tools. The team is tasked with ensuring data governance, adherence to security standards, and the ability to scale solutions effectively. In this position, the Lead Databricks Administrator will investigate and analyze new technical possibilities, tools, and techniques that can reduce complexity, create a more efficient and productive delivery process, or develop better technical solutions that increase business value. The administrator will be responsible for meeting Service Level Agreement (SLA) targets and will work collaboratively to ensure that team targets are met. Additionally, the role requires ensuring that all changes to production systems are planned and approved in accordance with the Change Management process. The Lead Databricks Administrator will take complete ownership of 2-3 technologies, which includes maintaining, upgrading, training, inspiring, and mentoring team members. The role also involves working closely with internal customers to resolve Databricks issues, ensuring a high level of service and support for the platform.

Responsibilities

• Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity and create a more efficient delivery process.
• Responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met.
• Ensure all changes to Production systems are planned and approved in accordance with the Change Management process.
• Responsible for 2-3 technologies including complete ownership of all aspects of the technology (maintain, upgrade, train, inspire, and mentor).
• Work with internal customers on resolving Databricks issues.

Requirements

• 3+ years of experience providing 2nd and/or 3rd line support in a fast-paced environment.
• 2+ years of experience with Databricks and integration with other Azure technologies.
• 2+ years of experience with coding in Python and Spark with performance tuning background.
• 1+ years of solid experience with development of Terraform as IaaC.
• 1+ years of experience in Terraform Cloud, Azure Functions, Github, CI/CD deployments preferred.
• 6+ months of experience with Unity Catalog and use of other Databricks tools such as Databricks Workflows, Delta Sharing, Serverless and SQL Warehouses.
• Ability to diagnose standard deployments and investigate issues to determine root cause.
• Ability to solve problems and work to tight deadlines.
• Ability to communicate with core infrastructure teams and non-technical business units.
• Strong interpersonal and communication skills.
• Willingness to embrace change.
• Ability to work in a highly collaborative environment.
• Experience with cloud cost monitoring and tagging resources in a defined hierarchy.
• Experience in troubleshooting data pipelines in Spark.
• Experience in Azure Security and Databricks architecture is preferred.

Benefits

• Medical, dental, and vision insurance
• Health Savings Account (HSA)
• Flexible Spending Account (FSA)
• 401(k) plan
• Life insurance
• Disability insurance
• Paid time off for salaried personnel
• Paid sick leave for hourly employees on Service Contract Act projects