Lead Databricks Administrator (84.51)

$166,400 - $187,200/Yr

ManpowerGroup - Cincinnati, OH

Full-time - Mid Level

Hybrid - Cincinnati, OH

Administrative and Support Services

About the position

Our retail domain client is seeking a Lead Databricks Administrator to join their team. As a Lead Databricks Administrator, you will be part of the client supporting Team. The ideal candidate will have Databricks, Unity, Python, and Azure experience, which will align successfully in the organization. The Lead Databricks Administrator will provide problem resolution for referred incidents and will also be responsible for the administration and management of our internally developed Databricks platform. This role is typically 20% project work and 80% incident management, focusing on the support of our Databricks platform and associated tools. The team is responsible for the Databricks platform, enabling new tools to ensure data governance, adherence to security standards, and the ability to scale our solutions. The project person will be supporting Business as Usual operations, setting up infrastructures as a team, and problem-solving as questions arise. In this role, you will investigate and analyze new technical possibilities, tools, and techniques that reduce complexity, create a more efficient and productive delivery process, or create better technical solutions that increase business value. You will be responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met. Additionally, you will ensure all changes to production systems are planned and approved in accordance with the Change Management process. You will have complete ownership of 2-3 technologies, including maintaining, upgrading, training, inspiring, and mentoring team members. Working with internal customers to resolve Databricks issues will also be a key part of your responsibilities, along with diagnosing standard deployments and investigating issues to determine root causes.

Responsibilities

• Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity and create a more efficient delivery process.
• Responsible for meeting Service Level Agreement (SLA) targets and ensuring team targets are met.
• Ensure all changes to Production systems are planned and approved in accordance with the Change Management process.
• Responsible for 2-3 technologies including complete ownership of all aspects of the technology (maintain, upgrade, train, inspire, and mentor).
• Work with internal customers on resolving Databricks issues.
• Ability to diagnose standard deployments and investigate issues to determine root cause.

Requirements

• 3 or more years' experience providing 2nd and/or 3rd line support in a fast-paced environment.
• 2+ years of experience with Databricks and integration with other Azure technologies.
• 6+ months of experience with Unity Catalog and use of other Databricks tools such as Databricks Workflows, Delta Sharing, Serverless, and SQL Warehouses.
• 2+ years of experience with coding in Python and Spark with performance tuning background.
• 1+ years of solid experience with development of Terraform as Infrastructure as Code (IaaC).
• 1+ years of experience in Terraform Cloud, Azure Functions, Github, CI/CD deployments preferred.
• Experience with cloud cost monitoring and tagging resources in a defined hierarchy.
• Experience in troubleshooting data pipelines in Spark.
• Experience in Azure Security and Databricks architecture is preferred.

Nice-to-haves

• Strong interpersonal and communication skills.
• Ability to solve problems and work to tight deadlines.
• Welcomes and embraces change.
• Ability to work in a highly collaborative environment.