Databricks Architect

$115,000 - $140,000/Yr

Wevision - Irvine, CA

Full-time - Mid Level

Remote - Irvine, CA

Professional, Scientific, and Technical Services

About the position

The Databricks Architect at WeVision LLC is responsible for architecting and designing solutions that meet both functional and non-functional requirements. This role involves leading the design, implementation, and optimization of the Databricks platform, ensuring it is optimized for performance, scalability, and reliability. The architect will collaborate with various teams to integrate the Databricks platform with other systems and technologies, while also delivering hands-on implementation using best practices in infrastructure as code and DevOps.

Responsibilities

• Architect and design solutions to meet functional and non-functional requirements.
• Lead the design, implementation, and optimization of the Databricks platform.
• Work closely with the data engineering team to optimize the Databricks platform for performance, scalability, and reliability.
• Develop and maintain a comprehensive understanding of the data pipeline and data architecture.
• Collaborate with other teams to ensure integration of the Databricks platform with other systems and technologies.
• Deliver hands-on implementation of Databricks and associated cloud infrastructure using best practices around infrastructure as code and DevOps.
• Create and review architecture and solution design artifacts.
• Evangelize re-use through the implementation of shared assets.
• Enforce adherence to architectural standards/principles and usability design standards.
• Proactively guide engineering methodologies, standards, and leading practices.
• Provide guidance to engineering staff and review as-built configurations during the construction phase.
• Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
• Analyze and compare various architectural options based on feasibility and impact, proposing actionable plans.
• Demonstrate strong analytical and technical problem-solving skills.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.
• 8+ years of experience in data warehousing, cloud architecture, and data integration, with at least 3 years focused on Databricks.
• Hands-on experience implementing the Databricks platform in a production environment using infrastructure as code and DevOps.
• Proficiency in Python, SQL, data modeling, and ETL processes, with familiarity in Azure cloud platforms.
• Experience building data engineering solutions using Microsoft Azure stack, including Azure Databricks, Azure Data Factory, Azure Event Hub, and Azure DevOps.
• Excellent communication skills to articulate complex technical concepts to both technical and non-technical stakeholders.

Nice-to-haves

• Experience in the full development lifecycle of Machine Learning.
• Familiarity with Agile/SCRUM development methodologies and software development lifecycle principles.