Databricks Senior Architect

About the position

As a Databricks Senior Architect, you will lead the development and implementation of data solutions using the Databricks platform. This role involves acting as a technical advisor, collaborating with development teams, and establishing architectural visions to drive data-driven outcomes. You will be responsible for architecting, deploying, and migrating workloads into production, while also contributing to the team's growth and sharing best practices.

Responsibilities

• Assist in architecting, developing, deploying, or migrating use cases and workloads into production on Databricks Lakehouse.
• Be the first contact for any technical challenges or questions related to development and production.
• Collaborate with users, technical, and support teams to complete projects in a timely manner.
• Implement Databricks Product Innovations, Private Previews, and Upgrades as needed.
• Provide regular internal and external updates on progress and risks/blockers to leadership.
• Contribute to the development of the team by sharing best practices and assets.
• Operate as an expert solution architect and trusted advisor for significant data analytics architecture, design, development, and adoption of the Databricks Data Intelligence Platform.
• Build Databricks serverless platform that powers big data, machine learning, and Gen AI workloads.
• Automatically improve the performance and efficiency of workloads running on the platform.
• Build multi- (SQL, Python) notebooks with a focus on Data Engineering and Data Science (AI/ML).

Requirements

• A minimum of a bachelor's degree in computer science, Information system, Engineering, Data Science, or equivalent experience through work experience.
• 5+ years of experience as an Architect within the domain of Data and AI, accountable for technical delivery.
• Experience in architecting and implementing Databricks solutions using Medallion architecture.
• Hands-on expertise with Databricks implementation on Azure.
• Azure security/networking knowledge is advantageous.
• Experience designing and developing large-scale distributed systems and big data technologies such as Apache Spark™, Hadoop, or Cassandra.
• Proficient in writing code in Python and SQL.
• Proficient in designing/implementing Auto Loader, DLT (Delta Live Tables), and Streaming solutions for structured, semi-structured, and unstructured data in Databricks.
• Understanding of how to attribute business value and outcomes to specific project deliverables.
• Experience conducting discovery workshops, creating strategic roadmaps, conducting business analysis, and managing delivery of complex programs/projects.
• Expertise in implementing Row Level Security, Column Masking, Data encryption, and decryption solutions in Databricks.
• Continuous learning and keeping up with the fast evolution of the Databricks Lakehouse platform.

Nice-to-haves

• Databricks Certification
• Deep hands-on knowledge in Big Data Engineering or DWH technology.

Benefits

• 401k with employer match
• Health/Dental/Vision insurance plans
• Paid time off
• 10 paid holidays
• Stock purchase plan