Databricks Senior Architect

$115,000 - $160,000/Yr

Primoris Service Corporation - Dallas, TX

Full-time - Senior

Dallas, TX

Heavy and Civil Engineering Construction

About the position

The Databricks Senior Architect will lead the development and implementation of data engineering, analytics, and AI/ML solutions on the Databricks platform. This role involves acting as a technical advisor, collaborating with development teams, and establishing architectural visions to drive data-driven outcomes. The architect will also be responsible for addressing technical challenges, implementing product innovations, and contributing to team development through best practices.

Responsibilities

• Assist in architecting, developing, deploying, or migrating use cases and workloads into production on Databricks Lakehouse.
• Be the first contact for any technical challenge or questions related to development and production.
• Collaborate with users, technical and support teams to complete projects in a timely manner.
• Implement Databricks Product Innovations, Private Previews, and Upgrades as needed.
• Provide regular internal and external updates on progress and risks/blockers to leadership.
• Contribute to the development of the team by sharing best practices and assets.
• Operate as an expert solution architect and trusted advisor for significant data analytics architecture, design, development, and adoption of the Databricks Data Intelligence Platform.
• Build Databricks serverless platform that powers big data, machine learning, and Gen AI workloads.
• Build multi-language (SQL, Python) notebooks focusing on Data Engineering and Data Science (AI/ML).

Requirements

• A minimum of a bachelor's degree in computer science, Information system, Engineering, Data Science, or equivalent experience through work experience.
• 5+ years of experience as an Architect within the domain of Data and AI, contributing to technical debates and design choices.
• Experience in architecting and implementing Databricks solutions using Medallion architecture.
• Hands-on expertise with Databricks implementation on Azure, with Azure security/networking knowledge advantageous.
• Experience designing and developing large-scale distributed systems and big data technologies such as Apache Spark™, Hadoop, or Cassandra.
• Proficient in writing code in Python and SQL.
• Proficient in designing/implementing Auto Loader, DLT (Delta Live Tables), and Streaming solutions for structured, semi-structured, and unstructured data in Databricks.
• Understanding of how to attribute business value and outcomes to specific project deliverables.
• Experience conducting discovery workshops, creating strategic roadmaps, conducting business analysis, and managing delivery of complex programs/projects.
• Expertise in implementing Row Level Security, Column Masking, Data encryption, and decryption solutions in Databricks.
• Continuous learning and keeping up with the fast evolution of the Databricks Lakehouse platform.

Nice-to-haves

• Databricks Certification
• Deep hands-on knowledge in Big Data Engineering or DWH technology.

Benefits

• 401k w/employer match
• Health/Dental/Vision insurance plans
• Paid time off
• 10 paid holidays
• Stock purchase plan