Lead Cloud Data Engineer - Azure & Databricks

Amentum - Dearborn, MI

Full-time - Mid Level

Dearborn, MI

Professional, Scientific, and Technical Services

About the position

The Lead Cloud Data Engineer - Azure & Databricks is responsible for designing and implementing complex cloud solutions using Microsoft Azure, with a focus on data engineering and analytics. This role requires strong proficiency in Azure services, particularly Databricks and Azure Data Factory, to develop scalable data pipelines and architectures that support advanced analytics and machine learning initiatives. The position involves collaboration with cross-functional teams to translate business requirements into technical solutions, ensuring optimal performance and compliance with security standards.

Responsibilities

• Design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.
• Develop and maintain scalable and efficient data pipelines and architectures.
• Ensure optimal architecture and performance of applications deployed on Azure.
• Provide expertise in cloud security, ensuring compliance with industry standards and company policies.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Manage the full lifecycle of data and analytics solutions, from requirements gathering to deployment and maintenance.
• Conduct system troubleshooting and provide technical support as needed.
• Stay updated with the latest developments in cloud technologies and introduce innovations and improvements to internal systems.

Requirements

• 7+ years of experience as a data engineer, with strong proficiency in Azure cloud services, Databricks, and Azure Data Factory.
• 3+ years of experience with designing and implementing data solutions using Azure Cloud.
• Azure Data Engineering or Databricks Certification.
• Strong knowledge of programming languages such as Python, SQL, or Scala.
• Experience with data modeling, ETL/ELT development, data integration, and orchestration techniques.
• Experience with designing and developing end-to-end data and analytics solutions leveraging Azure Data Lake, Azure Databricks, and Data Factory.
• Experience with designing scalable data analytics architecture to implement advanced analytics solutions, including machine learning and AI.

Nice-to-haves

• Additional Azure Certifications like Azure ML, Analytics Specialty, or Azure Solutions Architect.