Azure Data engineer

Alphosoft - Urbandale, IA

Full-time

Urbandale, IA

Publishing Industries

About the position

The Azure Data Engineer position at John Deere involves leveraging Azure cloud technologies to design and implement data solutions that enhance data quality and management within the manufacturing industry. The role requires expertise in various Azure tools and a strong understanding of data architecture principles to build robust data pipelines and support agile product development.

Responsibilities

• Design and implement data solutions using Azure cloud technologies.
• Develop and maintain data pipelines using Azure Data Factory, Synapse, and Databricks.
• Ensure data quality and effective metadata management.
• Collaborate with Product Scrum Agile teams to align with agile principles.
• Implement dimensional data modeling and design, including Star Schemas.
• Utilize PySpark and SQL for building production-grade data tools.

Requirements

• Proficiency in Azure cloud technologies, specifically Synapse, Azure Data Factory, Delta Lake, and Databricks.
• Deep understanding of data architecture principles, including Data Quality, Metadata Management, and Master Data Management (MDM).
• Experience with dimensional data modeling and design, including developing Star Schemas.
• Advanced skills in PySpark and SQL for building data pipelines.
• Familiarity with hybrid data ecosystems integrating on-premises and cloud technologies.
• Strong knowledge of CI/CD methodologies and best practices.