Azure Data Engineer

Avanade - Florham Park, NJ

Full-time - Mid Level

Florham Park, NJ

Professional, Scientific, and Technical Services

About the position

Avanade Inc. is seeking Azure Data Engineers to deliver analytics and business intelligence solutions to clients in Florham Park, NJ. The role involves designing and setting up projects that integrate information from various sources to facilitate analysis and decision-making, as well as developing and maintaining data warehouse architecture and relational databases to support data mining and reporting.

Responsibilities

• Design and set up projects that integrate information from various sources.
• Utilize knowledge to plan and deliver data warehouse and storage solutions.
• Participate in designing and running bespoke data services for individual projects.
• Design, develop, adapt, and maintain data warehouse architecture and relational databases.
• Customize storage and extraction, meta-data, and information repositories.
• Create and use effective metrics and monitoring processes.
• Monitor key performance indicators to identify areas for improvement.
• Create building blocks for transforming enterprise data solutions.
• Design and build modern data pipelines, data streams, and data services.
• Create and maintain report forms, information dashboards, data generators, and other information portals.

Requirements

• Bachelor's degree in Computer Science, Applied Mathematics, Statistics, Machine Learning, or a closely related field.
• At least 7 years of experience as an Azure Data Engineer or in a similar role in a technology or IT consulting environment.
• 7 years of experience performing data engineering, warehousing, publishing, and visualization throughout the full data lifecycle.
• 5 years of experience in data profiling, cataloguing, and mapping to enable the design and build of technical data flows.
• 7 years of experience defining ETA architecture and ETL process design.
• 5 years of experience in end-to-end implementation of data warehousing analytics solutions built on MS or Azure platforms.
• 6 years of experience working with Azure.
• 4 years of experience using DPM specific tooling, including Spark, Python, Databricks, Azure Synapse, SQL Server, Azure Data Lake, and/or Azure Data Factory (ADF).
• 5 years of experience with CI/CD tools, including Azure DevOps, Terraform, and/or Jenkins.