Azure Data Engineer

$139,360 - $139,360/Yr

InfoVision - Boston, MA

Full-time - Mid Level

Boston, MA

Professional, Scientific, and Technical Services

About the position

The Azure Data Engineer role involves designing, implementing, and optimizing data pipelines and architectures using Microsoft technologies. The position requires collaboration with cross-functional teams to ensure the integration of data solutions into core products, while also focusing on data quality and business value.

Responsibilities

• Review and analyze structured, semi-structured, and unstructured data sources for quality and completeness.
• Design, architect, implement, and test rapid prototypes that demonstrate the value of data.
• Participate in early-stage design and feature definition activities.
• Implement robust data pipelines using Microsoft and Databricks Stack.
• Create reusable and scalable data pipelines.
• Collaborate with team members across multiple engineering teams to support integration of prototypes into core products.
• Convey complex data insights to non-technical stakeholders effectively.
• Manage multiple projects simultaneously in a collaborative environment.

Requirements

• Advanced working knowledge and experience with relational and non-relational databases.
• Solid understanding of relational and NoSQL databases, data modeling, and database management systems (DBMS).
• Experience building and optimizing Big Data pipelines, architectures, and datasets.
• Strong analytic skills related to working with structured and unstructured datasets.
• Experience in Python, Kubernetes, Azure, Snowflake, CI/CD.
• Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
• Strong experience in Azure Data Factory, Databricks, Event Hub, Azure Synapse.
• Azure DevOps experience to deploy data pipelines through CI/CD.