Azure Data Engineer

About the position

As an Azure Data Engineer, you will be responsible for developing Data Engineering workloads as part of our solutions. As part of a small, dynamic team, you will have the opportunity to contribute to multiple phases of the solution life cycle including designing and implementing models and processes for large scale datasets used for analytics and AI.

Responsibilities

• Use Azure Data Factory extensively for ingesting data from disparate source systems.
• Use Azure Data Factory as an orchestration tool for ingesting data from upstream to downstream systems.
• Automate jobs using different triggers (Event, Scheduled and Tumbling) in ADF.
• Perform T-SQL and Workflows performance tuning and optimization of queries for reports that take longer execution time.
• Use T-SQL to develop DDL, DML and dynamic SQL daily.
• Extract data from heterogeneous sources (OLTP, Flat Files, and Microsoft Excel) and transferred to OLAP using ADF pipeline/SSIS Package.
• Maintain code version in the repository with Git/VSTS.
• Use Pull Request to Create/ Review/Merge scripts in Git repository in Azure Repos.
• Involve with full development cycle of a Data Warehouse, including requirements gathering, design, implementation, and maintenance.
• Write complex stored procedure, views using T SQL using SQL management studio.

Requirements

• 3+ years of general technology experience of which 2 years of programming experience (T-SQL, Python, PySpark)
• 2 years leveraging cloud-based architectures (Azure)
• Must possess exceptional analytical and troubleshooting abilities
• Highly motivated individual with strong sense of ownership
• Must be proactive with solid organizational and time management skills
• Strong written and verbal communication skills
• Must be eligible to work in the U.S.

Nice-to-haves

• Integration experience with all or any of the following: Azure Data Factory, Databricks, Azure Synapse Analytics, SQL Server Integration Services, Informatica, Microsoft Fabric, etc.

Benefits

• A culture that both wows our customers and employees;
• Variety of challenging projects, and the ability to work with leading-edge technologies;
• Competitive salary & group benefits;
• Generous training and education opportunities;
• Diverse team social events;
• Be part of a team that believes in diversity, inclusion, and a fun atmosphere!