Azure Data engineer at Irving, TX (Onsite/Hybrid)

E-Solutions Group - Irving, TX

Full-time - Mid Level

Irving, TX

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Azure Data Engineer position at E-Solutions Inc. in Irving, TX, is a contract role that requires a highly skilled individual with extensive experience in Azure Data Factory and Databricks, particularly within the Big Data ecosystem. The ideal candidate will have over 15 years of experience working with Azure technologies, specifically in developing and maintaining innovative Azure solutions that involve data processing and management. This role demands a deep understanding of data cleansing, mapping, and transformation to ensure that data is optimized for storage and use according to both business and technical requirements. In this position, the Azure Data Engineer will be responsible for building and maintaining data pipelines that integrate various data sources, ensuring that data is accurately loaded into storage and reporting structures. This includes working with data warehouses, high-speed indexes, and real-time reporting systems. The engineer will also be tasked with automating tasks and deploying production-standard code, which includes unit testing, continuous integration, and versioning. Troubleshooting and maintaining the data warehouse will also be key responsibilities, requiring a proactive approach to data management and problem-solving. Candidates must possess a strong technical background, with mandatory skills in Azure (Big Data Azure), ADF, DataBricks, Python or C#, SQL Data Warehouse, Analysis Services, Azure Functions, and Serverless Architecture. A technical certification in multiple technologies is desirable, and an engineering degree (BE/ME/BTech/MTech/BSc/MSc) is required. This position is onsite/hybrid, providing flexibility in the work environment while demanding a high level of expertise and commitment to data engineering best practices.

Responsibilities

• Develop and maintain innovative Azure solutions.
• Build data pipelines to collectively bring together data.
• Load transformed data into storage and reporting structures including data warehouses and real-time reporting systems.
• Automate tasks and deploy production standard code with unit testing and continuous integration.
• Ensure data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements.
• Extract data, troubleshoot, and maintain the data warehouse.

Requirements

• 15+ years of experience with Azure Data Factory and Databricks.
• Strong knowledge of Big Data ecosystem tools (e.g., Hadoop, Hive).
• Proficiency in Python or C# is a MUST.
• Experience with SQL Data Warehouse and Analysis Services.
• Familiarity with Azure Functions and Serverless Architecture.
• Ability to work with ARM Templates.

Nice-to-haves

• Technical certification in multiple technologies is desirable.