Azure Data Engineer

Htc Global Services - Washington, DC

Full-time - Mid Level

Washington, DC

Professional, Scientific, and Technical Services

About the position

As an Azure Data Engineer at HTC Global Services, you will play a crucial role in expanding and optimizing data and pipeline architectures. This position involves collaborating with software developers, database architects, data analysts, and data scientists to ensure a consistent data delivery architecture across various projects. You will be responsible for optimizing data collection and flow, as well as developing innovative Azure solutions to meet business and technical requirements.

Responsibilities

• Expand and optimize data and pipeline architectures.
• Assist software developers, database architects, data analysts, and data scientists with data initiatives.
• Ensure a consistent data delivery architecture throughout ongoing projects.
• Cleansing, mapping, transforming, and optimizing data for storage and use according to requirements.
• Develop and maintain innovative Azure solutions.
• Design solutions using Microsoft Azure services and other tools.
• Automate tasks and deploy production standard code with unit testing and continuous integration.
• Load transformed data into storage and reporting structures.
• Build data pipelines to bring together data from various sources.
• Extract data, troubleshoot, and maintain the data warehouse.

Requirements

• 10+ years of data experience with Data Bricks experience required.
• Previous experience as an Azure Data Engineer or similar role.
• Experience building and optimizing big data pipelines, architectures, and datasets.
• Strong analytic skills related to working with unstructured datasets.
• Ability to design and implement well-written code.
• Ability to work to tight deadlines.
• Ability to test data from source to presentation layer.
• Ability to support and troubleshoot data pipelines.
• Confident and concise communication skills.

Nice-to-haves

• Experience with Python, SQL and NoSQL databases, Scala, Spark-SQL.
• Familiarity with Azure services such as ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates.

Benefits

• Paid-Time-Off
• Paid Holidays
• 401K matching
• Life and Accidental Death Insurance
• Short & Long Term Disability Insurance
• Variety of other perks