IT Engineer (Azure Cloud Data Engineer)

Ampcus - Chantilly, VA

Full-time - Mid Level

Chantilly, VA

Professional, Scientific, and Technical Services

About the position

The IT Engineer (Azure Cloud Data Engineer) at Ampcus, Inc. is responsible for designing and building scalable data pipelines for both near real-time and batch data processing. This role involves providing technical leadership, guiding team members, and ensuring effective communication with business leadership to meet data requirements and drive business objectives. The position requires a strong technical background in cloud technologies, particularly Azure, and a focus on data integration and processing.

Responsibilities

• Design and build highly scalable data pipelines for near real-time and batch data ingestion, processing, and data integration.
• Provide technical leadership and guidance to educate team members on the development and operations of streaming and event-driven applications.
• Identify potential issues and risks during project implementation and suggest mitigation strategies.
• Communicate and manage the process of manipulating and merging large datasets.
• Work directly with business leadership to understand data requirements and propose solutions that drive business objectives.
• Perform other duties as assigned.

Requirements

• Degree in Information Systems, Computer Science, Engineering, or related field, or equivalent combination of education, training, and experience.
• Working knowledge of message-oriented middleware/streaming data technologies such as Kafka, MQ, Azure Event Hub, Spark, Spark Streaming.
• Strong programming skills/experience in C#/.NET and Logic App.
• Strong programming skills/experience in Azure Functions using various protocols/triggers.
• Hands-on experience in configuring Azure Event Hub, Event Grid, Stream Analytics, logic/function apps, and JSON.
• Expert level skills in Python, Databricks, and Azure Data Factory.
• Experience with ETL tools and techniques and knowledge of CI/CD processes.
• Experience with cloud NoSQL databases, ideally Cosmos DB or equivalent.