Actalent - Charlotte, NC
posted 3 months ago
As an Azure Data Engineer at Actalent, you will play a crucial role in managing and processing large datasets using Azure SQL, Azure Storage, and Gen2 Data Lake. Your expertise will be essential in supporting Energy and Sustainability Data strategies, as well as AI Agent-based solutions. You will be responsible for developing and managing data lakes utilizing Delta Lake and various file formats, leveraging the capabilities of Azure Gen2 Data Lake. In this position, you will implement event-driven architectures using Azure Service Bus, Azure Event Hubs, and Azure Event Grid, ensuring that our data systems are robust and responsive. You will design, implement, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks, Kubernetes, and other Azure services. Your role will also involve ensuring data security and compliance with relevant regulations and best practices, optimizing data storage and retrieval for performance and cost efficiency. Collaboration is key in this role, as you will work closely with data scientists and analysts to develop data models and provide valuable data insights. Additionally, you will automate data workflows and monitoring to ensure high availability and reliability of our data systems. This position offers the opportunity to work fully remote, allowing you to contribute to our innovative projects from anywhere.