Data Engineering Manager - Remote

Kforce - Tampa, FL

Full-time - Manager

Remote - Tampa, FL

Administrative and Support Services

About the position

The Data Engineering Manager will lead a team in designing, implementing, and managing data solutions primarily within the Azure ecosystem, with a focus on Microsoft Fabric and AI integration. This hands-on role requires expertise in data engineering and ETL development, as well as experience with Azure tools and services. The manager will oversee the development of scalable data solutions, optimize data processes, and ensure the effective use of modern data architectures.

Responsibilities

• Lead and manage the design, implementation, and operation of scalable data solutions within the Microsoft Fabric analytics platform
• Develop end-to-end data engineering, integration, and real-time analytics solutions using Microsoft technologies
• Manage data lakes, Lakehouses, and Delta Lake tables within Microsoft Fabric
• Optimize data models, queries, and ETL processes for performance and scalability
• Build and manage data pipelines leveraging Azure Data Factory, Synapse, ADLS, and Databricks
• Implement and manage data connectors to unify data within Microsoft Fabric
• Oversee CI/CD pipelines and automate deployments with Azure DevOps (including Fabric pipelines)
• Automate infrastructure deployment with tools like Terraform, Bicep, ARM, and Ansible
• Manage containerized applications using Docker, Kubernetes, ACR, ACI, and Azure Container Apps
• Provision, configure, and monitor Azure resources such as Storage Accounts, Key Vaults, Function Apps, Logic Apps, Databases, and Messaging Services
• Provide support for data visualization, reporting, and advanced analytics using Power BI and other tools

Requirements

• Experience integrating AI and Machine Learning capabilities into Microsoft Fabric
• Knowledge of machine learning workflows and data preparation for Azure AI services
• Familiarity with tools like Azure OpenAI and Copilot integration for enhancing data services
• Ability to design and deploy end-to-end AI solutions, including real-time data pipelines, APIs, and user-facing applications
• Strong hands-on experience with Azure technologies: Azure SQL Database, Synapse, Data Factory, Databricks, ADLS, and Power BI
• Proficiency in programming languages like SQL and Python for data transformation and processing
• Expertise in Azure DevOps, CI/CD implementation, and pipeline optimization
• Strong knowledge of infrastructure automation tools and deployment processes
• Solid understanding of core Azure services such as Key Vault, Storage Accounts, and App Services
• Proficiency with CLI and scripting tools like PowerShell
• Experience in managing and scaling modern data architectures and pipelines

Benefits

• Medical, dental, and vision insurance
• Health Savings Account (HSA)
• Flexible Spending Account (FSA)
• 401(k) plan
• Life insurance
• Disability insurance
• Paid time off for salaried personnel