Data Engineering Manager

Full-time - Manager

Irondale, AL

About the position

The Data Engineering Manager brings strong expertise in ETL methodologies, data transformation, and cloud-based data platforms to lead a data engineering team in optimizing data handling and workflows. This role’s focus on leveraging AI-driven automation techniques will enhance data processing efficiency over time. The ideal candidate for this position has a blend of hands-on technical ability, leadership skills specific to data engineering, and strategic vision for data processing.

Responsibilities

• Provide general Leadership, Management, and Accountability (LMA) for ETL developers and data engineers, ensuring best practices in data processing.
• Develop and maintain ETL pipelines for structured and unstructured data processing.
• Implement AI-driven automation techniques to improve ETL efficiency over time.
• Ensure data quality, security, and compliance in all processes and foster a culture of continuous improvement.
• Establish and track KPIs for ETL performance, AI-driven automation, data integrity, and team productivity.

Requirements

• 5+ years of experience in ETL development, data engineering, or a related field.
• 3+ years of leadership experience in a software development or data engineering role.
• Experience working with unstructured data and data transformation techniques.
• Hands-on experience with ETL tools and data processing frameworks.
• Proficiency in Microsoft development tools, including Visual Studio, using C#.
• Experience with cloud-based data platforms (AWS Glue, Redshift, etc.).
• Strong knowledge of database systems, data lakes, and data warehouse solutions.

Nice-to-haves

• Hands-on experience or familiarity with AI/ML techniques for data transformation and anomaly detection.
• Experience with DevOps practices, CI/CD pipelines, and containerization (Docker, Kubernetes).
• Experience with S3, EC2, Secrets Manager, CloudWatch, RDS.
• Experience building complicated Regular Expressions.
• Knowledge of data governance and regulatory compliance frameworks.