Manager Data Engineering - Hybrid

$122,880 - $184,320/Yr

The Hartford - Hartford, CT

Full-time - Mid Level

Hartford, CT

Insurance Carriers and Related Activities

About the position

The Manager of Data Engineering at The Hartford is responsible for overseeing the ingestion and management of third-party data assets within the Enterprise Data Office. This role focuses on expanding and optimizing data pipelines and product architecture, ensuring efficient data flow and collection for cross-functional teams. The ideal candidate will have a strong background in data engineering, capable of supporting various teams and projects while maintaining optimal data delivery architecture.

Responsibilities

• Build small to medium scale data pipelines and data products.
• Architect, design, prototype, implement, and optimize Cloud/Hybrid architectures for data operationalization.
• Develop team capabilities and influence decisions regarding pipeline tools.
• Implement continuous integration and continuous delivery practices aligned with Enterprise DevOps.
• Ensure adherence to data engineering practices such as source code management and issue tracking.
• Review, design, and integrate complex data, recommending data cleansing solutions as needed.
• Provide documentation and operating guidance for users at all levels.
• Stay updated on emerging data technologies and evaluate tools for effective delivery.
• Collaborate in developing project strategies, roadmaps, and implementations.

Requirements

• Bachelor's degree and 5 years of Data Engineering experience.
• Extensive experience in Python programming and Pyspark.
• Familiarity with Object Oriented Design patterns.
• 2+ years of experience in developing and operating production workloads in cloud infrastructure.
• Proven experience with the software development life cycle (SDLC) and agile methodologies.
• Hands-on experience with AWS Services such as S3, EMR, Glue, Lambda, and Cloud Formation.
• Experience with DevOps tools for Continuous Integration and Deployment like GitHub, Jenkins, and AWS CICD tools.
• Knowledge of SQL Queries and Unix scripting.
• Ability to design, implement, and oversee ETL processes.
• Excellent troubleshooting skills and performance tuning of ETL processes.

Nice-to-haves

• Experience working on Snowflake data warehouse.
• Any Cloud certifications.

Benefits

• Short-term and annual bonuses
• Long-term incentives
• On-the-spot recognition