Sr. Data Engineer

$113,360 - $170,040/Yr

The Hartford - Charlotte, NC

Full-time - Mid Level

Charlotte, NC

Insurance Carriers and Related Activities

About the position

The Hartford is seeking a Senior Data Engineer to join the Feature Integration team within the Data Science Enablement organization. This role involves driving end-to-end solution delivery for large-scale data products, ensuring the integrity and scalability of data pipelines, and collaborating with architects and stakeholders to implement data product architecture. The position requires strong communication skills and adaptability to support the Entity Resolution tech stack in a hybrid work environment.

Responsibilities

• Accountable for a large-scale data product as a Senior Data Engineer.
• Drive end-to-end solution delivery involving multiple platforms and technologies.
• Oversee certain parts of very large complex implementations, leveraging ELT solutions to acquire, integrate, and operationalize data.
• Partner with architects and stakeholders to influence and implement the vision of the pipeline and data product architecture.
• Articulate risks and tradeoffs of technology solutions to senior leaders and translate as needed for business leaders.
• Accountable for data pipeline and product physical solution designs across teams and tool recommendations.
• Implement and utilize leading big data methodologies (AWS, Hadoop/EMR, Spark, Kafka, Snowflake, and Talend) with cloud/on-premise hybrid hosting solutions.
• Guide the team to mature code quality management, DataOps principles, automated testing, and environment management practices.

Requirements

• Bachelor's degree in computer science or related field of study.
• 5+ years of experience in Python/Pyspark.
• 5+ years in large scale big data engineering experience and designing best practices in Programming, SDLC practices, Distributed systems, Data warehousing solutions SQL and NoSQL, ETL tools, CICD, Cloud Technologies (AWS/AZURE).
• 3+ years of developing and operating production workloads in cloud infrastructure (AWS, Azure, etc).

Nice-to-haves

• Exposure to AWS best practices.
• Knowledge of core functional components/services of AWS - compute, storage, Edge, Database, Migration and Transfer, Networking, and Governance.

Benefits

• Short-term or annual bonuses
• Long-term incentives
• On-the-spot recognition