Lead Data Engineer

State Farm - Dallas, TX

Full-time - Mid Level

Dallas, TX

Insurance Carriers and Related Activities

About the position

The Lead Data Engineer at State Farm will play a crucial role in developing innovative data products using AWS technologies within the Life/Health Data team. This position involves collaborating with business and technical partners to transition data to cloud-based solutions, investigate new services, and build creative data solutions. The role emphasizes professional growth and offers a supportive environment for associates to reach their full potential.

Responsibilities

• Work closely with the predictive modeling team, life actuaries, and business experts to develop data products to support business line stakeholders.
• Develop, test, implement, execute, validate, and monitor logic to build and maintain data products.
• Prepare and manipulate data for use in the development of data analytics solutions.
• Provide data pipeline solutions for the development, implementation, containerization, execution, validation, monitoring, and improvement of data analytics solutions.
• Demonstrate advanced understanding in data engineering practices, including ETL, data integration, reusable data pipelines, data management, data analytics, data visualization, and data science.
• Ensure conformance with State Farm data management and governance policies.
• Establish business domain knowledge for State Farm data sources.
• Identify critical and emerging technologies, techniques, tools, data sources, and platforms in the data engineering field, including cloud-based solutions.

Requirements

• Experience with developing solutions on AWS Cloud technologies and concepts (Glue, Lambda, Redshift, Postgres, Athena, S3, EC2, Pyspark).
• Design, deploy and maintain AWS cloud infrastructure using Terraform.
• Experience with version control (e.g., GitHub, GitLab).
• Hands-on GitOps experience.
• Experience in programming languages such as Python and SAS.
• Experience with any open-source database such as PostgreSQL, MySQL, etc.
• Experience with gathering and creating analytic business requirements, researching potential data sources, designing, developing, and maintaining data assets.
• Ability to learn and adopt new technologies and languages.
• Bachelor's degree in computer science or a related field.

Nice-to-haves

• Experience working with Life/Health Insurance data.
• Experience with the Model Building Lifecycle.
• Experience using deployment automation technologies, preferably Terraform.

Benefits

• Competitive pay with eligibility for annual raises and bonuses.
• Robust health and wellbeing programs with multiple healthcare plan options.
• Educational benefits including industry-leading training programs and tuition assistance.
• Generous time off policies including up to 20 days annually plus parental leave and paid holidays.
• Retirement planning support with free financial advisors and a 401(k) plan with company contributions.