Senior Data Engineer - IDMC

About the position

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) Manage and optimize data engineering processes focused on streaming data. Utilize IDMC and Snowflake for data warehousing tasks. Leverage Python and Snowpark for advanced data operations. Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics Designs, develops, and maintains real-time processing applications and real-time data pipelines Ensure quality of technical solutions as data moves across Centene’s environments Provides senior level knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions Develops, constructs, tests, and maintains architectures using advanced programming language and tools Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated Performs other duties as assigned Complies with all policies and standards.

Responsibilities

• Develops and operationalizes data pipelines for data consumption.
• Engages with the DevSecOps Engineer during continuous integration and continuous deployment.
• Guides the design and implementation of complex data management procedures.
• Manages and optimizes data engineering processes focused on streaming data.
• Utilizes IDMC and Snowflake for data warehousing tasks.
• Leverages Python and Snowpark for advanced data operations.
• Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of data structures.
• Designs, develops, and maintains real-time processing applications and data pipelines.
• Ensures quality of technical solutions as data moves across environments.
• Provides senior level knowledge and insight into the changing data environment.
• Develops, constructs, tests, and maintains architectures using advanced programming languages and tools.
• Drives improvements in data reliability, efficiency, and quality.

Requirements

• A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science).
• 4 – 6 years of related experience or equivalent experience.
• Experience with Big Data and Data Processing.
• Experience diagnosing system issues, engaging in data validation, and providing quality assurance testing.
• Experience with Data Manipulation and Data Mining.
• Experience working in a production cloud infrastructure.
• Proven expertise in IDMC and Snowflake.
• Knowledge of Python and Snowpark is advantageous.
• Strong understanding of cloud concepts related to AWS, Snowflake, and the Informatica IDMC platform.

Nice-to-haves

• Intermediate ability to identify basic problems and procedural irregularities.
• Intermediate ability to work independently.
• Intermediate demonstrated analytical skills.
• Intermediate demonstrated project management skills.
• Intermediate ability to demonstrate a high level of accuracy under pressure.
• Intermediate judgment and decision-making skills.

Benefits

• Competitive pay.
• Health insurance.
• 401K and stock purchase plans.
• Tuition reimbursement.
• Paid time off plus holidays.
• Flexible approach to work with remote, hybrid, field or office work schedules.