Staff Observability Solutions Engineer (Pipeline)

$106,605 - $213,210/Yr

CVS Health

Full-time - Mid Level

10,001+ employees

Health and Personal Care Retailers

About the position

The Staff Observability Solutions Engineer (Pipeline) at CVS Health is responsible for designing, implementing, and managing data pipelines that facilitate efficient data processing and delivery from various sources. This role is crucial for supporting large-scale data analytics and ensuring that data flows seamlessly to enable automation and monitoring. The engineer will collaborate with cross-functional teams to optimize workflows and provide mentorship to junior engineers.

Responsibilities

• Design, implement, and manage data pipelines to handle data from diverse sources.
• Ensure efficient data processing, routing, and delivery across various systems.
• Work with large-scale data analytics platforms such as Clickhouse, Splunk, the ELK stack, DataBricks, and Snowflake.
• Utilize and manage data pipeline technologies including Vector.dev, Cribl, Confluent/Kafka, Airflow, and Apache Ni-Fi.
• Develop custom scripts and tools using Python and other relevant programming languages.
• Collaborate with data engineering, analytics, and observability teams to optimize data workflows and infrastructure.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Stay updated with the latest trends and best practices in data pipeline technologies and large-scale data analytics.
• Provide guidance and mentorship to junior engineers and other team members.

Requirements

• 7+ years of extensive experience in designing and managing data pipelines.
• Proficiency with data pipeline technologies such as Vector.dev, Cribl, Confluent/Kafka, Airflow, and Apache Ni-Fi.
• Strong programming skills in Python, and familiarity with other languages such as Java or Scala.
• Experience with large-scale data analytics platforms such as Clickhouse, Splunk, the ELK stack, DataBricks, and Snowflake.
• Solid understanding of data processing, routing, and delivery mechanisms.
• Ability to work collaboratively with cross-functional teams.
• Strong problem-solving skills and a proactive approach to identifying and addressing issues.
• Excellent communication and documentation skills.
• Proven ability to stay current with the latest technologies and best practices in data engineering and analytics.

Benefits

• Full range of medical, dental, and vision benefits.
• 401(k) retirement savings plan.
• Employee Stock Purchase Plan.
• Fully-paid term life insurance plan.
• Short-term and long-term disability benefits.
• Well-being programs.
• Education assistance and free development courses.
• CVS store discount and discount programs with participating partners.
• Paid Time Off (PTO) and paid holidays.