Senior Streaming Engineer (GCP)

$116,100 - $170,280/Yr

Rackspace Technology - San Antonio, TX

Full-time - Senior

San Antonio, TX

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. This role involves designing and developing scalable data processing solutions, leveraging advanced Java techniques, and requires a solid understanding of public cloud technologies, especially GCP. The ideal candidate will work in a remote environment, demonstrating excellent communication skills and the ability to solve complex problems independently and creatively.

Responsibilities

• Design and develop scalable data processing solutions using advanced Java techniques.
• Build reusable and reliable code for stream and batch processing systems at scale.
• Work with technologies such as Pub/Sub, Kafka, DataFlow, Flink, Hadoop, Pig, Oozie, Hive, and Spark.
• Implement automation/DevOps best practices for CI/CD, IaC, and Containerization.

Requirements

• Proficiency in Java with solid experience in asynchronous programming paradigms.
• Hands-on experience with reactive programming techniques for real-time data handling.
• Ability to design, debug, and optimize concurrent processes within distributed systems.
• Expertise in public cloud services, particularly in GCP.
• Experience in building reusable and reliable code for stream and batch processing systems at scale.
• Experience with GCP managed services and cloud-based messaging/stream processing systems.
• Knowledge in containerization technologies like Docker and Kubernetes.
• Strong programming abilities in Java and Python.

Nice-to-haves

• Experience with other cloud technologies is a plus.

Benefits

• Variable compensation in the form of bonus, commissions, or other discretionary payments based on performance.