Xoriant - Santa Clara, CA

posted about 2 months ago

Full-time - Principal
Santa Clara, CA
Professional, Scientific, and Technical Services

About the position

As a Principal Big Data Engineer, you will play a crucial role in our data ingestion and processing platform team. This position requires a strong focus on architecture, design, and development of scalable data solutions. You will be expected to adapt to various big-data frameworks and tools, tailoring them to meet the specific use-cases required by the project. Your ability to communicate effectively with research and development teams, as well as data scientists, will be essential in identifying and resolving bottlenecks in the data processing pipeline. In this role, you will design and implement various architectural models that support scalable data processing and storage. You will also be responsible for building tools that facilitate proper data ingestion from multiple heterogeneous sources. Your expertise will help ensure that our data infrastructure is robust, efficient, and capable of handling large volumes of data effectively. The ideal candidate will have a proactive approach to problem-solving, a commitment to quality, and the ability to execute tasks efficiently. Excellent interpersonal and teamwork skills are essential, as you will collaborate with various stakeholders to drive the success of our data initiatives.

Responsibilities

  • Architect, design, and develop scalable data solutions for data ingestion and processing.
  • Adapt to various big-data frameworks and tools based on project requirements.
  • Communicate with research and development teams and data scientists to identify and resolve bottlenecks.
  • Design and implement architectural models for scalable data processing and storage.
  • Build tools for effective data ingestion from multiple heterogeneous sources.

Requirements

  • 3+ years of experience in design and implementation in an environment with hundreds of terabytes of data.
  • 3+ years of experience with large data processing tools such as Dataflow, GKE, BQ, and Beam.
  • 3+ years of experience with Java programming language.
  • Strong problem-solving skills and a can-do attitude.
  • Excellent interpersonal and teamwork skills.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service