Senior Data Engineer

$124,800 - $156,000/Yr

The Judge Group - New York, NY

posted 2 months ago

Full-time - Senior
Remote - New York, NY
Administrative and Support Services

About the position

The Senior Data Engineer position is a fully remote role that requires a highly skilled individual with extensive experience in software engineering and data management. The ideal candidate will have a minimum of 7 years of experience in software engineering, with at least 2 years specifically focused on using the Go programming language. This role is critical for building and maintaining data-intensive APIs, utilizing a RESTful approach to ensure efficient data handling and processing. In addition to API development, the candidate will be expected to have proven experience in stream processing, particularly with Apache Kafka. This involves managing real-time data streams and ensuring that data flows seamlessly through the system. A strong understanding of Unit Testing and Test Driven Development methodologies is essential, as the candidate will be responsible for ensuring the reliability and quality of the code produced. Familiarity with containerization technologies, specifically Docker, is also required, as the role involves creating and maintaining containerized application deployments. Furthermore, the candidate should have a proven ability to build and maintain cloud-based infrastructure on major cloud providers such as AWS, Azure, or Google Cloud Platform. Experience in data modeling for large-scale databases, whether relational or NoSQL, is also a key requirement for this position. This role offers the opportunity to work in a dynamic environment where innovation and technical expertise are highly valued.

Responsibilities

  • Build and maintain data-intensive APIs using a RESTful approach.
  • Implement stream processing solutions using Apache Kafka.
  • Conduct Unit Testing and apply Test Driven Development methodologies.
  • Create and maintain containerized application deployments with Docker.
  • Build and maintain cloud-based infrastructure on AWS, Azure, or Google Cloud Platform.
  • Model data for large-scale databases, both relational and NoSQL.

Requirements

  • At least 7 years of experience in software engineering.
  • At least 2 years of experience with Go programming language.
  • Proven experience (2 years) in building and maintaining data-intensive APIs using a RESTful approach.
  • Experience with stream processing using Apache Kafka.
  • Comfort with Unit Testing and Test Driven Development methodologies.
  • Familiarity with creating and maintaining containerized application deployments with Docker.
  • Proven ability to build and maintain cloud-based infrastructure on AWS, Azure, or Google Cloud Platform.
  • Experience in data modeling for large-scale databases, either relational or NoSQL.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service