Senior Data Engineer

$124,800 - $156,000/Yr

The Judge Group - Atlanta, GA

posted 2 months ago

Full-time - Senior
Remote - Atlanta, GA
Administrative and Support Services

About the position

The Senior Data Engineer position is a fully remote role that requires a highly skilled individual with extensive experience in software engineering and data management. The ideal candidate will have a strong background in building and maintaining data-intensive APIs, particularly using a RESTful approach. This role is crucial for developing and optimizing data pipelines and ensuring the efficient processing of large datasets. The successful candidate will be responsible for implementing stream processing solutions using Apache Kafka, which is essential for real-time data processing and analytics. In addition to technical skills, the candidate should be comfortable with Unit Testing and Test Driven Development methodologies, ensuring that the code is robust and reliable. Familiarity with containerization technologies, particularly Docker, is also required, as the role involves creating and maintaining containerized application deployments. The candidate will also need to demonstrate a proven ability to build and maintain cloud-based infrastructure on major cloud providers such as AWS, Azure, or Google Cloud Platform. Data modeling experience for large-scale databases, whether relational or NoSQL, is a key requirement for this position. The Senior Data Engineer will work closely with other team members to design and implement data solutions that meet the needs of the organization and its clients. This role offers an exciting opportunity to work in a dynamic environment where innovation and collaboration are encouraged.

Responsibilities

  • Build and maintain data-intensive APIs using a RESTful approach.
  • Implement stream processing solutions using Apache Kafka.
  • Create and maintain containerized application deployments with Docker.
  • Develop and optimize data pipelines for efficient data processing.
  • Design and implement cloud-based infrastructure on AWS, Azure, or Google Cloud Platform.
  • Model data for large-scale databases, both relational and NoSQL.
  • Collaborate with team members to design data solutions that meet organizational needs.

Requirements

  • At least 7 years of experience in software engineering.
  • At least 2 years of experience with Go programming language.
  • Proven experience (2 years) building and maintaining data-intensive APIs using a RESTful approach.
  • Experience with stream processing using Apache Kafka.
  • Comfort with Unit Testing and Test Driven Development methodologies.
  • Familiarity with creating and maintaining containerized application deployments with Docker.
  • Proven ability to build and maintain cloud-based infrastructure on a major cloud provider like AWS, Azure, or Google Cloud Platform.
  • Experience in data modeling for large-scale databases, either relational or NoSQL.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service