Senior Data Engineer

$124,800 - $156,000/Yr

The Judge Group - Boston, MA

Full-time - Senior

Remote - Boston, MA

Administrative and Support Services

About the position

The Senior Data Engineer position is a fully remote role that requires a highly skilled individual with extensive experience in software engineering and data management. The ideal candidate will have a minimum of 7 years of experience in software engineering, with at least 2 years specifically focused on using the Go programming language. This role is critical for building and maintaining data-intensive APIs, utilizing a RESTful approach to ensure efficient data handling and processing. In addition to API development, the candidate will be expected to have proven experience in stream processing, particularly with Apache Kafka. This involves designing and implementing systems that can handle real-time data streams effectively. A strong understanding of Unit Testing and Test Driven Development methodologies is essential, as the candidate will be responsible for ensuring the reliability and quality of the code produced. Familiarity with containerization technologies, specifically Docker, is also required, as the role involves creating and maintaining containerized application deployments. Furthermore, the candidate should have a proven ability to build and maintain cloud-based infrastructure on major cloud providers such as AWS, Azure, or Google Cloud Platform. Experience in data modeling for large-scale databases, whether relational or NoSQL, is crucial for this position, as it will directly impact the efficiency and scalability of the data systems being developed.

Responsibilities

• Build and maintain data-intensive APIs using a RESTful approach.
• Implement stream processing solutions using Apache Kafka.
• Develop and execute Unit Testing and Test Driven Development methodologies.
• Create and maintain containerized application deployments with Docker.
• Build and maintain cloud-based infrastructure on AWS, Azure, or Google Cloud Platform.
• Model data for large-scale databases, both relational and NoSQL.

Requirements

• At least 7 years of experience in software engineering.
• At least 2 years of experience with Go programming language.
• Proven experience (2 years) in building and maintaining data-intensive APIs using a RESTful approach.
• Experience with stream processing using Apache Kafka.
• Comfort with Unit Testing and Test Driven Development methodologies.
• Familiarity with containerized application deployments using Docker.
• Proven ability to build and maintain cloud-based infrastructure on a major cloud provider like AWS, Azure, or Google Cloud Platform.
• Experience in data modeling for large-scale databases, either relational or NoSQL.