Java Developer With Spark

Diverse Lynx - McLean, VA

Full-time - Mid Level

McLean, VA

Administrative and Support Services

About the position

We are seeking a Mid-level Java Developer with expertise in Apache Spark to join our team in McLean, VA. This position is primarily on-site and is offered as a contract role. The ideal candidate will have a minimum of 6 years of experience in software development, specifically in developing, programming, and maintaining applications using the Apache Spark open-source framework. The role requires a strong understanding of various components of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming capabilities. As a Spark Developer, you will be responsible for working with big data processing tools and techniques, ensuring that applications are optimized for performance and scalability. You will collaborate with cross-functional teams to design and implement solutions that meet business requirements. A solid background in distributed systems and experience with streaming data platforms is essential for success in this role. The candidate should possess excellent analytical and problem-solving skills, with a proven track record as a Spark Developer or in a related role. Familiarity with the Hadoop ecosystem and strong programming skills in Java, Scala, or Python are critical. Additionally, knowledge of Java Spring Boot with microservice architecture, REST/GraphQL, MongoDB, Kubernetes (preferably EKS), and AWS services such as S3, Lambda, Step Functions, AMQ, SNS, SQS, and CloudWatch Events will be highly beneficial.

Responsibilities

• Develop, program, and maintain applications using the Apache Spark framework.
• Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.
• Collaborate with cross-functional teams to design and implement solutions that meet business requirements.
• Optimize applications for performance and scalability.
• Utilize big data processing tools and techniques effectively.

Requirements

• 6+ years of experience in software development.
• Strong programming skills in Java, Scala, or Python.
• Proven experience as a Spark Developer or in a related role.
• Familiarity with big data processing tools and techniques.
• Experience with the Hadoop ecosystem.
• Good understanding of distributed systems.
• Experience with streaming data platforms.
• Excellent analytical and problem-solving skills.

Nice-to-haves

• Knowledge of Java Spring Boot with microservice architecture.
• Experience with REST/GraphQL.
• Familiarity with MongoDB.
• Experience with Kubernetes (preferably EKS).
• Knowledge of TDD and ATDD methodologies.
• Experience with AWS services such as S3, Lambda, Step Functions, AMQ, SNS, SQS, and CloudWatch Events.