Senior Spark/Java Developer

$85,800 - $185,800/Yr

CGI - Lafayette, LA

posted about 2 months ago

Full-time - Senior
Lafayette, LA
1,001-5,000 employees
Professional, Scientific, and Technical Services

About the position

The Senior Spark/Java Developer position at CGI is a pivotal role that requires a strong background in Java and Spark development, particularly within the health care sector. This position is designed for individuals who thrive in a fast-paced, agile environment and are eager to contribute to innovative solutions that support one of the largest leaders in the health care industry. The successful candidate will be responsible for the entire product lifecycle, from planning and design to execution, ensuring that business needs are met in a timely manner. This includes collaborating closely with product, engineering, design, and testing teams to create value propositions and deliver high-quality solutions. In this role, you will design and implement highly efficient Spark applications in Java, focusing on performance optimization. This involves tuning Spark jobs, optimizing transformations, and leveraging advanced Spark features for both batch and real-time processing. You will also be responsible for developing data pipelines using Apache Spark, analyzing performance issues, and identifying bottlenecks that require changes to enhance performance. Your expertise in Java/J2EE Micro-services, particularly with Spring Boot, will be crucial in delivering effective solutions. Additionally, you will configure applications for DevOps using Jenkins and GIT, build pipelines, and deploy applications to cloud environments such as Open Shift and AWS. The role also includes developing a Staging Layer using Delta Lake for the Ingestion Framework and managing data publishing and consumption using Kafka. You will implement solutions to transform and serialize datasets into JSON messages using Spark SQL and have a solid understanding of RESTful web services and API development. The position offers an exciting opportunity to continually seek ways to improve product quality and customer satisfaction, making it a rewarding career choice for the right candidate.

Responsibilities

  • Design and implement highly efficient Spark applications in Java, focusing on performance optimization.
  • Develop data pipelines using Apache Spark for Big Data processing.
  • Analyze performance concerns and identify bottlenecks that require changes to improve performance.
  • Utilize in-depth knowledge of Java/J2EE Micro-services (Spring Boot) and Big Data to deliver solutions.
  • Configure applications for DevOps using Jenkins and GIT, and build pipelines using Jenkins.
  • Deploy applications to cloud environments using various cloud services, maintaining applications in Open Shift and AWS.
  • Develop Staging Layer using Delta Lake for the Ingestion Framework.
  • Implement and manage data publishing and consumption using Kafka.
  • Transform and serialize datasets into JSON messages using Spark SQL.
  • Understand and develop RESTful web services and APIs.

Requirements

  • At least 8+ years of experience with end-to-end Java and Spark implementation, integration, and enhancement projects.
  • Experience working with an Onshore-offshore model.
  • Demonstrated experience in designing and implementing highly efficient Spark applications in Java, focusing on performance optimization.
  • Experience in developing data pipelines using Apache Spark.
  • Experience in analyzing performance concerns and issues, identifying bottlenecks for improvement.
  • In-depth knowledge of Java/J2EE Micro-services (Spring Boot) and Big Data solutions.
  • Experience in configuring applications for DevOps using Jenkins and GIT.
  • Experience in deploying applications to cloud environments and maintaining them in Open Shift and AWS.
  • Experience in developing Staging Layer using Delta Lake for the Ingestion Framework.
  • Experience in implementing and managing data publishing and consumption using Kafka.
  • Understanding of RESTful web services and API development.

Nice-to-haves

  • Experience with Docker and Kubernetes.
  • Familiarity with MySQL and drools.

Benefits

  • Dental insurance
  • Health insurance
  • Pet insurance
  • Vision insurance
  • 401(k) Plan and Profit Participation for eligible members
  • Generous holidays, vacation, and sick leave plans
  • Comprehensive insurance plans including medical, dental, vision, life, and disability coverage
  • Back-up child care
  • Member Assistance Program
  • 529 college savings program
  • Personal financial management tool
  • Lifestyle management programs
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service