ApTask - Wilmington, DE

posted 30 days ago

Full-time
Wilmington, DE
Administrative and Support Services

About the position

The Full Stack Java Developer with AWS role involves designing, developing, and maintaining scalable data pipelines. The position requires collaboration with data scientists and analysts to deliver high-quality data solutions while ensuring data quality, integrity, and security. The developer will also optimize data processing jobs for performance and cost-efficiency, and monitor data pipeline issues to ensure reliability.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Spark and Java.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
  • Deliver high-quality data solutions based on stakeholder needs.
  • Optimize and tune data processing jobs for performance and cost-efficiency.
  • Ensure data quality, integrity, and security across all data pipelines and storage solutions.
  • Develop and maintain data models, schemas, and documentation.
  • Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.

Requirements

  • Over 15+ years of experience in software development, particularly with Java and data pipelines.
  • Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue.
  • Experience with SQL and NoSQL databases.
  • Strong understanding of data processing frameworks like Spark.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service