Randstad - Jersey City, NJ
posted 2 months ago
We are looking for a skilled Full Stack Developer with expertise in Java and Python, particularly in the context of data processing and management using Hadoop and Teradata. This role is crucial for developing, managing, and scaling our data-based applications and processes. The ideal candidate will have a strong background in the Hadoop ecosystem and any RDBMS, with a solid understanding of data processing, storage, and analysis using these technologies. The successful candidate will be responsible for designing and developing data processing and ingestion solutions utilizing Hadoop and its related technologies, such as HDFS, MapReduce, Hive, Impala, and PySpark, or Teradata. This position requires writing scalable, robust, and high-performance code for data processing and analysis, as well as designing and building data processing workflows and pipelines for both batch and real-time data. Additionally, the candidate should be proficient in handling middleware services using Python and have excellent development skills with the Hadoop ecosystem and Teradata. Candidates should also possess experience with Unix shell scripting and Autosys, and be capable of managing large datasets, potentially up to 30 TB. The role demands strong SQL skills, particularly in writing optimized queries, and a keen understanding of performance improvement techniques. Problem-solving abilities, attention to detail, and a good grasp of testing concepts in agile development are essential. Familiarity with REST APIs using Python, React JS, HTML/CSS, and secure coding risk management practices is also required.