Nr Consulting - Hanover, NJ
posted about 2 months ago
Full-time - Senior
Hanover, NJ
Administrative and Support Services
About the position
The Senior AWS Big Data Engineer is responsible for developing data ingestion, processing, and analytical pipelines for big data solutions. This role requires extensive experience with AWS and big data technologies, focusing on both private and public cloud architectures. The engineer will provide practical direction within AWS Native and Hadoop environments, ensuring efficient data management and processing.
Responsibilities
- Develop data ingestion, processing, and analytical pipelines for big data solutions.
- Provide practical direction within AWS Native and Hadoop environments.
- Work with private and public cloud architectures, considering migration strategies.
- Utilize AWS services such as EC2, S3, Glue, Lambda, and others for data management.
- Implement streaming technologies like Kafka, Kinesis, and NiFI for real-time data processing.
- Collaborate with DevOps teams using tools like GitLabs, Jenkins, and CodePipeline.
Requirements
- At least 8 years of experience in developing data ingestion and processing pipelines.
- Strong experience with AWS, Python, PySpark, and Hadoop technologies.
- Minimum of 5 years of hands-on experience in AWS and Big Data technologies.
- Proficiency in programming languages such as Java, C#, Node.js, Python, and SQL.
- Experience with DevOps tools such as GitLabs, Jenkins, and CodeBuild.
- Must have at least one AWS Certification.
