AWS Data Engineer

Capgemini - Newark, NJ

Full-time - Entry Level

Newark, NJ

Professional, Scientific, and Technical Services

About the position

As an AWS Data Engineer at Capgemini, you will play a crucial role in designing, building, and maintaining efficient, reusable, and reliable architecture and code. Your primary responsibility will be to develop robust data ingestion pipelines that facilitate the seamless transfer of data from on-premises systems to AWS. You will ensure optimal performance and quality in high-scale data engineering projects, actively participating in architecture and system design discussions. This position requires hands-on development and unit testing of applications, where you will collaborate with the development team to integrate individual components into complex enterprise web systems. You will work in a team environment alongside product production operations, quality engineering, and cross-functional teams to deliver projects throughout the entire software development lifecycle. Identifying and resolving performance issues will be a key part of your role, as will staying updated with new technology developments and implementations. Additionally, you will participate in code reviews to ensure that coding standards and best practices are adhered to, contributing to the overall quality of the software produced.

Responsibilities

• Design, build, and maintain efficient reusable and reliable architecture and code.
• Build reliable and robust data ingestion pipelines within AWS.
• Ensure optimal performance and quality of high-scale data engineering projects.
• Participate in architecture and system design discussions.
• Independently perform hands-on development and unit testing of applications.
• Collaborate with the development team to integrate individual components into complex enterprise web systems.
• Work with product production operations, QE/QA, and cross-functional teams to deliver projects throughout the software development cycle.
• Identify and resolve performance issues in data engineering projects.
• Stay updated with new technology developments and implementations.
• Participate in code reviews to ensure standards and best practices are met.

Requirements

• Bachelor's degree in computer science, Software Engineering, MIS, or equivalent combination of education and experience.
• 5-10 years of experience implementing and supporting data lakes, data warehouses, and data applications on AWS for large enterprises.
• Programming experience with Python, Shell scripting, and SQL.
• Solid experience with AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, and Secrets Manager.
• Experience implementing solutions on AWS-based data lakes.
• Good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, and Elasticsearch.
• Experience in AWS data lake/data warehouse/business analytics.
• Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS.
• Knowledge of ETL/ELT processes and end-to-end data solutions on AWS.
• Experience architecting and implementing CI/CD strategies for EDP.
• Implement high-velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred).
• Migrate data from traditional relational database systems and file systems to AWS relational databases such as Amazon RDS, Aurora, and Redshift.
• Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
• Implement POCs on new technology or tools for EDP and onboard for real use cases.
• AWS Solutions Architect or AWS Developer Certification preferred.
• Good understanding of Lakehouse/data cloud architecture.

Nice-to-haves

• AWS Solutions Architect or AWS Developer Certification preferred.

Benefits

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching, and learning programs
• Employee Resource Groups
• Disaster Relief