AWS Data Engineer

MDMS Recruiting - Newark, NJ

Full-time

Newark, NJ

Administrative and Support Services

About the position

The AWS Data Engineer role involves developing and deploying application code and data pipelines in a cloud environment, specifically utilizing AWS services. The position requires expertise in various programming languages and tools, with a focus on data security and monitoring techniques. The ideal candidate will have experience in big data environments and possess strong collaborative and leadership skills.

Responsibilities

• Develop and deploy application code using SQL, Python, and Spark.
• Create and manage data pipelines in a cloud environment.
• Utilize AWS services such as Glue, Athena, Lambda, and Redshift.
• Secure data using IAM and Active Directory.
• Develop Linux and UNIX shell scripts.
• Implement monitoring and logging techniques with CloudWatch and Splunk.
• Manage version control using Artifactory, Jenkins, and Bitbucket.

Requirements

• Experience in developing and deploying application code using SQL, Python, and Spark.
• Proficiency in AWS services including Glue, Athena, Lambda, Redshift, and PostgreSQL.
• Experience in securing data with IAM and Active Directory.
• Familiarity with Linux and UNIX shell scripting.
• Experience in big data or warehouse environments such as Hadoop or DB2 LUW.
• Knowledge of monitoring and logging techniques with CloudWatch and Splunk.
• Experience with version control tools and branching techniques.

Nice-to-haves

• AWS Cloud Practitioner certification or other AWS certification.
• Experience in financial services technology.
• Agile experience.