AWS Data Engineer

$145,600 - $145,600/Yr

Spectraforce Technologies - Newark, NJ

Full-time - Mid Level

Newark, NJ

Administrative and Support Services

About the position

The AWS Data Engineer role at SPECTRAFORCE involves developing and deploying data pipelines in a cloud environment, specifically utilizing AWS services. The position requires strong programming skills in SQL and Python, along with experience in big data technologies. The engineer will work collaboratively in an Agile environment, contributing to the data journey for the organization while ensuring data security and compliance.

Responsibilities

• Develop and deploy application code using SQL, Python, and Spark.
• Create and manage data pipelines in a cloud environment, specifically AWS.
• Utilize AWS services such as Glue, Athena, Lambda, and Redshift for data processing.
• Secure data using IAM and Active Directory.
• Develop Linux and UNIX shell scripts for automation and data processing.
• Implement monitoring and logging techniques using Cloudwatch and Splunk.
• Manage version control using tools like Artifactory, Jenkins, and Bitbucket.

Requirements

• 3-5 years of experience in developing and deploying data pipelines in the cloud.
• Proficiency in AWS services including Glue, Athena, Lambda, Redshift, and S3.
• Experience with SQL, Python, Spark, and Pyspark.
• Familiarity with big data environments such as Hadoop and DB2 LUW.
• Knowledge of monitoring and logging techniques with Cloudwatch and Splunk.
• Experience in Agile methodologies and collaborative work environments.

Nice-to-haves

• AWS Cloud Practitioner certification or other AWS certifications.
• Experience in the financial services technology sector.

Benefits

• ACA compliant health benefits
• Dental insurance
• Vision insurance
• Accident insurance
• Critical illness insurance
• Voluntary life insurance
• Hospital indemnity insurance
• Commuter benefits
• 401K plan with matching
• Referral bonus program
• Paid sick leave when required by law