Big Data Engineer

Transcend It Solutions - Columbus, OH

Full-time - Mid Level

Columbus, OH

Professional, Scientific, and Technical Services

About the position

The Big Data Engineer role focuses on developing a new platform for Credit Card data, utilizing a blend of Java and Python skills, with a strong emphasis on Java. The position offers an opportunity to work within two scrum teams, contributing to impactful new development projects in a collaborative environment.

Responsibilities

• Develop and maintain a new platform for Credit Card data.
• Utilize Java and Python for software engineering tasks.
• Work with large data sets and perform ETL processes.
• Implement data processing using Spark, EMR, and Glue.
• Collaborate with team members in a scrum environment.

Requirements

• Strong proficiency in Java programming.
• Experience with large data sets and high-volume data collection applications.
• Familiarity with ETL processes.
• Proficient in Spring Boot framework.
• Experience with Spark or other large-scale data processing tools.
• Knowledge of AWS services, specifically S3, EMR, and Glue.
• Experience with RDBMS SQL.

Nice-to-haves

• Python or PySpark experience.
• Experience with data lakes.
• Background in Credit Card application development.
• Familiarity with Snowflake.
• Experience with Terraform.
• Knowledge of GraphQL.

Benefits

• Competitive hourly rate of $65/hr.