data engineer iv

$154,856 - $175,656/Yr

Randstad - Charlotte, NC

Full-time - Mid Level

Charlotte, NC

Administrative and Support Services

About the position

The Data Engineer IV position at Randstad US in Charlotte, North Carolina, is a contract role focused on developing and optimizing data platforms on AWS. The ideal candidate will be a skilled coder and analyst with extensive experience in data engineering, capable of communicating technical concepts to non-technical audiences. This role requires collaboration with product owners and architects to ensure effective delivery of data solutions, emphasizing data security, quality, and innovative problem-solving.

Responsibilities

• Provides technical direction and engages the team in discussions on building features and responsible for product tech delivery.
• Works closely with the Product Owner and team to align on delivery goals and timing.
• Collaborates with architects on key technical decisions for data and overall solution.
• Leads design and implementation of data quality check methods.
• Ensures data security and permissions solutions, including data encryption, user access controls, and logging.
• Thinks unconventionally to find the best way to solve for defined use cases with fuzzy requirements.
• Demonstrates a self-starter mentality and conducts research to solve problems, presenting findings clearly.
• Thrives in a fail-fast environment, participating in mini PoCs and an inspect and adapt process.
• Maintains a questioning and improvement mindset, suggesting alternative solutions to current practices.
• Exhibits customer-facing skills by interfacing with stakeholders and product teams, troubleshooting support, and debugging issues.

Requirements

• Bachelor's degree in a relevant field.
• 5+ years of experience in Data Engineering or Software Engineering roles.
• Proficiency in coding and data analysis.
• Experience with AWS data platforms, data lakes, and data pipelines.
• Strong knowledge of the tech stack including GIT, AWS, IAM, API Gateway, Lambda, Step Functions, Lakeformation, EKS, Glue, Athena, S3, Apache Hudi, Flink, PostgreSQL, SQL, RDS, Python, Java, and Terraform Enterprise.

Nice-to-haves

• Experience with Kafka and Kafka Schema Registry.
• Familiarity with additional AWS services such as CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift.
• Experience with Concourse and Secrets Management Platforms like Vault and AWS Secrets Manager.
• Background in Kubernetes, Distributed Systems, Microservice architecture, and containers.
• Experience in transitioning on-premise big data platforms to cloud-based platforms.
• Implementation and tuning experience in streaming use cases in big data ecosystems.

Benefits

• Health insurance coverage
• 401K contribution
• Incentive and recognition program