Data Engineer II

$114,400 - $118,560/Yr

Intelliswift Software - Austin, TX

posted 2 months ago

Full-time - Mid Level
Austin, TX
Professional, Scientific, and Technical Services

About the position

The Data Engineer II position is focused on designing, building, and maintaining robust data pipelines and infrastructure to facilitate data-driven insights. The role requires expertise in data modeling, data warehousing, ETL processes, and scripting, with a strong emphasis on AWS cloud services. The engineer will work on architecting scalable and fault-tolerant data solutions, ensuring data quality, governance, and compliance while continuously improving and automating processes.

Responsibilities

  • Design, build, and maintain robust data pipelines and infrastructure.
  • Architect scalable and fault-tolerant pipelines for data extraction, transformation, and loading.
  • Implement ingestion, transformation, and integration processes with a focus on data quality.
  • Design and implement high-performance, scalable, and cost-efficient data storage solutions.
  • Automate infrastructure deployment and maintenance processes using CI/CD principles.
  • Develop and maintain ETL processes and optimized data models.
  • Collaborate with analysts and functional managers to understand data needs.
  • Ensure data governance, security, and compliance through robust policies and processes.
  • Continuously evaluate and optimize processes, pipelines, and infrastructure.

Requirements

  • 3+ years of data engineering experience with data modeling, warehousing, and building ETL pipelines.
  • Strong knowledge of professional software engineering best practices.
  • Experience with SQL and distributed systems related to data storage and computing.
  • Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT, or equivalent.

Nice-to-haves

  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles.
  • Experience with non-relational databases/data stores.
  • Master's degree in computer science, engineering, analytics, mathematics, statistics, IT, or equivalent.
  • Experience in modern scripting or programming languages such as Python, Java, Scala, or NodeJS.

Benefits

  • Competitive pay rate of $55/hr. to $57/hr.
  • Hybrid work model with 3 days in office.
Job Description Matching

Match and compare your resume to any job description

Start Matching
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service