Custom Staffing - Herndon, VA

posted 2 months ago

Full-time - Mid Level
Herndon, VA
Administrative and Support Services

About the position

We are at the forefront of innovation, leveraging data to drive impactful decisions and solutions. Our team is passionate about harnessing the power of data to transform industries and improve lives. We are looking for a Data Engineer to join our dynamic team and lead the charge in building robust, scalable data pipelines. This position requires a strong technical background and a commitment to excellence in data engineering practices. The Data Engineer will be responsible for architecting and developing complex data pipelines that are not only efficient but also scalable to meet the growing demands of our data-driven initiatives. The role involves optimizing and troubleshooting existing data pipelines to ensure their performance, reliability, and scalability. The ideal candidate will have a deep understanding of data engineering principles and a proven track record of delivering high-quality data solutions.

Responsibilities

  • Lead the design, development, and maintenance of complex, scalable data pipelines.
  • Ensure performance, reliability, and scalability of data pipelines.
  • Optimize and troubleshoot existing data pipelines.

Requirements

  • 7+ years of experience in data engineering or related roles.
  • Advanced proficiency in SQL and experience with relational databases such as PostgreSQL, MySQL, or NoSQL.
  • Extensive experience with big data technologies such as Hadoop and Spark.
  • Deploy, monitor, and maintain cloud technologies such as AWS, Google Cloud Platform, or Azure and their data services.
  • Solid experience with DevOps practices and tools including CI/CD, Docker, and Kubernetes.
  • Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.
  • Ensure data quality and consistency through rigorous testing, validation, and governance practices.
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Benefits

  • 100% employer paid healthcare benefits for employee
  • Competitive salary based on experience
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service