Infomatics Incorporated - Vienna, VA

posted 4 days ago

Full-time - Senior
Vienna, VA
Professional, Scientific, and Technical Services

About the position

The Data Engineer role is focused on designing, building, and maintaining data pipelines and infrastructure to support data analytics and business intelligence initiatives. The position requires a strong background in data engineering, particularly with tools and technologies such as Python, PySpark, and AWS. The ideal candidate will also have experience with automation testing and various data management tools.

Responsibilities

  • Design and implement data pipelines to support analytics and reporting.
  • Collaborate with data scientists and analysts to understand data requirements.
  • Optimize data storage and retrieval processes for efficiency.
  • Ensure data quality and integrity throughout the data lifecycle.
  • Implement automation testing for data processes and pipelines.

Requirements

  • 10+ years of experience in data engineering.
  • Proficiency in Python and PySpark.
  • Experience with AWS services and Kubernetes/EKS.
  • Strong understanding of data pipeline architecture and design.

Nice-to-haves

  • Experience with Cucumber for automation testing.
  • Familiarity with SonarQube and Fortify for code quality.
  • Knowledge of Snowflake, AMQ s, Java, Spring Boot, Informatica, SAS, AutoSys, and DB2.

Benefits

  • Competitive salary
  • Health insurance
  • 401k plan
  • Flexible working hours
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service