Data Engineer

$93,420 - $146,005/Yr

Noblis - Huntsville, AL

posted about 2 months ago

Part-time,Full-time - Mid Level
Huntsville, AL
Professional, Scientific, and Technical Services

About the position

Noblis is seeking to hire a Data Engineer with an ACTIVE Top Secret Clearance. As a Data Engineer, you will be instrumental in building and maintaining the data infrastructure. You will design, develop, and manage robust data pipelines and ETL processes to ensure the seamless collection, transformation, integration, and visualization of data from various sources. Your role will involve working closely with data scientists and analysts to understand data requirements and implement data-driven solutions. In this position, you will provide engineering expertise to deliver an advanced visual analytic application. You will develop data analytics for desktop and web-developed visual analytic software, facilitating the bulk analysis of relational information utilizing advanced graphics, visualization, and high-performance computing. You will also establish an application that produces manageable, actionable intelligence from streams of structured and semi-structured data. Additionally, you will design strategies for enterprise database systems and set standards for operations, programming, and security, as well as design and construct large relational databases. Integrating new systems with existing warehouse structures and refining system performance and functionality will also be key responsibilities. This role requires a Bachelor's degree in computer science, data science, or a related analytical, scientific, or technical discipline, along with 8 years of experience. Alternatively, an additional six years of experience can be considered in lieu of a degree. You should have experience conducting data normalization, developing and troubleshooting ETL workflows, and building and maintaining data infrastructure within cloud environments such as AWS, MS Azure, or Google Cloud. Knowledge of data lakehouse concepts, particularly using Databricks, is also essential. An active Top Secret security clearance with SCI eligibility is required for this position.

Responsibilities

  • Provide engineering expertise to deliver an advanced visual analytic application.
  • Develop data analytics for desktop and web-developed visual analytic software.
  • Facilitate the bulk analysis of relational information utilizing advanced graphics, visualization, and high-performance computing.
  • Establish an application that produces manageable, actionable intelligence from streams of structured and semi-structured data.
  • Design strategies for enterprise database systems and set standards for operations, programming, and security.
  • Design and construct large relational databases.
  • Integrate new systems with existing warehouse structure and refine system performance and functionality.

Requirements

  • Bachelor's degree in computer science, data science, or other related analytical, scientific, or technical discipline with 8 years of experience; additional six years of experience is considered in lieu of a degree.
  • Experience conducting data normalization (validation, cleaning, enrichment).
  • Experience with data pipelines to include data extraction, transformation, integration, and loading.
  • Experience developing, monitoring, and troubleshooting ETL workflows and processes.
  • Experience building and maintaining data infrastructure within cloud environments such as Amazon Web Services, MS Azure, and/or Google Cloud.
  • Experience or knowledge of data lakehouse concepts (including using Databricks).
  • Active Top Secret security clearance with SCI eligibility.

Nice-to-haves

  • Strong self-organization and self-management skills, with emphasis on self-initiation, teamwork and follow through.
  • Strong professional and interpersonal skills.
  • Experience with data warehousing using AWS Redshift, MySQL, or Snowflake.
  • Experience incorporating open source tools into existing architectures as tools and technologies evolve.
  • Experience with tools such as Spark, Hadoop, Hive, AWS EMR, or Kafka.
  • Experience with NoSQL implementations, including MongoDB or Cassandra.
  • Experience with Unix and Linux, such as use of basic commands and Shell scripting.
  • Experience using tools and technologies such as Apache Spark, AWS Glue, Amazon S3, and/or Amazon Redshift.
  • Experience with Java and other programming languages.
  • Experience operating in a scaled agile (SAFe) environment.
  • Experience with Atlassian Suite of tools; Jira, Confluence.

Benefits

  • Health insurance coverage
  • Life insurance coverage
  • Disability insurance coverage
  • Financial and retirement benefits
  • Paid leave
  • Professional development
  • Tuition assistance
  • Work-life programs
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service