Database Developer

$96,000 - $200,000/Yr

Raytheon Technologies - Herndon, VA

posted about 2 months ago

Full-time - Mid Level
Herndon, VA
Computer and Electronic Product Manufacturing

About the position

Nightwing is seeking a Database Developer to support a multifaceted global software deployment project. This position is contingent upon funding, an open position, customer approval, completion of a favorable background investigation, and successful TS/SCI with Polygraph clearance crossover. The Database Developer will play a crucial role in the project, particularly in extract, transform, load (ETL) workflows. The work involves regular engagement with data scientists, analysts, and managers to ensure the successful implementation of data processes. The responsibilities of the Database Developer include loading large datasets into the client's on-premises and Cloud environments, developing and maintaining ingestion algorithms and schemas for large datasets, and analyzing new large-volume datasets to optimize the data ingest processes. The developer will also support the creation of Apache NiFi schemas for new data loads and develop software tools that efficiently preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real-time. Ensuring proper access controls are implemented and generating metrics to track data ingest statistics to maintain data integrity and provenance are also key responsibilities. Additionally, the developer will document the data-flows according to standards set by the Sponsor and work with multiple Database Management Systems (Oracle, SQL, Mongo, etc.). The ideal candidate will have a strong background in Computer Science, Computer Engineering, Systems Engineering, or a closely related discipline, along with professional experience in AWS cloud services, Databricks, SQL database structures, and Apache NiFi. The role requires a demonstrated ability to develop and deploy ETL processes for large data sets, create operating system level scripts for ETL operations, and implement multiprocessing data-flows to parallelize ingest operations. Strong coordination and collaboration skills are essential, as is the ability to communicate technical concepts to non-technical audiences. This position offers an exciting opportunity to contribute to the future of cybersecurity and intelligence services at Nightwing.

Responsibilities

  • Load large datasets into the client's on-premises and Cloud environments.
  • Develop and maintain ingestion algorithms and schemas for large datasets.
  • Analyze new large-volume datasets to optimize the data ingest processes.
  • Support the creation of Apache NiFi schemas for new data loads.
  • Develop software tools that efficiently preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real-time.
  • Ensure proper access controls are implemented.
  • Generate metrics to track data ingest statistics to maintain data integrity and provenance.
  • Document the data-flows according to standards set by Sponsor.
  • Work with multiple Database Management Systems (Oracle, SQL, Mongo, etc.).

Requirements

  • Demonstrated professional experience in Computer Science, Computer Engineering, Systems Engineering, or closely related discipline.
  • Demonstrated professional experience with AWS cloud services, including long-term storage options, and cloud-based database services.
  • Demonstrated experience working with Databricks.
  • Demonstrated experience understanding SQL database structures and mapping them between different SQL databases.
  • Demonstrated professional experience working with Apache NiFi.
  • Demonstrated professional experience working with large data and high performance compute clusters such as Hadoop or similar.
  • Demonstrated experience with API development techniques.
  • Demonstrated experience developing and deploying ETL processes for large data sets.
  • Demonstrated experience creating operating system level scripts to perform ETL operations on SQL databases.
  • Demonstrated professional experience with version control systems, preferably Git.
  • Demonstrated experience testing the development of software solutions for the extraction, transformation, and loading of data using the most efficient languages for the task such as NiFi, Python, and SQL.
  • Demonstrated experience implementing multiprocessing data-flows to parallelize ingest operations.
  • Demonstrated experience exhibiting strong coordination and collaboration skills.
  • Demonstrated experience working with full-stack developers to deploy applications that leverage large data sets.
  • Demonstrated experience communicating technical concepts to non-technical audiences.

Benefits

  • Paid holidays
  • Disability insurance
  • Health insurance
  • Dental insurance
  • Flexible spending account
  • Paid time off
  • Parental leave
  • Employee assistance program
  • Vision insurance
  • 401(k) matching
  • Flexible schedule
  • Life insurance
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service