About the position
Core4ce is seeking a Data Engineer to support a mission-critical organization focused on optimized data conditioning and delivery systems for mission analytics. The role involves designing and developing new software products and enhancing existing ones, requiring a hands-on developer with a strong background in service-oriented architecture and Agile methodologies.
Responsibilities
- Design and develop complex new software products.
- Make significant enhancements to existing software.
- Build modular, reusable services and features.
- Deploy and maintain NiFi clusters.
Requirements
- Experienced with Apache NiFi and IC equivalent.
- General understanding and ability to work with zookeeper.
- Expert level experience developing data ETL processes.
- 5+ years experience with a variety of scripting languages including bash, Python, and Groovy.
- Experienced using EC2 instances in AWS.
- 2-5 years of experience working with Ansible, developing playbooks and roles for software driven deployment of NiFi clusters and zookeeper clusters.
- Understanding of Git and Gitlab.
- 2-5 years' experience using REST APIs to call RESTful services.
- Familiar with Linux - particularly the new Rocky variant.
- Working level familiarity with Elasticsearch and Kibana.
Nice-to-haves
- Able to develop dashboard visualizations in Kibana from data in Elasticsearch.
