Torch Technologies - Colorado Springs, CO
posted 2 months ago
We are seeking a skilled and motivated Data Engineer to join USSPACECOM J6 and contribute to the development and maintenance of our data infrastructure. As a Data Engineer, you will play a pivotal role in designing, building, and optimizing data pipelines, ensuring the efficient and reliable flow of data from various sources to our data storage and processing systems. Your expertise will enable us to extract valuable insights from large datasets and support data-driven decision-making across the command. In this role, you will collaborate with cross-functional teams, including data scientists, analysts, network engineers, and software engineers to understand data requirements and develop scalable data solutions. You will be responsible for developing, maintaining, and optimizing ETL (Extract, Transform, Load) processes to ensure the timely and accurate movement of data from source systems to data warehouses and other storage solutions. Additionally, you will design and implement data models, schemas, and structures that facilitate efficient querying and analysis. Ensuring data quality and integrity is crucial, and you will implement data validation, cleansing, and transformation processes. Monitoring and troubleshooting data pipelines will be part of your daily tasks, where you will identify and resolve performance bottlenecks, errors, and inconsistencies. You will also explore and implement new technologies, tools, and best practices in data engineering to enhance data processing efficiency and scalability. Collaborating in the design and implementation of data security and privacy measures to protect sensitive information will be essential. Documentation is key in this role, as you will document data pipeline architecture, processes, and procedures for reference and knowledge sharing. Staying up-to-date with industry trends and advancements in data engineering will allow you to incorporate relevant innovations into our practices.