Virtue Corporate Group - St. Louis, MO
posted 3 months ago
The Data Integration Engineer will play a crucial role in designing, implementing, and managing data integration solutions using Azure Data Factory and Azure API Management. This position is essential for ensuring data integrity and optimizing data workflows, which are vital components of the overall data strategy of the organization. The successful candidate will work closely with cross-functional teams, including data architects and analysts, to understand data requirements and integration needs. They will also be responsible for performing database backup and restore operations, ensuring the availability and reliability of critical data. In this role, the Data Integration Engineer will design, develop, and maintain ETL (Extract, Transform, Load) processes using Azure Data Factory. They will implement data integration solutions that enable seamless data flow between various systems and applications, while also monitoring and optimizing data pipelines for performance, reliability, and efficiency. Additionally, the engineer will configure and manage APIs using Azure API Management to ensure secure and scalable access to data and services. Collaboration with development teams will be necessary to integrate APIs into applications and workflows, as well as troubleshoot and resolve issues related to API connectivity and performance. The position also involves regular database management tasks, including performing backup and restore activities to ensure data protection and recovery, monitoring database performance, and implementing tuning and optimization strategies. The Data Integration Engineer will document data integration processes, workflows, and technical specifications, while ensuring compliance with organizational policies and industry standards. They will also implement and maintain data security measures to protect sensitive information and stay current with emerging trends and technologies in data integration and API management.