Data Integration Engineer

E-Solutions Group - Saint Louis, MO

Full-time

Saint Louis, MO

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Data Integration Engineer will play a crucial role in designing, implementing, and managing data integration solutions using Azure Data Factory and Azure API Management. This position is essential for ensuring data integrity and optimizing data workflows while supporting the overall data strategy of the organization. The successful candidate will work closely with cross-functional teams to facilitate seamless data flow between various systems and applications, ensuring that data is available and reliable for critical business operations. In this role, the Data Integration Engineer will be responsible for performing database backup and restore operations, which are vital for data protection and recovery. The engineer will also monitor database performance and implement tuning and optimization strategies to enhance efficiency. Additionally, the position requires collaboration with data architects, analysts, and other stakeholders to understand data requirements and integration needs, providing technical support and guidance to team members regarding data integration and API management. The Data Integration Engineer will also ensure that all data integration processes comply with organizational policies and industry standards, implementing and maintaining data security measures to protect sensitive information. Staying current with emerging trends and technologies in data integration and API management is also a key aspect of this role, as it will help the engineer to innovate and improve existing processes.

Responsibilities

• Design, develop, and maintain ETL (Extract, Transform, Load) processes using Azure Data Factory.
• Implement data integration solutions that enable seamless data flow between various systems and applications.
• Monitor and optimize data pipelines for performance, reliability, and efficiency.
• Configure and manage APIs using Azure API Management to ensure secure and scalable access to data and services.
• Collaborate with development teams to integrate APIs into applications and workflows.
• Troubleshoot and resolve issues related to API connectivity and performance.
• Perform regular database backup and restore activities to ensure data protection and recovery.
• Monitor database performance and implement tuning and optimization strategies.
• Support database maintenance tasks, including patching, upgrades, and capacity planning.
• Work with data architects, analysts, and other stakeholders to understand data requirements and integration needs.
• Provide technical support and guidance to team members regarding data integration and API management.
• Document data integration processes, workflows, and technical specifications.
• Ensure data integration processes comply with organizational policies and industry standards.
• Implement and maintain data security measures to protect sensitive information.
• Stay current with emerging trends and technologies in data integration and API management.

Requirements

• Familiarity with Azure Data Factory and Azure API Management.
• Experience with database activities including backup and restore operations.
• Strong understanding of ETL processes and data integration techniques.
• Ability to monitor and optimize data pipelines for performance and reliability.
• Experience in configuring and managing APIs for secure data access.
• Knowledge of database performance tuning and optimization strategies.
• Ability to collaborate effectively with cross-functional teams and stakeholders.
• Strong documentation skills for data integration processes and workflows.

Nice-to-haves

• Experience with cloud-based data solutions beyond Azure.
• Familiarity with data security best practices and compliance standards.
• Knowledge of additional programming languages or data processing tools.