Senior Data Engineer (Azure/D365)

INSPYR Solutions - Houston, TX

Full-time - Mid Level

Houston, TX

Administrative and Support Services

About the position

We are seeking a highly skilled Data Engineer with a strong technical background in Microsoft Dynamics 365 Finance to join our team. The ideal candidate will have extensive experience with the Data Management Framework (DMF), data entities, and data structures within D365 Finance, along with hands-on expertise in data migration, data mapping, and D365 database upgrade processes. Additionally, familiarity with Dataverse Dual Write operations, Azure Data Lake integration, and Azure Synapse is required. This role will focus on creating tools, processes, and automation to support test data set creation for D365 Finance lower environments, data extraction to a third-party Data Lake, and D365 Finance production archive and purge operations. The Data Engineer will be responsible for building and testing data entities, data structures, and configurations within D365 Finance. They will oversee and support the D365 database upgrade process using self-service environments. The role also involves configuring and testing Dataverse Dual Write operations to synchronize data between D365 Finance and other systems, as well as integrating D365 Finance with Azure Data Lake and Synapse to support data analysis and reporting. In addition, the Data Engineer will design and implement tools, processes, and automation solutions for creating and deploying test data sets in D365 lower environments, and support data extraction processes for third-party data lakes. Establishing and enforcing data governance policies for D365 Finance is crucial, ensuring data accuracy, consistency, and security. The engineer will also develop and execute strategies for D365 production archive and purge operations to maintain optimal system performance.

Responsibilities

• Build and test data entities, data structures, and configurations within D365 Finance.
• Oversee and support the D365 database upgrade process using self-service environments.
• Configure and test Dataverse Dual Write operations to synchronize data between D365 Finance and other systems.
• Integrate D365 Finance with Azure Data Lake and Synapse to support data analysis and reporting.
• Design and implement tools, processes, and automation solutions for creating and deploying test data sets in D365 lower environments.
• Support data extraction processes for third-party data lakes.
• Establish and enforce data governance policies for D365 Finance, ensuring data accuracy, consistency, and security.
• Develop and execute strategies for D365 production archive and purge operations to maintain optimal system performance.

Requirements

• Strong knowledge of the D365 Finance Data Management Framework, data entities, and data structures.
• Hands-on experience with data migration and data mapping in D365 Finance.
• Proficiency with Dataverse Dual Write operations and Azure Data Lake/Synapse integration.
• Experience with the D365 database upgrade process using self-service environments.
• Advanced SQL, data querying skills, and data modeling techniques.
• Working knowledge of Azure DevOps and Git repositories.
• Broad understanding of Azure services such as virtual machines, virtual networks, network security groups, storage accounts, and key vaults.
• Skilled in working with Microsoft Lifecycle Services (LCS) to move data into and out of LCS-deployed self-service environments.
• Excellent communication and teamwork skills.
• Ability to work independently, manage multiple priorities, and lead a workstream.
• Understanding of data security and compliance, and the importance of protecting customer data.
• Familiarity with Agile methodologies.

Benefits

• Comprehensive medical benefits
• Competitive pay
• 401(k) retirement plan
• and much more!