Microsoft Fabric ETL Senior Developer

$156,000 - $166,400/Yr

Mastech Digital - Washington, DC

Full-time - Mid Level

Remote - Washington, DC

Professional, Scientific, and Technical Services

About the position

The Microsoft Fabric ETL Senior Developer will be responsible for designing, implementing, and optimizing ETL processes using Microsoft Fabric for a major application. This role involves collaboration with a globally distributed development team to ensure efficient data processing and transformation, while adhering to best practices and business requirements.

Responsibilities

• Ensure that data is efficiently and accurately processed from source systems into the Microsoft Fabric data layer and transformed across the various levels of transformation inside Fabric.
• Collaborate with business analysts and business stakeholders to understand data requirements, transformation rules, and relevant accounting business logic.
• Develop transformation logic to clean, enrich, aggregate, and otherwise modify data to meet business needs.
• Implement data validation and error handling procedures to ensure data integrity.
• Implement processes to load processed data into Microsoft Fabric data storage or previously worked in technologies like Azure Synapse, Azure Data Lake, etc.
• Optimize data loading processes to ensure performance and scalability.
• Design and deploy ETL pipelines using Python and PySpark within Microsoft Fabric.
• Collaborate with data architects to design the data architecture and models that align with the accounting application requirements.
• Implement data schemas, star/snowflake schema designs for data warehouses, and OLAP cubes, as necessary.
• Optimize ETL processes for performance and resource utilization.
• Implement indexing, partitioning, and other performance enhancements to handle large volumes of data efficiently.
• Develop and execute unit tests, integration tests, and end-to-end tests for ETL processes.
• Troubleshoot and resolve issues, making improvements and adjustments as needed.
• Validate data accuracy and consistency throughout the ETL lifecycle.
• Create and maintain comprehensive documentation for ETL processes, data sources, data flow diagrams, and data models.
• Ensure documentation is up-to-date and accessible to relevant stakeholders.
• Ensure all data processing complies with relevant policies and standards.

Requirements

• High proficiency in Microsoft Fabric and related ETL tools (e.g., Azure Data Factory).
• Knowledge of database systems (e.g., SQL Server, Azure SQL Database, Synapse Analytics) and understanding of data warehousing concepts and architecture.
• Experience with data modeling and schema design.
• Familiarity with programming languages used in ETL processes (e.g., Python, PySpark).
• Strong understanding of data engineering principles, including data modeling, data transformation, and data optimization.
• Strong SQL skills for data extraction, transformation, and querying.
• Knowledge of accounting principles and logic is highly beneficial.

Nice-to-haves

• Microsoft Certified: Fabric Analytics Engineer Associate (strongly preferred)
• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Azure Developer Associate
• Microsoft Certified: Azure Solutions Architect Expert

Benefits

• Medical, Dental (Including Ortho) & Vision Insurance (Option to Enroll).
• Paid Leaves (Wherever applicable).
• Life & Disability Coverage (Upon eligibility).
• 401K Option, Education Assistance Program and more.