Sr Data Engineer - No CTC (Only w2)

MetaSense Marketing - New York, NY

Full-time - Mid Level

New York, NY

Administrative and Support Services

About the position

We are seeking a highly skilled Data Engineer with hands-on experience in the Financial or Banking industry, capable of quickly building scalable data solutions. The ideal candidate will have a strong background in Azure Cloud and will work within a cross-functional Agile team. This role requires collaboration with stakeholders to understand business requirements, particularly for capturing revenue data for brokers, while ensuring compliance with regulatory standards.

Responsibilities

• Design and develop efficient ETL workflows to extract, transform, and load data from various sources.
• Collaborate with stakeholders to understand business requirements and capture revenue data for brokers.
• Work with compliance and security teams to ensure all systems meet regulatory standards.
• Build a flexible data capture system while maintaining Business as Usual (BAU) functionality.
• Implement data governance frameworks and establish data quality standards.
• Set up alerts and notifications for batch jobs to ensure timely identification and resolution of issues.

Requirements

• Strong proficiency in Python programming, particularly in developing ETL processes and data manipulation.
• Hands-on knowledge of Microsoft Azure services, including Azure Data Factory, Azure Databricks, Azure Storage, and Azure Virtual Machines.
• Experience in architecting scalable and flexible data pipelines with a focus on performance optimization.
• Understanding of data governance principles, data quality management, and experience ensuring compliance with financial regulations.