Data Engineer

$110,000 - $118,000/Yr

Willis Towers Watson - Arlington, VA

Full-time - Senior

Arlington, VA

Insurance Carriers and Related Activities

About the position

As a Senior Data Engineer at WTW, you will be instrumental in designing, building, and optimizing complex data pipelines and ETL processes. Your role will involve leveraging Azure Synapse and PySpark to create advanced data analytics systems and outputs for downstream consumption. You will architect scalable data models to support business processes and utilize Generative AI technologies to enhance data extraction and analysis solutions. The ideal candidate will have over 10 years of experience in data engineering, particularly in ETL and data modeling within Azure cloud solutions.

Responsibilities

• Lead the design, development, and optimization of complex ETL processes and pipelines.
• Architect and develop scalable data solutions utilizing Azure Synapse with a focus on performance optimization.
• Design and maintain logical and physical data models to align with business needs.
• Lead the application of Generative AI technologies for data analysis and extraction.
• Develop, implement, and manage automated data pipelines for continuous integration and deployment.
• Collaborate with Data Engineers, analysts, and business stakeholders to understand data requirements.
• Continuously monitor and optimize data pipelines and queries for enhanced performance.
• Drive cloud-native engineering best practices on the Azure platform.
• Create and maintain documentation for data pipelines, models, and processes.

Requirements

• 10+ years of experience in Data Engineering and ETL processes.
• 5+ years of experience in Azure Synapse Analytics, including PySpark notebooks.
• 5+ years of experience in Data Modeling with expertise in relational and dimensional modeling.
• 3+ years of experience in integrating Generative AI technologies for data functions.
• Expertise in Azure Cloud Ecosystem, including Azure Data Lake and Azure Data Factory.
• Strong proficiency in PySpark and distributed computing frameworks.
• Solid understanding of Data Governance principles and usage of Purview.
• Strong SQL skills and proficiency in Python, Scala, or R.
• Experience with DevOps practices such as CI/CD pipelines.

Nice-to-haves

• Azure Certifications: Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.
• Experience with real-time data streaming solutions such as Azure Event Hubs.
• Hands-on experience with BI Tools such as Power BI.
• Knowledge of NoSQL databases such as Cosmos DB or MongoDB.
• Experience with containerization (Docker, Kubernetes) for data engineering workloads.
• Experience in the Property and Casualty Insurance industry.

Benefits

• Medical (including prescription coverage)
• Dental
• Vision
• Health Savings Account
• Commuter Account
• Flexible Spending Accounts
• Group Accident Insurance
• Group Critical Illness Insurance
• Life Insurance
• AD&D
• Group Legal
• Identity Theft Protection
• Wellbeing Program
• Work/Life Resources (including Employee Assistance Program)
• Paid Holidays
• Annual Paid Time Off
• Short-Term Disability
• Long-Term Disability
• Other Leaves (e.g., Bereavement, FMLA, ADA, Jury Duty, Military Leave, Parental and Adoption Leave)
• Contributory Pension Plan and Savings Plan (401k)