Data Engineer

Insurance Services Office - Jersey City, NJ

Full-time - Mid Level

Jersey City, NJ

5,001-10,000 employees

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The Data Engineer role within the Enterprise Data Management team focuses on developing, maintaining, and optimizing ETL processes to ensure efficient data integration and transformation workflows. The position requires collaboration with cross-functional teams to understand data requirements and deliver actionable insights while ensuring data quality, consistency, and security.

Responsibilities

• Develop, maintain, and optimize ETL processes using ETL technologies.
• Write clean, optimized code to efficiently process large volumes of data.
• Conduct data analysis to troubleshoot and resolve data-related issues.
• Develop and implement data processing systems using SQL, Python, and big data technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
• Ensure data quality, consistency, and security by implementing data validation, cleansing, and access control mechanisms.
• Continuously monitor and optimize data infrastructure performance, ensuring high availability, scalability, and reliability.
• Conduct SQL querying and analysis to validate and enhance data quality.
• Prepare monthly data quality reports/metrics to track deviations in data.
• Provide afterhours or weekend support for ETL processes and troubleshoot any issues that may arise.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering or a related STEM field.
• 2 to 5 years of hands-on experience in data engineering.
• Minimum 2 years of experience with Amazon Web Services (AWS) - EC2, ECS, S3, SQS, Athena, RDS, Dynamo DB, Cloud Watch, IAM and Lambda.
• Strong proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
• 2+ years of expertise in Python programming and familiarity with data manipulation libraries such as Pandas and NumPy.
• Familiarity with data pipeline orchestration tools like Step Functions, AirFlow or similar.
• 2+ years of experience with CI/CD, CloudFormation, Changeset execution and rollback.
• Excellent problem-solving skills and the ability to work independently in a fast-paced environment.

Nice-to-haves

• Experience with entity resolution or similar technology.

Benefits

• Flexible hybrid work model
• Support, coaching, and training for career development
• Recognition as a Great Place to Work
• Inclusivity and diversity initiatives