Senior Data Engineering Manager

$176,000 - $230,000/Yr

Smartasset - New York, NY

Full-time - Senior

Remote - New York, NY

About the position

The Senior Data Engineering Manager at Financial Insight Technology, Inc. (dba SmartAsset) is responsible for leading data engineering initiatives that transform data into a strategic asset. This role involves overseeing the development of scalable and efficient data platforms, mentoring a team of data engineers, and ensuring that data deliverables meet regulatory and security standards. The position emphasizes collaboration, innovation, and the application of advanced data processing techniques.

Responsibilities

• Lead data engineering efforts to turn data into a strategic asset.
• Mentor and manage a high-performing team of data engineers.
• Oversee the development of scalable, high-performance data platforms.
• Develop and maintain advanced ETL pipelines in Python.
• Implement real-time streaming data pipelines.
• Optimize SQL queries for efficient data retrieval.
• Utilize AWS services for data storage and processing.
• Manage cloud storage systems for data efficiency.
• Implement Docker containerization for scalable ETL pipelines.
• Apply advanced statistical methods for data analysis and modeling.
• Utilize Snowflake data warehouse for data loading and query optimization.
• Facilitate data exchange with external vendors via APIs.
• Ensure data deliverables adhere to regulatory and security requirements.
• Establish CI/CD pipelines for automated deployment and testing.
• Leverage Spark for distributed data processing tasks.
• Utilize data modeling techniques to ensure data accuracy.
• Enhance data pipelines for quality, security, efficiency, and scalability.
• Collaborate with cross-functional teams to deliver data for analytics and machine learning.

Requirements

• Bachelor's degree or U.S. equivalent in Computer Science, Computer Engineering, Information Management, or related field, plus 5 years of professional experience as a Data Engineer or related role.
• In lieu of a Bachelor's degree, a Master's degree or U.S. equivalent in a related field plus 3 years of experience is acceptable.
• 2 years of experience processing data utilizing Snowflake, Redshift, Spark, or Hadoop.
• 2 years of experience prototyping Python-based ETL solutions.
• 2 years of experience utilizing SQL including advanced query optimization.
• 2 years of experience utilizing data modeling and relational database technologies.
• 2 years of experience utilizing cloud platforms including AWS or GCP.
• 2 years of experience utilizing Spark for distributed data processing.

Benefits

• Telecommuting from anywhere in the U.S.
• Competitive salary range of $176,000 - $230,000 per year.