Lead Data Engineer

$185,000 - $235,000/Yr

Jobot - Indianapolis, IN

Full-time - Senior

Remote - Indianapolis, IN

Administrative and Support Services

About the position

The Lead Data Engineer will play a crucial role in a growing subsidiary of a large public company, focusing on data product engineering and leading cross-functional teams to deliver data projects. This position offers the opportunity to work remotely while contributing to the development of data solutions and products using advanced data engineering techniques and tools.

Responsibilities

• Lead cross-functional teams to deliver data projects.
• Design and implement data pipelines for batch and streaming data.
• Develop and maintain data APIs and microservices for data integration.
• Conduct data quality checks and implement monitoring solutions.
• Architect solutions on AWS or equivalent public cloud platforms.
• Collaborate with stakeholders to understand data needs and deliver solutions.

Requirements

• Completed BS, MS, or PhD in Computer Science, Mathematics, Statistics, Engineering, Operations Research, or other quantitative field.
• 7+ years of experience as a Data Engineer with proficiency in data extraction, processing, and storage.
• 2+ years of experience leading a cross-functional team and managing a small team.
• Strong programming skills in Python and understanding of core computer science principles.
• Experience with building batch and streaming pipelines using SQL, PySpark, and Pandas.
• Knowledge of relational and dimensional data modeling concepts.
• Experience with orchestrating workflows and data pipelines using tools like Airflow.
• Familiarity with Git, CI/CD pipelines, Docker, and Kubernetes.
• Experience with architecting solutions on AWS or equivalent public cloud platforms.

Nice-to-haves

• Experience in assessing and implementing new data tools to enhance the data engineering stack.
• Knowledge of data mesh concepts.
• Familiarity with domains such as recommender systems, fraud detection, and marketing science.
• Knowledge of vector databases and knowledge graphs.
• Familiarity with tools like Snowflake, RDS, Fivetran, dbt, and Data Governance tools.

Benefits

• Competitive base salary between $185k and $235k.
• Generous stock grant.
• Bonus of 15-20%.
• 100% remote work.
• 401k with dollar for dollar match, up to 6% of eligible earnings.
• Comprehensive medical, dental, vision, and life insurance.
• 17 paid holidays per year, including 3 floating holidays.
• Annual Paid Time Off (PTO) with separate sick days.
• 12 weeks paid Parental Leave.
• Caregiver Leave.
• Adoption and Surrogacy Assistance Plan.
• Flexible workplace accommodation.
• Tuition reimbursement.
• Ability to attend conferences.
• Company discounts.
• Donation matching to over 1.5 million nonprofit organizations.