Lead Data Engineer (P248)

84.51 - Cincinnati, OH

Full-time - Mid Level

Cincinnati, OH

About the position

As a Lead Data Engineer at 84.51, you will be responsible for building and supporting solutions that manage and distribute big data for various products. This role involves collaborating with data scientists and other engineers to enhance data capabilities and services, utilizing a range of technologies including Databricks, Terraform, and Snowflake. You will lead the design and development of cloud-based solutions, ensuring best practices throughout the software development lifecycle (SDLC).

Responsibilities

• Take ownership of systems, processes, and the tech stack while driving features to completion through all phases of the entire 84.51 SDLC.
• Lead the design of and develop Cloud based solutions.
• Perform unit and integration testing.
• Participate in implementation of BI visualizations.
• Collaborate with Architecture, Data Scientists, Product, and other Lead Engineers to ensure consistent development practices.
• Provide mentoring to junior engineers.
• Partner closely with Product colleagues to inform strategy and roadmap decisions.
• Participate in Agile rituals (Sprint Reviews, Stand-Ups, Retros, etc.).
• Collaborate with other engineers to solve and bring new perspectives to complex problems.
• Drive improvements in people, practices, and procedures.
• Embrace new technologies and an ever-changing environment.

Requirements

• Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another STEM degree.
• 5+ years proven ability of professional data development experience.
• 3+ years proven ability of developing within a data platform, with some preferably in Databricks and Snowflake.
• 3+ years developing experience with either Java or Python.
• Understanding and some experience with front-end development, preferably Angular.
• Proficient in SQL.
• Experience with PySpark/Spark/Airflow.
• Cloud Native Architecture / ReUsable Capabilities (Microservices, Libraries, Engines).
• Experience with (Azure/Google Cloud Platform/AWS) Cloud Platforms.
• Experience with Terraform.
• Test Driven Development.

Nice-to-haves

• Experience working with Unity Catalog.
• Exposure to NoSQL (Mongo, Cassandra).
• Exposure to Hadoop.
• Exposure to Service Oriented Architecture.
• Exposure to cloud platforms (Azure/Google Cloud Platform/AWS).
• Exposure to BI tooling e.g Tableau, PowerBI, Cognos.
• Proficient with relational data modeling and/or data mesh principles.
• Continuous Integration/Continuous Delivery.