Senior Data Engineer

Datalogz - New York, NY

Full-time - Mid Level

New York, NY

About the position

The Senior Data Engineer at Datalogz plays a crucial role in supporting the development of data pipelines, focusing on data extraction, transformation, and loading processes. This position requires writing high-quality code, collaborating with stakeholders to meet project requirements, and ensuring the integrity of data handling in compliance with legal guidelines. The role also involves working with various Business Intelligence tools and automating data extraction from APIs to maintain up-to-date dashboards and reports.

Responsibilities

• Write clean, high-quality, high-performance, maintainable code
• Work with Product and internal stakeholders to develop clear project requirements and ensure timelines are met
• Support data pipeline development, including data extraction, transformation, and loading to databases
• Work on data exploration and building data pipelines with Business Intelligence tools like Power BI, Tableau, Qlik & Looker
• Schedule automatic extraction of data from APIs to keep dashboards and reports up to date
• Develop common transformations for JSON and SQL data interoperability
• Perform SQL CRUD operations to maintain databases
• Develop data integrations and applications using SQL in various environments
• Schedule and orchestrate ETL tasks for concurrency, reliability, and performance
• Develop locally using containerized services before production deployment
• Test, debug, and resolve bugs until a solution is reached
• Understand contractual and legal guidelines for handling sensitive data

Requirements

• Bachelor's degree preferred
• 5+ years of relevant work experience
• Fluency with Python & SQL
• Comfortable working in an unstructured environment deploying data/code to the cloud (GCP/AWS/Azure)
• Ability to juggle multiple priorities and align them with core product development objectives
• Previous experience at a B2B SaaS venture-backed startup is preferred
• On-prem / DevOps experience is a plus
• Familiarity with data modeling, ETL/ELT processes, data warehousing, and business intelligence tools

Nice-to-haves

• Experience working with Airflow, Docker, and dbt
• Experience working with large BI environments

Benefits

• Company equity
• Medical insurance
• Dental insurance
• Vision insurance
• Unlimited PTO