Data Engineer

$108,000 - $149,000/Yr

Appfolio - San Diego, CA

Full-time

San Diego, CA

Professional, Scientific, and Technical Services

About the position

At AppFolio, we are innovators and changemakers, dedicated to revolutionizing the real estate industry through our cutting-edge cloud and AI solutions. As a Data Engineer, you will play a pivotal role in creating the Data Platform that powers our Analytics and Data Science teams. This position is crucial for establishing a single source of truth for key performance indicators (KPIs) across the organization, enabling the discovery of impactful insights that inform our company strategy. You will collaborate cross-functionally with analysts and researchers to understand their analytics and reporting needs, engineering creative solutions to address these at scale. Your responsibilities will include designing, building, maintaining, and refining ETL pipelines that support our ‘source of truth’ tables and views in Snowflake. You will also create and maintain dashboards and data sources for our analytics teams and leaders in Tableau Online. In addition, you will take on ad-hoc reporting and analytics projects to support key initiatives across the business. Identifying reliability, scalability, and data quality issues will be part of your role, as you strive to continuously improve our systems by building observability and tests. You will lead efforts to automate and self-service processes, drive deployment and release cycles, and ensure a robust and scalable platform. Collaboration is key in this role, as you will work closely with data scientists, analysts, and cross-functional teams to design data models, database schemas, and data storage solutions. Staying up to date with the latest data engineering trends, technologies, and best practices will be essential to your success in this fast-paced environment.

Responsibilities

• Design, build, maintain, and refine ETL pipelines behind the ‘source of truth' tables and views in Snowflake.
• Create, maintain, and refine ‘source of truth' dashboards and data sources for analytics teams and leaders in Tableau Online.
• Take on ad-hoc reporting and analytics projects as necessary to support key initiatives across the business.
• Identify reliability, scalability and data quality issues by building observability and tests in the system, and strive to continuously improve the system.
• Identify opportunities for automating and self-servicing processes, and lead the efforts to implement them.
• Drive the deployment and release cycles, ensuring a robust and scalable platform.
• Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions, helping them to solve problems and create innovative analytics models and solutions in a fast-paced environment.
• Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements

• 2+ years of experience designing, developing and maintaining ETL data pipelines while adhering to software engineering best practices.
• Expertise in data extraction via RESTful APIs in Python using multithreading and asynchronous paradigms.
• Proficiency in data engineering tools and technologies - SQL, Python, Airflow and DBT.
• Experience with data warehouse technology such as Snowflake including data security and governance.
• Solid experience monitoring and enforcing data quality using end-to-end observability.
• Experience with cloud technology especially AWS tech stack (s3, ec2, eks), docker and kubernetes.
• Understanding of data modeling principles with experience serving as data steward for business-critical data/reporting assets.
• Experience with design and ownership of reporting layers of BI solution with advanced working knowledge of Tableau.
• BS in Computer Science or a related technical discipline.

Nice-to-haves

• Experience building Semantic layers for data platforms is desired.
• Experience with CI/CD and automated testing.
• Experience with building self-serve processes.
• Experience with Snowplow and clickstream.
• Experience with Agile software development processes.

Benefits

• Base salary range of $108,000-$149,000 based on skills, education, and experience.
• Eligibility for additional benefits and bonuses based on role and employment type.