Sr. Data Engineer, Analytics

About the position

Highspot’s Data Platform crew lies under the Data & Analytics pillar, aspires to build the central repository for all data at Highspot, handling the collection, cleansing, transformation, and application of data to generate various business insights with low-latency and reliability. We’re very proud of our customer loyalty and our rapid growth, which needs a scalable and low-latency big data platform to support all data use cases. We’re looking for a Senior Data Engineer who will bring creativity and experience to bear as they work collaboratively with a talented team on those opportunities and challenges.

Responsibilities

• Design, develop, and maintain an efficient, reliable and scalable big data platform and ETL (batch & streaming) to process high-throughput and fast-growing data.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, and revolutionizing ETL tools.
• Work closely with PM to design efficient models of large, complex datasets that meet functional / non-functional business requirements.
• Make data discoverable and accessible for Business Customers, Data Scientists and Analysts across the company.
• Partner cross-functionally across all of Highspot’s feature engineering crews, as well as with QA/DevOps/Site-Reliability.

Requirements

• 5+ years of experience in cloud computing, big data platforms / tools, and large-scale distributed systems.
• Proficient in programming with one of the common languages: Java, Clojure, Python, etc.
• Proficient in Kafka, Flink, Debezium, or Snowflake will be plus.
• Experience with general software development and testing tools.
• Experience building data streaming pipelines, as well as big data infrastructure in general.
• Experience with performance analysis and improvement in distributed systems.
• Programming experience using SQL, generating data analytics, and developing business insights.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with data visualization tools and software libraries.
• An entrepreneurial spirit: you’re agile, creative, resourceful, and tenacious as you solve problems and achieve team and company goals.
• Comfortable with modern open source technologies and tools.
• Passion to learn new technologies and infrastructure.
• B.S./M.S in Computer Science or equivalent industry experience.

Benefits

• Comprehensive medical, dental, vision, disability, and life benefits
• Health Savings Account (HSA) with employer contribution
• 401(k) Matching with immediate vesting on employer match
• Flexible PTO
• 8 paid holidays and 5 paid days for Annual Holiday Week
• Quarterly Recharge Fridays (paid days off for mental health recharge)
• 18 weeks paid parental leave
• Access to Coaches and Therapists through Modern Health
• 2 volunteer days per year
• Commuting benefits