Staff Engineer - Data Engineering - Spark

$145,000 - $165,000/Yr

Early Warning Services - San Francisco, CA

Full-time - Senior

San Francisco, CA

1,001-5,000 employees

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

This position is a key role in the development, testing, and deployment of complex solutions at Early Warning. The role involves building data strategies, driving technical and data architecture, and collaborating with cross-functional teams to conceptualize and implement new features. The individual will also be responsible for ensuring the quality and performance of applications, while actively seeking improvements in engineering and data standards.

Responsibilities

• Build data strategy for broad or complex requirements.
• Participate in the strategic development of methods, techniques, and evaluation criteria for projects and programs.
• Drive all aspects of technical and data architecture, design, prototyping, and implementation.
• Provide leadership and technical expertise in building a technical plan and backlog of stories.
• Guide a broad functional area and lead efforts through functional team members.
• Represent engineering in cross-functional team sessions and present sound arguments to persuade others.
• Collaborate with product managers, designers, and other engineering groups to build new features.
• Actively own features or systems and define their long-term health.
• Assist Support and Operations teams in identifying and resolving production issues.
• Develop and implement tests for ensuring quality, performance, and scalability of applications.
• Seek out ways to improve engineering and data standards, tooling, and processes.

Requirements

• Bachelor's degree in computer science or related technical field.
• Ten or more years of relevant experience.
• Seven or more years of experience in developing complex data platforms, distributed systems, SaaS, cloud solutions, and microservices.
• Six or more years of experience in developing Data Warehouse and Big Data platforms.
• Four or more years of experience in developing Business Intelligence Solutions.
• Two or more years of experience in operationalizing AI/ML models.
• Demonstrated experience in delivering business-critical systems to the market.
• Ability to influence and work in a collaborative team environment.
• Experience designing/developing scalable systems.
• Extensive experience implementing Data Warehouse using SQL Server or equivalent.

Nice-to-haves

• Experience with Big Data Platforms (Cloudera, Spark/Scala, Hive, Hbase, Kafka).
• Knowledge of monitoring and alerting systems (AppDynamics).
• Knowledge of ACH/EFT and real-time payment networks (RTP, FedNow).
• FinTech experience.
• Kubernetes experience.

Benefits

• Healthcare Coverage - Competitive medical, dental, and vision plans.
• 401(k) Retirement Plan with a 100% Company Safe Harbor Match.
• Unlimited Time Off for Exempt employees and generous PTO for Non-Exempt employees.
• 12 weeks of Paid Parental Leave.
• Maven Family Planning support for parenting journeys.