Senior Software Engineer - Data Infrastructure

$153,000 - $222,000/Yr

Applied Intuition - Mountain View, CA

Full-time - Mid Level

Mountain View, CA

Professional, Scientific, and Technical Services

About the position

The Senior Software Engineer - Data Infrastructure role at Applied Intuition focuses on scaling open-source data infrastructure to support the company's data lifecycle. This position involves working across various business units to design and develop both external and internal products, handling massive volumes of data critical to Applied Intuition's platform. The role encourages engineers to take ownership of technical and product decisions while fostering a collaborative team culture.

Responsibilities

• Scale infrastructure to support all deployment types (cloud, hybrid, on-prem) and across regions.
• Be involved in the end-to-end data lifecycle, from the external-facing product to the underlying platform and infrastructure.
• Build features to tune processing pipelines for fast data ingestion and indexing based on customer needs and workloads.
• Enable product workflows that expose performant query interfaces and offer easy-to-use integration hooks.
• Develop and deploy high-quality software using modern tooling and frameworks, especially open-source technologies.

Requirements

• Experience with large-scale open source data technologies (Spark, Kafka, Hudi, Flyte, etc.).
• Experience with containerization and other modern software development workflows.
• Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.

Nice-to-haves

• Expertise with modern programming languages (Python, C++, GoLang, Scala, etc.).
• Experience with other open-source data technologies not listed above.
• Expertise with Kubernetes.
• Experience with enterprise software, including on-prem and/or cloud environments.
• Deep knowledge of data quality, data profiling and cleansing techniques.

Benefits

• Base salary
• Equity in the form of options and/or restricted stock units
• Comprehensive health insurance
• Dental insurance
• Vision insurance
• Life insurance
• Disability insurance
• 401k retirement benefits with employer match
• Learning and wellness stipends
• Paid time off