Data Infrastructure Engineer
$200,000 - $200,000/Yr
Obsidian Security - Palo Alto, CA
posted 2 months ago
Full-time - Mid Level
Palo Alto, CA
Publishing Industries
About the position
The Data Infrastructure Engineer at Obsidian Security will be responsible for building and maintaining data infrastructure in GCP and AWS to support the company's SaaS security product. This role involves addressing challenges related to scalability, stability, visibility, and maintainability of data infrastructure, while collaborating closely with DevOps and engineering teams to automate processes and ensure system reliability.
Responsibilities
- Build and maintain data infrastructure in GCP and AWS.
- Design, set up, and maintain data infrastructure components such as Databricks, ElasticSearch, Kafka, ScyllaDB, CloudSQL, RDS, and DynamoDB.
- Work with DevOps/SRE team to automate processes and set up monitoring for critical systems.
- Collaborate with engineering teams for capacity planning, performance tuning, and production maintenance.
- Take on-call shifts with the team.
Requirements
- 5+ years of DevOps/SRE working experience in GCP/AWS.
- Bachelor's degree in Computer Science or a related engineering field.
- Expertise in Databricks, ElasticSearch, ScyllaDB, Kafka, CloudSQL/RDS.
- Good experience in GCP/AWS infrastructure design and automation.
- Experience with Kubernetes service mesh, auto-scaling, and version upgrading.
Benefits
- Competitive compensation with equity and 401k
- Comprehensive healthcare with dental and vision coverage
- Flexible paid time off and paid holiday time off
- 12 weeks of new parent or family leave
- Personal and professional development resources
- Work with experienced DevOps teammates
