Senior Cloud Infrastructure Engineer - Observability (FedRAMP)

Splunk

Full-time

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Infrastructure Software Engineer role at Splunk focuses on maintaining and provisioning the infrastructure for the Splunk Observability Cloud. This position involves working with cloud-native systems engineering, infrastructure-as-code, and automation to ensure the platform is secure, performant, and cost-efficient. The engineer will design new services, mentor new team members, and work on various infrastructure projects to enhance the cloud-scale microservices platform.

Responsibilities

• Design new services, tools, and monitoring to be implemented by the entire team.
• Analyze the tradeoffs of the proposed design and make recommendations based on these tradeoffs.
• Mentor new engineers to achieve more than they thought possible.
• Work on infrastructure projects including adopting new cloud-native frameworks and services.
• Automate cloud provider infrastructure via Terraform, Kubernetes, and Helm.
• Develop code for tools and automation to reduce manual tasks and human error.
• Establish and document run books and guidelines for using the multi-cloud infrastructure and microservices platform.
• Improve the resiliency of the multi-cloud microservices platform.
• Handle networking, routing, and load balancing tasks.
• Implement security vulnerability remediation and patching automation.
• Automate deployment of services in new provider zones/regions.
• Design and productionize access tiers to provide appropriate permissions across roles.

Requirements

• Bachelors/Masters in Computer Science, Engineering, or related technical field, or equivalent practical experience.
• 7+ years of solid hands-on cloud infrastructure experience on public cloud platforms specifically AWS or GCP.
• 3+ years of strong hands-on experience deploying, managing, and monitoring large-scale Kubernetes clusters in the public cloud.
• Experience with Infrastructure-as-Code using Terraform and/or Helm.
• Experience with infrastructure automation and scripting using Python and/or bash scripting.
• Knowledge of microservices fundamentals including Service Mesh using Istio, service discovery, deployment strategies, monitoring, scheduling, and load balancing.
• Excellent problem-solving, triaging, and debugging skills in large-scale distributed systems.
• Candidate must be a US citizen or a permanent resident and must reside on US soil.

Nice-to-haves

• AWS Solutions Architect certification preferred.
• CKA and HashiCorp-certified Terraform Associate certifications preferred.
• Experience with Infrastructure-as-Code using Terraform, CloudFormation, Google Deployment Manager, Packer, Pulumi, ARM, etc.
• Experience with developing infrastructure or platform services using GoLang or Python.
• Experience with CI/CD frameworks and Pipeline-as-Code such as Jenkins, Spinnaker, Gitlab, Argo, Artifactory, etc.
• Exposure to monitoring tools such as Splunk, Prometheus, Grafana, ELK stack, etc. in order to build observability for large-scale microservice deployments.
• Experience handling cloud infrastructure and operations in strict security, compliance, and regulatory environments such as FedRAMP.

Benefits

• Diversity, equity, and inclusion initiatives
• Equal employment opportunity policies