Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

$100,000 - $100,000/Yr

Netflix

Full-time - Mid Level

Remote

10,001+ employees

Broadcasting and Content Providers

About the position

The Software Engineer L4/L5 position in Model Serving Systems at Netflix focuses on developing and expanding the computational platform for machine learning and artificial intelligence applications. This role is critical in building scalable infrastructure to support high-traffic distributed services, particularly for real-time model inference and serving, as well as enabling innovations in large language models (LLMs). The engineer will collaborate with cross-functional teams to enhance Netflix's ML/AI capabilities and improve user experiences through advanced personalization techniques.

Responsibilities

• Develop and expand compute infrastructure to support growing AI needs.
• Build and maintain scalable model serving systems for ML applications.
• Collaborate with engineers, product managers, and data scientists to drive ML/AI innovation.
• Optimize performance and reduce latency for model inference and serving.
• Implement best practices in observability and logging for ML systems.

Requirements

• Experience building high-traffic distributed services and infrastructure for online ML model inference.
• Familiarity with scalable model-serving solutions for generative models and LLMs.
• Proficiency in object-oriented programming, preferably in Java.
• Experience with deployment tools like Triton Inference Server, TensorRT, and Docker.
• Experience working with public cloud platforms such as AWS, Azure, or GCP.
• Strong communication skills and a proactive approach to promoting best practices.

Nice-to-haves

• Experience with performance tuning and deployment management.
• Knowledge of capacity planning for ML systems.
• Interest in multidisciplinary collaboration across engineering and data science.

Benefits

• Health Plans
• Mental Health support
• 401(k) Retirement Plan with employer match
• Stock Option Program
• Disability Programs
• Health Savings and Flexible Spending Accounts
• Family-forming benefits
• Life and Serious Injury Benefits
• Paid leave of absence programs
• Flexible time off for salaried employees
• 35 days of paid time off for hourly employees