Senior Machine Learning Engineer

About the position

MasterControl is looking for a Senior Machine Learning Engineer to join our Machine Learning team to develop, deploy, and implement the use of machine learning models, especially large language models (LLMs). The ideal candidate is someone who has strong ML fundamentals as well as software engineering skills and can apply them in real production settings. They will partner closely with a cross functional team of ML, application, and data engineers to understand requirements and apply your own domain expertise to build high performance and reusable ML/LLM APIs. The candidate should also be comfortable with infrastructure and large-scale system design, as well as diagnosing both model performance and system failures.

Responsibilities

• Manage the entire ML model lifecycle: train/fine-tune, optimize, deploy, and monitor ML models
• Build high performance, observable, reusable, and cost-effective API services
• Optimize inference latency by quantizing or low ranking LLMs at fine-tuning
• Design and be part of larger platform infrastructure design
• Diagnose both model performance and system failures
• Engage with your team, provide code reviews, encourage best practices, and consistently raise others up
• Resolve product issues in conjunction with technical support
• Engage with ML researchers and stay up to date on the latest trends from industry and academia
• Participate in team's on-call process to ensure the availability of our services
• Own projects end-to-end from requirements, scoping, and design to implementation

Requirements

• 2+ years of experience building machine learning training pipelines or inference services in a production setting
• 3+ years of experience developing with object-oriented languages and frameworks in a production setting
• Experience with data manipulation tools/libraries such as SQL, Spark, Pandas, Numpy, etc
• Experience with Git/Github
• Experience with LLM deployment, fine tuning, training, prompt engineering
• Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc
• Experience working with a cloud technology stack (Azure, AWS or GCP--preferably AWS)
• Strong knowledge of REST APIs, microservices, and data structures
• Experience with Docker
• Experience with Python
• Experience with Kubernetes and/or Infrastructure as code (e.g. terraform) is a plus
• Experience with Java/Spring/Spring Boot is a plus
• Strong critical thinking, problem-solving, and communication abilities
• Strong sense of responsibility and drive to create exceptional applications
• Positive attitude with a penchant for collaboration and respect

Nice-to-haves

• Experience with Kubernetes and/or Infrastructure as code (e.g. terraform)
• Experience with Java/Spring/Spring Boot

Benefits

• Competitive compensation
• 100% medical premium coverage
• 401(k) plan with company match
• Generous PTO packages that increase with tenure
• Schedule flexibility
• Fitness clubs
• Company parties and employee recognition programs
• Wellness programs (free Fitbit, gym membership and athletic shoe reimbursements, etc.)
• Onsite physician and massage therapist
• Innovation center and gaming rooms at the office
• Dental/vision plans
• Employer paid life insurance policy
• Much, much more!