Principal Software Engineer in Test, AI Inference

Full-time - Mid Level

Boston, MA

About the position

At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs to every enterprise. We are looking for a Software Engineer in Test to work closely with our Machine Learning and Product teams to test and validate our cutting-edge Deep Learning Execution Engine and inference optimization products. As a core quality engineer in our AI inference teams, you will have the opportunity to actively participate in our product teams as well as the upstream vLLM community. You will work as part of an evolving development team to rapidly design, secure, build, test, and release new capabilities. You should have a passion for working in open-source communities and for developing solutions that integrate Red Hat, open-source, and partner technologies into a cohesive platform. If you are someone who wants to contribute to solving challenging technical problems at the forefront of deep learning, this is the role for you.

Responsibilities

• Work closely with the Machine Learning teams to have a good understanding of product behavior and features
• Create comprehensive test plans and cases to meet product requirements
• Perform thorough functional, performance, regression testing etc to validate product quality
• Implement test code and framework to automate test execution
• Monitor, analyze, and report the test results and test failures
• Contribute to a culture of continuous improvement by sharing recommendations and technical knowledge with team members
• Collaborate with product management, other engineering, and cross-functional teams to analyze and clarify business requirements
• Communicate effectively to stakeholders and team members to ensure proper visibility of quality efforts
• Give thoughtful and prompt code reviews
• Mentor and guide other engineers

Requirements

• Proven record (3+ years) of software testing experience with excellent quality
• Experience with source code management tools such as Git, GitHub, or GitLab
• Good knowledge of software testing methodologies, tools such as PyTest, unittest, and best practices
• Strong experience in API and performance testing especially for C++ and Python based products
• Knowledge and experience in core Machine Learning algorithms and fundamentals
• Familiar with Linux/Unix systems and have automation experience
• Experience with Docker, Podman, and Kubernetes or Openshift
• Experience in setting up infrastructure in AWS, Azure, or GCP
• Experience in setting up CI/CD processes and GitHub actions

Nice-to-haves

• While a Bachelor’s degree or higher in computer science or a related discipline is valued, we prioritize practical experience and technical prowess
• Understanding of how Open Source and Free Software communities work
• vLLM community contributions

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!