AI Product Engineer - Inference Solutions

$149,440 - $224,160/Yr

AMD - San Jose, CA

Full-time - Mid Level

San Jose, CA

Computer and Electronic Product Manufacturing

About the position

At AMD, we are committed to transforming lives through our technology, and we are looking for a highly motivated AI Product Engineer to join our Inference Solutions team. This role is pivotal in managing the customer experience for AMD's Software Solutions for machine learning (ML) inferencing. The successful candidate will play a crucial role in facilitating the adoption of our ML inferencing solutions by ensuring a seamless onboarding process for customers and delivering a best-in-class customer experience. You will collaborate closely with research and development (R&D), marketing, and key customers to drive the evolution of our products and support strategic business engagements that leverage AMD's ML inferencing solutions. In this position, you will be responsible for enabling the end-to-end productization of AI inferencing solutions by evaluating various solutions targeting AMD's CPU, NPU, and embedded devices. This involves conducting extensive flow and usability analysis, as well as generating performance data for model inferencing flows. You will also develop use cases, examples, tutorials, and methodology collaterals for AI inference software components and ecosystems, which include tools such as Compiler, Quantizer, Optimizer, Runtime, Profiler, Visualizer, and Debugger. Your role will require you to engage with software developers to collaborate on product development, analyze product and feature specifications, and provide early feedback to ensure usability. You will interact with both internal and external customers to understand their issues, assist them in debugging their workflows, and create use cases to reproduce issues, ultimately driving successful adoption of our solutions. Additionally, you will collaborate with sales and marketing teams on strategic business engagements and work closely with R&D to prioritize issues and manage escalations effectively.

Responsibilities

• Facilitate customer onboarding and deliver best-in-class customer experience for AMD's ML inferencing solutions.
• Enable end-to-end AI inferencing solution productization by evaluating solutions targeting AMD's CPU/NPU/Embedded devices.
• Conduct extensive flow and usability analysis and generate performance data for model inferencing flows.
• Develop use cases, examples, tutorials, and methodology collaterals for AI inference software components and ecosystems.
• Engage with software developers to collaborate on product development and analyze product/feature specifications.
• Interact with internal and external customers to understand their issues and assist them in debugging workflows.
• Create use cases to reproduce issues and drive successful adoption of solutions.
• Collaborate with sales and marketing teams on strategic business engagements.
• Work closely with R&D to prioritize issues and manage escalations.

Requirements

• Master's degree in computer engineering, computer science, electrical engineering, or comparable disciplines.
• 3-10 years of experience in relevant areas, particularly in AI frameworks such as PyTorch and ONNX.
• Experience with state-of-the-art models in domains like CNN, Transformers, LLMs, and Generative AIs.
• Experience in model analysis, performance benchmarking, and accuracy testing.
• Hands-on experience with Python, C, and C++.
• Expertise with development tools such as Git, CMake, Make, Conda, Docker, VSCode, bash, and Linux.
• Good project management skills and the ability to present solutions clearly and concisely.

Nice-to-haves

• Experience in quantizing and pruning ML networks.
• Experience working on and managing open-source AI projects.
• Familiarity with AI inference SDKs (e.g., Vitis AI, TensorRT, OpenVINO, SNPE) or AI accelerators.
• Ability to think from the end-user's perspective and advocate for their needs.

Benefits

• Competitive benefits package including health insurance, dental insurance, and vision insurance.
• Employee Stock Purchase Plan allowing employees to purchase AMD stock at a discount.
• Annual bonus or sales incentive based on role performance.