Sr Machine Learning Engineer, AI Software Solutions

AMD - Austin, NY

Full-time - Mid Level

Austin, NY

Computer and Electronic Product Manufacturing

About the position

At AMD, we are committed to transforming lives through our technology, enriching industries, communities, and the world. Our mission is to create exceptional products that accelerate next-generation computing experiences, serving as the foundation for data centers, artificial intelligence, PCs, gaming, and embedded systems. The culture at AMD is built on pushing the limits of innovation to tackle the world's most pressing challenges. We prioritize execution excellence while fostering a direct, humble, collaborative, and inclusive environment that values diverse perspectives. The AI Software Solutions Team at AMD is at the forefront of defining the next era of computing. We recognize the transformative benefits of AI in various sectors, from enabling medical research to reducing urban congestion. Our team specializes in AI optimization and fine-tuning large language models, unlocking unprecedented efficiency in Generative AI. We extend our expertise beyond hardware, developing custom AI software solutions for leading industry clients. Joining our team means being part of a powerhouse that is shaping the future of AI technology. As a Senior Machine Learning Engineer, you will be part of a world-class team dedicated to enabling software for top-tier data centers and supercomputers. We are looking for talented and motivated software engineers to help optimize the software ecosystem for the next generation of GPU computational accelerators. You will collaborate with sophisticated clients to leverage the latest hardware capabilities for their AI applications, combining cutting-edge hardware with the latest software libraries, frameworks, and SDKs to solve complex challenges in the AI landscape.

Responsibilities

• Enable models, libraries, and applications for Instinct GPUs in both on-prem and Cloud environments.
• Analyze and optimize the performance of software.
• Collaborate with a team of Software Engineers to push the boundaries of efficiency and performance.
• Develop custom AI Software Solutions for industry-leading AI customers.
• Work with the latest applications, libraries, frameworks, and SDKs to innovate and solve complex challenges.

Requirements

• Minimum 4 years of experience in software engineering or related fields.
• Strong programming skills in C++ and Python.
• BS in Computer Science, Computer Engineering, or related field with several years of experience, or MS/PhD with relevant experience.
• Experience developing software in an end customer product delivery environment.
• Experience with open-source software development and collaboration with community maintainers.
• Familiarity with software engineering methodologies such as Agile, Scrum, or Kanban.
• Excellent analytical and problem-solving skills.
• Ability to work independently and as part of a team.
• Willingness to learn new skills, tools, and methods to enhance software quality.

Nice-to-haves

• Experience with GPU kernel programming using CUDA, HIP, or OpenCL.
• Experience in implementing and optimizing parallel methods on GPU accelerators (NCCL/RCCL, OpenMP, MPI).
• Performance analysis skills for both CPU and GPU.
• Experience with Singularity, Docker, and/or Kubernetes.
• Experience in all phases of software development from requirement gathering to final release.
• Strong communication skills to provide timely updates to the leadership team.

Benefits

• Base pay competitive with market rates.
• Eligibility for annual bonuses or sales incentives.
• Opportunity to own shares of AMD stock through the Employee Stock Purchase Plan with discounts.
• Comprehensive benefits package including health insurance, retirement plans, and more.