Senior Software Engineer, Deep Learning Inference - New HW Enablement

Full-time - Senior

Santa Clara, CA

Computer and Electronic Product Manufacturing

About the position

The Senior Software Engineer, Deep Learning Inference at NVIDIA's TensorRT team is responsible for integrating new hardware functionalities into TensorRT's compiler and runtime. This role involves collaborating with various teams to enhance the performance and functionality of TensorRT, ensuring NVIDIA remains at the forefront of AI technology. The position requires a strong background in software development, particularly in C++, and a passion for deep learning and innovation.

Responsibilities

• Orchestrate the integration of new hardware functionalities into TensorRT's compiler and runtime.
• Work closely with teams and stakeholders across the hardware and software stack to understand and leverage new features.
• Guide the design and implementation of robust, high-quality C++ code in alignment with Modern C++ standards.
• Contribute to the continuous improvement of software practices and processes within the team.

Requirements

• Masters, PhD, or equivalent experience in Computer Engineering, Computer Science, Electrical Engineering, or AI.
• At least 12 years of relevant software development experience.
• Strong C++ skills, including knowledge of and application of best practices with C++11 and C++14.
• Familiarity with deep learning concepts and frameworks.
• A track record of taking initiative and driving projects to completion.
• Excellent interpersonal skills and a collaborative, pragmatic approach to solving problems.

Nice-to-haves

• Proficiency with Python and/or CUDA, ideally with experience in a professional environment.
• Background with systems programming, embedded systems, and/or compiler development.
• Experience in software performance benchmarking, profiling, and optimizations.
• Experience with state-of-the-art deep learning models (such as Large Language Models) & frameworks for inference.
• Background with C++17.

Benefits

• Equity and benefits package based on location and experience.