Software Engineering Manager, AI Compiler

Meta - Bellevue, WA

Full-time - Manager

Bellevue, WA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The MTIA (Meta Training & Inference Accelerator) Software team is at the forefront of developing a comprehensive AI Compiler strategy and optimizing compiler toolchains. This initiative is crucial for enabling the training and inference of Meta's production deep learning (DL) and machine learning (ML) workloads on specialized MTIA AI accelerator hardware. We are seeking a Software Engineering Manager who will lead the development of the compiler stack and drive high-performance compiler optimizations and tuning specifically tailored for the MTIA AI accelerator hardware. In this role, you will be responsible for growing a team of domain experts within the AI Compiler space. You will need to communicate effectively, collaborate, and build strong relationships with clients and peer teams to facilitate cross-functional projects. The position requires a strategic and tactical approach, where you will develop a vision and strategy while helping to set the direction for your team. You will also need to stay informed about ongoing software development activities within the team, assist in overcoming technical challenges, and be actively involved in design decisions that impact the project. As a Software Engineering Manager, you will play a pivotal role in shaping the future of AI compiler technology at Meta, ensuring that our tools are optimized for performance and efficiency in a rapidly evolving technological landscape.

Responsibilities

• Grow a team of domain experts within AI Compiler.
• Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects.
• Operate strategically and tactically; develop vision, strategy, and help set direction for the team.
• Remain up-to-date on ongoing software development activities in the team, help work through technical challenges, and be involved in design decisions.

Requirements

• Experience with compiler architecture and development, particularly ML compilers or DSLs or static/dynamic languages compilers.
• 2+ years of experience in managing a team of compiler engineers of varied skill levels.
• Experience with cross functional collaboration with hardware or AI framework teams.
• Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management.

Nice-to-haves

• Experience with compiler optimizations such as loop optimizations, vectorization, parallelization, HW architecture specific optimizations.
• Experience in compiling and code generation targeting ML accelerators or custom hardware, GPUs or CPUs.
• Experience with different programming models for high-performance computations, e.g. GPU CUDA programming or OpenCL or OpenMP programming.
• Experience with MLIR, or LLVM or IREE or XLA or Triton or TVM or Halide.
• Knowledge of ML frameworks like PyTorch, TensorFlow, ONNX, MXNet, etc.