Institute of Foundation Models · Sunnyvale, CA
GPU kernel engineer at MBZUAI's Institute of Foundation Models focused on CUDA kernel development and optimization for deep learning training and inference. Work includes profiling, performance benchmarks, and validating kernel outputs and gradients against reference implementations. Stack includes C++, CUDA, Python, and PyTorch.
About the Institute of Foundation Models
We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.
As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.
The Role
The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and support the team to develop new and cutting-edge systems. The ideal candidate will have a strong background in parallel computing, and hands-on experience in system level coding, debug methodologies, and large-scale machine learning experience.
This role focuses on CUDA kernel development and optimization. Distributed training experience is a plus.
Compensation
$150,000 – $450,000/year + discretionary performance bonus + benefits
The posted salary range represents the company’s good faith estimate of the base compensation for this position upon hire. The actual base compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, and specific business needs. In addition to base salary, total compensation includes an annual discretionary performance bonus and comprehensive benefits.
Benefits Include
Compensation: USD 150,000 – 450,000 per year salary