Maintains the inference engine layer built on llama.cpp, ONNX, and MLX, and ports models such as LFM2 onto new runtimes while verifying correctness. Designs benchmark suites for inference performance, model quality, and knowledge evaluation across hardware targets. Runs verifications of external partner solutions against those benchmarks.
Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability. We partner with enterprises across consumer electronics, automotive, life sciences, and financial services. We are scaling rapidly and need exceptional people to help us get there.
Our inference stack is central to everything we ship. You'll be a core part of the team responsible for the engine layer that runs our models in production and in partner environments, and for the benchmarking infrastructure we use to evaluate our own work and verify what partners bring to us. Day to day, that means working closely with research and product, but also directly with external engineering teams.
We need someone who:
Must-have:
Nice-to-have: