• Companies
  • News
By technology
  • Python17.1k
  • AWS11.9k
  • Kubernetes8.5k
  • Docker8.2k
  • C++5.7k
  • PostgreSQL5.4k
  • SQL5.1k
By category
  • Backend Developer11.5k
  • DevOps Engineer3.5k
  • Machine Learning Engineer3.3k
  • Full Stack Developer3.2k
  • Data Engineer2.8k
  • Embedded Engineer2.2k
  • Frontend Developer863
By city
  • San Francisco, CA6.2k
  • New York, NY5.6k
  • Seattle, WA1.3k
  • Washington, DC1.2k
  • Toronto, ON1.2k
  • Boston, MA1k
  • Austin, TX1k
Work mode
  • On-site22k
  • Remote10.2k
  • Hybrid7.3k
Job type
  • Full-time38.2k
  • Contract601
  • Part-time529
  • Freelance215
  • internship4
  • seasonal1
Experience
  • Entry level
  • Mid level
  • Senior
  • Staff+
  • Engineering management

The job board for developers. Find your next role at companies that value great engineering.

© 2023-2026 . All rights reserved.

Logos provided by Logo.dev
All jobs

Senior Machine Learning Engineer, Inference

Jobgether · US

Extracted from the posting

Base
$250,000 – $300,000
Equity
Competitive equity, amount not stated
Remote
Onsite in Mountain View, CA preferred; remote in US, Canada, UK, Germany, Switzerland, Serbia
Visa
H-1B and OPT transfers supported
Stack
vLLM, TensorRT-LLM, SGLang, CUDA

Senior Machine Learning Engineer role focused on inference optimization for real-time voice and LLM systems in production. Work involves vLLM, TensorRT-LLM, SGLang, quantization, speculative decoding, CUDA/C++, and distributed multi-GPU serving on Kubernetes and Ray. Serves consumer-scale AI products.

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure. Working directly with modern inference engines, you will apply cutting-edge acceleration techniques to improve performance and scalability. You will collaborate closely with research and product teams to turn innovative models into reliable production systems. This is an opportunity to make a significant technical impact on AI products serving hundreds of millions of users.

Accountabilities

    How Jobgether works:

    We use an

    AI-powered matching process

    to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

    We appreciate your interest and wish you the best!

     Why Apply Through Jobgether?

    Data Privacy Notice:

    By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

    #LI-CL1

    Technologies

    vLLMTensorRT-LLMSGLangCUDAC++RustPythonKubernetesRay
    Jobgether
    Jobgether

    Job details

    TypeFull-time
    Work ModeOn-site
    LevelSenior
    Location🇺🇸Mountain View, CA
    Salary$250,000 - $300,000
    PostedNov 06, 2026
    Apply Now

    Related jobs

    Snowflake

    Staff Forward Deployed Engineer, Applied AI

    Snowflake
    $200,000 - $287,500🇺🇸 Menlo Park, CAHybrid · Full-timeSnowpark · pandas · NumPy
    Whiterabbit.ai

    Research Scientist Intern (2026)

    Whiterabbit.ai
    RemoteRemote · Full-timePython
    N1 Health

    Associate Data Ops Engineer

    N1 Health
    $70,000 - $90,000🇺🇸 Boston, MAHybrid · Full-timePython · SQL