• Companies
  • News
By technology
  • Python13.2k
  • AWS9.4k
  • Kubernetes6.9k
  • Docker6.8k
  • C++4.5k
  • PostgreSQL4.4k
  • SQL3.6k
By category
  • Backend Developer10.6k
  • DevOps Engineer3k
  • Machine Learning Engineer2.8k
  • Data Engineer2.4k
  • Full Stack Developer2.4k
  • Embedded Engineer2k
  • Mobile Developer744
By city
  • San Francisco, CA5.2k
  • New York, NY4.6k
  • Seattle, WA1.1k
  • Toronto, ON827
  • Washington, DC827
  • Boston, MA743
  • Austin, TX729
Work mode
  • On-site18.5k
  • Remote7.9k
  • Hybrid4.6k
Job type
  • Full-time30.1k
  • Part-time440
  • Contract406
  • Freelance145
  • internship4
  • seasonal1
Experience
  • Entry level
  • Mid level
  • Senior
  • Staff+
  • Engineering management

The job board for developers. Find your next role at companies that value great engineering.

© 2023-2026 . All rights reserved.

Logos provided by Logo.dev
Add
36 matches
NewestHighest base
Pluralis Research

Research Scientist - Pre-training

today
Pluralis Research · San Francisco, CA
RemoteFull-timePython · PyTorch
Pluralis Research

Research Engineer - Pre-training

today
Pluralis Research · San Francisco, CA
RemoteFull-timePython · PyTorch
Qualtrics

Staff Machine Learning Engineer

today
Qualtrics · Seattle, WA
$213k–259kHybridFull-timePython · Java
webAI

Staff R&D AI Engineer

today
webAI · Austin, TX
On-siteFull-timePyTorch · TensorFlow
Featherless AI

AI Researcher — Training Optimization

today
Featherless AI · Remote (world)
RemoteFull-timePyTorch · FSDP
Featherless AI

Machine Learning Engineer — Training Optimization

today
Featherless AI · Remote (world)
RemoteFull-timePyTorch · DeepSpeed
Andromeda Cluster

Senior Site Reliability Engineer

today
Andromeda Cluster · San Francisco, CA
RemoteFull-timeKubernetes · Python
Liquid AI

Product Manager

today
Liquid AI · San Francisco, CA
HybridFull-timePyTorch · Python
Liquid AI

Member of Technical Staff - Multi-Modal, Audio

today
Liquid AI · Boston, MA
On-siteFull-timePyTorch · DeepSpeed
Liquid AI

Member of Technical Staff - Distributed Training Engineer

today
Liquid AI · San Francisco, CA
On-siteFull-timePyTorch · DeepSpeed
FriendliAI

Forward Deployed Engineer - AI Inference

today
FriendliAI · San Francisco, CA
On-siteFull-timeKubernetes · Docker
Articul8

Principal Applied AI Researcher - Domain- Specific Models (Dublin, CA)

today
Articul8 · Dublin, CA
On-siteFull-timePyTorch · Python
Articul8

Senior Applied AI Researcher (Dublin, CA)

today
Articul8 · Dublin, CA
On-siteFull-timeDeepSpeed · FSDP
Articul8

Applied AI Researcher (Dublin, CA)

today
Articul8 · Dublin, CA
On-siteFull-timePyTorch · Python
Cantina

Machine Learning Engineer, Voice Conversion

today
Cantina · Europe; United States
RemoteFull-timePyTorch · CUDA
Dyna Robotics

Research Engineer

today
Dyna Robotics · Redwood City, CA
On-siteFull-timePyTorch · Kubernetes
Prime Intellect

Head of Product

today
Prime Intellect · San Francisco, CA
$200k–300kHybridFull-timePython · PyTorch
Prime Intellect

Research Engineer - RL Infrastructure

today
Prime Intellect · San Francisco, CA
$150k–350kHybridFull-timePyTorch · DeepSpeed
Prime Intellect

Research Engineer - Distributed Training

today
Prime Intellect · San Francisco, CA
$150k–350kHybridFull-timePyTorch · CUDA
Designworks Talent

Principal Hardware Design Engineer

today
Designworks Talent · Bellevue, WA
HybridFull-timeKubernetes · CUDA
  • 1
  • 2
  • Next
Pluralis Research

Research Scientist - Pre-training

Pluralis Research · 🇺🇸 San Francisco, CA · posted today
ApplyFull posting

Extracted from the posting

Base
Not stated
Equity
Equity-heavy package; no specific percentage stated
Remote
Remote-first; main teams in Australia and North America; cross-timezone work
Funding
Backed by Union Square Ventures and other tier-1 investors; amount not stated
Visa
Optional full visa sponsorship and relocation to Australia or US
Stack
Python, PyTorch, FSDP, DeepSpeed

TL;DR

Research Scientist role building distributed training systems for Protocol Learning, scaling from an 8B decentralized run to frontier-scale models. Work covers model, pipeline, and tensor parallelism on heterogeneous GPUs over high-latency links, plus fault tolerance for node churn. Stack includes PyTorch with FSDP, DeepSpeed, or Megatron.

About Pluralis Research →

The full posting

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.

This setting breaks nearly every assumption of datacenter training: communication-efficient training across different parallelism axes, fault tolerance as nodes join and drop mid-run, heterogeneous compute and networks, and robustness to malicious participants. Our published methods include Subspace Networks, Factored Gossip DiLoCo, AsyncMesh, and Sentinel.

As a Research Scientist you'll build the training system that takes Protocol Learning from the 8B run to frontier scale: large models on heterogeneous hardware, in physically different regions, connected by ordinary internet.

Key Responsibilities

  • Distributed pretraining: Implement and optimize model-parallel training. Data, pipeline, and tensor parallelism for large models on heterogeneous GPUs under low-bandwidth, high-latency links.
  • Performance optimization: Implement techniques that reduce communication overhead while maintaining model convergence in challenging network environments.
  • Elasticity and fault tolerance: Make runs survive node churn. Robust checkpointing, state synchronization, and recovery as participants join and leave.
  • Run instrumentation: Build the monitoring that shows throughput, bottlenecks, and model quality across hundreds of devices.

What We're Looking For

  • Hands-on distributed training (required): You've trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or your own implementation. You understand data, tensor, and pipeline parallelism.
  • Strong engineering: Production-quality Python. Concurrency, failure handling, profiling before optimizing.
  • Evidence of execution: Shipped systems, research code, open-source work, or serious personal projects.
  • Mission alignment: You believe Protocol Learning is the viable third path for collective, trustless, and sovereign AI.

Nice to Have

  • Hands-on experience training or serving large language models such as Nemotron, Qwen or OLMo.
  • Experience with P2P networking and NAT traversal.
  • Experience with post-training and RL.
  • Experience with inference and serving systems.
  • Experience at proprietary, open-weight and open-source AI labs

Compensation & Benefits

  • Equity-Heavy Package: We offer significant ownership for key technical contributors in addition to a high base salary.
  • Remote-First Culture: Flexible work environment with team members distributed globally.
  • Visa Sponsorship: Optional full visa sponsorship and relocation support to either Australia or the US.
  • Open Problems: Training and serving frontier models on hardware you don't control, over networks you don't own, mostly has no published answers yet. You'll write some of the first ones.

FYI's

  • We work remotely across the world, with the main teams in Australia and North America. You'll need to be comfortable working across timezones.
  • Applicants must have professional-level English proficiency (written and spoken).
  • Recruiters: we aren't looking for agency support at this time. We'll reach out if we need help.

We are backed by Union Square Ventures and other tier-1 investors, and we are a world-class, deeply technical team of ML researchers. Pluralis is unapologetically ideological. We believe AI, and the world, end up on a better path if we succeed in implementing the protocol for intelligence. If this resonates, please apply.