Skip to content

Pull requests: huggingface/trl

New pull request New
118 Open 2,865 Closed
118 Open 2,865 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(async-grpo): add sampling parameter parity
#5418 opened Mar 31, 2026 by kdubovikov Loading…
4 of 8 tasks
Delta weight sync using Xet buckets
#5417 opened Mar 31, 2026 by AmineDiro • Draft
8 tasks
fix(async-grpo): honor model init dtype
#5416 opened Mar 31, 2026 by kdubovikov Loading…
3 of 8 tasks
2
Remove duplicated prepare_deepspeed
#5414 opened Mar 31, 2026 by albertvillanova Loading…
1
Skip redundant forward pass for on-policy vLLM importance sampling
#5413 opened Mar 31, 2026 by GJ98 Loading…
3 of 8 tasks
1
7
add JEPO trainer
#5411 opened Mar 31, 2026 by zbills Loading…
3 of 7 tasks
4
Add log_multimodal param to GRPOConfig and RLOOConfig to control image logging
#5408 opened Mar 30, 2026 by apardyl Loading…
3 of 8 tasks
4
Add DistillationTrainer for efficient on-policy distillation
#5407 opened Mar 30, 2026 by cmpatino Loading…
3 of 5 tasks
27
Add length-normalized sigmoid loss type to DPO trainer
#5406 opened Mar 30, 2026 by BrownianNotion Loading…
5 of 8 tasks
1
6
Add per-sample tool filtering to GRPOTrainer via tools column
#5398 opened Mar 27, 2026 by lailanelkoussy Loading…
3 tasks done
30
Better test consistency RLOO vs GRPO
#5396 opened Mar 27, 2026 by qgallouedec Loading…
1
Add tool calling support to RLOOTrainer
#5395 opened Mar 27, 2026 by qgallouedec Loading…
11
feat(grpo): add stop_tool_names for immediate agent loop termination
#5390 opened Mar 27, 2026 by lailanelkoussy Loading…
1
13
Remove xfail for ZeRO 2 and 3 + SFT + PEFT test
#5383 opened Mar 27, 2026 by qgallouedec Loading…
2
Fix DAPO token-level loss to use prompt-level aggregation
#5381 opened Mar 26, 2026 by matdou Loading…
2 of 5 tasks
1
6
Remove truncation_mode from DPO
#5372 opened Mar 25, 2026 by albertvillanova Loading…
8
[vllm-serve] Add extra_llm_kwargs for passing additional arguments to vllm.LLM()
#5367 opened Mar 25, 2026 by jonahsamost Loading…
1 of 5 tasks
10
add more generaic device suppport for CI tests
#5357 opened Mar 24, 2026 by kaixuanliu Loading…
1
Add chunked LM head for memory-efficient log-prob computation for AsyncGRPOTrainer
#5349 opened Mar 23, 2026 by AmineDiro Loading…
25
[Test] Fix *test_training_vlm_multi_image* by skipping vision params in assertion
#5341 opened Mar 22, 2026 by YangKai0616 Loading…
5
Fix Liger kernel crash with device_map="auto" on multi-GPU in GRPOTrainer
#5340 opened Mar 22, 2026 by YangKai0616 Loading…
8
Enable Tensor Parallelism in SFT script
#5331 opened Mar 21, 2026 by songhappy Loading…
2
Support multimodal tool responses in environment_factory for VLM training
#5323 opened Mar 20, 2026 by sergiopaniego Loading…
5 tasks
27
(5/5) async grpo metrics
#5322 opened Mar 20, 2026 by AmineDiro Loading…
6
(4/5) async grpo break out of generation loop (is_done)
#5321 opened Mar 20, 2026 by AmineDiro Loading…
6
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.