Skip to content

Pull requests: pytorch/torchtitan

New pull request New
238 Open 1,760 Closed
238 Open 1,760 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix validator skipping a batch each round by using itertools.islice ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2637 opened Mar 20, 2026 by fegin Loading…
1
4
[graph_trainer] Add Qwen3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2635 opened Mar 19, 2026 by yiming0416 • Draft
[graph_trainer] Remove eager AC ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2634 opened Mar 19, 2026 by yiming0416 Loading…
2
[Module] Refactor init_weights to config-based param_init system ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2633 opened Mar 19, 2026 by fegin Loading…
Fix unreachable links in markdown files CLA Signed This label is managed by the Meta Open Source bot.
#2632 opened Mar 19, 2026 by Andrei-Aksionov Loading…
9
[Draft WIP] MoE with LocalMap ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2625 opened Mar 18, 2026 by acisseJZhong • Draft
[DONT LAND] Full Dtensor fully_shard + Local Map + FlexAttention ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2621 opened Mar 18, 2026 by fegin Loading…
2
Only apply grouped GEMM padding for MXFP8 and FP8 non-HybridEP cases ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2620 opened Mar 18, 2026 by danielvegamyhre Loading…
2
[WIP][Full Dtensor] Work with full dtensor fully_shard ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2616 opened Mar 17, 2026 by fegin • Draft
Actually correct training w/ packed datasets defaults ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2610 opened Mar 16, 2026 by joecummings • Draft
[Observability 7/7] Timing spans and step tags across all trainers ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2607 opened Mar 16, 2026 by felipemello1 Loading…
7 tasks done
6
[Observability 6/7] Wire observability into Trainer, Flux, FT, and Forge ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2606 opened Mar 16, 2026 by felipemello1 Loading…
5 tasks done
23
[Observability 5/7] RolloutLogger for RL rollout JSONL with filtering ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2605 opened Mar 16, 2026 by felipemello1 Loading…
3 tasks done
8
[Observability 4/7] MetricsProcessor — throughput, memory, validation, log scheduling ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2604 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
12
[Observability 3/7] Experiment metrics with background aggregation subprocess ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2603 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
14
[Observability 2/7] Structured system logging and gantt chart generation ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2602 opened Mar 16, 2026 by felipemello1 Loading…
4 tasks done
40
[Observability 1/7] Toy trainers for observability development ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2601 opened Mar 16, 2026 by felipemello1 Loading…
No Weight Decay Keywords CLA Signed This label is managed by the Meta Open Source bot.
#2600 opened Mar 16, 2026 by francesco-bertolotti Loading…
7
add async activation offloading to CPU with pinned memory pool CLA Signed This label is managed by the Meta Open Source bot.
#2581 opened Mar 15, 2026 by dean-mccoppin Loading…
1
Add weight tying support for Llama3 CLA Signed This label is managed by the Meta Open Source bot.
#2580 opened Mar 15, 2026 by dean-mccoppin Loading…
1
3
Implement torch compile and mxfp8 for flux CLA Signed This label is managed by the Meta Open Source bot.
#2579 opened Mar 15, 2026 by hlahkar Loading…
@wwwjn
3
Configurable Z Loss CLA Signed This label is managed by the Meta Open Source bot.
#2576 opened Mar 14, 2026 by francesco-bertolotti Loading…
[5/N] Support lora moe ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2569 opened Mar 13, 2026 by mori360 • Draft
[RL] Changes to enable compilation for trainer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2568 opened Mar 13, 2026 by Lucaskabela Loading…
1
12
[mxfp8 training] add TP warning ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2562 opened Mar 12, 2026 by danielvegamyhre Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.