Commit History

Merge branch 'main' into hf_space
2bb73ed
Running

Victarry commited on

Make P2P in warmup/cooldown stage to sync comm.
fa7e466

Victarry commited on

Add support to set custom stage time.
0a0d256

Victarry commited on

Add visualization script and README for Pipeline Parallelism in Megatron-LM
592da35

Victarry commited on

Update link.
efe627a

Victarry commited on

Add HF config.
f300aa9

Victarry commited on

Update UI.
3061061

Victarry commited on

Add microbatch_group_size_per_vp_stage to app config button.
95f5e38

Victarry commited on

Update readme.
14964a0

Victarry commited on

Update app
d51ece3

Victarry commited on

Add microbatch_group_size_per_vp_stage as configurable.
9e8f4f3

Victarry commited on

Update dualpipe implementaion
7fc2bda

Victarry commited on

Update formula for 1F1B-interleave-overlap.
2b92a30

Victarry commited on

Add formula for DualPipe
1c6de61

Victarry commited on

Add DualPipe-V support.
912dfd2

Victarry commited on

Add table results.
00f66fa

Victarry commited on

Update UI.
9afc581

Victarry commited on

Add HF space link.
926861c

Victarry commited on

Add dockerfile and update packages.
1fbfd41

Victarry commited on

Add requirements.
394d603

Victarry commited on

update UI.
c95703b

Victarry commited on

Improve UI components.
dbf4731

Victarry commited on

Add interactive server.
e43fc85

Victarry commited on

Update config.
b6b2608

Victarry commited on

Add support for DualPipe.
b5211c1

Victarry commited on

Update overlapped time.
5c333de

Victarry commited on

Update readme.
0c01e47

Victarry commited on

Fix device labels order.
abfba45

Victarry commited on

Update visualizer.
9930ba1

Victarry commited on

Add references
fdd20b5

Victarry commited on

Update.
db218de

Victarry commited on

Add support for 1F1B-interleave-overlap.
e875526

Victarry commited on

Update visualizer for 1F1B overlap.
666b16e

Victarry commited on

Add visualization for 1F1B overlap.
e37f1c9

Victarry commited on

Update implementation for 1F1B overlapping.
01cd5a6

Victarry commited on

Add 1F1B-overlap implementation.
8c34011

Victarry commited on

Update color and example.
8bbb8ac

Victarry commited on

Add support for zero-bubble-1P.
5b26da5

Victarry commited on

Add bubble rate formula.
817f91f

Victarry commited on

Fix device order.
b8b207c

Victarry commited on

Improve visualizer performance.
d6ff36f

Victarry commited on

Refactor schedule execution model and simplify execution flow
2853f63

Victarry commited on

Add images.
0c2b7e4

Victarry commited on

Fix bug.
42b7f6e

Victarry commited on

Update visualizer.
53c5fd9

Victarry commited on

Add VPP support and refactor project.
ec4024f

Victarry commited on

Update example usage.
c02cff7

Victarry commited on

Update.
03b3dcb

Victarry commited on

Add dash backend visualizer.
096b444

Victarry commited on

Update args logic.
e88b5a9

Victarry commited on