Skip to content

[shardformer] support pipeline for gpt #4200

Closed
Closed
[shardformer] support pipeline for gpt#4200
Assignees
Fridge003
Labels
pipeline-parallelrelated to the pipeline-parallel featureshardformer

Description

@Fridge003
Fridge003
opened on Jul 10, 2023

support pipeline for gpt models, integrate its policy to shardformer, and add relevant tests.

Metadata

Metadata

Assignees

Labels

pipeline-parallelrelated to the pipeline-parallel featureshardformer

Type

No type

Fields

No fields configured for issues without a type.

Projects

Shardformer
Status
✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions