Sparse attention + refactor + v0.3.0#342

Closed

jeffra wants to merge 16 commits into

staging-sparse-attention

Commits on Aug 28, 2020

Sparse Transformer: adding codes related to ST (#58)

arashashari
authored and
jeffra
committed
docker update (#66)
jeffra
committed
Adding/updating sparsity config (#68)

arashashari
authored and
jeffra
committed
adding unit test/s for sparse transformer (#60)

arashashari
authored and
jeffra
committed
fix a naming issue in utils file: bert_mode -> bert (#69)

arashashari
authored and
jeffra
committed
updating deepspeed config for Sparse Transformer (#62)

arashashari
authored and
jeffra
committed
updating sparsityconfig and layout creation to enable variable sequence length per batch (#71)

arashashari
authored and
jeffra
committed
Adding Sparse Transformer Tutorial Documentation (#70)

arashashari
authored and
jeffra
committed
adding documentation for Sparse Transformer and current result (#64)

arashashari
authored and
jeffra
committed
DeepSpeed ops refactor (#73)
jeffra
committed
Update ds
jeffra
committed
Update runner.py
jeffra
committed
Updated code based on name change from "sparse transformer" to "sparse attention" (#76)
arashashari
authored

Commits on Sep 1, 2020