Skip to content

Add 4-bit quantized inference to run BLOOM-176B on 2 A100 GPUs#2526

Closed
RezaYazdaniAminabadi wants to merge 14 commits into
masterfrom
quantize-inference
Closed

Add 4-bit quantized inference to run BLOOM-176B on 2 A100 GPUs#2526
RezaYazdaniAminabadi wants to merge 14 commits into
masterfrom
quantize-inference

Merge branch 'master' of github.com:microsoft/DeepSpeed into quantize…

5917d5a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs