Skip to content

Add support for batch size to --perplexity#407

Merged
ggerganov merged 10 commits into
ggml-org:masterfrom
glinscott:batch_perplexity
Apr 13, 2023
Merged

Add support for batch size to --perplexity#407
ggerganov merged 10 commits into
ggml-org:masterfrom
glinscott:batch_perplexity

Update batch size for efficiency

23fd782
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs