Popular repositories Loading

1. test-Gpu-Isolation test-Gpu-Isolation Public

2. serving serving Public

   Forked from knative/serving

   Kubernetes-based, scale-to-zero, request-driven compute

   Go

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. Yuan-2.0 Yuan-2.0 Public

   Forked from IEIT-Yuan/Yuan-2.0

   Yuan 2.0 Large Language Model

   Python

5. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++