Skip to content

Commit acdd712

Browse files
fix script issues in MD file (#538)
1 parent c297155 commit acdd712

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

ChatQnA/docker/xeon/README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,7 @@ Build vLLM docker.
100100
git clone https://github.com/vllm-project/vllm.git
101101
cd ./vllm/
102102
docker build --no-cache -t opea/vllm:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f Dockerfile.cpu .
103+
cd ..
103104
```
104105

105106
Build microservice.
@@ -293,6 +294,10 @@ curl http://${host_ip}:8000/v1/reranking\
293294

294295
6. LLM backend Service
295296

297+
In first startup, this service will take more time to download the LLM file. After it's finished, the service will be ready.
298+
299+
Use `docker logs CONTAINER_ID` to check if the download is finished.
300+
296301
```bash
297302
# TGI service
298303
curl http://${host_ip}:9009/generate \
@@ -310,6 +315,8 @@ curl http://${host_ip}:9009/v1/completions \
310315

311316
7. LLM Microservice
312317

318+
This service depends on above LLM backend service startup. It will be ready after long time, to wait for them being ready in first startup.
319+
313320
```bash
314321
curl http://${host_ip}:9000/v1/chat/completions\
315322
-X POST \
@@ -329,7 +336,7 @@ curl http://${host_ip}:8888/v1/chatqna -H "Content-Type: application/json" -d '{
329336

330337
If you want to update the default knowledge base, you can use the following commands:
331338

332-
Update Knowledge Base via Local File Upload:
339+
Update Knowledge Base via Local File [nke-10k-2023.pdf](https://github.com/opea-project/GenAIComps/blob/main/comps/retrievers/langchain/redis/data/nke-10k-2023.pdf) Upload:
333340

334341
```bash
335342
curl -X POST "http://${host_ip}:6007/v1/dataprep" \

0 commit comments

Comments
 (0)