Help me fix a problem related to Docker networking

[mal1k-me]

Hi. I was trying to get the Khoj Docker container connect to my local Mistral Ollama model using the admin panel but it seems there's a bigger issue related to Docker network communications.

I made sure the model works using ollama run mistral. The requests to the local /v1 node endpoints of Ollama OpenAI API do indeed send back a sound response using curl, too.

Below you'll find a link to docker-compose up output. Your help is appreciated 😀

https://gist.github.com/mal1k-me/30fbc6e85f1fa26f2bc3fcff71c11d69

[adityakrmishra]

Solution for Docker Networking Issue

Hi there!

It looks like you're facing a Docker networking issue with the Khoj container. Here are a few steps you can try to resolve the problem:

1. Check Docker Network Configuration:

   • Ensure that your Docker container is connected to the correct network. You can check this by running:

     docker network ls

   • If the container is not on the expected network, connect it using:

     docker network connect <network_name> <container_name>

   • Restart the Khoj container:

     docker restart <container_name>

2. Update Khoj Configuration:

   • Open the Khoj configuration file located at /path/to/khoj/config.yaml.
   • Ensure that the GitHub sync settings are correctly configured:

     github:
       token: <your_github_token>
       repo: <your_repo_name>

   • Save the changes and restart the Khoj service:

     docker-compose down
     docker-compose up -d

3. Check Docker Logs:

   • Review the Docker logs for any errors or warnings that might give more insight into the issue:

     docker logs <container_name>

4. Network Connectivity:

   • Ensure that your local network settings are correctly configured and that there are no firewall rules blocking the connection.

5. Restart Docker:

   • Sometimes, simply restarting Docker can resolve network connectivity issues.

If these steps don't resolve the issue, you might want to share the relevant logs or error messages from the Docker container for further assistance.

Hope this helps! 😊

[debanjum]

Hey @mal1k-me , thanks for sharing the detailed server logs. I see 2 kinds of errors:

1. The searxng search-1 | TimeoutError errors during init
   These errors seems benign. Khoj is still able to do online searches using searxng. Still need to investigate why that happens
2. The chat server-1 | APIConnectionError request timeouts on calls to LLM
   Multiple self-hosting users trying to use Khoj via an OpenAI proxy API like Ollama/LMStudio/LiteLLM have reported this. It seems to be caused by api call timeout/retry period. That shorter period to trigger timeout/retry works for requests to actual openai models but seems to cause problems for the slower api calls to local chat models.

I'll try and reproduce the issue myself and see if this hypothesis for the second issue (also suggested in #1035 (comment)) holds true. If this is the reason a longer/configurable timeout for local models maybe the fix for the second issue