From 16e931da12418252aac29b65fa8ef923e821ce75 Mon Sep 17 00:00:00 2001 From: youkaichao Date: Thu, 25 Jul 2024 21:37:41 -0700 Subject: [PATCH 1/2] add known issues --- docs/source/getting_started/debugging.rst | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/docs/source/getting_started/debugging.rst b/docs/source/getting_started/debugging.rst index 2aa52e79888a3..57e89728f6010 100644 --- a/docs/source/getting_started/debugging.rst +++ b/docs/source/getting_started/debugging.rst @@ -65,6 +65,10 @@ Here are some common issues that can cause hangs: If the problem persists, feel free to `open an issue on GitHub `_, with a detailed description of the issue, your environment, and the logs. +Some known issues: + +- In ``v0.5.2``, ``v0.5.3``, and ``v0.5.3.post1``, there is a bug caused by `zmq `_ , which can cause hangs at a low probability (once in about 20 times, depending on the machine configuration). The fix is to upgrade to the latest version of ``vllm``. + .. warning:: After you find the root cause and solve the issue, remember to turn off all the debugging environment variables defined above, or simply start a new shell to avoid being affected by the debugging settings. If you don't do this, the system might be slow because many debugging functionalities are turned on. From 438b3761af5f452d4ca27f1899b987b114c655d4 Mon Sep 17 00:00:00 2001 From: youkaichao Date: Thu, 25 Jul 2024 21:38:48 -0700 Subject: [PATCH 2/2] add known issues --- docs/source/getting_started/debugging.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/getting_started/debugging.rst b/docs/source/getting_started/debugging.rst index 57e89728f6010..d7066f2325b3a 100644 --- a/docs/source/getting_started/debugging.rst +++ b/docs/source/getting_started/debugging.rst @@ -67,7 +67,7 @@ If the problem persists, feel free to `open an issue on GitHub `_ , which can cause hangs at a low probability (once in about 20 times, depending on the machine configuration). The fix is to upgrade to the latest version of ``vllm``. +- In ``v0.5.2``, ``v0.5.3``, and ``v0.5.3.post1``, there is a bug caused by `zmq `_ , which can cause hangs at a low probability (once in about 20 times, depending on the machine configuration). The solution is to upgrade to the latest version of ``vllm`` to include the `fix `_ . .. warning::