News

(vllm) llm@aitt:/data_a/llm$ python collect_env.py INFO 05-23 10:07:58 [__init__.py:239] Automatically detected platform cuda. Collecting environment information... ===== System Info ===== OS : Ubuntu ...
Your current environment L40 & H20 How would you like to use vllm (VllmWorker rank=0 pid=185081) ERROR 05-24 13:52:18 [multiproc_executor.py:522] WorkerProc hit an exception. (VllmWorker rank=0 pid ...