INFO 08-11 15:10:56 [__init__.py:235] Automatically detected platform cuda.
ERROR 08-11 15:10:58 [registry.py:396] Error in inspecting model architecture 'Qwen3ForCausalLM'
ERROR 08-11 15:10:58 [registry.py:396] Traceback (most recent call last):
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 394, in _try_inspect_model_cls
ERROR 08-11 15:10:58 [registry.py:396] return model.inspect_model_cls()
ERROR 08-11 15:10:58 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 365, in inspect_model_cls
ERROR 08-11 15:10:58 [registry.py:396] return _run_in_subprocess(
ERROR 08-11 15:10:58 [registry.py:396] ^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 666, in _run_in_subprocess
ERROR 08-11 15:10:58 [registry.py:396] returned = subprocess.run(_SUBPROCESS_COMMAND,
ERROR 08-11 15:10:58 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 548, in run
ERROR 08-11 15:10:58 [registry.py:396] with Popen(*popenargs, **kwargs) as process:
ERROR 08-11 15:10:58 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 1026, in __init__
ERROR 08-11 15:10:58 [registry.py:396] self._execute_child(args, executable, preexec_fn, close_fds,
ERROR 08-11 15:10:58 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 1950, in _execute_child
ERROR 08-11 15:10:58 [registry.py:396] raise child_exception_type(errno_num, err_msg, err_filename)
ERROR 08-11 15:10:58 [registry.py:396] PermissionError: [Errno 13] Permission denied: ''
ERROR 08-11 15:10:59 [registry.py:396] Error in inspecting model architecture 'TransformersForCausalLM'
ERROR 08-11 15:10:59 [registry.py:396] Traceback (most recent call last):
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 394, in _try_inspect_model_cls
ERROR 08-11 15:10:59 [registry.py:396] return model.inspect_model_cls()
ERROR 08-11 15:10:59 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 365, in inspect_model_cls
ERROR 08-11 15:10:59 [registry.py:396] return _run_in_subprocess(
ERROR 08-11 15:10:59 [registry.py:396] ^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/model_executor/models/registry.py", line 666, in _run_in_subprocess
ERROR 08-11 15:10:59 [registry.py:396] returned = subprocess.run(_SUBPROCESS_COMMAND,
ERROR 08-11 15:10:59 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 548, in run
ERROR 08-11 15:10:59 [registry.py:396] with Popen(*popenargs, **kwargs) as process:
ERROR 08-11 15:10:59 [registry.py:396] ^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 1026, in __init__
ERROR 08-11 15:10:59 [registry.py:396] self._execute_child(args, executable, preexec_fn, close_fds,
ERROR 08-11 15:10:59 [registry.py:396] File "/home/mxf/anaconda3/lib/python3.11/subprocess.py", line 1950, in _execute_child
ERROR 08-11 15:10:59 [registry.py:396] raise child_exception_type(errno_num, err_msg, err_filename)
ERROR 08-11 15:10:59 [registry.py:396] PermissionError: [Errno 13] Permission denied: ''
Traceback (most recent call last):
File "/mnt/e/QWEN/demo_vllm.py", line 9, in <module>
llm = LLM(model="./qwen3-1.7b")
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/entrypoints/llm.py", line 273, in __init__
self.llm_engine = LLMEngine.from_engine_args(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/engine/llm_engine.py", line 490, in from_engine_args
vllm_config = engine_args.create_engine_config(usage_context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/engine/arg_utils.py", line 1004, in create_engine_config
model_config = self.create_model_config()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mxf/anaconda3/lib/python3.11/site-packages/vllm/engine/arg_utils.py", line 872, in create_model_config
return ModelConfig(
^^^^^^^^^^^^
File "/home/mxf/anaconda3/lib/python3.11/site-packages/pydantic/_internal/_dataclasses.py", line 123, in __init__
s.__pydantic_validator__.validate_python(ArgsKwargs(args, kwargs), self_instance=s)
pydantic_core._pydantic_core.ValidationError: 1 validation error for ModelConfig
Value error, Model architectures ['Qwen3ForCausalLM', 'TransformersForCausalLM'] failed to be inspected. Please check the logs for more details. [type=value_error, input_value=ArgsKwargs((), {'model': ...attention_dtype': None}), input_type=ArgsKwargs]
For further information visit https://errors.pydantic.dev/2.11/v/value_error
该错误怎么解决
最新发布