root@autodl-container-8bf9409db0-3243e00c:~/autodl-tmp# python utils_one.py
2025-06-04 22:18:14,601 - __main__ - INFO - 初始化对话评估系统...
2025-06-04 22:18:14,602 - __main__ - INFO - 加载嵌入模型: /root/autodl-tmp/paraphrase-multilingual-MiniLM-L12-v2
2025-06-04 22:18:16,425 - __main__ - INFO - 嵌入模型加载成功，设备: cuda
2025-06-04 22:18:16,426 - __main__ - INFO - 加载生成模型: /root/autodl-tmp/Qwen3-14b
2025-06-04 22:18:16,651 - accelerate.utils.modeling - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk).
Loading checkpoint shards: 67%|██████████████████████████████████████████████████████████████████████████████████████████████████████▋ | 4/6 [00:03<00:01, 1.27it/s]
2025-06-04 22:18:19,830 - __main__ - ERROR - 生成模型加载失败: Error while deserializing header: MetadataIncompleteBuffer
2025-06-04 22:18:19,830 - __main__ - ERROR - 生成模型加载失败: Error while deserializing header: MetadataIncompleteBuffer
2025-06-04 22:18:19,830 - __main__ - ERROR - 评估系统初始化失败: Error while deserializing header: MetadataIncompleteBuffer
Traceback (most recent call last):
File "/root/autodl-tmp/utils_one.py", line 482, in <module>
evaluator = DialogueEvaluator(
^^^^^^^^^^^^^^^^^^
File "/root/autodl-tmp/utils_one.py", line 231, in __init__
self.dialogue_generator = DialogueGenerator(gen_model_path, device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/autodl-tmp/utils_one.py", line 88, in __init__
self.model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 571, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/modeling_utils.py", line 279, in _wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4400, in from_pretrained
) = cls._load_pretrained_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4818, in _load_pretrained_model
state_dict = load_state_dict(
^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/modeling_utils.py", line 513, in load_state_dict
with safe_open(checkpoint_file, framework="pt") as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
safetensors_rust.SafetensorError: Error while deserializing header: MetadataIncompleteBuffer
最新发布
扫一扫
853
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
