PS C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui> & .\.venv\Scripts\python.exe -m app.lora_trainer
INFO:__main__:[1] 加载 Tokenizer...
INFO:__main__:[2] 加载并 Tokenize 数据...
The OrderedVocab you are attempting to save contains holes for indices [3, 4, 5, 9, 10, 11, 12, 13], your vocabulary could be corrupted !
Map: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 618063/618063 [14:21<00:00, 717.79 examples/s]
INFO:__main__:[3] 加载模型 + LoRA 适配...
INFO:accelerate.utils.modeling:We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk).
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [01:19<00:00, 39.88s/it]
===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
binary_path: C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll
CUDA SETUP: Loading binary C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Loading binary C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Loading binary C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected.
CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig.
CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following:
CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null
CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a
CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\app\lora_trainer.py", line 117, in <module>
trainer = LoRATrainer(config)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\app\lora_trainer.py", line 30, in __init__
self._load_model()
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\app\lora_trainer.py", line 82, in _load_model
self.model = get_peft_model(self.model, lora_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\mapping.py", line 193, in get_peft_model
return MODEL_TYPE_TO_PEFT_MODEL_MAPPING[peft_config.task_type](
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\peft_model.py", line 1609, in __init__
super().__init__(model, peft_config, adapter_name, **kwargs)
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\peft_model.py", line 171, in __init__
self.base_model = cls(model, {adapter_name: peft_config}, adapter_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\lora\model.py", line 141, in __init__
super().__init__(model, config, adapter_name, low_cpu_mem_usage=low_cpu_mem_usage)
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\tuners_utils.py", line 184, in __init__
self.inject_adapter(self.model, adapter_name, low_cpu_mem_usage=low_cpu_mem_usage)
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\tuners_utils.py", line 496, in inject_adapter
self._create_and_replace(peft_config, adapter_name, target, target_name, parent, current_key=key)
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\lora\model.py", line 226, in _create_and_replace
new_module = self._create_new_module(lora_config, adapter_name, target, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\lora\model.py", line 321, in _create_new_module
from .bnb import dispatch_bnb_8bit
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\peft\tuners\lora\bnb.py", line 19, in <module>
import bitsandbytes as bnb
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\__init__.py", line 7, in <module>
from .autograd._functions import (
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\autograd\__init__.py", line 1, in <module>
from ._functions import undo_layout, get_inverse_transform_indices
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\autograd\_functions.py", line 9, in <module>
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\functional.py", line 17, in <module>
from .cextension import COMPILED_WITH_CUDA, lib
File "C:\Users\vipuser\Documents\ai_writer_project_final_with_fixed_output_ui\.venv\Lib\site-packages\bitsandbytes\cextension.py", line 22, in <module>
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues
最新发布