AutoGPTQ报torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed的解决办法

这个问题是我在用Llama factory时候遇到的，主要是报类似这样的错误：

torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed because the input is not positive-definite (the leading minor of order 5892 is not positive-definite).

搜了一下，这是AutoGPTQ可能出现的问题：

[BUG]torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed because the input is not positive-definite (the leading minor of order 18163 is not positive-definite). · Issue #196 · AutoGPTQ/AutoGPTQ · GitHub

我试了一下，发现直接用AutoGPTQ也会出现类似的问题，例如这里直接使用其主页（