Skip to content
This repository was archived by the owner on May 12, 2023. It is now read-only.
This repository was archived by the owner on May 12, 2023. It is now read-only.

An error regarding Unicode DecodeError(关于Unicode DecodeError的错误) #61

@funnygeeker

Description

@funnygeeker

Hello, I am using an Alpaca model that supports Chinese, but I often encounter the following error when using PyLLaMACpp:
(您好,我使用了一个支持中文的alpaca模型,但是在使用PyLLaMACpp时经常出现以下错误:)

Traceback (most recent call last):
  File "C:\Users\xxxxxxx\PycharmProjects\pyllamacpp\main.py", line 10, in <module>
    model.generate("你好", n_predict=64, new_text_callback=new_text_callback, n_threads=8, verbose=True)
  File "C:\Users\xxxxxxx\PycharmProjects\pyllamacpp\venv\lib\site-packages\pyllamacpp\model.py", line 112, in generate
    pp.llama_generate(self._ctx, self.gpt_params, self._call_new_text_callback, verbose)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe6 in position 0: unexpected end of data

This model can generally run normally in other similar programs, but it always encounters errors when generating replies using PyLLaMACpp.(这个模型在其他类似程序中基本能正常运行,但是在使用PyLLaMACpp时总是在回复生成到一半时出错。)

The source of the model(模型来源):https://huggingface.co/P01son/ChatLLaMA-zh-7B-int4

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions