Python解析json文件报错：'utf8' codec can't decode byte 0xbb in position 0: invalid start byte

最新推荐文章于 2024-09-13 21:26:23 发布
转载 最新推荐文章于 2024-09-13 21:26:23 发布 · 3.6k 阅读 · 0

本文介绍了在Python中遇到的JSON解码错误“'utf8' codec can't decode byte 0xbb in position 0: invalid start byte”的原因及解决办法。此错误通常是因为文件头部存在BOM标记导致，文中提供了如何通过Sublime Text去除BOM标记的方法。

今天尝试读一个json文件，数据为一行，字典列表形式，结果一直报错

代码：

[python]  view plain  copy
  1. f = file('relation.json')  
  2. d = json.load(f)  
报错：

'utf8' codec can't decode byte 0xbb in position 0: invalid start byte


在使用Python的时候，经常会碰到这个报错，之前一直弄不清楚是什么问题，今天专门研究了一下，报错的意思大概是，无法解码，在位置0处有非法的开始字节。

了解后发现，在utf-8编码文件中BOM在文件头部，占用三个字节，用来标示该文件属于utf-8编码，现在已经有很多软件识别bom头，但是还有些不能识别bom头，比如PHP就不能识别bom头，这也是用记事本编辑utf-8编码后执行就会出错的原因了。

解决方案:

打开sublime，新建文件，选择File->save with encoding->UTF-8, 就可以了。


参考：

http://www.crifan.com/fixed_problem_for_python_valueerror_no_json_object_could_be_decoded/

http://jingyan.baidu.com/article/9f63fb91d72eb5c8410f0e44.html



转载自：https://i-blog.csdnimg.cn/blog_migrate/b1f6921232f24c571c0f50de299f4758.png

python 编码问题 UnicodeDecodeError: ‘utf8’ codec can’t decode byte 0xb4 in position 0: invalid start byt
rifengxxc的博客
08-02 1万+
解决python下的一种编码问题
tf.gfile.FastGFile造成的'utf-8' codec can't decode..错误
grllery的博客
11-07 6776
环境：tensorflow 1.4.0python3.5 import matplotlib.pyplot as plt import tensorflow as tf image_raw_data = tf.gfile.FastGFile("test.bmp", 'r').read() with tf.Session() as sess: img_data = tf.image....
python爬虫解析json数据报错(unicode error) 'utf-8' codec can't decode byte 0xbb in position 0
shulixu的博客
09-25 1万+
先解释一些 概念 序列化（Serialization）：将对象的状态信息转换为可以存储或可以通过网络传输的过程，传输的格式可以是JSON、XML等。反序列化就是从存储区域（JSON，XML）读取反序列化对象的状态，重新创建该对象。 JSON（JavaScript Object Notation）：一种轻量级数据交换格式，相对于XML而言更简单，也易于阅读和编写，机器也方便解析和生
Python解决UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbb in position 0: invalid start byte
qq_34815075的博客
09-13 2326
1、读取文件报错，UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0xbb in position 0: invalid start byte。分析：报错原因，文件并非utf-8格式。解决办法多种：方法一：打开文件，在wps或者word另存为utf-8格式在读取。方法二：获取该文件的编码。
UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbb in position 0: invalid start byte
zhangyysp的博客
11-18 858
注意文件的编码类型，大多数都是utf-8，如果还是报unicode错误在试试gbk或者gb2312。如果在使用pandas打开csv文件的时候报错。
Python UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbb in position 0: invalid start byte
程志伟的博客
08-17 7130
关注微信公共号：小程在线 关注优快云博客：程志伟的博客 df1 = pd.read_csv('F:\Python\科室数据.csv',encoding='UTF-8') df1.head(3) Traceback (most recent call last): File "<ipython-input-7-ea22cad5d7ab>", line 2, in <module> encoding='UTF-8') File "E:\anaconda3\li...
为何报错“‘utf-8’ codec cant't decode byte 0xff in position 0 : invalid start byte”
最新发布
07-23
我们遇到了一个编码错误：'utf-8' codec can't decode byte 0xff in position 0: invalid start byte 这个错误通常是因为文件不是UTF-8编码，而是其他编码（如UTF-16、UTF-32或带BOM的UTF-8）导致的。 0xff 0xfe ...
PS D:\DATAJUICER> python data-juicer-main/tools/postprocess/count_token.py ` >> --data_path ds2.jsonl ` >> --text_keys text ` >> --tokenizer_method gpt2 ` >> --num_proc 1 2025-07-07 16:17:33.994 | INFO | __main__:prepare_tokenizer:22 - Loading tokenizer from HuggingFace... 0it [00:00, ?it/s] Traceback (most recent call last): File "D:\DATAJUICER\data-juicer-main\tools\postprocess\count_token.py", line 61, in <module> fire.Fire(main) File "D:\software\python\Lib\site-packages\fire\core.py", line 135, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\software\python\Lib\site-packages\fire\core.py", line 468, in _Fire component, remaining_args = _CallAndUpdateTrace( ^^^^^^^^^^^^^^^^^^^^ File "D:\software\python\Lib\site-packages\fire\core.py", line 684, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^ File "D:\DATAJUICER\data-juicer-main\tools\postprocess\count_token.py", line 44, in main for sample in tqdm(reader): File "D:\software\python\Lib\site-packages\tqdm\std.py", line 1181, in __iter__ for obj in iterable: File "D:\software\python\Lib\site-packages\jsonlines\jsonlines.py", line 434, in iter yield self.read( ^^^^^^^^^^ File "D:\software\python\Lib\site-packages\jsonlines\jsonlines.py", line 307, in read lineno, line = next(self._line_iter) ^^^^^^^^^^^^^^^^^^^^^ File "<frozen codecs>", line 322, in decode File "D:\software\python\Lib\encodings\utf_8_sig.py", line 69, in _buffer_decode return codecs.utf_8_decode(input, errors, final) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
07-08
这个错误表明脚本在尝试读取 `ds2.jsonl` 文件时遇到了 **UTF-8 编码问题**（文件可能以其他编码格式保存，如 `UTF-16` 或 `GBK`）。以下是解决方案和详细说明： --- ### **错误原因** 1. **文件编码不匹配**： ...
Exception in Tkinter callback Traceback (most recent call last): File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 330, in find_cookie line_string = line.decode('utf-8') UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc8 in position 25: invalid continuation byte During handling of the above exception, another exception occurred: Traceback (most recent call last): File "_pydevd_bundle/pydevd_cython.pyx", line 532, in _pydevd_bundle.pydevd_cython.PyDBFrame._handle_exception File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 16, in getline lines = getlines(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 47, in getlines return updatecache(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 136, in updatecache with tokenize.open(fullname) as fp: File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 394, in open encoding, lines = detect_encoding(buffer.readline) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 381, in detect_encoding encoding = find_cookie(second) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 335, in find_cookie raise SyntaxError(msg) SyntaxError: invalid or missing encoding declaration for 'D:\\project\\desktop_jijun\\desktop_jijun\\desktop_jijun.py' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 330, in find_cookie line_string = line.decode('utf-8') UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc8 in position 25: invalid continuation byte During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tkinter\__init__.py", line 1883, in __call__ return self.func(*args) File "D:\project\desktop_jijun\desktop_jijun\desktop_jijun.py", line 169, in consaltant content = response.content.decode('gbk') File "_pydevd_bundle/pydevd_cython.pyx", line 1366, in _pydevd_bundle.pydevd_cython.SafeCallWrapper.__call__ File "_pydevd_bundle/pydevd_cython.pyx", line 322, in _pydevd_bundle.pydevd_cython.PyDBFrame.trace_exception File "_pydevd_bundle/pydevd_cython.pyx", line 452, in _pydevd_bundle.pydevd_cython.PyDBFrame.handle_user_exception File "_pydevd_bundle/pydevd_cython.pyx", line 535, in _pydevd_bundle.pydevd_cython.PyDBFrame._handle_exception File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 16, in getline lines = getlines(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 47, in getlines return updatecache(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 136, in updatecache with tokenize.open(fullname) as fp: File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 394, in open encoding, lines = detect_encoding(buffer.readline) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 381, in detect_encoding encoding = find_cookie(second) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 335, in find_cookie raise SyntaxError(msg) SyntaxError: invalid or missing encoding declaration for 'D:\\project\\desktop_jijun\\desktop_jijun\\desktop_jijun.py' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 330, in find_cookie line_string = line.decode('utf-8') UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc8 in position 25: invalid continuation byte During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "d:\vs\benti\common7\ide\extensions\microsoft\python\core\debugpy\__main__.py", line 45, in <module> cli.main() File "d:\vs\benti\common7\ide\extensions\microsoft\python\core\debugpy/..\debugpy\server\cli.py", line 444, in main run() File "d:\vs\benti\common7\ide\extensions\microsoft\python\core\debugpy/..\debugpy\server\cli.py", line 285, in run_file runpy.run_path(target_as_str, run_name=compat.force_str("__main__")) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 265, in run_path return _run_module_code(code, init_globals, run_name, File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 97, in _run_module_code _run_code(code, mod_globals, init_globals, File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "D:\project\desktop_jijun\desktop_jijun\desktop_jijun.py", line 197, in <module> root.mainloop() File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tkinter\__init__.py", line 1420, in mainloop self.tk.mainloop(n) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tkinter\__init__.py", line 1887, in __call__ self.widget._report_exception() File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tkinter\__init__.py", line 1603, in _report_exception root.report_callback_exception(exc, val, tb) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tkinter\__init__.py", line 2341, in report_callback_exception traceback.print_exception(exc, val, tb) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 103, in print_exception for line in TracebackException( File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 509, in __init__ self.stack = StackSummary.extract( File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 366, in extract f.line File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\traceback.py", line 288, in line self._line = linecache.getline(self.filename, self.lineno).strip() File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 16, in getline lines = getlines(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 47, in getlines return updatecache(filename, module_globals) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\linecache.py", line 136, in updatecache with tokenize.open(fullname) as fp: File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 394, in open encoding, lines = detect_encoding(buffer.readline) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 381, in detect_encoding encoding = find_cookie(second) File "C:\Users\lry20\AppData\Local\Programs\Python\Python38\lib\tokenize.py", line 335, in find_cookie raise SyntaxError(msg) SyntaxError: invalid or missing encoding declaration for 'D:\\project\\desktop_jijun\\desktop_jijun\\desktop_jijun.py' a Press any key t
06-20
- `UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc8` - API返回数据使用GBK编码而非UTF-8 - 错误位置：`response.json()`解析时 3. **Tkinter线程阻塞**： - 回调函数中直接执行耗时网络请求导致UI...
解决(unicode error) 'utf-8' codec can't decode byte 0xbb in position 0: invalid start byte
热门推荐
异想天开
04-16 6万+
在python文件中加了中文字符，执行就报错： SyntaxError: (unicode error) 'utf-8' codec can't decode byte 0xbb in position 0: invalid start byte 我们一般会在python文件第二行添加如下编码申明： # -*- coding:utf-8 -*- 这个地方重点要注意就是，申明只是告诉python...
Flask刚开始遇到的问题UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbb in position 0: invalid start
qq_57072593的博客
03-03 706
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xbb in position 0: invalid start 解决方案之一
Python报错"utf-8' codec can't decode byte 0xb0 in position 0: invalid start byte"
weixin_45901516的博客
05-11 8954
Python报错"utf-8’ codec can’t decode byte 0xb0 in position 0: invalid start byte" 上周在做变量相关性分析时，导入数据一直提示报错，用的Spyder，从来没遇到过这个情况， 代码如下： 报错提示如下： 后面发现仅仅是数据源文件上传格式不对，修改为GBK即可 修改后代码如下： ...
‘utf-8‘ codec can‘t decode byte 0xbe in position 0: invalid start byte问题解决方法
玉一的博客
04-15 4万+
问题1：读取文件名格式错误问题: Initializing from file failed 出现原因：在jupyter读取csv文件时候，最好不要用中文命名 解决方法：更改成中文则问题解决 问题2：'utf-8' codec can't decode byte 0xbe in position 0: invalid start byte 原因：文件读取编码格式错误 解决方法1：读取csv文件时候增加编码格式 ...
python代码运行时出现以下错误：‘utf-8‘ codec can‘t decode byte 0xb0 in position 0: invalid start byte
weixin_41033231的博客
12-11 1378
使用msgpack.Unpacker对bin文件进行解包时，出现错误：'utf-8' codec can't decode byte 0xb0 in position 0: invalid start byte。默认情况下，解包程序参数raw=False，它假设str类型是有效的UTF-8字符串。
UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbe in position 0: invalid start byte
DanielSmith
05-12 4717
UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0xbe in position 0: invalid start byte 这个问题导致的原因： 在生成txt文件的时候没有指定utf-8的格式，所以再打开的时候，按照utf-8无法decode 解决办法： 手动生成创建一个txt文件，一般手动创建的时候，默认编码的格式是utf-8 将原来的txt文件另存为，在另存为的时候选择编码格式为utf-8 ...
SyntaxError: (unicode error) ‘utf-8‘ codec can‘t decode byte 0xbb in position 0: invalid start byte
风一样的少年
02-21 1505
如果你vi打开看到的是中文,但是cat 出来的是乱码，那指定是不正常的。614809646 qq群->然后再试试，看看问题修复了不。这说明中文环境是有问题的。和tts,运维、开发等等。# 有问题可以进群聊聊。
UnicodeDecodeError: ‘utf-8‘ codec can‘t decode byte 0xbb in position 38: invalid start byte
qq_45623158的博客
11-26 441
UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0xbb in position 38: invalid start byte Python 编码中最常见同时也是最顽固的两个错误： UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 0-1: ordinal not in range(128) UnicodeDecodeError: ‘utf-8’ codec ca
python打包后报错UnicodeDecodeError: utf-8 codec can t decode byte 0xb1 in position 10: invalid start byte
12-19
在Python打包后报错UnicodeDecodeError: utf-8 codec can't decode byte 0xb1 in position 10: invalid start byte的情况下，这通常是由于文件编码问题引起的。解决此问题的一种方法是在打包时指定编码格式。可以使用以下命令将文件打包为zip文件，并指定编码格式为utf-8： ```shell zip -r --encoding=UTF-8 archive.zip folder/ ``` 其中，archive.zip是打包后的文件名，folder/是要打包的文件夹路径。指定编码格式为UTF-8可以确保在解压缩时不会出现编码问题。 另外，还可以尝试在代码中使用Python的codecs模块来指定文件编码格式。例如，如果要打开一个名为file.txt的文件并指定编码格式为utf-8，可以使用以下代码： ```python import codecs with codecs.open('file.txt', 'r', encoding='utf-8') as f: # do something with the file ```
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值