UnicodeDecodeError: 'utf8' codec can't decode bytes&nbsp

▼

编码问题真的是个很常见且困扰的问题:
原文是ansi编码,(windows下默认编码),换到linux下工作,需要转为utf8编码,文件多所以写了个小程序,
其中执行到这:outfile.write(line.encode('utf-8')),会报错:
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 0-1: invalid data.
具体原因可以参见: http://www.crifan.com/unicodeencodeerror_gbk_codec_can_not_encode_character_in_position_illegal_multibyte_sequence/
修改为:
outfile.write(line.decode('gbk','ignore').encode('utf-8','ignore')).即可正确运行.

如果是utf8变为ansi:
这样写即可:
outfile.write(line.decode('utf-8','ignore').encode('gbk','ignore'))