Python2未知编码字符串转为utf-8编码

关注

原创最新推荐文章于 2026-09-07 15:21:54 发布 1.8k 阅读 AI 写同款· GEO 优化 ›

字符串编码：ASCII、GB系列、Unicode、UTF-8 对字符串编码进行汇总和区别编码的由来：计算机自己能理解的“语言”是二进制数，最小的信息标识是二进制数，8个二进制位表示一个字节；而我们人类所能理解的语言文字则是一套由英文字母、汉语汉字、标点符号字符、阿拉伯数字等等很多的字符构成的字符集。如果要让计算机来按照人类的意愿进行工作，则必须把人类所使用的这些字符集转换为计算机所能理解的二进制码，这个过程就是编码，他的逆过程称为解码。最... 阅读详情

Python2未知编码字符串转为utf-8编码

Python的编码问题总是非常烦人，一不小心就出来乱码，本函数采用的方法为：分别用try判断是否能解码成功，如果能成功表明为相应编码，解码成功后再编码为utf-8，代码如下：

# -*- coding: utf-8 -*-

def to_utf8(data):
    try:
        # print("Trying decode with utf-8 ...")
        data_de = data.decode("utf-8")
        # print("Use utf-8 decode success")
        # print("Trying encode with utf-8 ...")
        # data = data_de.encode("utf-8")
        # print("Use utf-8 encode success\n")
        return data
    except:
        # print("Use utf-8 decode failed\n")
        pass

    try:
        # print("Trying decode with ascii ...")
        data_de = data.decode("ascii")
        # print("Use ascii decode success")
        # print("Trying encode with utf-8 ...")
        data = data_de.encode("utf-8")
        # print("Use utf-8 encode success\n")
        return data
    except:
        # print("Use ascii decode failed\n")
        pass

    try:
        # print("Trying decode with gbk ...")
        data_de = data.decode("gbk")
        # print("Use gbk decode success")
        # print("Trying encode with utf-8 ...")
        data = data_de.encode("utf-8")
        # print("Use utf-8 encode success\n")
        return data
    except:
        # print("Use gbk decode failed\n")
        pass

    try:
        # print("Trying decode with utf-16-le ...")
        data_de = data.decode("utf-16-le")
        # print("Use utf-16-le decode success")
        # print("Trying encode with utf-8 ...")
        data = data_de.encode("utf-8")
        # print("Use utf-8 encode success\n")
        return data
    except:
        # print("Use utf-16-le decode failed\n")
        pass

    # 如果以上几种都不能解码成功，返回传过来的字符串
    return data