Java自动检测文件编码（字符集）

最新推荐文章于 2021-02-16 22:05:43 发布

weixin_30699443

最新推荐文章于 2021-02-16 22:05:43 发布

阅读量598

点赞数

CC 4.0 BY-SA版权

文章标签： java

原文链接：http://www.cnblogs.com/chenhuanBlogs/p/10229413.html

本文介绍了一种使用IBM ICU4J库检测文件编码并读取的方法，通过CharsetDetector类可以自动识别文件的字符集，如gb18030、big5、utf-8等，确保文件内容正确读取。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >


// 使用之前请调用getAllDetectableCharsets()检查是否满足要求，中文仅有{gb18030, big5,utf-*}
import com.ibm.icu.text.CharsetDetector;
import com.ibm.icu.text.CharsetMatch;

static HashSet<String> getWhiteList(String fileName) {
        if (fileName == null) {
            return null;
        }
        HashSet<String> rs = null;
        InputStreamReader isr = null;
        BufferedReader br = null;
        try {
            FileInputStream fis = new FileInputStream(fileName);
            BufferedInputStream bis = new BufferedInputStream(fis);// markSupported
            CharsetMatch charsetMatch = new CharsetDetector().setText(bis).detect();
            if (charsetMatch != null) {
                isr = new InputStreamReader(bis, charsetMatch.getName());
                System.out.println("Open '" + fileName + " ' with charset: " + charsetMatch.getName());
            } else {
                isr = new InputStreamReader(bis);
                System.out.println(
                        "Open '" + fileName + " ' with charset( default, because no charset is detected by IBM.ICU4J): "
                                + isr.getEncoding());
            }
            br = new BufferedReader(isr);
            String line = null;
            rs = new HashSet<String>();
            while ((line = br.readLine()) != null) {
                rs.add(line);
            }
        } catch (FileNotFoundException e) {
            System.out.println("WARNING: File '" + fileName + "' is not exist.");
        } catch (IOException e) {
            System.out.println("WARNING: IOException occured when read Whitelist.");
        } finally {
            try {
                if (br != null) {
                    br.close();
                }
            } catch (IOException e) {
                System.out.println("WARNING: IOException occured when close BufferedReader.");
            }
        }
        return rs;
    }