win环境下python3操作中文PDF文件提取中文信息

最新推荐文章于 2024-05-31 09:41:16 发布

置顶作小寒

最新推荐文章于 2024-05-31 09:41:16 发布

阅读量2.4k

点赞数 1

分类专栏： python pandas科学计算 NLP

本文链接：https://blog.youkuaiyun.com/qq_34069180/article/details/89843810

版权

python 同时被 3 个专栏收录

109 篇文章

订阅专栏

pandas科学计算

3 篇文章

订阅专栏

NLP

2 篇文章

订阅专栏

博客介绍了从GitHub下载pdfminer.six并解压文件，因处理中文文件需预编译，处理CJK语言要在运行setup.py install前做相应操作，编译后进行setup并成功生成所需文件。还分享经验，要勤看源代码和GitHub，不能只调包。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

https://github.com/pdfminer/pdfminer.six

下载后解压文件

由于处理中文文件，需要预编译

要处理CJK语言，请在运行setup.py install之前执行以下操作：

mkdir pdfminer\cmap

python tools\conv_cmap.py -c B5=cp950 -c UniCNS-UTF8=utf-8 pdfminer\cmap Adobe-CNS1 cmaprsrc\cid2code_Adobe_CNS1.txt
python tools\conv_cmap.py -c GBK-EUC=cp936 -c UniGB-UTF8=utf-8 pdfminer\cmap Adobe-GB1 cmaprsrc\cid2code_Adobe_GB1.txt
python tools\conv_cmap.py -c RKSJ=cp932 -c EUC=euc-jp -c UniJIS-UTF8=utf-8 pdfminer\cmap Adobe-Japan1 cmaprsrc\cid2code_Adobe_Japan1.txt
python tools\conv_cmap.py -c KSC-EUC=euc-kr -c KSC-Johab=johab -c KSCms-UHC=cp949 -c UniKS-UTF8=utf-8 pdfminer\cmap Adobe-Korea1 cmaprsrc\cid2code_Adobe_Korea1.txt
python setup.py install

正在执行，也很简单对不对

中日韩文字编译后，开始setup

成功！20181108版本

终于生成啦。很棒了

需要的文件是

import argparse
import logging
import six
import sys
import pdfminer.settings
pdfminer.settings.STRICT = False
import pdfminer.high_level
import pdfminer.layout
from pdfminer.image import ImageWriter


def extract_text(files=[], outfile='-',
            _py2_no_more_posargs=None,  # Bloody Python2 needs a shim
            no_laparams=False, all_texts=None, detect_vertical=None, # LAParams
            word_margin=None, char_margin=None, line_margin=None, boxes_flow=None, # LAParams
            output_type='text', codec='utf-8', strip_control=False,
            maxpages=0, page_numbers=None, password="", scale=1.0, rotation=0,
            layoutmode='normal', output_dir=None, debug=False,
            disable_caching=False, **other):
    if _py2_no_more_posargs is not None:
        raise ValueError("Too many positional arguments passed.")
    if not files:
        raise ValueError("Must provide files to work upon!")

    # If any LAParams group arguments were passed, create an LAParams object and
    # populate with given args. Otherwise, set it to None.
    if not no_laparams:
        laparams = pdfminer.layout.LAParams()
        for param in ("all_texts", "detect_vertical", "word_margin", "char_margin", "line_margin", "boxes_flow"):
            paramv = locals().get(param, None)
            if paramv is not None:
                setattr(laparams, param, paramv)
    else:
        laparams = None

    imagewriter = None
    if output_dir:
        imagewriter = ImageWriter(output_dir)

    if output_type == "text" and outfile != "-":
        for override, alttype in (  (".htm", "html"),
                                    (".html", "html"),
                                    (".xml", "xml"),
                                    (".tag", "tag") ):
            if outfile.endswith(override):
                output_type = alttype

    if outfile == "-":
        outfp = sys.stdout
        if outfp.encoding is not None:
            codec = 'utf-8'
    else:
        outfp = open(outfile, "wb")


    for fname in files:
        with open(fname, "rb") as fp:
            pdfminer.high_level.extract_text_to_fp(fp, **locals())
    return outfp

这次的经验就是，勤看源代码，找出版本问题，不能单单只会调包而深入代码研究原理。勤看GitHub，国内大部分内容都是直接照抄国外开源内容....