Deep Learning for Information Extraction From Digital Documents: An Innovative Approach to Automatic Parsing and Rich Text Extraction From PDF Files

Deep Learning for Information Extraction From Digital Documents: An Innovative Approach to Automatic Parsing and Rich Text Extraction From PDF Files

Yavuz Kömeçoğlu, Serdar Akyol, Fethi Su, Başak Buluz Kömeçoğlu
DOI: 10.4018/978-1-6684-4045-2.ch009
OnDemand:
(Individual Chapters)
Available
$37.50
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

Print-oriented PDF documents are excellent at preserving the position of text and other objects but have difficulties in processing. Processable PDF documents will provide solutions to the unique needs of different sectors by paving the way for many innovations such as searching within documents, linking with different documents, or restructuring in a format that will increase the reading experience. In this chapter, a deep learning-based system design is presented that aims to export clean text content, separate all visual elements, and extract rich information from the content without losing the integrated structure of content types. While the F-RCNN model using the Detectron2 library was used to extract the layout, the cosine similarities between the wod2vec representations of the texts were used to identify the related clips, and the transformer language models were used to classify the clip type. The performance values on the 200-sample data set created by the researchers were determined as 1.87 WER and 2.11 CER in the headings and 0.22 WER and 0.21 CER in the paragraphs.
Chapter Preview
Top

Introduction

Technology refers to the body of information that is used to produce useful products and to design new products, or all the physical processes that transform inputs into outputs and the social arrangements accompanying this transformation. The role of technology in the field of international competition has become so decisive that today the classification of economic development has gradually turned into technology producing and non-producing countries. The most important subject of today's technological development is data and its processing. The huge increase in data volume and data diversity, the fact that even simple daily activities produce data, require very large volumes of warehouses to store this data. At the same time, the processing of these data and the ability to quickly analyze them for the purpose make the dimensions important in terms of data storage and processing capacity. The analysis of data and the size of the data are also factors affecting competition in areas such as trade, energy, and economy. For this reason, to obtain economic value from big data, it is important to process the correct data with advanced analytical methods, to keep up with the new developing technologies with the machine learning method, and to affect the decision-making processes.

In many countries, the ecosystem, which includes public institutions/organizations, the private sector, and academia, sets targets for artificial intelligence applications and quality data. Big data collection platforms, increasing the capacity of analysis and decision making and implementation accordingly, and creating problem pools for sectors are the main ones (Ferrara et al.,2014; Chang et al.,2006). Access to quality data by extracting valuable information from data is a core mission of many businesses intelligence services that require large-scale document processing. Understanding the documents included in the business processes in terms of page layout allows the establishment of the contextual structure at the stage of semantically interpreting the document terms in it. In this book chapter, the focus is on PDF, which is the most preferred document format open to sharing electronically for security reasons, since the possibility of making changes and editing the document is limited. PDF is the most widely used format for book, magazine, newspaper, and article-like document formats and is developed by Adobe Systems. On the other hand, it is largely kept in unstructured PDF format in the scientific literature (Jimeno Yepes et al., 2021). This format, which is very suitable for preserving basic visual elements, also has great difficulties in terms of automatic processing of these visual contents by machines. Extracting non-natural language content such as figures and tables, which often provide a summary and worthwhile information, as well as text in formatted formats with a focus on visuality, from a PDF file is another challenge. To provide comprehensive information extraction, it is necessary to determine the document layout and to parse the visually enriched texts and non-natural language content in a machine-structured format with background and other special formal features. Based on this need, the authors make use of the information contained in PDF documents with a complex layout, image processing, and deep learning methods in this book chapter and propose a solution that enables the document outline to be determined, parsed into elements, defined as a clip, and the title, subtitle, image, and actual text content of the clip itself to be output in reading order.

Key Terms in this Chapter

Regex: The abbreviation of the term “regular expression”. It is a string of characters developed in theoretical computer science and formal language theory that allows to create patterns for matching, locating, and managing text.

Ngram (N-Gram): It is the general name given to consecutive arrays consisting of n elements. In the context of NLP and computational linguistics, the elements that make up n-grams can be selected as words, syllables, phonemes or letters in a spoken text or written text. The variable expressed with n represents the value for which the repetition is controlled, while the gram corresponds to the weight of this repeated value in the array.

Portable Document Format (PDF): A document format developed by Adobe that can preserve the layout of all the elements in it independently of hardware and operating system and can be viewed on any system.

Layout: It is the name given to the placement and order of the elements in the document.

Optical Character Recognition (OCR): A technology of converting mechanical and handwriting to digital text character by character on scanned images.

Complete Chapter List

Search this Book:
Reset