Electronic device, method, and non-transitory storage medium for optical character recognition

Abstract

According to an embodiment, an electronic device for optical character recognition (OCR) and an operating method of the electronic device are provided. The electronic device for optical character recognition includes a memory; and a processor electrically connected with the memory, wherein the processor is configured to store at least one content and at least one lexicon individually corresponding to the at least one content in the memory, obtain an image of at least one character scanned by an electronic pen on a printed document, identify a content corresponding to the image from the at least one content, identify a lexicon corresponding to the identified content from the at least one lexicon, and obtain result information recognized by performing optical character recognition on the image based on the identified lexicon and original data of the identified content. Other various embodiments are also possible.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to an electronic device, method, and non-transitory storage medium for optical character recognition. Background Art

[0002] Optical character recognition (OCR) is a technology that uses light to read text. Specifically, it shines light onto handwritten or printed text, symbols, or marks, converts the reflected light into electrical signals, and reads the text via the electrical signals.

[0003] Optical character recognition, which was once limited to large devices such as scanners, is expanding its application to small devices such as cameras, mobile devices, tablets or smart pens (electronic pens). Summary of the Invention

[0004] Technical issues

[0005] However, conventional optical character recognition technology has a low recognition rate problem. For smart pens that acquire digital text data through dynamic scanning, the problem of poor recognition is even more serious.

[0006] Traditional optical character recognition technology has limited applications because it scans and reads analog images and saves them as digital data.

[0007] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above may be applicable as prior art to the present disclosure.

[0008] Technical Solution

[0009] According to various embodiments, an electronic device, a method, and a non-transitory storage medium for optical character recognition with an enhanced recognition rate may be provided.

[0010] According to various embodiments, an electronic device for optical character recognition includes a memory and a processor electrically connected to the memory. The processor is configured to: store at least one content and at least one lexeme table corresponding to the at least one content in the memory; obtain an image of at least one character scanned on a printed document by an electronic pen; identify the content corresponding to the image from the at least one content; identify the lexeme table corresponding to the identified content from the at least one lexeme table; and obtain recognition result information obtained by performing optical character recognition on the image based on the identified lexeme table and raw data of the identified content.

[0011] According to various embodiments, a method for performing optical character recognition (OCR) by an electronic device includes: storing at least one content and at least one word part table corresponding individually to the at least one content in a memory of the electronic device; obtaining an image of at least one character scanned by an electronic pen on a printed document; identifying content corresponding to the image from the at least one content, identifying a word part table corresponding to the identified content from at least one word part table, and obtaining result information recognized by performing optical character recognition on the image based on the identified word part table and original data of the identified content.

[0012] According to various embodiments, a non-transitory storage medium storing instructions is provided, the instructions being executed by a processor to enable the processor to: store at least one content and at least one word part table individually corresponding to the at least one content in a memory; obtain an image of at least one character scanned by an electronic pen on a printed document; identify content corresponding to the image from the at least one content, identify a word part table corresponding to the identified content from at least one word part table, and based on the identified word part table and original data of the identified content, obtain result information recognized by performing optical character recognition on the image.

[0013] According to various embodiments, an electronic device includes: a first component of a housing; a pen tip formed at an end of the first component; a second component of the housing configured to be detachable from the end of the first component; and an optical character recognition module mounted within the first component. The second component contains ink and is configured to fill the pen tip with ink when the second component is coupled to the end of the first component to cover the pen tip. The optical character recognition module is configured to scan at least one character from at least a portion of a printed document for optical character recognition. At least a portion of the printed document is colored by the ink when in contact with the pen tip.

[0014] Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the disclosure.

[0015] Before proceeding with the following detailed description, it may be helpful to define certain words and phrases used throughout this patent document: the terms "include" and "comprising" and their derivatives mean including but not limited to; the term "or" is open-ended, meaning and / or; the phrases "associated with" and "related thereto" and their derivatives may mean including, comprised within, interconnected with, contained, contained within, connected to or connected with, coupled to or coupled with, communicable with, cooperating with, interleaved with, juxtaposed with, proximate to, subject to or closely associated with, having, having an attribute of, and the like; and the term "controller" means any device, system, or component thereof that controls at least one operation, such device being implemented in hardware, firmware, or software, or some combination of at least two. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.

[0016] In addition, the various functions described below can be implemented or supported by one or more computer programs, each of which is formed of a computer-readable program code and embedded in a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, processes, functions, objects, classes, instances, related data, or parts thereof that are suitable for being implemented in a suitable computer-readable program code. The phrase "computer-readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as a read-only memory (ROM), a random access memory (RAM), a hard drive, a compact disc (CD), a digital video disc (DVD), or any other type of memory. "Non-transitory" computer-readable medium does not include wired, wireless, optical, or other communication links that transmit temporary electricity or other signals. Non-transitory computer-readable media include media that can permanently store data and media that can store and then overwrite data, such as rewritable optical discs or erasable storage devices.

[0017] Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.

[0018] Advantageous Effects of the Invention

[0019] As apparent from the above description, according to embodiments, in an electronic device and an operating method for an electronic device, content corresponding to a printed document and a lexeme table generated corresponding to the content are mapped and pre-stored. If at least one character is scanned from a printed document, information obtained by performing optical character recognition on an image of the scanned at least one character is obtained based on the pre-stored raw data and lexeme table. This allows for enhanced recognition rates for the scanned at least one character and various additional information of the printed document. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, wherein like reference numerals represent like parts.

[0021] A more complete understanding of the present disclosure and its many attendant aspects will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, in which:

[0022] Figure 1 is a diagram showing a network environment according to an embodiment;

[0023] Figure 2 is a diagram showing an example configuration of a first electronic device, a second electronic device, and a server according to an embodiment;

[0024] Figure 3 is a diagram showing an example configuration of a server according to an embodiment;

[0025] Figure 4A 、 Figure 4B and Figure 4C is a diagram showing a specific example configuration of a second electronic device according to the embodiment;

[0026] Figure 5 is a view showing an example of a second electronic device scanning a character according to an embodiment;

[0027] Figure 6 is a diagram showing an example operation process of a server according to an embodiment;

[0028] Figure 7 is a diagram showing an example operation process of a server according to an embodiment;

[0029] Figure 8 is a view showing an example of a second electronic device scanning a character according to an embodiment;

[0030] Figure 9A 、 Figure 9B 、 Figure 9C 、 Figure 9D 、 Figure 9E 、 Figure 9F and Figure 9G is a diagram showing an example operation process of a server according to an embodiment;

[0031] Figure 10 is a diagram illustrating an example operation process for performing optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment;

[0032] Figure 11 is a diagram showing an example screen displayed on a first electronic device according to an embodiment;

[0033] Figure 12A and Figure 12B is a diagram showing an example screen displayed on a first electronic device according to an embodiment;

[0034] Figure 13 is a diagram illustrating an example operation process for performing optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment;

[0035] Figure 14 is a diagram illustrating an example operation process for performing optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment;

[0036] Figure 15A 、 Figure 15B and Figure 15C is a diagram showing an example screen displayed on a first electronic device according to an embodiment;

[0037] Figure 16A and Figure 16B is a diagram showing an example screen displayed on a first electronic device according to an embodiment;

[0038] Figure 17A and Figure 17B is a diagram showing an example screen displayed on a first electronic device according to an embodiment; and

[0039] Figure 18 is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0040] Throughout the drawings, like reference numerals will be understood to refer to like elements, components and structures. DETAILED DESCRIPTION

[0041] Discussed below Figures 1 to 18 The various embodiments used to describe the principles of the present disclosure in this patent document are intended only as illustrations and should not be interpreted in any way as limiting the scope of the present disclosure. Those skilled in the art will understand that the principles of the present disclosure can be implemented in any suitably arranged system or device.

[0042] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to embodiments of the present disclosure, the electronic device is not limited to those described above.

[0043] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but rather include various changes, equivalents or alternatives of the corresponding embodiments. With respect to the description of the accompanying drawings, similar figure numerals may be used to refer to similar or related elements. It should be understood that the singular form of the noun corresponding to the item may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include all possible combinations of the items listed together in a corresponding phrase. As used herein, terms such as "first" and "second" or "first" and "second" may be used to simply distinguish a corresponding component from another component without limiting the component in other respects (e.g., importance or order). It should be understood that if an element (e.g., a first element) is referred to as being "coupled to," "connected to," or "coupled to" another element (e.g., a second element) (with or without the term "operatively" or "communicatively"), it should be understood that the element may be coupled to the other element directly (e.g., by wire), wirelessly, or via a third element.

[0044] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms such as "logic," "logic block," "component," or "circuit." A module may be a single integrated component, or its smallest unit or component, adapted to perform one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0045] Various embodiments as described herein may be implemented as software (e.g., program 140) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) readable by a machine (e.g., electronic device 101). For example, a processor (e.g., processor 120) of a machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute at least one of the one or more instructions with or without further components under the control of the processor. This allows the machine to be operated to perform at least one function in accordance with the called at least one instruction. The one or more instructions may include compiler-generated code or interpreter-executable code. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between situations where data is semi-permanently stored in the storage medium and situations where data is temporarily stored in the storage medium.

[0046] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a commodity between a buyer and a seller. The computer program product may be in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or via an application store (e.g., PlayStore). TM ), or directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated or at least temporarily stored on a machine-readable storage medium, such as a memory on a manufacturer's server, a server of an app store, or a relay server.

[0047] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as performed by a corresponding one of the multiple components before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or heuristically, or one or more of the operations may be performed or omitted in a different order, or one or more other operations may be added.

[0048] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 can communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 can communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0049] The processor 120 may execute, for example, software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of the electronic device 101 coupled to the processor 120, and may perform various data processing or calculations. According to an embodiment, as at least part of the data processing or calculation, the processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the commands or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)), and a secondary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that may operate independently of or in conjunction with the main processor 121. Additionally or alternatively, the secondary processor 123 may be adapted to consume less power than the main processor 121 or be specific to a designated function. The secondary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121 .

[0050] The auxiliary processor 123 may replace the main processor 121 when the main processor 121 is in an inactive (e.g., sleep) state, or control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101 together with the main processor 121 when the main processor 121 is in an active state (e.g., executing an application). Depending on the embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

[0051] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data of commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0052] The program 140 may be stored as software in the memory 130 and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0053] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0054] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 can include, for example, a speaker or an earpiece. The speaker can be used for general purposes, such as playing multimedia or playing recordings, while the earpiece can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker or as a component of the speaker.

[0055] The display device 160 can visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling a corresponding one of the display, the hologram device, and the projector. Depending on the embodiment, the display device 160 may include a touch circuit adapted to detect a touch, or a sensor circuit adapted to measure the strength of the force caused by the touch (e.g., a pressure sensor).

[0056] The audio module 170 can convert sound into an electrical signal, and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly coupled to the electronic device 101.

[0057] The sensor module 176 can detect the operating state (e.g., power or temperature) of the electronic device 101 or the environmental state (e.g., the state of the user) outside the electronic device 101, and then generate an electrical signal or a data value corresponding to the detected state. Depending on the embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared sensor (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0058] The interface 177 may support one or more specified protocols for direct (e.g., wired) or wireless coupling of the electronic device 101 to an external electronic device (e.g., electronic device 102). Depending on the embodiment, the interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

[0059] The connection terminal 178 may include a connector via which the electronic device 101 may be physically connected to an external electronic device (e.g., the electronic device 102). Depending on the embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0060] The haptic module 179 may convert electrical signals into mechanical stimulation (eg, vibration or motion) or electrical stimulation, which the user may recognize via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0061] The camera module 180 can capture still images or moving images. Depending on the embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

[0062] The power management module 188 may manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as, for example, at least a portion of a power management integrated circuit (PMIC).

[0063] The battery 189 may supply power to at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable main battery, a rechargeable secondary battery, or a fuel cell.

[0064] The communication module 190 can support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and performing communication via the established communication channel. The communication module 190 may include one or more communication processors that can operate independently of the processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate via a first network 198 (e.g., such as Bluetooth TM , a short-range communication network such as Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (for example, a long-range communication network such as a cellular network, the Internet, or a computer network (for example, a LAN or a wide area network (WAN)). These various types of communication modules may be implemented as a single component (for example, a single chip), or may be implemented as multiple components separated from each other (for example, multiple chips). The wireless communication module 192 may use the user information (for example, an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196 to identify and authenticate the electronic device 10 in the communication network (for example, the first network 198 or the second network 199).

[0065] The antenna module 197 can send or receive signals or power to the outside (e.g., an external electronic device) or from the outside (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiator formed by a conductor or conductive pattern formed on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include one or more antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (e.g., the first network 198 or the second network 199) can be selected from a plurality of antennas by, for example, the communication module 190. Signals or power can then be sent or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, other components other than the radiator (e.g., a radio frequency integrated circuit (RFIC)) may be further formed as components of the antenna module 197.

[0066] At least some of the above components can be coupled to each other and transmit signals (e.g., commands or data) between each other via an inter-peripheral communication scheme (e.g., a bus, general-purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI).

[0067] According to an embodiment, instructions or data may be sent or received between electronic device 101 and external electronic device 104 via server 108 coupled to second network 199. Each of electronic devices 102 and 104 may be of the same or different type as electronic device 101. According to an embodiment, all or some operations to be performed at electronic device 101 may be performed at one or more of external electronic devices 102, 104, or 108. For example, if electronic device 101 is to automatically perform a function or service, or in response to a request from a user or another device, electronic device 101 may request one or more external electronic devices to perform at least a portion of the function or service, instead of or in addition to performing the function or service. The one or more external electronic devices receiving the request may perform at least a portion of the requested function or service, or additional functions or services related to the request, and transmit the results of the execution to electronic device 101. Electronic device 101 may provide the results (whether or not further processed) as at least part of a response to the request. To this end, for example, cloud computing, distributed computing, or client-server computing technologies may be used.

[0068] Figure 2 is a diagram illustrating an example configuration of a first electronic device, a second electronic device, and a server according to an embodiment. Figure 3 is a diagram showing an example configuration of a server according to the embodiment.

[0069] Reference Figure 1 and Figure 2 According to an embodiment, a network environment for optical character recognition may be configured via communication between a first electronic device 101, a second electronic device 102 (eg, an electronic pen), and a server 108 (eg, a third electronic device).

[0070] According to an embodiment, when the second electronic device 102 scans at least one character (e.g., a string of characters) on a printed document (e.g., text printed on a sheet of paper or cloth), the processor 120 of the first electronic device 101 may receive image data of the scanned at least one character from the second electronic device 102 via the communication module 190. The processor 120 may obtain an image to be read based on the received image data until the character scanning is completed, and control the transmission of the image to be read to the server 108 via the communication module 190. The communication module 190 may communicate with the second electronic device 102 via, for example, a first communication scheme (e.g., short-range communication such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)), and may communicate with the server 108 via, for example, a second communication scheme (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a local area network (LAN) or a wide area network (WAN)). The communication module 190 may communicate with the second electronic device 102 and / or the server 108 via other communication schemes.

[0071] According to an embodiment, the processor 120 of the first electronic device 101 may configure an object so that at least one content that can be provided from the server 108 can be selected based on information related to the content received from the server 108, and control the display 160 to display a screen (e.g., a first screen) including the configured object. When at least one of the objects displayed on the first screen is selected, the processor 120 may identify at least one content that individually corresponds to the selected at least one object, and transmit information related to the identified at least one content to the server 108 via the communication module 190. The processor 120 may receive result information obtained by optical character recognition in the server 108, and control the display 160 to display the received result information.

[0072] According to an embodiment, the processor 120 of the first electronic device 101 may obtain the original data of at least one content and at least one word part table corresponding to the at least one content separately, and based on the obtained original data and at least one word part table, use an optical character recognition algorithm (e.g., an application, function, or program) to read the image of at least one character scanned by the second electronic device, and obtain information obtained by optical character recognition from the read image. After identifying the information obtained by optical character recognition, the processor 120 may compare at least one word read from the image with the original data of the identified content based on the word part table corresponding to the identified content, and may correct the at least one word. The processor 120 may obtain information obtained by optical character recognition, which includes at least one corrected word. Here, the information obtained by optical character recognition may show a higher character recognition rate than the result of reading the image. The processor 120 may control the display 160 to display the obtained result information. As another example, the processor 120 may send the obtained result information to another external electronic device.

[0073] According to an embodiment, the processor 120 of the first electronic device 101 can obtain additional information of the identified content and control the display 160 to display the obtained additional information together with the obtained result information. Here, the additional information may include at least one of the following items: the title of the content, information about the author / publisher of the content, the subtitle of the content, the page of the content, information indicating a part including the optical character recognition result information (for example, a subtitle or chapter including the optical character recognition result information), a mapped image related to the result information, an image related to the result information (or a specific part of the image related to the result information), a descriptive document related to the result information, audio related to the result information (or a specific part of the audio related to the result information), similar result information of other users, document source information of the content (url or file path), and information of an object or related document used to edit the result information.

[0074] According to an embodiment, when the second electronic device 102 switches to a mode for word search (e.g., the second mode) and scans at least one character on a printed document, the processor 120 sends a word search request for the scanned at least one character to the server 108, obtains search information of at least one word corresponding to the scanned at least one character from the server 108 in response to the request, and controls the display 160 to display the obtained search information.

[0075] According to an embodiment, after providing information obtained through optical character recognition, when the second electronic device 102 rescans at least one character at a position corresponding to the result information on the printed document, the processor 120 may identify at least one word corresponding to the scanned at least one character and send a message of a word search request including the identified at least one word to the server 108. The processor 120 may obtain search information obtained by the server 108 in response to the word search request. According to another embodiment, the processor 120 may use an application (e.g., a dictionary application, program, or function) for word search executed on the first electronic device 101 to obtain search information for the at least one word corresponding to the scanned at least one character from dictionary data stored in the memory 130.

[0076] According to an embodiment, the processor 120 may control the display 160 to display the acquired search information and information obtained through optical character recognition. When a specific object (an object for a word list) displayed on a screen (e.g., a first screen) of the display is selected, the processor 120 may control the display 160 to display history information of previously searched words.

[0077] According to an embodiment, the memory 130 of the first electronic device 101 may store image data received from the second electronic device 102 and may store information obtained through optical character recognition received from the server 108. According to an embodiment, the memory 130 may store information related to at least one content received from the server 108 and store a composition of the first screen configured based on the information related to the at least one content. According to an embodiment, the memory 130 may store original data of at least one content provided from the server 108 and at least one lexeme table corresponding solely to the at least one content.

[0078] According to an embodiment, the display 160 of the first electronic device 101 may display a first screen for selecting or searching for at least one content and a screen (eg, a second screen) including information obtained through optical character recognition.

[0079] Reference Figure 2 According to an embodiment, the second electronic device 102 (e.g., an electronic pen) may scan at least one character (e.g., a character string) on ​​a printed document using an optical character recognition function, and transmit image data of the scanned at least one character to the first electronic device 101 through a first communication scheme (e.g., Bluetooth communication). The second electronic device 102 may selectively execute a mode for optical character recognition (e.g., a first mode) or a mode for performing a word search on the at least one character scanned on the printed document (e.g., a second mode).

[0080] Reference Figure 2According to an embodiment, the server 108 (eg, a third electronic device) may include a processor 201 , a communication module 203 , and a memory 205 .

[0081] According to an embodiment, as a preprocessing operation before performing optical character recognition, the processor 201 of the server 108 (eg, the third electronic device) may store at least one content in the memory 205, the content including a string and at least one protocol individually corresponding to the at least one content.

[0082] Reference Figure 3 , the processor 201 can analyze the original data of at least one content 301, identify the positions of the words included in the analyzed original data, and generate a lexeme table 303 corresponding to each of the at least one content 301 based on the identified positions. The processor 201 can use the identification information (document ID) to map the generated at least one lexeme table 303 with the at least one content 301 and store the result in the memory 205. Here, the at least one content can be stored together with the content-related information 305 including the identification information (document ID) and the file path information (file path). Each lexeme table may include information 307 related to the following items: identification information (document ID) for identifying the mapped content, the words included in the original data of the mapped content, and the lexeme table including the position information of each word. According to an embodiment, when a request to upload at least one content is received from the first electronic device 101 or an external electronic device, the processor 201 can generate at least one lexeme table corresponding to the at least one content individually according to the request.

[0083] According to an embodiment, the processor 201 may obtain an image of at least one character scanned by the second electronic device 102 from the first electronic device 101, identify content corresponding to the image from content stored in the memory 205, and obtain original data of the identified content and a lexeme table corresponding to the identified content from the memory 205. Here, the identified content may be content selected by a user from at least one content before scanning the print image, or content uploaded when a request is made to upload content corresponding to the print image.

[0084] According to an embodiment, the processor 201 may obtain result information obtained by optical character recognition from the image of the scanned at least one character based on the obtained lexeme table and the original data, and control the communication module 203 to send the obtained result information to the first electronic device 101 or an external electronic device. The processor 201 may compare at least one word read from the image of the scanned at least one character with the original data of the identified content based on the lexeme table corresponding to the identified content, correct the at least one word, and obtain information obtained by optical character recognition, which includes the corrected at least one word.

[0085] According to an embodiment, the processor 201 may obtain additional information of the identified content. The additional information may include at least one of the following: a page of the original data including the optical character recognition result, an author of the original data, a title of the original data, or information indicating a portion including the optical character recognition result.

[0086] According to an embodiment, when a search request for at least one character scanned by the second electronic device 102 is received via the first electronic device 101, the processor 201 may identify at least one word of the scanned at least one character and provide search information for the identified word. Here, the search information may include at least one of details (e.g., dictionary meaning), synonyms, antonyms, examples, or sources of the identified word.

[0087] According to an embodiment, when the second electronic device 102 receives a word search request for at least one scanned character from the first electronic device 101 in a search mode state, the processor 201 can obtain search information of at least one word read from the image of the at least one scanned character and provide the obtained search information to the first electronic device 101.

[0088] According to an embodiment, when at least one character is rescanned at a position corresponding to the result information of the printed document after the information obtained by optical character recognition is provided, the processor 201 may receive a request to search for at least one word corresponding to the scanned at least one character from the first electronic device 101. The processor 201 may provide search information of the at least one word to the first electronic device 101 according to the search request.

[0089] According to an embodiment, the processor 201 of the server 108 (which may be a hardware module or a software module (e.g., an application program)) may be a hardware component (function) or a software component (program), and include at least one of the following: various sensors, a data measurement module, an input / output interface, a module for managing the status or environment of the server 108, or a communication module included in the server 108. According to an embodiment, the processor 201 may include, for example: a hardware module, a software module, a firmware module, or a combination of two or more thereof. According to an embodiment of the present disclosure, the processor 201 may not include at least some of these components, or may include other components for performing image processing operations in addition to these components.

[0090] According to an embodiment, the communication module 203 of the server 108 can be connected to the first electronic device 101 via a network, and the communication module 203 can receive at least one content requested to be uploaded from the first electronic device 101 or an external electronic device (not shown), and send at least one content requested to be downloaded by the first electronic device 101 or an external electronic device (not shown). The communication module 203 can send information obtained by the processor 201 through optical character recognition to the first electronic device 101. The communication module 203 can communicate with the first electronic device 101 via a second communication scheme.

[0091] The above has been combined Figure 2 The first electronic device 101 and the server 108 of FIG. 100 describe the main components of the first electronic device 101 and the server 108. However, according to various embodiments, Figure 2 The components shown in FIG are not essential components, and each of the electronic device 101 and the server 108 can be implemented with more or fewer components than those shown. Figure 2 The described location of each of the first electronic device 101 and the server 108 may vary according to embodiments.

[0092] Figure 4A 、 Figure 4B and Figure 4C is a diagram showing a specific example configuration of a second electronic device according to the embodiment. Figure 5 is a view illustrating an example in which a second electronic device scans characters according to an embodiment.

[0093] Reference Figure 4A and Figure 4B According to an embodiment, the second electronic device 102 may include a first component 410 and a second component 420 detachably provided to the first component 410. The second electronic device 102 may include a pen tip 401 formed at the end of the first component 410, an optical character recognition module 403, a processor 405, a communication module 407, and a battery 409 provided inside the first component 410. The second electronic device may include various other components. According to an embodiment, at least a portion of the processor 405 and the communication module 407 may be formed on a printed circuit board or in a chip. The processor 405, the communication module 407, the optical character recognition module 403, and the battery 409 may be electrically connected to each other.

[0094] According to an embodiment, the pen tip 401 of the second electronic device 102 may protrude from the side surface of the first component 410. According to an embodiment, when the second component 420 is installed to cover the pen tip 401 at the side surface where the pen tip 401 of the first component 410 is located, the ink contained in the second portion 423 may be filled. Figure 5As shown, when the pen tip 401 contacts the location to be scanned on the printed document 501, the scan area 511 printed with the filled ink in the document 501 may be colored. According to another embodiment, the pen tip 401 of the second electronic device 102 may be configured to not protrude. According to another embodiment, the pen tip 401 of the second electronic device 102 may be configured to be replaceable.

[0095] According to an embodiment, the optical character recognition module 403 of the second electronic device 102 (as the main body of the first component 410 of the housing) may include at least one of the following: a filter (e.g., an IR filter) 411, a first sensor (e.g., a line sensor) 413, a second sensor (e.g., a pressure sensor) 415, a button (e.g., a mode switch) 417, a third sensor (e.g., a Hall sensor) 419, and a light source (not shown). The first component 410 may also include any other components.

[0096] For example, the filter 411 as an IR filter may filter light of a predetermined intensity generated from the light source. The light generated from the light source may be, for example, a light emitting diode (LED), an organic light emitting diode (OLED), or a laser beam, but is not limited thereto.

[0097] The first sensor 413 can detect the light signal received through the filter 411, scan at least one character (e.g., a string) on ​​the printed document along each line based on the detected light signal, and obtain image data for each pixel. The first sensor 413 can be operated when the second electronic device 102 is turned on.

[0098] The second sensor 415 can detect a signal for identifying the start and end of at least one character scan. When the pen tip 401 is in contact with the printed document and pressed, the second sensor 415 can detect the pressure transmitted from the pen tip 401. For example, when a preset threshold value of pressure or greater is detected, the second sensor 415 can transmit a signal to the processor 405 of the second electronic device 102, and when the pressure is released, for example, when a pressure less than the preset threshold is detected, no signal may be transmitted to the processor 405 of the second electronic device 102. Therefore, when receiving a signal, the processor 405 of the second electronic device 102 can identify the start and maintenance of a character scan, and unless a signal is received, it can identify the termination of a character scan. The second sensor 415 can be operated when the second electronic device 102 is turned on.

[0099] The button 417 can be set on the outer surface of the housing of the first component 410 of the second electronic device 102, and can transmit a switching signal to the processor 405 of the second electronic device 102 according to the button input to switch to a mode for optical character recognition (e.g., the first mode) or a mode for word search (e.g., the second mode).

[0100] When the second component 420 is attached to / detached from one side surface of the first component 410, the third sensor 419 can detect a signal and, upon detecting the signal, transmit the signal to the battery 409 and the processor 405 of the second electronic device 102. Therefore, upon receiving the signal from the third sensor 419, the processor 405 of the second electronic device 102 can turn on the second electronic device 102, and upon receiving the signal from the third sensor 419, turn off the second electronic device 102.

[0101] According to an embodiment, the second component 420 of the second electronic device 102 can be divided into a first portion 421 and a second portion 423. The first portion 421 is configured to be detachably coupled to either end of the first component 410 along the length of the first component 410, and the second portion 423 can be filled with ink. Multiple second portions 423 can be provided according to the ink color. According to another embodiment, the second component 420 of the second electronic device 102 can include the first portion 421 without the second portion 423 that can be filled with ink.

[0102] According to an embodiment, upon detecting a signal from the third sensor 419, the processor 405 of the second electronic device 102 may control the second electronic device 102 to be turned on and control the image data output from the first sensor 413 to be sent to the first electronic device 101 via a communication module (not shown). For example, the processor 405 may send the image data to the first electronic device 101 at each preset time interval. According to an embodiment, the processor 405 of the second electronic device 102 may include an optical character recognition algorithm (program or function), and use the optical character recognition algorithm (or program or function) to obtain a character image based on the image data output from the first sensor 413 at each preset time interval, and analyze the obtained character image pixel by pixel to recognize at least one character. The processor 405 may send the image of the recognized at least one character to the first electronic device 101.

[0103] According to an embodiment, upon receiving a switching signal from the button 417, the processor 405 of the second electronic device 102 may switch to a mode for optical character recognition (e.g., the first mode) or a mode for performing a word search (e.g., the second mode) according to the button input. The processor 405 may generate a signal of a different frequency for each mode or send mode identification information for identifying each mode to the first electronic device 101. Upon receiving signals of different frequencies or mode identification information, the first electronic device 101 may identify the operation mode performed on the second electronic device 102 and perform an operation according to the identified operation mode (e.g., the first mode or the second mode). For example, in the first mode, the first electronic device 101 may perform optical character recognition to improve the optical character recognition rate, and display and store the obtained result information. In the second mode, the first electronic device 101 may perform a word search on at least one recognized character, and display and store the obtained search information.

[0104] According to an embodiment, the processor 405 of the second electronic device 102 can obtain identification information for identifying the color of the ink in the second component 420, and identify the color of the filled ink based on the obtained identification information. For example, the processor 405 of the second electronic device 102 can be electrically connected to the second component 420 and receive information related to identification information configured to indicate the color of the ink included in the second component 420. As another example, the processor 405 of the second electronic device 102 can identify the color of the filled ink by coupling with the second component 420 based on preset color information and information identified by identifying a specific symbol or mark formed on the second component 420. As another example, the second electronic device 102 can also include a component capable of detecting color (e.g., a sensor), and can identify the color of the ink output on the printed document via the component capable of detecting color (e.g., a sensor). According to an embodiment, the processor 405 of the second electronic device 102 can send the identification information for identifying the obtained ink color to the first electronic device 101 when sending the scanned image data.

[0105] According to an embodiment, the processor 405 of the second electronic device 102, which may be a hardware module or a software module (e.g., an application), may be a hardware component (function) or a software component (program), and include at least one of the following: various sensors, a data measurement module, an input / output interface, a module for managing the state or environment of the second electronic device 102, or a communication module included in the second electronic device 102. According to an embodiment, the processor 405 of the second electronic device 102 may include, for example, a hardware module, a software module, a firmware module, or a combination of two or more thereof. According to an embodiment of the present disclosure, the processor 405 of the second electronic device 102 may not include at least some of these components, or may include other components for performing image processing operations in addition to these components.

[0106] According to an embodiment, the communication module 407 of the second electronic device 102 can communicate with the first electronic device 101 via a first communication scheme, for example, short-range communication (e.g., Bluetooth or Bluetooth Low Energy (BLE)). According to an embodiment, the communication module 407 of the second electronic device 102 can use an electromagnetic radiation (EMR) input scheme to send / receive signals for a user interface to / from the first electronic device 101. According to another embodiment, when the user presses or touches a button 417 set on the surface of the housing to switch the operating mode, the communication module 407 of the second electronic device 102 can send signals of different frequencies for each operating mode.

[0107] According to an embodiment, the battery 409 of the second electronic device 102 may store power for overall operation of the second electronic device 102 and may be rechargeable or non-rechargeable. For example, the battery 409 may include an electric double layer capacitor (EDLC).

[0108] Reference Figure 4C According to an embodiment, the second electronic device 102 may further include the above combination Figure 4A and Figure 4BThe components of the second electronic device 102 and the third component 430 are described. The third component 430 can be configured on the other side of the first component 410 (for example, the opposite side surface of the pen tip 401 formed along the longitudinal direction of the housing). The third component 430 may include a dielectric tip (not shown) protruding from the other end of the first component 410 and a coil unit (not shown) electrically connected to the dielectric tip inside the first component 410 to generate an electromagnetic field. The third component 430 can be electrically connected to the processor 405. The third component 430 can generate an electromagnetic field signal on the touch panel of an external display (for example, the display 160 of the first electronic device 101). According to an embodiment, when the result information obtained by reading and obtaining at least one character scanned on the printed document is displayed on the external display (for example, the display 160 of the first electronic device 101), the second electronic device 102 can input additional information related to the result information (for example, at least one of a memo, a picture, an image, a video, or a URL) on the touch panel of the display (for example, the display 160 of the first electronic device 101) via the third component 430.

[0109] According to an embodiment, the second electronic device 102 may further include a component that outputs at least one of vibration, light, smell, or sound.

[0110] The above has been combined Figure 4A 、 Figure 4B and Figure 4C The second electronic device 102 of FIG. 1 depicts the main components of the second electronic device 102. However, according to various embodiments, Figure 4A 、 Figure 4B and Figure 4C The components shown in FIG are not essential components, and the second electronic device 102 may be implemented with more or fewer components than those shown. Figure 4A 、 Figure 4B and Figure 4C The depicted locations of the main components of the second electronic device 102 may vary according to various embodiments.

[0111] According to an embodiment, an electronic device for optical character recognition (e.g., Figure 1 and Figure 2 The first electronic device 101 or Figure 1 and Figure 2The server 108 includes a memory and a processor electrically connected to the memory. The processor is configured to store at least one content including a character string and at least one lexeme table corresponding to the at least one content in the memory, obtain an image of at least one character scanned by an electronic pen on a printed document, identify content corresponding to the image from the at least one content, identify a lexeme table corresponding to the identified content from the at least one lexeme table, and obtain information obtained by performing optical character recognition on the image based on the identified lexeme table and raw data of the identified content.

[0112] According to an embodiment, the processor may be configured to generate at least one lexeme table corresponding to the at least one content in response to uploading the at least one content. Each of the at least one lexeme table includes identification information of the corresponding content, words included in the original data of the corresponding content, and position information of each word.

[0113] According to an embodiment, the processor may be configured to, when obtaining optical character recognition result information from an image, correct at least one of the one or more words read from the image based on the identified lexeme table and the original data; and obtain result information including a portion of the original data or result data corresponding to the one or more words in which the at least one word has been corrected. The portion of the original data may correspond to a sentence including the result data. The image of the at least one character scanned by the electronic pen may correspond to at least a portion of a printed document, the at least portion of the printed document being colored by ink due to contact between a pen tip formed in a first component of the electronic pen and filled with ink contained in a second component of the electronic pen and the printed document.

[0114] According to an embodiment, the processor may be configured to provide a screen including objects individually corresponding to content including a string, and in response to selecting at least one object from the objects, obtain at least one content corresponding to the selected at least one object based on information related to the selected at least one object, and obtain at least one lexeme table individually corresponding to the obtained at least one content. The processor may be configured to obtain at least one content and at least one lexeme table from an external device.

[0115] According to an embodiment, the processor may be configured to provide additional information of the identified content and, in response to a word search request, provide search information of at least one word read from the image.

[0116] According to an embodiment, an electronic device for optical character recognition (e.g., Figure 1 and Figure 2 The first electronic device 101 or Figure 1 and Figure 2The server 108 may further include a display electrically connected to the processor and configured to display the optical character recognition result information. According to an embodiment, the processor may be configured to store the result information in a memory, share excerpt information obtained by scraping at least a portion of the result information stored in the memory with at least one other user, and control the display to display information associated with the excerpt information input by the at least one other user, or to display excerpt information associated with the result information stored in the memory shared by the at least one other user.

[0117] According to an embodiment, the processor may be configured to, after providing the information obtained through optical character recognition, provide search information of the scanned at least one word in response to scanning at least one word at a position of the printed document corresponding to the result information.

[0118] According to an embodiment, the processor can be configured to identify a word in at least one character read from an image when obtaining information obtained through optical character recognition, obtain position information of a word in the original data corresponding to the identified word based on a word position table, obtain a comparison value indicating the number of printing errors by comparing the identified word with data in one or more original data placed in a position included in the position information, select the position of the minimum comparison value obtained, and correct the word based on the data placed in the selected position.

[0119] According to an embodiment, an electronic device (e.g., Figure 1 the second electronic device 102, Figure 2 the second electronic device 102, Figure 4A and Figure 4B The second electronic device 102, or Figure 4C The second electronic device 102 may include: a first component of a housing; a pen tip formed at an end of the first component; a second component of the housing configured to be detachable from the end of the first component; and an optical character recognition module installed inside the first component. The second component may contain ink and may be configured to fill the pen tip with ink when the second component is coupled to the end of the first component to cover the pen tip. The optical character recognition module may be configured to scan at least one character from at least a portion of a printed document for optical character recognition. At least a portion of the printed document may be colored by the ink when in contact with the pen tip.

[0120] According to an embodiment, the electronic device may further include a third component configured at the other end of the first component to generate an electromagnetic field signal on the touch panel of the external display. The third component may include a dielectric tip protruding from the other end of the first component, and a coil unit electrically connected to the dielectric tip within the first component and configured to generate the electromagnetic field signal. The pen tip may be replaceable and configured to scan at least one character without releasing ink.

[0121] The following describes in detail the above server (for example, Figure 1 and Figure 2 ) or the first electronic device (e.g., Figure 1 and Figure 2 The operation process on the first electronic device 101).

[0122] Figure 6 is a diagram illustrating an exemplary operation procedure of a server according to an embodiment.

[0123] According to the embodiment, combined Figure 6 The server described (e.g. Figure 1 and Figure 2 The operation process of the server 108) can also be performed by the first electronic device (e.g., Figure 1 and Figure 2 Executed by electronic device 101).

[0124] Reference Figure 6 In operation 601, according to an embodiment, the server may store at least one content, map the at least one content to at least one lexeme table corresponding to the at least one content, and store them. According to an embodiment, when a first electronic device (e.g., Figure 1 and Figure 2 When the first electronic device 101 or other external electronic device (not shown) uploads content, the server 108 can generate a lexeme table corresponding to the uploaded content, map the generated lexeme table to the uploaded content using identification information about the uploaded content, and store the mapped content and lexeme table. According to another embodiment, when the first electronic device performs operation 601, the first electronic device can obtain at least one content and at least one lexeme table corresponding to the at least one content from the server 108, and store them.

[0125] In operation 603, the server may obtain the second electronic device (eg, Figure 2 、 Figure 4A 、 Figure 4B or Figure 4C The second electronic device 102) prints the document (eg, Figure 5According to an embodiment, the server may read the image of the scanned at least one character (e.g., a character string) and use an optical character recognition algorithm (program or function) to recognize the at least one character in the image. According to another embodiment, the server may obtain result data obtained by the first electronic device or other external electronic device by reading the image of the scanned at least one character using an optical character recognition algorithm (application, program, or function). The optical character recognition algorithm executed on the first electronic device or other external electronic device may be a lightweight algorithm, and the result data read may be data with a low recognition rate (including errors).

[0126] In operation 605, the server may identify content (e.g., first content) corresponding to the obtained image. The identified content may be content requested to be uploaded corresponding to content selected via a screen displayed on the first electronic device or a printed document. Depending on the embodiment, the server may obtain information related to the identified content directly from the second electronic device or through an electronic device (e.g., the first electronic device) communicating with the second electronic device, and may identify content corresponding to the image based on the obtained content-related information.

[0127] In operation 607, the server may obtain the original data of the identified content and the lexeme table corresponding to the identified content. According to an embodiment, the server may export the memory (e.g., Figure 2 According to another embodiment, when the first electronic device performs operation 601, the first electronic device may export the lexeme table and the original data obtained from the server 108 and stored in the memory (for example, Figure 1 and Figure 2 The word part table and original data in the memory 130).

[0128] In operation 609, the server may obtain result information of optical character recognition (OCR) of the image based on the obtained raw data and the lexeme table. The result information of optical character recognition may include result data in which at least one word included in at least one character (or character string) read from the image is corrected. The result data may be final result data having an improved recognition rate compared to at least one character (or result data) initially recognized using an optical character recognition algorithm (program or function).

[0129] According to an embodiment, in operation 609, the server may separate at least one character (or string) read from the image word by word, identify the word, and obtain information about the position of the word corresponding to the identified word in the original data based on the obtained lexeme table. The server may select a position with the fewest typographical errors by comparing the identified word with data at a position included in the position information in one or more original data, and correct the word based on the data at the selected position. The server may obtain final result data including the corrected word as optical character recognition result information. According to an embodiment, when the characters read from the image are a string of words, the server may sequentially compare each of the identified words with the same or similar words included in the original data. When comparing with the original data, the server may identify the position with the fewest typographical errors in each word based on the position information included in the obtained lexeme table. If the positions with the fewest typographical errors identified for each word are sequentially consecutive, the server may correct some of the words based on the data at these positions (a portion of the original data).

[0130] Due to the above combination Figure 6 The operation process of the server described above can also be performed by the first electronic device (eg Figure 1 and Figure 2 The operation process of the first electronic device is executed by the electronic device 101, and the operation process of the first electronic device is not described in detail here.

[0131] Figure 7 is a diagram illustrating an exemplary operation procedure of a server according to an embodiment.

[0132] Combination of the above Figure 7 The lexeme table of the description can be found in Figure 6 is generated by the server in operation 601.

[0133] Reference Figure 7 According to an embodiment, a server (e.g. Figure 2 The server 108 can analyze the raw data of at least one content (hereinafter taking the first content 710 as an example) and identify at least one position of a word included in the analyzed raw data of the first content 710. Here, the at least one position can be specified based on the number identified by sequentially counting the words from the starting point (starting position 0) of the raw data. According to an embodiment, the server can sequentially specify positions for all words in the raw data from starting position 0. According to another embodiment, in addition to, for example, articles, Korean propositions and / or symbols, the server can select a specific word from the words analyzed in the raw data and specify the position of the selected word.

[0134] According to an embodiment, since the positions of words are specified sequentially from a starting point (starting position 0), the server can distinguish the words from the original data and generate a lexeme table 720 corresponding to the first content 710 based on at least one position identified by each word. The server can map the position information (e.g., 721, 723, 725, 727, ...) including the position identified by each word with the words (e.g., global, agitation, system, in, ...) and the first content identification information (e.g., document ID), distinguish between the words, and construct the lexeme table 720. The lexeme table 720 may include identification information (document ID), word information, and position information. The identification information may be configured in an integer form, the word information may be in a string form, and the position information may be in a list form.

[0135] Figure 8 is a view illustrating an example of character scanning by the second electronic device according to the embodiment. Figures 9A to 9G is a diagram illustrating an exemplary operation procedure of a server according to an embodiment.

[0136] Reference Figure 8 According to an embodiment, the second electronic device 102 (eg Figure 2 、 Figure 4A 、 Figure 4B or Figure 4C The second electronic device 102 can scan at least one character (e.g., a character string) on ​​the printed document 801. For example, the second electronic device 102 can scan a specific character string 803 from the printed document 801 and send image data of the specific character string 803 to the first electronic device (e.g., Figure 1 and Figure 2 The first electronic device (or server (eg, Figure 1 and Figure 2 The server 108 can obtain the image to be read 805 based on the received image data. When the specific character string 803 of the printed document 801 is, for example, "agitation system end", the image to be read 805 obtained by the character string scanning by the second electronic device 102 may be incorrectly identified as "agitation system end".

[0137] Reference Figure 9A and Figure 9B , server (e.g., Figure 1 and Figure 2 Server 108 (or first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101)) can identify Figure 8The server can read the content corresponding to the printed document 801 (hereinafter, the first content is described as an example), and obtain the original data 910 of the identified first content and the first word part table 920 corresponding to the first content based on the position information 921 about the first content. Figure 8 The image 805 shown is displayed, and the characters (e.g., character strings) (agitation system end) included in the image 805 are split word by word. The server can identify the character segments (e.g., agitation, system, end) and can obtain words that correspond individually to the character segments identified in the first word part table 920. For example, the server can obtain the words that are closest to the identified character segments. The server can obtain position information mapped to each word obtained from the first word part table 920. The server can sequentially compare the character segments (e.g., agitation, system, end) with the original data 910 based on the obtained position information, and obtain the data ("agitation system and") that is most similar to the character segment in the original data 910. The server can correct the partial characters (character segments) read from the image 805 based on the obtained data. The server can obtain result data (or final result data) corresponding to the corrected characters as result information recognized by optical character recognition. When comparing the character segments with the original data, the server can sequentially compare the character segments sentence by sentence from the starting point (0) 901 of the first sentence in the original data 910 to the end point (not shown) of the last sentence. When the word most similar to the character segment is identified in multiple sentences, the server can select the most similar phrase identified from the first sentence of the multiple identified sentences. For example, the server can select a phrase including the word with the smallest value of position information among the most similar words identified in the multiple sentences as the phrase to be corrected for the character read from image 805.

[0138] Reference Figure 9A, the server can obtain a first word (agitation) similar to the first character segment (agitation), a second word (system) similar to the second character segment (system), and a third word (and) and a fourth word (end) similar to the third character segment (end) from the first word segment table 920. The server can identify a plurality of position information 921, 923, 925, and 927 that are individually mapped to the obtained first word (agitation), second word (system), third word (and), and fourth word (end). For example, the server can use the position information 921 of the first word (agitation) mapped to the first sentence (e.g., the first sentence) of the original data 910 to identify each position (e.g., 2, 39, and 82) corresponding to the first word (agitation). The server can use the position information 923 of the second word (system) mapped to the first sentence (e.g., the first sentence) of the original data 910 to identify each position (e.g., 3, 40, and 83) corresponding to the second word (system). The server can identify each position (e.g., 13, 32, 57, and 84) corresponding to the third word (and) using position information 925 of the third word (and) mapped to the first sentence (e.g., the first sentence) of the original data 910. The server can identify the position (e.g., 71) corresponding to the fourth word (end) using position information 927 of the fourth word (end) mapped to the first sentence (e.g., the first sentence) of the original data 910.

[0139] Refer to 9B and Figure 9CSince the three words correspond to the character segment of the characters included in read image 805 (e.g., "agitation system end"), the server can search the original data for a phrase including these three words to compare the character segments. For example, the server can identify the two words following the first word (agitation) in each position identified corresponding to the first word (agitation) (e.g., positions 2, 39, and 82). The server can compare the identified phrases (e.g., 903, 905, and 907) with the characters included in image 805 (e.g., "agitation system end") to identify the number of characters that were incorrectly recognized due to a typographical error. For example, the server can compare phrase 903 (e.g., "agitation system in") identified in the first position (position 2) of the first word (agitation) with the characters included in image 805 (e.g., "agitation system end") to obtain a comparison value (e.g., an edit distance) indicating the number of characters that were incorrectly recognized due to a typographical error. As a result of the comparison, the server can obtain a comparison value of 3 for phrase 903 (e.g., "agitation system in"). For example, the server may compare phrase 905 (e.g., "agitation system market") identified in the second position (39th position) of the first word (agitation) with the characters (e.g., "agitation system end") included in image 805 to obtain a comparison value. As a result of the comparison, the server may obtain a comparison value of 6 for phrase 905 (e.g., "agitation system market"). For example, the server may compare phrase 907 (e.g., "agitation system and") identified in the third position (82nd position) of the first word (agitation) with the characters (e.g., "agitation system end") included in image 805 to obtain a comparison value. As a result of the comparison, the server may obtain a comparison value of 1 for phrase 907 (e.g., "agitation system and").

[0140] Reference Figure 9B and Figure 9D, the server may compare the first character segment (agitation) with the original data, and then compare the original data with the second character segment (system) in the character segment (e.g., agitation, system, end). For example, the server may identify a phrase (e.g., 903, 905, and 907) that includes a word before the second word (system) and a word after the second word (system) in each position (e.g., 3, 40, and 83 positions) identified corresponding to the second word (system) similar to the second character segment (system). The server may compare the identified phrase (e.g., 903, 905, and 907) with the characters included in the image 805, thereby identifying the number of characters that were incorrectly recognized due to printing errors. For example, the server may compare the phrase (e.g., 903, 905, and 907) identified in each position (3, 40, and 83 positions) of the second word (system) with the characters (e.g., agitation system end) included in the image 805, and obtain a result such as Figure 9D For example, the server may compare phrase 903 (e.g., "agitation system in") identified in the first position (3 position) of the second word (system) with the characters (e.g., "agitation system end") included in image 805 to obtain a comparison value. As a result of the comparison, the server may obtain 3 as the comparison value of phrase 903 (e.g., "agitation system in"). For example, the server may compare phrase 905 (e.g., "agitation system market") identified in the second position (40 position) of the second word (system) with the characters (e.g., "agitation system end") included in image 805 to obtain a comparison value. As a result of the comparison, the server may obtain 6 as the comparison value (e.g., edit distance) of phrase 905 (e.g., "agitation system market"). For example, the server may compare phrase 907 (e.g., "agitation system and") identified in the third position (83 position) of the second word (system) with the characters (e.g., "agitation system end") included in image 805 to obtain a comparison value. As a result of the comparison, the server may obtain 1 as a comparison value (eg, edit distance) of the phrase 907 (eg, “agitation system and”).

[0141] Reference Figure 9E and Figure 9F, the server may compare the second character segment (system) with the original data, and then compare the original data with the third character segment (end) in the character segment (e.g., agitation, system, end). For example, the server may identify a phrase (e.g., 909) that includes two words preceding the fourth word (end) in each position (e.g., 3, 40, and 83 positions) identified corresponding to a fourth word (end) similar to the third character segment (end). The server may identify the number of printing errors by comparing the identified phrase 909 with the characters included in the image 805. For example, the server may compare the phrase 909 identified in the position (71 position) of the fourth word (end) with the characters ("agitation system end") included in the image 805, and obtain a comparison value. As a result of the comparison, the server may obtain 15 as a comparison value (e.g., edit distance) of the phrase 909 (e.g., "turned many end"), as Figure 9F shown.

[0142] Reference Figure 9G , as above combined 9A to 9F As described, the server can obtain a comparison result (phrase) by comparing a character segment (e.g., agitation, system, end) with the last sentence up to the original data, select a phrase 907 (e.g., "agitation system end") having the smallest comparison value (e.g., 1) in the comparison result, correct the characters read from the image 805 with the selected phrase 907, and obtain the corrected characters as the final result data. For example, the server can replace the data obtained by performing optical character recognition on the image 805 with the data of the selected phrase 907 to obtain the final result data. When multiple sentences include a phrase with the smallest comparison value, the server can select a sentence whose first word (e.g., agitation) is at the front (e.g., at the position with the smallest value) from the multiple sentences. When the selected sentence includes multiple phrases with the smallest comparison value, the server can select a phrase including the first word (e.g., agitation) at the front (e.g., at the position with the smallest value) in the selected sentence from the multiple phrases. The server can send or display the obtained final result data as result information to another device (e.g., a first electronic device). According to an embodiment, the server may display or send the entire sentence including the phrase corresponding to the final result data as result information to other devices (eg, the first electronic device). Figures 9A to 9G The described operation process can also be performed by the first electronic device (eg Figure 1 and Figure 2The operation process of the first electronic device is executed by the electronic device 101, so the operation process of the first electronic device is not described in detail.

[0143] Figure 10 is a diagram illustrating an example operation process for optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment. Figure 11 is a view illustrating an example screen displayed on a first electronic device according to an embodiment. Figure 12A and Figure 12B is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0144] Reference Figure 10 According to an embodiment, in operation 1001, as a pre-processing operation before performing optical character recognition, the server 108 (eg, Figure 1 and Figure 2 The server 108) can store the data stored by the first electronic device 101 ( Figure 1 and Figure 2 The electronic device 101) or other external electronic device converts books, paper or other documents into digital data and uploads the digital data. After storing at least one of the contents, the server 108 can generate at least one lexeme table corresponding to the at least one content, map the generated at least one lexeme table to the at least one content, and store them in the memory (for example, Figure 2 Memory 205), as above combined Figure 7 described.

[0145] In operation 1003, the server 108 can store the data stored in the memory (e.g., Figure 2 Information related to at least one content among the contents stored in the memory 205) is sent to the first electronic device 101.

[0146] In operation 1005, the first electronic device 101 may display the received information related to at least one content on a screen configured to search for or select content (hereinafter, the first screen is taken as an example for description). Figure 11As shown, the first electronic device 101 can display a first screen 1101 on the display 160. The first screen 1101 can be divided into a first area 1110 and a second area 1120. The first area may include a first portion (e.g., a search box) 1111 for searching for content and a second portion 1113 for displaying an object for selecting content. The second area 1120 may be an area for displaying information related to content discovered or selected by the user. The first electronic device 101 can display at least one object on the second portion 1113 of the first screen 1101, which can serve as a user interface configured based on information related to at least one content received from the server 108.

[0147] The above operations 1001 to 1005 may be pre-processing operations before performing optical character recognition, and then operations for optical character recognition may be performed.

[0148] In operation 1007, the second electronic device 102 may scan at least one character on the printed document. In operation 1009, the second electronic device 102 may transmit image data of the scanned at least one character to the first electronic device 101. Depending on the embodiment, the second electronic device 102 may transmit the image data of the scanned at least one character or the read image directly to the server 108.

[0149] In operation 1011, the first electronic device 101 may receive image data of at least one character scanned by the second electronic device 102, and may obtain an image to be read based on the received image data. According to an embodiment, the first electronic device 101 may receive image data scanned at each predetermined time interval (or line by line by a line sensor) from the second electronic device 102 until the scanning is terminated. Upon receiving all image data of at least one character from the scanning start point to the scanning end point, the first electronic device 101 may generate an image of the scanned at least one character based on the received image data (for example, Figure 8 The first electronic device 101 may receive a signal from the second electronic device 102 indicating that the operation mode is for optical character recognition, and identify the operation mode of the second electronic device 102.

[0150] In operation 1013, when one of the objects for selecting at least one content displayed on the first screen 1101 is selected, the first electronic device 101 may identify the first content indicated by the selected object. In operation 1015, the first electronic device 101 may transmit information (e.g., identification information) and an image related to the identified first content to the server 108. According to another embodiment, operation 1013 may be performed after operation 1005, before character scanning is performed on the printed document.

[0151] In operation 1017, the server 108 may read the image received from the first electronic device 101 and obtain result data. The result data may include printing errors caused by reading the at least one character initially scanned as is. According to another embodiment, the server 108 may obtain data generated by reading the image of the at least one scanned character using an optical character recognition algorithm (program or function) from the first electronic device or other external electronic device. In this case, the server 108 may omit operation 1017. The optical character recognition algorithm executed on the first electronic device or other external electronic device may be a lightweight algorithm, and the result data read may be data with a low recognition rate (including errors).

[0152] In operation 1019 , the server 108 may identify the first content based on the received first content-related information, and obtain original data of the identified first content and a first lexeme table corresponding to the first content.

[0153] In operation 1021, the server 108 may obtain information obtained by optical character recognition from the image based on the obtained raw data and the word part table. Figures 9A to 9G The information obtained by optical character recognition is obtained during the described operation process, and no detailed description thereof is given. The optical character recognition result information may include result data in which at least one word included in at least one character (or character string) read from the image is corrected. Compared with the preliminary recognition result data using the optical character recognition algorithm (program or function), the corrected result data can be final result data with an improved recognition rate. As in operations 1019 and 1021, the server 108 can perform optical character recognition to correct the result data, thereby improving the recognition rate of the result data.

[0154] In operation 1023 , the server 108 may transmit the obtained optical character recognition result information to the first electronic device 101 .

[0155] In operation 1025, the first electronic device 101 may display the received optical character recognition result information. The first electronic device 101 may display the second screen 1201 on the display 1601, such as Figure 12Aand Figure 12B As shown. The second screen 1201 can be configured to display result information 1221 or 1223 obtained by optical character recognition on the first content selected or found from the first screen 1101 and additional information related to the first content (for example, title 1213, author / publisher information 1215, subtitle, page, a mapping image related to the result information, document source information (Uniform Resource Locator (URL) or file path), an object for editing the result information or information related to the related document). In addition, the second screen 1201 can be configured to include other information related to the first content and can be configured in various forms. For example, Figure 12A As shown, the first electronic device 101 can display data obtained by correcting at least one character read from the scanned image on the first area 1211 of the second screen 1201 (for example, Figure 9G As another example, Figure 12B As shown, the first electronic device 101 can display data (for example, Figure 9G As another example, when the user selects the sentence 1223 including the word "agitation system and") as the optical character recognition result information. Figure 12A The result data (eg, Figure 9G When the first electronic device 101 obtains the result data (for example, Figure 9G 1223 of the sentence "agitation system and"), and as Figure 12B As shown, the obtained sentence 1223 is displayed on the first area 1211.

[0156] According to an embodiment, the first electronic device 101 may edit the Figure 12A and Figure 12B The result information 1221 or 1223 shown is stored separately from the editing result.

[0157] According to an embodiment, the first electronic device 101 may store Figure 1 The memory 130) is separately stored as follows Figure 12A and Figure 12B The result information 1221 or 1223 , at least a portion of the result information 1221 or 1223 , or the editing result is shown as excerpt information for sharing with at least one other user.

[0158] According to an embodiment, the first electronic device 101 may identify the color that is highlighted when the second electronic device 102 scans a character string on a printed document, and display the result data in the identified color. The first electronic device 101 may edit the word or character string of each identified color differently. For example, upon receiving scanned image data from the second electronic device 102, the first electronic device 101 may receive information related to the color of the filled ink from the second electronic device 102, and identify the color that is highlighted on the scanned image data. As another example, the first electronic device 101 may use a camera or a color sensor to identify the color that is highlighted on the printed document. According to an embodiment, the first electronic device 101 may display the received result information together with the previous result information obtained by the previous scan, and may edit multiple result information.

[0159] Figure 13 is a diagram illustrating an example operation process for optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment.

[0160] Reference Figure 13 According to an embodiment, in operation 1301, the server 108 (e.g., Figure 1 and Figure 2 The server 108) can access the first electronic device 101 ( Figure 1 and Figure 2 The electronic device 101) or other external electronic device receives a request to upload specific content (hereinafter, described by taking the first content as an example) as a preprocessing operation before performing optical character recognition. In operation 1303, the server 108 can upload the first content requested to be uploaded and store the original data of the uploaded first content and the first content related information (for example, identification information, file path information and / or additional information). In operation 1305, the server 108 can generate a first word part table corresponding to the uploaded first content, as described above in combination with Figure 7 In operation 1307, the server 108 may map the generated first lexeme table with the first content and store them in a memory (eg, Figure 2 in the memory 205).

[0161] In operation 1309, the second electronic device 102 may scan at least one character corresponding to the first content on the printed document. In operation 1311, the second electronic device 102 may transmit image data of the scanned at least one character to the first electronic device 101. Depending on the embodiment, the second electronic device 102 may transmit the image data of the scanned at least one character or the read image directly to the server 108.

[0162] In operation 1313, the first electronic device 101 may receive image data of at least one character scanned by the second electronic device 102, and may obtain an image to be read based on the received image data. In operation 1315, the first electronic device 101 may send the image to the server 108. According to an embodiment, the first electronic device 101 may receive image data scanned at each predetermined time interval (or line by line by a line sensor) from the second electronic device 102 until the scanning is terminated. Upon receiving all image data of at least one character from the scanning start point to the scanning end point, the first electronic device 101 may generate an image of the scanned at least one character based on the received image data (for example, Figure 8 The first electronic device 101 may receive a signal from the second electronic device 102 indicating that the operation mode is for optical character recognition, and identify the operation mode of the second electronic device 102.

[0163] In operation 1317, the server 108 may read the image received from the first electronic device 101 and obtain result data. The result data may include printing errors caused by reading the at least one character initially scanned as is. According to another embodiment, the server 108 may obtain result data obtained by reading the image of the at least one scanned character using an optical character recognition algorithm (program or function) from the first electronic device 101 or other external electronic device. In this case, the server 108 may omit operation 1317. The optical character recognition algorithm executed on the first electronic device 101 or other external electronic device may be a lightweight algorithm, and the result data read may be data with a low recognition rate (including errors).

[0164] In operation 1319 , the server 108 may identify the first content based on the received first content-related information, and obtain original data of the identified first content and a first lexeme table corresponding to the first content.

[0165] In operation 1321, the server 108 may obtain information obtained by performing optical character recognition on the image based on the obtained original data and the word part table. Figures 9A to 9GThe information obtained by optical character recognition is obtained by the operation process described in the foregoing, and no detailed description is given. The optical character recognition result information may include result data in which at least one word included in at least one character (or character string) read from the image is corrected. Compared with the preliminary recognition result data using the optical character recognition algorithm (program or function), the above result data can be final result data with an improved recognition rate. As in operations 1319 and 1321, the server 108 can perform optical character recognition to correct the result data, thereby improving the recognition rate of the result data.

[0166] In operation 1323 , the server 108 may transmit the obtained optical character recognition result information to the first electronic device 101 .

[0167] In operation 1325, the first electronic device 101 may display the received optical character recognition result information. The first electronic device 101 may display the second screen 1201 on the display 1601, such as Figure 12A and Figure 12B As shown. The second screen 1201 can be configured to display the result information 1221 or 1223 of the received first content and the additional information related to the first content. Here, the additional information related to the first content may include at least one of the following: title 1213, author / publisher information 1235, subtitle, page, information indicating the part including the optical character recognition result (for example, a subtitle or chapter including the optical character recognition result information), a mapped image related to the result information, an image related to the result information (or a specific part of the image related to the result information), a descriptive document related to the result information, audio related to the result information (or a specific part of the audio related to the result information), similar result information of other users, document source information (url or file path) of the content, and an object for editing the result information or information of the related document. According to an embodiment, the first electronic device 101 can display the received result information together with the prior result information obtained by the prior scan, and can edit multiple result information.

[0168] Figure 14 is a diagram illustrating an example operation process for optical character recognition between a first electronic device, a second electronic device, and a server according to an embodiment.

[0169] Reference Figure 14 According to an embodiment, the server 108 (e.g., Figure 1 and Figure 2 The server 108) can store the data stored by the first electronic device 101 ( Figure 1 and Figure 2The electronic device 101 or other external electronic device converts books, paper or other documents into digital data) and uploads the digital data as a pre-processing operation before performing optical character recognition. When storing at least one of the contents, the server 108 can generate at least one lexeme table corresponding to the at least one content, map the generated at least one lexeme table with the at least one content, and pre-store them in a memory (for example, Figure 2 Memory 205), as described above Figure 7 described.

[0170] In operation 1401, the server 108 may receive a message for requesting at least one content from a first electronic device. In operation 1403, the server 108 may receive a message for requesting at least one content from a memory (eg, Figure 2 The server 108 may obtain the original data of the requested at least one content and the lexeme table corresponding to each of the at least one content in the memory 205 of the server 108. In operation 1405, the server 108 may send the obtained at least one original data and at least one lexeme table to the first electronic device 101.

[0171] In operation 1407, the first electronic device 101 may store the received at least one original data and at least one lexeme table in a memory (eg, Figure 1 and 2 in the memory 130).

[0172] In operation 1409, the second electronic device 102 may scan at least one character on the printed document. In operation 1411, the second electronic device 102 may transmit image data of the scanned at least one character to the first electronic device 101. Depending on the embodiment, the second electronic device 102 may transmit the image data of the scanned at least one character or the read image directly to the server 108.

[0173] In operation 1413, the first electronic device 101 may receive image data of at least one character scanned by the second electronic device 102, and may obtain an image to be read based on the received image data. According to an embodiment, the first electronic device 101 may receive image data scanned at each predetermined time interval (or line by line by a line sensor) from the second electronic device 102 until the scanning is terminated. Upon receiving all image data of at least one character from the scanning start point to the scanning end point, the first electronic device 101 may generate an image of the scanned at least one character based on the received image data (for example, Figure 8805), and the generated image can be read directly. The at least one character scanned can be a single word or a character string of multiple words. According to an embodiment, the first electronic device 101 can receive a signal from the second electronic device indicating that the operation mode is a mode for optical character recognition, and identify the operation mode of the second electronic device. In operation 1413, the first electronic device 101 can read the image and obtain result data. The result data may include printing errors caused by reading the at least one character originally scanned as is. According to another embodiment, the server 108 can obtain data obtained by reading the image of the scanned at least one character using an optical character recognition algorithm (program or function) from the first electronic device or other external electronic device. In this case, the server 108 can omit operations 1403 and 1405. The optical character recognition algorithm executed on the first electronic device or other external electronic device can be a lightweight algorithm, and the result data read can be low recognition rate (containing errors) data.

[0174] In operation 1415, the first electronic device 101 may identify the first content corresponding to the image. For example, the first electronic device 101 may identify the first content corresponding to the image. Figure 11 At least one content selected or searched content in the first screen 1101 shown is the first content. As another example, the first electronic device 101 may execute an application (program or function) for optical character recognition and then identify that the content requested to be uploaded via the application is the first content.

[0175] In operation 1417, the first electronic device 101 can retrieve the data from a memory (eg, Figure 1 and 2 The memory 130) obtains the original data of the first content and the first lexeme table corresponding to the first content.

[0176] In operation 1419, the first electronic device 101 may obtain information obtained by performing optical character recognition on the image based on the obtained original data and the word part table. Figures 9A to 9G The information obtained by optical character recognition is obtained by the operation process described in the foregoing, and no detailed description is given. The optical character recognition result information may include result data in which at least one word included in at least one character (or character string) read from the image is corrected. Compared with the preliminary recognition result data using the optical character recognition algorithm (program or function), the corrected result data can be final result data with an improved recognition rate. As in operations 1019 and 1021, the server 108 can perform optical character recognition to correct the result data, thereby improving the recognition rate of the result data.

[0177] In operation 1421, the first electronic device 101 may display the obtained optical character recognition result information. Figure 12A and Figure 12B The second screen 1201 is shown on the display 1601. The second screen 1201 can be configured to display the result information 1221 or 1223 of the first content selected or discovered from the first screen 1101 and additional information related to the first content. Here, the additional information related to the first content can include at least one of the following: title 1213, author / publisher information 1235, subtitle, page, information indicating the portion including the optical character recognition result (for example, a subtitle or chapter including the optical character recognition result information), a mapped image related to the result information, an image related to the result information (or a specific portion of the image related to the result information), a descriptive document related to the result information, audio related to the result information (or a specific portion of the audio related to the result information), similar result information of other users, document source information (URL or file path) of the content, and an object for editing the result information or information related to the related document. According to an embodiment, the first electronic device 101 can display the received result information together with the previous result information obtained by the previous scan, and can edit multiple result information.

[0178] Figure 15A 、 Figure 15B and Figure 15C is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0179] Reference Figure 15A 、 Figure 15B and Figure 15C According to an embodiment, the first electronic device (eg Figure 1 and Figure 2 The first electronic device 101) can obtain an image of a character 1503 scanned by the second electronic device 102 from the printed document 1501 in a word search mode (e.g., the second mode) performed by the second electronic device 102, read the obtained image, and perform a word search to obtain detailed information about the word corresponding to the scanned character 1503. The first electronic device can receive a signal switched according to the operation mode from the second electronic device 102 and identify the operation mode of the second electronic device 102. The first electronic device can search for words corresponding to the read characters through a dictionary application or a search application. The first electronic device can obtain search information when performing a word search and display the obtained search information on the search result screen 1520. According to an embodiment, the first electronic device can send an image or data read from the image to a server and receive search information from the server. According to another embodiment, the first electronic device can retrieve search information from a memory (e.g., Figure 1 and Figure 2 The search information about the word corresponding to the scanned character 1503 is obtained from a dictionary database stored in the memory 130).

[0180] According to an embodiment, when the second electronic device 102 rescans characters at a position of the printed document 1501 corresponding to the result information after providing the optical character recognition result information, the first electronic device may identify at least one word corresponding to the scanned characters, and may send a message for a word search request including the identified at least one word to the server 108, or retrieve the word search request from a memory (e.g., Figure 1 and Figure 2 The first electronic device may directly search for the identified at least one word in a dictionary database of a memory 130 of a computer or an external device. Upon obtaining search information, the first electronic device may display the obtained search information on a search results screen 1520. For example, the first electronic device may display a second screen 1510 displaying optical character recognition result information together with a search results screen 1520 displaying the obtained search information.

[0181] According to an embodiment, when a specific object (object of a word list) displayed on a display screen (e.g., the second screen 1510) is selected, the first electronic device may display historical information 1531 of previously searched words on the second screen 1510 or other separate screen 1530.

[0182] Figure 16A and Figure 16B is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0183] According to an embodiment, the first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101) can share the excerpt with at least one other user as described above. Figure 10 、 Figure 13 and Figure 14 The excerpt information obtained by extracting the result information obtained, and / or the excerpt information obtained by extracting at least one content provided by the application. Here, the excerpt information obtained by extracting the result information is the following information: stored in a memory (for example, Figure 1 and Figure 2 The necessary information is separately collected from a plurality of result information obtained by performing optical character recognition on a character string scanned from a printed document, wherein the character string corresponds to a character string scanned from a second electronic device (e.g., Figure 2 、 Figure 4A 、 Figure 4B or Figure 4C The second electronic device 102) provides content via the application.

[0184] Reference Figure 16A According to an embodiment, when a user finds or selects content (e.g., research on 'Book A') 1601 from the above combination Figure 11 When the first screen 1101 is selected, the first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101 may display a third screen 1610 on the display 160 for sharing information related to the selected content 1601 with at least one other user. In some embodiments, the first electronic device may perform optical character recognition on an image of at least one character corresponding to the selected content 1601 scanned on the printed document, thereby obtaining result information 1603. The first electronic device may display the obtained result information 1603 and at least a portion of the content 1601 including the result information 1603 on the third screen 1610. The first electronic device may display a button 1613 on the third screen 1610 for adding at least one of text, a link, a picture, or a video. In some embodiments, in response to selecting the button 1611 displayed on the third screen 1610, the first electronic device may display a fourth screen 1620 on the display 160 for selecting at least one of the other users (e.g., user A, user B, user C, and user D) to access the content 1601. The first electronic device may display an object 1621 individually indicating other users (e.g., user A, user B, user C, and user D) who access the content 1601, and an object 1623 indicating "Read Together" corresponding to each of the other users (e.g., user A, user B, user C, and user D) on the fourth screen 1620. For example, the first electronic device may identify that the user has selected the object 1623 individually corresponding to the first user (user A) and the second user (user B) among the other users (e.g., user A, user B, user C, and user D).

[0185] Reference Figure 16B According to an embodiment, the first electronic device (eg Figure 1 and Figure 2The first electronic device 101 may share the obtained result information 1603 displayed on the fourth screen 1620 and / or excerpt information excerpted from at least a portion of the selected content 1601 with the first user (user A) and the second user (user B) in response to the user selecting an object 1623 individually corresponding to the first user (user A) and the second user (user B) among other users (e.g., user A, user B, user C, and user D) on the fourth screen 1620. In response to identifying that the object 1623 individually corresponding to the first user (user A) and the second user (user B) is selected, the first electronic device may display a fifth screen 1630 on the display 160, the fifth screen 1630 displaying excerpt information related to the content 1601 for each of the first user (user A) and the second user (user B).

[0186] Reference Figure 16B , the first electronic device may identify input information corresponding to an opinion input in the form of a reply to excerpt information (e.g., excerpt information 1631 or 1633) shared by at least one of the user, the first user (user A), or the second user (user B). The first electronic device may display the identified input information on the fifth screen 1630, the identified input information being related to the excerpt information shared by at least one of the first user (user A) or the second user (user B). According to an embodiment, the first electronic device may share the excerpt information (e.g., excerpt information 1631 or 1633) shared by at least one of the first user (user A) or the second user (user B) with other users on at least one social media account.

[0187] Figure 17A and Figure 17B is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0188] Reference Figure 17A According to an embodiment, the first electronic device (eg Figure 1 and Figure 2The first electronic device 101 of the embodiment may display a sixth screen 1710 on the display, the sixth screen 1710 being used to search for excerpt information 1713 and 1715 related to at least one content provided via an application, shared by at least one other user (e.g., at least one of user A, user C, user D, or user E). According to an embodiment, the first electronic device may display a search box 1701 on the sixth screen 1710 for searching for excerpt information shared by other users, and may display excerpt information 1713 and 1715 found based on input information (e.g., a topic tag or a user name) entered via the search box 1701 on the sixth screen 1710. For example, the excerpt information may be information for identifying a real-time knowledge learning status (e.g., an insight status) of each other user.

[0189] Reference Figure 17A According to the embodiment, when the user combines Figure 11 When searching for or selecting content on the described first screen 1101, the first electronic device may display excerpt information related to the selected content (e.g., book A) shared by other users on the sixth screen 1710. The first electronic device may display excerpt information 1713 related to content individually selected for each other user (e.g., at least one of user A, user C, user D, and user E) on the sixth screen 1710.

[0190] Reference Figure 17B For example, when a first user (user A) is selected on the sixth screen 1710, the first electronic device may display at least a portion of the excerpt information shared by the selected first user (user A) (e.g., text 1 1721 and text 2 1723) on the seventh screen 1720. The first electronic device may display a button 1725 for adding at least one of text, link, picture, or video on the seventh screen 1720.

[0191] Figure 18 is a view illustrating an example screen displayed on a first electronic device according to an embodiment.

[0192] Reference Figure 18 According to an embodiment, the first electronic device (eg Figure 1 and Figure 2 The first electronic device 101) can add additional information (for example, at least one of a memo (MEMO), a picture, an image, a video or a URL) to the above combination Figure 10 、 Figure 13 and Figure 14 The result information 1811 obtained by reading the image of the scanned at least one character is described. For example, the first electronic device may receive the result information 1811 obtained by the third component (eg, Figure 4C The third component 430) receives input information corresponding to additional information (eg, memo 1813) created or selected on the touch panel of the display 160, and displays the received input information in association with result information 1811 on the second screen 1201.

[0193] According to an embodiment, the first electronic device can add the characters 1503 scanned from the printed document by the second electronic device to the third component (eg, Figure 4C The third component 430), as above combined Figure 15A 、 Figure 15B and Figure 15C According to another embodiment, the additional information may be input using an input interface other than the second electronic device.

[0194] According to an embodiment, the first electronic device may add additional information (e.g., at least one of a memo, a picture, an image, a video, or a URL) input by another user to the characters 1503 scanned from the printed document by reading the second electronic device (as described above in conjunction with Figure 15A 、 Figure 15B and Figure 15C described) or scan at least one character (as described above in combination Figure 10 、 Figure 13 and Figure 14 Result information 1811 obtained by using the image described).

[0195] According to an embodiment, the first electronic device may provide result information obtained by reading at least one character scanned on a printed document using at least one of an automatic export (e.g., Word, PDF, or PPT) or a reading (e.g., audio book) function. Figure 18 The illustrated first screen 1201 displays an object indicating an automatic export or reading function.

[0196] According to an embodiment, the first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101 can store references to content used by a group of users (e.g., reading or school) in class, research, or debate by source or page, and store words scanned from a printed document by a second electronic device in, for example, a word list. The first electronic device can share references to content or words stored in a word list with other users and can search for references to content shared by other users or words stored in a word list.

[0197] According to an embodiment, the first electronic device (eg, Figure 1 and Figure 2The first electronic device 101 can collect and store all information extracted from a printed document by users belonging to a group (e.g., a reading conference or a school), and reflect the extracted information to the content corresponding to the printed document and display it. For example, the first electronic device can reflect the extracted information, which is differentiated by user group, to the content corresponding to the printed document and display it.

[0198] According to the embodiment, when the user selects Figure 11 When the first screen 1101 described above selects content, the first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101) may provide additional information related to the selected content (eg, content provided from other documents or other applications).

[0199] According to an embodiment, the first electronic device (eg, Figure 1 and Figure 2 The first electronic device 101 can interoperably transmit result information obtained by reading an image of at least one scanned character to another user on the Internet, for example, in conjunction with an application related to a remote course (for example, Internet tutoring). Figure 10 、 Figure 13 and Figure 14 described) or at least one character scanned from a printed document by a second electronic device (as described above in combination with Figure 15A 、 Figure 15B and Figure 15C The first electronic device may receive, store, and display characters scanned from printed characters by other users or result information obtained by reading images of scanned characters. Here, the characters or result information received from other users may be displayed on content corresponding to the printed document displayed on the screen on which the Internet-based remote course is being replayed.

[0200] According to an embodiment, a method for performing optical character recognition (OCR) by an electronic device includes: storing at least one content and at least one word part table corresponding individually to the at least one content in a memory of the electronic device; obtaining an image of at least one character scanned by an electronic pen on a printed document; identifying content corresponding to the image from the at least one content, identifying a word part table corresponding to the identified content from at least one word part table, and obtaining result information recognized by performing optical character recognition on the image based on the identified word part table and original data of the identified content.

[0201] According to an embodiment, the method may further include: in response to uploading the at least one content, generating at least one lexeme table corresponding to the at least one content. Each of the at least one lexeme table includes identification information of the corresponding content, words included in the original data of the corresponding content, and position information of each word.

[0202] According to an embodiment, obtaining result information obtained by performing optical character recognition on an image includes correcting at least one of one or more words read from the image based on an identified lexeme table and original data, and obtaining result information including a portion of the original data or result data corresponding to the one or more words in which the at least one word has been corrected. The portion of the original data corresponds to a sentence including the result data. The image of the at least one character scanned by the electronic pen corresponds to at least a portion of a printed document, the at least portion of the printed document being colored by ink contained in a second component of the electronic pen by contacting a pen tip formed in a first component of the electronic pen with the printed document.

[0203] According to an embodiment, the method may further include: displaying a screen on a display of the electronic device, the screen including objects corresponding individually to content including a character string; in response to selecting at least one object from the objects, obtaining at least one content corresponding to the selected at least one object based on information related to the selected at least one object; and obtaining at least one lexeme table corresponding individually to the obtained at least one content. The method may also include: obtaining at least one content and at least one lexeme table from an external device.

[0204] According to an embodiment, the method may further include providing history information of previously searched words when a specific object (object of the word list) displayed on the screen is selected.

[0205] According to an embodiment, the method may further include: displaying result information obtained by optical character recognition on a display of an electronic device, storing the result information in a memory, configuring excerpt information or at least one content obtained by extracting at least part of the result information stored in the memory to be shared with at least one other user, and displaying information associated with the excerpt information input by at least one other user on the display, or displaying excerpt information associated with the result information stored in the memory shared by at least one other user on the display.

[0206] According to an embodiment, the method may further include providing additional information of the identified content, and providing search information of at least one word read from the image in response to a word search request.

[0207] According to an embodiment, the method may further include, in response to scanning at least one word at a position of the printed document corresponding to the result information after providing the result information, providing search information of the scanned at least one word.

[0208] According to an embodiment, obtaining information obtained through optical character recognition may include: identifying at least one word corresponding to at least one character read from an image; obtaining position information of at least one word in the original data corresponding to the identified at least one word based on at least one word position table; obtaining a comparison value indicating the number of printing errors by comparing the identified at least one word with data placed at a position included in the position information in one or more original data; selecting a position corresponding to a minimum comparison value of the obtained comparison values; and correcting at least one word based on the data placed at the selected position.

[0209] According to an embodiment, a non-transitory storage medium storing instructions is provided, and the instructions are executed by a processor to enable the processor to perform the following operations: storing at least one content and at least one word part table corresponding individually to the at least one content in a memory; obtaining an image of at least one character scanned by an electronic pen on a printed document; identifying content corresponding to the image from the at least one content, identifying a word part table corresponding to the identified content from the at least one word part table, and obtaining result information recognized by performing optical character recognition on the image based on the identified word part table and the original data of the identified content.

[0210] Although the present disclosure has been described with various embodiments, various changes and modifications may be suggested to one skilled in the art. It is intended that the present disclosure encompass such changes and modifications as fall within the scope of the appended claims.

Claims

1. An electronic device for optical character recognition, comprising: Memory, which stores instructions; as well as a processor, electrically connected to the memory, Wherein, when the instructions are executed by the processor, the electronic device: storing at least one content and at least one lexeme table corresponding to the at least one content in the memory, obtaining an image of a word scanned by an electronic pen on a printed document, identifying content corresponding to the image from the at least one content, identifying a lexeme table corresponding to the identified content from the at least one lexeme table, and Obtaining result information by identifying the number of characters incorrectly recognized by performing optical character recognition on the image based on the identified lexeme table and the original data of the identified content, Each of the at least one lexeme table includes identification information of the corresponding content, words included in the original data of the corresponding content, and position information of each word.

2. The electronic device according to claim 1, wherein When the instructions are executed by the processor, the electronic device: In response to uploading the at least one content, generating the at least one lexeme table corresponding solely to the at least one content, Correcting at least one of the one or more words read from the image based on the identified lexeme table and the original data, and obtaining the result information, the result information including a portion of the original data or result data corresponding to one or more words in which the at least one word has been corrected, wherein the portion of the original data corresponds to a sentence comprising the result data, and wherein the image scanned by the electronic pen corresponds to at least a portion of the printed document, and the at least a portion of the printed document is colored by the ink contained in the second component of the electronic pen by bringing the pen tip formed in the first component of the electronic pen into contact with the printed document.

3. The electronic device according to claim 1, wherein When the instructions are executed by the processor, the electronic device: controlling a display of the electronic device to display a screen, the screen including an object corresponding solely to content including a character string; In response to selecting at least one object from the objects, obtaining at least one content corresponding to the selected at least one object based on information related to the selected at least one object; and At least one lexeme table individually corresponding to the obtained at least one content is obtained.

4. The electronic device according to claim 1, further comprising: a display electrically connected to the processor and configured to display result information of the optical character recognition, Wherein, when the instructions are executed by the processor, the electronic device: storing the result information in the memory, configuring the extracted information obtained by extracting at least a portion of the result information stored in the memory or the at least one content to be shared with at least one other user, and The display is controlled to display information associated with the excerpt information input by the at least one other user, or to display excerpt information shared by the at least one other user and associated with the result information stored in the memory.

5. The electronic device according to claim 1, wherein When the instructions are executed by the processor, the electronic device: Provide additional information about the identified content, In response to a word search request, search information of at least one word read from the image is provided, and in response to scanning at least one word at a position of the printed document corresponding to the result information after providing the result information, search information of the scanned at least one word is provided. The electronic device according to claim 1 , wherein: When the instructions are executed by the processor, the electronic device, upon obtaining the result information recognized by performing optical character recognition on the image: identifying at least one word from the words read from the image; Based on the lexeme table, obtaining position information of at least one word in the original data corresponding to the at least one identified word; obtaining a comparison value indicating a number of printing errors by comparing the identified at least one word with data in one or more original data placed in a position included in the position information; selecting the position corresponding to the minimum comparison value of the obtained comparison values; and The at least one word is corrected based on the data placed in the selected position.

7. A method for performing optical character recognition (OCR) by an electronic device, the method comprising: storing at least one content and at least one lexeme table corresponding to the at least one content in a memory of the electronic device; obtaining an image of a word scanned by the electronic pen on a printed document; identifying content corresponding to the image from the at least one content; identifying a lexeme table corresponding to the identified content from the at least one lexeme table; and Obtaining result information by identifying the number of characters incorrectly recognized by performing optical character recognition on the image based on the identified lexeme table and the original data of the identified content, Each of the at least one lexeme table includes identification information of the corresponding content, words included in the original data of the corresponding content, and position information of each word.

8. The method according to claim 7, further comprising: In response to uploading the at least one content, generating the at least one lexeme table corresponding solely to the at least one content, Wherein, obtaining result information obtained by performing optical character recognition on the image includes: Correcting at least one of the one or more words read from the image based on the identified lexeme table and the original data, and obtaining the result information, the result information including a portion of the original data or result data corresponding to one or more words in which the at least one word has been corrected, wherein the portion of the original data corresponds to a sentence including the result data, and wherein the image scanned by the electronic pen corresponds to at least a portion of the printed document, and the at least a portion of the printed document is colored by the ink contained in the second component of the electronic pen by bringing the pen tip formed in the first component of the electronic pen into contact with the printed document.

9. The method according to claim 7, further comprising: displaying a screen on a display of the electronic device, the screen including objects corresponding solely to content including the character string; In response to selecting at least one object from the objects, obtaining at least one content corresponding to the selected at least one object based on information related to the selected at least one object; and At least one lexeme table individually corresponding to the obtained at least one content is obtained, and in response to selection of a specific object displayed on the screen, history information of previously searched words is provided.

10. The method according to claim 7, further comprising: Displaying the result information of the optical character recognition on a display of the electronic device; storing the result information in the memory; configuring the extracted information obtained by extracting at least a portion of the result information stored in the memory or the at least one content to be shared with at least one other user; and Information associated with the excerpt information input by the at least one other user is displayed on the display, or excerpt information associated with the result information stored in the memory and shared by the at least one other user is displayed on the display.

11. The method according to claim 7, further comprising: Provide additional information about the identified content; providing search information of at least one word read from the image in response to a word search request; and In response to at least one word being scanned at a position of the printed document corresponding to the result information after the result information is provided, search information of the scanned at least one word is provided.

12. The method according to claim 7, wherein: Obtaining the result information recognized by performing optical character recognition on the image includes: identifying at least one of the words read from the image; Based on the lexeme table, obtaining position information of at least one word in the original data corresponding to the at least one identified word; obtaining a comparison value indicating a number of printing errors by comparing the identified at least one word with data in one or more original data placed in a position included in the position information; selecting the position corresponding to the minimum comparison value of the obtained comparison values; and The at least one word is corrected based on the data placed in the selected position.

13. A non-transitory storage medium storing instructions, the instructions being executable by a processor to enable the processor to: storing at least one content and at least one lexeme table corresponding to the at least one content in a memory; obtaining an image of a word scanned by the electronic pen on a printed document; identifying content corresponding to the image from the at least one content; identifying a lexeme table corresponding to the identified content from the at least one lexeme table; and Obtaining result information by identifying the number of characters incorrectly recognized by performing optical character recognition on the image based on the identified lexeme table and the original data of the identified content, Each of the at least one lexeme table includes identification information of the corresponding content, words included in the original data of the corresponding content, and position information of each word.

Images