Information processing device, program and system

Abstract

To provide: an information processing device capable of suppressing traffic to a character recognition device; a program; and a system.SOLUTION: According to an embodiment, an information processing device comprises an image interface, a communication interface, and a processor. The image interface acquires a photographic image containing a character string. The communication interface is connected to an external device. The processor generates intermediate information composed of information generated from the photographic image in a process of character recognition processing, and transmits the intermediate information to the external device through the communication interface.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device, a program, and a system. [Background technology]

[0002] There is a system in which character recognition of an image acquired by a terminal is performed by a cloud server. In such a system, the terminal transmits the acquired image to the cloud server and acquires the result of the character recognition from the cloud server.

[0003] Conventionally, systems have had the problem of large transfer volumes because they require sending images from terminals to cloud servers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-90623 A Summary of the Invention [Problem to be solved by the invention]

[0005] In order to solve the above problem, an information processing device, a program, and a system are provided that are capable of reducing the amount of data transferred to a device that performs character recognition. [Means for solving the problem]

[0006] According to an embodiment, an information processing device includes an image interface, a communication interface, and a processor. The image interface acquires a captured image including a character string. The communication interface connects to an external device. The processor generates intermediate information from the captured image, the intermediate information being composed of information generated in a character recognition process, and transmits the intermediate information to the external device via the communication interface. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating an example of the configuration of a recognition system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of the OCR device according to the embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating an example of the configuration of a server according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the operation of the OCR device according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of the configuration of the intermediate information according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the operation of the server according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of the operation of the OCR device according to the embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of the operation of the server according to the embodiment. [Figure 9] FIG. 9 is a diagram showing another operation example of the OCR device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment will be described with reference to the drawings. The recognition system according to the embodiment recognizes character strings from an image using character recognition processing (OCR (Optical Character Recognition) processing). Here, the recognition system recognizes the destination of a package from an image of a slip or the like attached to the package. The recognition system classifies the package based on the recognized destination.

[0009] Fig. 1 shows an example of the configuration of a recognition system 1 according to an embodiment. As shown in Fig. 1, the recognition system 1 includes a classification device 2, a camera 3, a network 6, an OCR device 10, a server 20, and the like.

[0010] The OCR device 10 is connected to a sorting device 2 and a camera 3. The OCR device 10 and the server 20 are also connected to a network 6.

[0011] Note that the recognition system 1 may further include components as necessary in addition to the components shown in FIG.

[0012] The sorting device 2 sorts packages inserted by an operator, a conveyor belt, a robot, or the like. The sorting device 2 receives destination information (character string information) related to the destination (character string) of the package from the OCR device 10. The sorting device 2 sorts the package based on the destination information. For example, the sorting device 2 sorts the package into a chute, pocket, cart, tray, or the like as a sorting destination. For example, the sorting device 2 is composed of a sorter, a conveyor belt, a robot, or the like.

[0013] The camera 3 photographs the baggage to be inserted into the sorting device 2. The camera 3 photographs the side on which the destination is displayed. For example, the camera 3 photographs the side on which a slip is attached. The camera 3 supplies the image obtained by photographing (photographed image) to the OCR device 10.

[0014] For example, the camera 3 is a CCD (Charge Coupled Device) camera. The camera 3 may also include a light source that illuminates the baggage.

[0015] The OCR device 10 (information processing device, first information processing device, external device) acquires a captured image from the camera 3. The OCR device 10 generates intermediate information related to OCR processing from the captured image. The OCR device 10 transmits the intermediate information to the server 20 and receives destination information related to the destination of the package shown in the captured image from the server 20. The OCR device 10 inputs the received destination information to the sorting device 2. The OCR device 10 and the intermediate information will be described in detail later.

[0016] The network 6 relays communication between the OCR device 10 and the server 20. For example, the network 6 is the Internet.

[0017] The server 20 (information processing device, second information processing device, external device) receives the intermediate information from the OCR device 10. The server 20 generates destination information based on the received intermediate information. The server 20 provides the generated destination information to the OCR device 10. The server 20 will be described in detail later.

[0018] Next, the OCR device 10 will be described. Fig. 2 shows an example of the configuration of the OCR device 10 according to the embodiment. Fig. 2 is a block diagram showing an example of the configuration of the OCR device 10. As shown in Fig. 2, the OCR device 10 includes a processor 11, a ROM 12, a RAM 13, an NVM 14, a communication unit 15, an operation unit 16, a display unit 17, a sorting device interface 18, and a camera interface 19.

[0019] The processor 11, the ROM 12, the RAM 13, the NVM 14, the communication unit 15, the operation unit 16, the display unit 17, the sorting device interface 18, and the camera interface 19 are connected to one another via a data bus or the like. The OCR device 10 may include components as necessary in addition to the components shown in FIG. 2, and certain components may be excluded from the OCR device 10.

[0020] The processor 11 (first processor) has a function of controlling the overall operation of the OCR device 10. The processor 11 may include an internal cache and various interfaces. The processor 11 realizes various processes by executing programs stored in advance in the internal memory, the ROM 12, or the NVM 14.

[0021] Some of the various functions realized by the processor 11 executing the programs may be realized by hardware circuits. In this case, the processor 11 controls the functions executed by the hardware circuits.

[0022] The ROM 12 is a non-volatile memory that stores in advance a control program, control data, etc. The control program and control data stored in the ROM 12 are incorporated in advance according to the specifications of the OCR device 10.

[0023] The RAM 13 is a volatile memory. The RAM 13 temporarily stores data being processed by the processor 11. The RAM 13 stores various application programs based on instructions from the processor 11. The RAM 13 may also store data necessary for executing the application programs and execution results of the application programs.

[0024] The NVM 14 is a non-volatile memory in which data can be written and rewritten. The NVM 14 is, for example, configured with a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The NVM 14 stores control programs, applications, various data, etc. according to the operational use of the OCR device 10.

[0025] The communication unit 15 (communication interface, first communication interface) is an interface for connecting to the network 6. That is, the communication unit 15 is an interface for transmitting and receiving data to and from the server 20, etc., through the network 6. For example, the communication unit 15 is an interface that supports a wired or wireless LAN (Local Area Network) connection.

[0026] The operation unit 16 accepts various operation inputs from an operator. The operation unit 16 transmits a signal indicating the input operation to the processor 11. The operation unit 16 may be configured from a touch panel.

[0027] The display unit 17 displays image data from the processor 11. For example, the display unit 17 is configured with a liquid crystal monitor. When the operation unit 16 is configured with a touch panel, the display unit 17 may be formed integrally with the operation unit 16.

[0028] The segmentation device interface 18 is an interface for connecting to the segmentation device 2. The segmentation device interface 18 transmits signals (e.g., destination information) from the processor 11 to the segmentation device 2. The segmentation device interface 18 also transmits signals from the segmentation device 2 to the processor 11.

[0029] The camera interface 19 (image interface) is an interface for connecting to the camera 3. The camera interface 19 transmits a signal from the processor 11 to the camera 3. The camera interface 19 also transmits a signal from the camera 3 (such as a captured image) to the processor 11.

[0030] Next, the server 20 will be described. Fig. 3 shows a configuration example of the server 20 according to the embodiment. Fig. 3 is a block diagram showing the configuration example of the server 20. As shown in Fig. 3, the server 20 includes a processor 21, a ROM 22, a RAM 23, an NVM 24, a communication unit 25, an operation unit 26, a display unit 27, and the like.

[0031] The processor 21, the ROM 22, the RAM 23, the NVM 24, the communication unit 25, the operation unit 26, and the display unit 27 are connected to one another via a data bus or the like. The server 20 may include components as necessary in addition to the components shown in FIG. 3, and certain components may be excluded from the server 20.

[0032] The processor 21 (second processor) has a function of controlling the overall operation of the server 20. The processor 21 may include an internal cache and various interfaces. The processor 21 realizes various processes by executing programs stored in advance in the internal memory, the ROM 22, or the NVM 24.

[0033] Some of the various functions realized by the processor 21 executing the programs may be realized by a hardware circuit. In this case, the processor 21 controls the functions executed by the hardware circuit.

[0034] The ROM 22 is a non-volatile memory in which control programs, control data, etc. are stored in advance. The control programs and control data stored in the ROM 22 are incorporated in advance in accordance with the specifications of the server 20.

[0035] The RAM 23 is a volatile memory. The RAM 23 temporarily stores data being processed by the processor 21. The RAM 23 stores various application programs based on instructions from the processor 21. The RAM 23 may also store data necessary for executing the application programs and execution results of the application programs.

[0036] The NVM 24 is a non-volatile memory to which data can be written and rewritten. The NVM 24 is, for example, an HDD, an SSD, a flash memory, etc. The NVM 24 stores control programs, applications, various data, etc. according to the operational purpose of the server 20.

[0037] The communication unit 25 (communication interface, second communication interface) is an interface for connecting to the network 6. That is, the communication unit 25 is an interface for transmitting and receiving data to and from the OCR device 10 and the like through the network 6. For example, the communication unit 25 is an interface that supports a wired or wireless LAN connection.

[0038] The operation unit 26 receives various operation inputs from an operator. The operation unit 26 transmits a signal indicating the input operation to the processor 21. The operation unit 26 may be configured as a touch panel.

[0039] The display unit 27 displays image data from the processor 21. For example, the display unit 27 is configured with a liquid crystal monitor. When the operation unit 26 is configured with a touch panel, the display unit 27 may be formed integrally with the operation unit 26.

[0040] Next, a description will be given of functions realized by the OCR device 10. The functions realized by the OCR device 10 are realized by the processor 11 executing a program stored in the internal memory, the ROM 12, the NVM 14, or the like.

[0041] FIG. 4 is a diagram for explaining the functions realized by the OCR device 10. As shown in FIG.

[0042] First, the processor 11 has a function of acquiring a photographed image (first step). Here, it is assumed that baggage to be put into the sorting device 2 is present in a position where the camera 3 can take an image.

[0043] The processor 11 causes the camera 3 to capture an image of the package via the camera interface 19. The processor 11 acquires, via the camera interface 19, from the camera 3, a captured image 103 in which the package appears.

[0044] The processor 11 also acquires parameters of the acquired photographed image 103. Here, the processor 11 acquires the size of the acquired photographed image 103.

[0045] The processor 11 also has a function (second step) of extracting baggage images in which the baggage appears from the captured images.

[0046] The processor 11 extracts the luggage image 104 from the captured image 103 using a predetermined image processing. For example, the processor 11 extracts the luggage image 104 by edge detection. The processor 11 may also extract the luggage image 104 using artificial intelligence such as a neural network. The method by which the processor 11 extracts the luggage image 104 from the captured image 103 is not limited to a specific method.

[0047] The processor 11 also acquires parameters of the extracted baggage image 104. Here, the processor 11 acquires the coordinates, size, angle (tilt of the baggage image 104), and color of the baggage image 104.

[0048] The processor 11 also has a function of extracting a character string image in which a character string appears from the baggage image 104.

[0049] Here, it is assumed that the baggage image 104 includes a destination character string, a barcode, and a label.

[0050] The processor 11 uses a predetermined image processing to extract a character string image showing a character string of a destination from the baggage image 104. For example, the processor 11 detects and extracts the character string image by pattern recognition. The processor 11 may also extract the character string image by using artificial intelligence such as a neural network. The method by which the processor 11 extracts the character string image from the baggage image 104 is not limited to a specific method.

[0051] The processor 11 also acquires parameters of the extracted character string image. Here, the processor 11 acquires the coordinates and size of the character string image. The processor 11 may also acquire a flag indicating whether the character string in the character string image is handwritten or printed. For example, the processor 11 determines whether the character string in the character string image is handwritten or printed using a predetermined image processing.

[0052] The processor 11 may also read a barcode from the baggage image 104. For example, the processor 11 obtains the coordinates and size of the barcode. The processor 11 also decodes the barcode to obtain information indicated by the barcode.

[0053] The processor 11 may also read a label from the baggage image 104. For example, the processor 11 acquires the coordinates and size of the label. The processor 11 also performs OCR processing on the label to acquire information (such as warnings) written on the label.

[0054] The processor 11 also has a function (third step) of extracting character candidates (images) that are candidates for an area including one character from the character string image.

[0055] Processor 11 extracts character candidates 105 having overlapping lines from the character string image. Here, character candidates 105 are patterns surrounded by rectangles. When character candidates 105 are extracted, processor 11 extracts a connection pattern of character candidates 105 based on the coordinates of character candidates 105 and the like. The connection pattern indicates a pattern of a series of character strings formed by each character candidate 105.

[0056] As shown in Fig. 4, processor 11 extracts a plurality of connection patterns. In Fig. 4, lines 106 between character candidates 105 indicate connections between character candidates 105. That is, the connection pattern indicates the connection between character candidates 105 indicated by connecting character candidates 105 from start point 107 to end point 108 by lines 106.

[0057] Moreover, the processor 11 has a function of calculating a score (likelihood) indicating the possibility that the character candidate 105 is a predetermined character string by OCR processing (fifth step).

[0058] Processor 11 matches character candidate 105 with dictionary information through OCR processing. Processor 11 calculates a score for character candidate 105 through matching. Here, the score indicates the possibility that the image of character candidate 105 is a predetermined character.

[0059] Here, processor 11 calculates scores for a plurality of predetermined characters. That is, processor 11 calculates, for each of a plurality of predetermined characters, a score indicating the possibility that character candidate 105 is the predetermined character. Processor 11 calculates a score for each character candidate 105 in a similar manner.

[0060] The processor 11 also has a function of generating intermediate information based on the information obtained in the first to fifth steps. The intermediate information is composed of information generated during the OCR process. That is, the intermediate information is information for recognizing character strings. Here, the intermediate information does not include the captured image 103, the baggage image 104, or the recognition result. The intermediate information is binary data.

[0061] An example of the configuration of intermediate information is shown in Fig. 5. As shown in Fig. 5, the intermediate information is composed of "image size", "package coordinates", "package size", "package angle", "package color", "character string coordinates", "character string cutout size", "barcode", "label", "handwritten / printed determination", "character candidate coordinates", "character candidate cutout size", "character candidate connection", and "character candidate score", etc.

[0062] The intermediate information may include configurations as necessary in addition to the configurations shown in FIG. 5, or specific configurations may be excluded from the intermediate information.

[0063] The "image size" is obtained in the first step. “Image size” indicates the size of the captured image 103 .

[0064] The "luggage coordinates", "luggage size", "luggage angle" and "luggage color" are obtained in the second step.

[0065] “Luggage coordinates” indicates the coordinates of the luggage image 104 . “Size of luggage” indicates the size of the luggage image 104 . The "baggage angle" indicates the inclination of the baggage image 104. “Color of luggage” indicates the color of the luggage image 104 .

[0066] The "character string coordinates," "character string cutout size," "barcode," "label," and "handwritten / printed determination" are obtained in the third step.

[0067] "String coordinates" indicates the coordinates of the string image. "Character string cutout size" indicates the size of the character string image. "Barcode" is information related to the barcode of the baggage image 104. For example, "barcode" indicates the coordinates of the barcode, the size of the barcode, and the information indicated by the barcode.

[0068] "Label" is information related to the label of the luggage image 104. For example, "Label" indicates the coordinates of the label, the size of the label, and the information written on the label. "Handwritten / printed" indicates whether the character string in the character string image is handwritten or printed.

[0069] The "coordinates of the character candidate", "cut-out size of the character candidate" and "connection of the character candidate" are acquired in the fourth step. “Coordinates of character candidate” indicates the coordinates of the character candidate 105 . “Cut-out size of character candidate” indicates the size of the character candidate 105 . “Connection of character candidates” indicates each connection pattern of the character candidates 105.

[0070] The "character candidate score" is obtained in the fifth step. “Character candidate score” indicates the score of each character candidate 105 .

[0071] The processor 11 also has a function of transmitting destination information related to the destination to the sorting device 2. After generating the intermediate information, the processor 11 transmits the generated intermediate information to the server 20 via the communication unit 15.

[0072] As will be described later, the server 20 transmits destination information to the OCR device 10 as part of the intermediate information.

[0073] The processor 11 receives the destination information from the server 20 through the communication unit 15. Upon receiving the destination information, the processor 11 transmits the received destination information to the sorting device 2 through the sorting device interface 18.

[0074] Next, a description will be given of functions realized by the server 20. The functions realized by the server 20 are realized by the processor 21 executing a program stored in the internal memory, the ROM 22, the NVM 24, or the like.

[0075] FIG. 6 is a diagram for explaining the functions realized by the server 20. As shown in FIG.

[0076] First, the processor 21 has a function of recognizing a character string written in a character string image based on the intermediate information. As described above, the processor 21 of the OCR device 10 transmits the intermediate information to the server 20 via the communication unit 15.

[0077] The processor 21 of the server 20 receives the intermediate information from the OCR device 10 via the communication unit 15 .

[0078] Upon receiving the intermediate information, the processor 21 obtains one connection pattern from the intermediate information.

[0079] When one connection pattern is acquired, the processor 21 matches the connection pattern with a predetermined candidate (character string). Here, the processor 21 calculates an evaluation value indicating the possibility that the character string indicated by the connection pattern is the predetermined candidate. The processor 21 calculates an evaluation value for each of the multiple candidates.

[0080] For example, the NVM 24 stores an address database indicating a plurality of candidates (here, address candidates). The processor 21 inputs each candidate indicated by the address database and each piece of information indicated by the intermediate information to a predetermined evaluation function, and calculates an evaluation value for each candidate.

[0081] Processor 21 similarly calculates an evaluation value for each candidate for each connection pattern indicated by the intermediate information.

[0082] When the evaluation value of each candidate for each connection pattern is calculated, the processor 21 identifies the largest evaluation value. When the largest evaluation value is identified, the processor 21 acquires the candidate corresponding to the identified evaluation value. The processor 21 acquires the candidate as a character string (here, a destination) written in the character string image.

[0083] The processor 21 also has a function of transmitting destination information related to the recognized character string to the OCR device 10.

[0084] As described above, the processor 21 recognizes the character string written in the character string image. Here, it is assumed that the processor 21 recognizes a destination as a character string. When the processor 21 recognizes the destination, it generates destination information related to the recognized destination.

[0085] For example, the destination information includes a recognized destination (the destination itself). The destination information may also indicate a sorting destination to which parcels of the recognized destination will be sorted. For example, the destination information may indicate a chute, pocket, cart, tray, or the like to which articles are sorted in the sorting device 2. The configuration of the destination information is not limited to a specific configuration.

[0086] When the destination information is generated, the processor 21 transmits the generated destination information to the OCR device 10 via the communication unit 25.

[0087] Next, an example of the operation of the recognition system 1 will be described. First, a description will be given of an example of the operation of the OCR device 10. FIG.

[0088] First, the processor 11 of the OCR device 10 acquires the captured image 103 from the camera 3 (S11). Upon acquiring the captured image 103, the processor 11 extracts the baggage image 104 from the captured image 103 (S12).

[0089] When the baggage image 104 is extracted, the processor 11 extracts a character string image from the baggage image 104 (S13). When the character string image is extracted, the processor 11 determines whether the character string written in the character string image is handwritten or printed (S14).

[0090] After determining whether the character string written in the character string image is handwritten or printed, processor 11 extracts character candidates 105 from the character string image (S15). After extracting character candidates 105, processor 21 calculates a score for each character candidate 105 (S16).

[0091] After calculating the score of each character candidate 105, processor 21 generates intermediate information (S17). After generating the intermediate information, processor 21 transmits the generated intermediate information to server 20 via communication unit 25 (S18).

[0092] After transmitting the intermediate information to the server 20, the processor 21 determines whether or not the destination information has been received through the communication unit 25 (S19). If it is determined that the destination information has not been received through the communication unit 25 (S19, NO), the processor 21 returns to S19.

[0093] When it is determined that the destination information has been received through the communication unit 25 (S19, YES), the processor 21 transmits the received destination information to the sorting device 2 through the sorting device interface 18 (S20). After transmitting the destination information to the sorting device 2, the processor 21 ends its operation.

[0094] Next, a description will be given of an example of the operation of the server 20. FIG.

[0095] First, the processor 21 of the server 20 receives the intermediate information from the OCR device 10 via the communication unit 25 (S21). Upon receiving the intermediate information, the processor 21 acquires one connection pattern from the intermediate information (S22).

[0096] When one connection pattern is acquired, the processor 21 matches the connection pattern with each candidate (S23). The processor 21 matches the connection pattern with each candidate and calculates an evaluation value for each candidate (S24).

[0097] After calculating the evaluation value of each candidate, processor 21 determines whether or not other connection patterns exist (S25). If it is determined that other connection patterns exist (S25, YES), processor 21 returns to S22.

[0098] If it is determined that no other connection patterns exist (S25, NO), the processor 21 recognizes the character string written in the character string image based on each evaluation value (S26). After recognizing the character string, the processor 21 transmits destination information related to the recognized character string to the OCR device 10 via the communication unit 25 (S27). After transmitting the destination information to the OCR device 10, the processor 21 ends its operation.

[0099] Next, a modification of the OCR device 10 will be described. Here, the processor 11 of the OCR device 10 generates a score map.

[0100] FIG. 9 is a diagram for explaining functions realized by the OCR device 10 in the modified example.

[0101] The first to third steps have been described above and will not be described here.

[0102] In the fourth step, the processor 11 generates a score map.

[0103] The score map can be obtained by applying machine learning, pattern recognition, or CNN (Convolutional Neural Network) to the character string image. The width W of the score map changes according to the width of the character string image (proportional or the same). The width H of the score map is the number of types of characters to be recognized + 1.

[0104] In the example of Figure 9, H=7 for "ΦABCDEF" (in actual OCR, H=several thousand since it includes numbers, kanji, etc.).

[0105] Here, "Φ" is a special character that means "nothing." Each row (ordinate) of the score map corresponds to each character (ΦABCDEF) to be recognized. Each column (abscissa) of the score map corresponds to each column of the character string image.

[0106] The score map has the characteristic that the score (value) of the corresponding column of the row corresponding to the "character" written in the character string image is large.

[0107] In the example of Figure 9, the second and third columns of the fourth row, which corresponds to the "C" in "CAFFEE," have larger values ​​than the other rows (ΦBCEF) (in the figure below, the largest value in each column is shown in bold). The same applies to "A" and "E".

[0108] The server 20 can recognize the characters written in the character string image by determining each character corresponding to the maximum score in each column of the score map.

[0109] The processor 11 generates intermediate information including the score map. Note that the intermediate information may include information acquired from the first to third steps. After generating the intermediate information, the processor 11 transmits the generated intermediate information to the server 20 via the communication unit 15.

[0110] The processor 11 of the OCR device 10 may generate information indicating a sorting destination based on the destination information. For example, when the destination information includes a destination, the processor 11 may generate information indicating a sorting destination for sorting parcels of the destination. The processor 11 transmits the generated information to the sorting device 2.

[0111] The sorting device 2 and the camera 3 may be integrally formed. The sorting device 2, the camera 3 and the OCR device 10 may be integrally formed.

[0112] The recognition system configured as described above generates intermediate information from a captured image in an OCR device. The recognition system transmits the intermediate information to a server. The recognition system recognizes character strings in the server based on the intermediate information. As a result, the recognition system can reduce the amount of data transferred to the server compared to when an image is sent to the server. Therefore, the recognition system can reduce the transfer time to the server and quickly recognize character strings.

[0113] In addition, the recognition system does not transmit the image to a server, so that the image can be prevented from being read. As a result, the recognition system can reduce the risk of personal information leaking.

[0114] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. The invention as described in the claims of the original application is set forth below. [C1] an image interface for acquiring a captured image including a character string; A communication interface for connecting to an external device; generating intermediate information composed of information generated during a character recognition process from the captured image; transmitting the intermediate information to the external device through the communication interface; A processor; An information processing device comprising: [C2] The processor, Extracting character candidates from the captured image; Extracting a connection pattern of the character candidates; calculating a score indicating the likelihood that the characters described in the character candidate are a predetermined character string; the intermediate information includes a connection pattern of the character candidates and the score; An information processing device according to [C1]. [C3] The intermediate information includes coordinates and sizes of the character candidates. The information processing device according to [C2]. [C4] The intermediate information indicates whether the character string is handwritten or printed. An information processing device according to any one of [C1] to [C3]. [C5] The processor receives string information associated with the string from the external device via the communication interface. An information processing device according to any one of [C1] to [C4]. [C6] The string is a destination. The information processing device according to [C5]. [C7] a sorting device interface for connecting to a sorting device for sorting the items; the processor transmits the string information to the segmenter through the segmenter interface; The information processing device according to [C6]. [C8] A program executed by a processor, The processor, A function for generating intermediate information composed of information generated during character recognition processing from a captured image including a character string; a function of transmitting the intermediate information to an external device; A program to achieve this. [C9] A communication interface for transmitting and receiving data to and from an external device; receiving intermediate information from the external device via the communication interface, the intermediate information being composed of information generated in the process of character recognition processing from a captured image including a character string; Recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; A processor; An information processing device comprising: [C10] the intermediate information includes a connection pattern of the character candidates extracted from the captured image and a score indicating a possibility that the character described in the character candidate is a predetermined character, The processor, calculating an evaluation value indicating a possibility that the character string is a predetermined candidate based on the connection pattern and the score; Recognizing the character string based on the evaluation value. An information processing device according to [C9]. [C11] The processor transmits string information related to the string to the external device via the communication interface. The information processing device according to [C9] or [C10]. [C12] A program executed by a processor, The processor, A function of receiving intermediate information from an external device, the intermediate information being composed of information generated in the process of character recognition processing from a captured image including a character string; a function of recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; A program to achieve this. [C13] A system including a first information processing device and a second information processing device, The first information processing device, an image interface for acquiring a captured image including a character string; a first communication interface connected to the second information processing device; generating intermediate information composed of information generated during a character recognition process from the captured image; transmitting the intermediate information to the second information processing device through the first communication interface; A first processor; Equipped with The second information processing device is a second communication interface for transmitting and receiving data to and from the first information processing device; receiving the intermediate information from the first information processing device through the second communication interface; Recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; A second processor; and Equipped with system. [Explanation of symbols]

[0115] 1...recognition system, 2...segmentation device, 3...camera, 6...network, 10...OCR device, 11...processor, 12...ROM, 13...RAM, 14...NVM, 15...communication unit, 16...operation unit, 17...display unit, 18...segmentation device interface, 19...camera interface, 20...server, 21...processor, 22...ROM, 23...RAM, 24...NVM, 25...communication unit, 26...operation unit, 27...display unit, 103...captured image, 104...luggage image, 105...character candidate, 106...line, 107...starting point, 108...end point.

Claims

1. An image interface for acquiring a captured image including a character string; A communication interface for connecting to an external device; generating intermediate information composed of information generated during a character recognition process from the captured image; transmitting the intermediate information to the external device through the communication interface; A processor; Equipped with The processor, Extracting character candidates from the captured image; Extracting a connection pattern of the character candidates; calculating a score indicating the likelihood that the characters described in the character candidate are a predetermined character string; the intermediate information includes a connection pattern of the character candidates and the score; Information processing device.

2. The intermediate information includes coordinates and sizes of the character candidates. The information processing device according to claim 1 .

3. The intermediate information indicates whether the character string is handwritten or printed. The information processing device according to claim 1 .

4. The processor receives string information associated with the string from the external device via the communication interface. The information processing device according to claim 1 .

5. The string is a destination. The information processing device according to claim 4.

6. a sorting device interface for connecting to a sorting device for sorting the items; the processor transmits the string information to the segmenter through the segmenter interface; The information processing device according to claim 5 .

7. A program executed by a processor, The processor, A function for generating intermediate information composed of information generated during character recognition processing from a captured image including a character string; a function of transmitting the intermediate information to an external device; Realize this, The processor further comprises: A function of extracting character candidates from the captured image; A function of extracting a connection pattern of the character candidates; A function of calculating a score indicating the possibility that the characters written in the character candidates are a predetermined character string; Realize this, the intermediate information includes a connection pattern of the character candidates and the score; program.

8. A communication interface for transmitting and receiving data to and from an external device; receiving intermediate information from the external device via the communication interface, the intermediate information being composed of information generated in the process of character recognition processing from a captured image including a character string; Recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; A processor; Equipped with the intermediate information includes a connection pattern of the character candidates extracted from the captured image and a score indicating a possibility that the character described in the character candidate is a predetermined character, The processor, calculating an evaluation value indicating a possibility that the character string is a predetermined candidate based on the connection pattern and the score; Recognizing the character string based on the evaluation value. Information processing device.

9. The processor transmits string information related to the string to the external device via the communication interface. The information processing device according to claim 8.

10. A program executed by a processor, The processor, A function of receiving intermediate information from an external device, the intermediate information being composed of information generated in the process of character recognition processing from a captured image including a character string; a function of recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; Realize this, the intermediate information includes a connection pattern of the character candidates extracted from the captured image and a score indicating a possibility that the character described in the character candidate is a predetermined character, The processor further comprises: a function of calculating an evaluation value indicating a possibility that the character string is a predetermined candidate based on the connection pattern and the score; A function of recognizing the character string based on the evaluation value; A program to achieve this.

11. A system including a first information processing device and a second information processing device, The first information processing device, an image interface for acquiring a captured image including a character string; a first communication interface connected to the second information processing device; generating intermediate information composed of information generated during a character recognition process from the captured image; transmitting the intermediate information to the second information processing device through the first communication interface; A first processor; Equipped with The first processor, Extracting character candidates from the captured image; Extracting a connection pattern of the character candidates; calculating a score indicating the likelihood that the characters described in the character candidate are a predetermined character string; the intermediate information includes a connection pattern of the character candidates and the score, The second information processing device is a second communication interface for transmitting and receiving data to and from the first information processing device; receiving the intermediate information from the first information processing device through the second communication interface; Recognizing the character string based on the intermediate information; generating character string information related to the recognized character string; A second processor; and Equipped with The second processor comprises: calculating an evaluation value indicating a possibility that the character string is a predetermined candidate based on the connection pattern and the score; Recognizing the character string based on the evaluation value. system.

Images