Reading device and reading method

Abstract

To provide a reader capable of improving recognition accuracy when an image recognition server performs the recognition of multiple images captured by multiple imaging parts.SOLUTION: A reader comprises a synchronization signal output part, a first imaging part, a second imaging part, an acquisition part, and a transmitter. The synchronization signal output part outputs a synchronization signal. The first imaging part images a reading object held over a reading window through the reading window in synchronization with the synchronization signal. The second imaging part images the reading object held over the reading window without the reading window in synchronization with the synchronization signal. The acquisition part acquires the first image of the reading object captured by the first imaging part in synchronization with the synchronization signal and the second image of the reading object captured by the second imaging part in synchronization with the synchronization signal. The transmitter associates the first image and the second image acquired by the acquisition part, and transmits them to an image recognition server which recognizes the images of the reading object.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] FIELD An embodiment of the present invention relates to a reading device and a reading method. [Background technology]

[0002] There are reading devices that read information about an object from an image of the object held over a reading window. For example, a code reading device that reads the data in a barcode attached to a product by an operator when the barcode is held over a reading window corresponds to this type of reading device.

[0003] Conventional reading devices read information from an image captured through a reading window. Therefore, it is not possible to read information based on an image of a surface other than the surface of the object being read that is held over the reading window. Therefore, a reading device has been considered that includes a first imaging unit that captures an image of the object being read through the reading window, and a second imaging unit that captures an image of the object without passing through the reading window, and that reads information from the images captured by each imaging unit. Furthermore, with recent improvements in image recognition technology, image recognition servers that can recognize information from various images have been developed. Therefore, a reading device equipped with multiple imaging units is connected to an image recognition server via a network, and the recognition processing of multiple images captured by each imaging unit is entrusted to the image recognition server. This allows for the construction of a high-performance reading system.

[0004] However, in this type of reading system, if multiple images captured by multiple imaging units are asynchronously sent from the reading device to the image recognition server, the order of the images sent to the image recognition server may be changed, resulting in incorrect image recognition. In particular, in the case of a reading device in which multiple objects to be read are successively held over the reading window to read their information, there is a high possibility that an image of one object to be read may be sandwiched between images of another object to be read, resulting in erroneous recognition. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-048648 Summary of the Invention [Problem to be solved by the invention]

[0006] The problem to be solved by the embodiments of the present invention is to provide a reading device that can improve the recognition accuracy when an image recognition server recognizes multiple images captured by multiple imaging units. [Means for solving the problem]

[0007] In one embodiment, the reading device includes a synchronization signal output unit, a first imaging unit, a second imaging unit, an acquisition unit, and a transmission unit. The synchronization signal output unit outputs a synchronization signal. The first imaging unit captures an image of an object to be read held over a reading window through the reading window in synchronization with the synchronization signal. The second imaging unit captures an image of the object to be read held over the reading window without passing the image through the reading window in synchronization with the synchronization signal. The acquisition unit acquires a first image of the object to be read captured by the first imaging unit in synchronization with the synchronization signal, and a second image of the object to be read captured by the second imaging unit in synchronization with the synchronization signal. The transmission unit associates the first image and the second image acquired by the acquisition unit and transmits them to an image recognition server that recognizes the image of the object to be read. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating the overall configuration of a code reading system according to an embodiment. [Figure 2] FIG. 1 is a schematic diagram illustrating an example of a product according to an embodiment. [Figure 3] FIG. 2 is a block diagram showing the main circuit configuration of the scanner according to the embodiment. [Figure 4] 4 is a flowchart showing the main information processing procedures executed by the scanner processor according to a code reading program in one embodiment. [Figure 5] 5 is a flowchart showing a specific procedure for the sticker detection process in FIG. 4. [Figure 6] 10 is a flowchart showing the main information processing procedures executed by the scanner processor according to a code reading program in another embodiment. [Figure 7] 7 is a flowchart showing a specific procedure for the sticker detection process in FIG. 6. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, several embodiments will be described with reference to the drawings. [First embodiment] First, the first embodiment will be described with reference to FIGS.

[0010] FIG. 1 is a diagram showing the overall configuration of a reading system 100 according to an embodiment. The reading system 100 includes a plurality of scanners 10, a plurality of POS (Point Of Sales) terminals 20, and an image recognition server 30. The plurality of scanners 10 and the POS terminals 20 correspond one-to-one to each other and are connected to each other via communication cables. The plurality of scanners 10 and the image recognition server 30 are connected to a communication network 40. The communication network 40 is typically a LAN (Local Area Network). The LAN may be a wired LAN or a wireless LAN. The communication network 40 may be the Internet, for example, and the image recognition server 30 may be a cloud computing server.

[0011] The scanner 10 is an example of a reading device that reads information from an image of an object captured by an imaging unit. In this embodiment, the object is a product, and the information is a barcode. That is, the scanner 10 functions as a code reading device. A barcode is a product code that is uniquely assigned to each product to identify the product, and is typically attached to the product case or package. The scanner 10 outputs the data of the read barcode to the POS terminal 20. Note that the scanner 10 may read information such as a two-dimensional data code or a character code from the product image instead of a barcode.

[0012] The POS terminal 20 acquires a product code from the barcode data read by the scanner 10. The POS terminal 20 acquires the price associated with the product code and set in the price master, and registers the sales data of the product based on that price. In other words, the barcode is a code for obtaining the product price. The POS terminal 20 is an example of a processing device that processes product sales data. Such POS terminals 20 are well known, so a detailed description thereof will be omitted here.

[0013] FIG. 2 is a schematic diagram showing an example of an object to be read according to this embodiment, i.e., a product 50. The product 50 is a product subject to a price change and is sold at a 10% discount from the regular price. As shown in FIG. 2, the product 50 has a barcode label 52 attached to a first surface 501 of the case or package, on which a barcode 51 is displayed along with the product name and regular price. The barcode label 52 may be printed on the case or package, or may be attached to the case or package as a sticker-like label.

[0014] A price change label 53 is attached to a second surface 502 adjacent to the first surface 501 of the case or package. The price change label 53 is attached to the second surface 502 as a sticker-like label. The price change label 53 is a label that displays price change information related to a price change. The price change label 53 in FIG. 2 displays price change information that discounts the price by 10%. The price change information is not limited to discount rate information. For example, it may be information on a discount amount for discounting the price, selling price information for changing the price to a specified selling price, or information on a surcharge rate for increasing the price.

[0015] A flag sticker 54 is affixed to the first surface 501. The flag sticker 54 indicates that a price change label 53 is attached to the product 50, and is affixed to the product 50 together with the price change label 53. As shown in FIG. 2, the flag sticker 54 is affixed so that at least a portion thereof overlaps the barcode label 52. The flag sticker 54 does not necessarily have to be affixed so as to overlap the barcode label 52. The flag sticker 54 may be affixed so as to be in contact with the edge of the barcode label 52, for example. The key is that the flag sticker 54 is affixed in the vicinity of the barcode label 52.

[0016] 2 illustrates a product 50 having a barcode label 52 and a flag sticker 54 attached to the first surface 501 and a price change label 53 attached to the second surface 502, but the barcode label 52, flag sticker 54, and price change label 53 may be attached to the same surface. For example, if there is enough space on the first surface 501 to which the barcode label 52 is attached for the price change label 53, the price change label 53 and flag sticker 54 are attached to the first surface 501. However, if there is not enough space, the flag sticker 54 is attached near the barcode label 52 on the first surface 501, and the price change label 53 is attached to the second surface 502. This type of practical operation can be achieved in this embodiment.

[0017] 3 is a block diagram showing the main circuit configuration of the scanner 10. The scanner 10 includes a processor 11, a main memory 12, an auxiliary storage device 13, a timer 14, a communication interface 15, a first image capture device 161, a second image capture device 162, an illumination device 163, a synchronization signal output circuit 164, and a terminal interface 17. The processor 11, the main memory 12, the auxiliary storage device 13, the timer 14, the communication interface 15, the first image capture device 161, the second image capture device 162, the illumination device 163, the synchronization signal output circuit 164, and the terminal interface 17 are connected by a system transmission path 18. The system transmission path 18 includes an address bus, a data bus, a control signal line, etc. The scanner 10 constitutes a computer by connecting the processor 11, the main memory 12, the auxiliary storage device 13, and the timer 14 via the system transmission path 18. The computer is connected to a communication interface 15, a first imaging device 161, a second imaging device 162, an illumination device 163, a synchronization signal output circuit 164, and a terminal interface 17, thereby realizing the function of the scanner 10.

[0018] The processor 11 corresponds to the central part of the computer. The processor 11 controls each part to realize various functions of the scanner 10 in accordance with an operating system or application programs. The processor 11 is, for example, a CPU (Central Processing Unit).

[0019] The main memory 12 corresponds to the main storage portion of the computer. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or application programs in the non-volatile memory area. The main memory 12 stores data required for the processor 11 to execute processes for controlling each part in the volatile memory area. The above data may also be stored in the non-volatile memory area. The main memory 12 uses the volatile memory area as a work area where data can be rewritten by the processor 11 as appropriate. The non-volatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0020] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. As the auxiliary storage device 13, for example, well-known storage devices such as an SSD (Solid State Drive), an HDD (Hard Disc Drive), or an EEPROM (Electric Erasable Programmable Read-Only Memory) are used alone or in combination. The auxiliary storage device 13 stores data used by the processor 11 when performing various processes, or data created by the processes in the processor 11. The auxiliary storage device 13 may also store the above-mentioned application programs.

[0021] The application programs stored in the main memory 12 or the auxiliary storage device 13 include a code reading program. There are no particular limitations on the method for installing the code reading program into the main memory 12 or the auxiliary storage device 13. The code reading program can be installed into the main memory 12, 22 or the auxiliary storage device 13, 23 by recording a control program on a removable recording medium or by distributing the code reading program via communication over a network. The recording medium can be in any form, such as an SD memory card or USB memory, as long as it can store a program and is readable by the device.

[0022] The timer 14 is a device that starts counting time in response to a start signal and outputs a timeout signal when the counting time reaches a predetermined timeout period. In this embodiment, the timeout period is the operating time required for the image recognition server 30 to recognize the price change information displayed on the price change label 53 from the product image.

[0023] The communication interface 15 is an interface with the image recognition server 30. The communication interface 15 transmits and receives data signals to and from the image recognition server 30 connected via the communication network 40 in accordance with a predetermined communication protocol.

[0024] The first imaging device 161 and the second imaging device 162 are both devices that have a CCD (Charge Coupled Device) imaging element, which is an area image sensor, a driving circuit that drives this CCD imaging element, and an imaging lens that forms an image of the imaging area on the CCD imaging element, and output data of the image formed on the CCD imaging element.

[0025] The first imaging device 161 is a device that captures an image of a commodity held over the reading window 101 through the reading window 101. The reading window 101 is provided on one side of the housing that constitutes the scanner 10, and is used by the operator of the scanner 10 to hold the commodity, which is the object to be read, over the reading window 101. Therefore, the first imaging device 161 is provided inside the housing. The first imaging device 161 functions as a first imaging unit.

[0026] The second imaging device 162 is a device that captures an image of a commodity held over the reading window 101 without passing through the reading window 101. Therefore, the second imaging device 162 is provided near the reading window 101 on the outside of the housing. For example, when an operator holds the first surface 501 of the commodity 50 shown in FIG. 2 over the reading window 101, the second imaging device 162 is provided in a position where it can capture an image of the second surface 502. The second imaging device 162 functions as a second imaging unit.

[0027] The lighting device 163 is a device that illuminates the outside of the reading window 101, that is, the space where the product is held over the reading window 101. The lighting device 163 uses, for example, an LED as a light source. The lighting device 163 may use a light-emitting element other than an LED as a light source. The lighting device 163 functions as a lighting unit.

[0028] The synchronization signal output circuit 164 is a circuit for repeatedly outputting a synchronization signal at a constant cycle. The synchronization signal is output in common to the first imaging device 161, the second imaging device 162, and the lighting device 163. The first imaging device 161 and the second imaging device 162 perform imaging operations for a constant time in synchronization with the synchronization signal. The lighting device 163 performs light emission operations for a constant time in synchronization with the synchronization signal. The cycle of the synchronization signal is set longer than the imaging operation time of the first imaging device 161 and the second imaging device 162 and the light emission operation time of the lighting device 163. The imaging operation time and the light emission operation time are set to be the same or the light emission operation time is set to be slightly longer than the imaging operation time. The synchronization signal output circuit 164 functions as a synchronization signal output unit.

[0029] The terminal interface 17 is an interface with the POS terminal 20. The terminal interface 17 transmits and receives data signals to and from the POS terminal 20 connected via a communication cable.

[0030] The scanner 10 uses part of the storage area of the main memory 12 as a first image memory 121 and a second image memory 122. The first image memory 121 is an area for storing images captured by the first imaging device 161 in chronological order. The second image memory 122 is an area for storing images captured by the second imaging device 162 in chronological order.

[0031] The processor 11 has functions as an acquisition unit 111, a reading unit 112, a determination unit 113, a synthesis unit 114, a transmission unit 115, a reception unit 116, an output unit 117, and a control unit 118. The acquisition unit 111 has a function of acquiring an image of a product captured by a first imaging device 161, known as a first image, and an image of a product captured by a second imaging device, known as a second image, in synchronization with a synchronization signal. The acquisition unit 111 can be referred to as an acquisition means.

[0032] The reading unit 112 has a function of reading a code for obtaining the price of a product, i.e., a barcode 51, from the first image or the second image acquired by the acquisition unit 111. Existing technology is used to read the barcode 51 from the image. The reading unit 112 can be referred to as a reading means.

[0033] The determination unit 113 has a function of determining whether or not a label displaying price change information related to a price change obtained from the barcode 51, i.e., a price change label 53, is attached to the product. If the determination unit 113 detects a flag sticker 54 attached near the barcode 51, it determines that a price change label 53 is attached to the product. If the determination unit 113 does not detect a flag sticker 54, it determines that a price change label 53 is not attached to the product. The determination unit 113 can be rephrased as a determination means.

[0034] The composition unit 114 has a function of combining the first image and the second image acquired by the acquisition unit 111. For example, the composition unit 114 joins a first image having the number of pixels Px in the X-axis direction and the number of pixels Py in the Y-axis direction of an XY two-dimensional coordinate system with a second image having the same number of pixels Px in the X-axis direction and the number of pixels Py in the Y-axis direction so that they are tangent in the X-axis direction, thereby generating a composite image having 2Px pixels in the X-axis direction and Py pixels in the Y-axis direction. Alternatively, the composition unit 114 joins the first image and the second image so that they are tangent in the Y-axis direction, thereby generating a composite image having Px pixels in the X-axis direction and 2Py pixels in the Y-axis direction. The composition unit 114 can be referred to as a composition means.

[0035] The transmission unit 115 has a function of transmitting the composite image generated by the synthesis unit 114 to the image recognition server 30. The transmission unit 115 can be rephrased as a terminal-side transmission unit or transmission means.

[0036] The receiving unit 116 has a function of receiving information recognized by the image recognition server 30. The information is, for example, price change information displayed on the price change label 53. The receiving unit 116 can be referred to as a terminal-side receiving unit or receiving means.

[0037] The output unit 117 has the following two functions. The first is a function to output the data of the barcode 51 read by the reading unit 112 to the POS terminal 20 when the determination unit 113 determines that the price change label 53 is not attached to the product. The second is a function to output the data of the barcode 51 read by the reading unit 112 and the price change information received by the receiving unit 116 to the POS terminal 20 when the determination unit 113 determines that the price change label 53 is attached to the product. The output unit 117 can be referred to as output means.

[0038] The control unit 118 has a function of controlling the start and stop operations of the first imaging device 161, the second imaging device 162, the lighting device 163, and the synchronization signal output circuit 164. The control unit 118 can be called a control means.

[0039] 4 and 5 are flowcharts showing the main information processing steps that the processor 11 of the scanner 10 executes in accordance with the code reading program. The main operations of the scanner 10 will be explained below in accordance with the flowcharts. Note that the information processing steps are not limited to those shown in the flowcharts. They can be modified as needed as long as similar operational effects are achieved.

[0040] In ACT1, the processor 11 waits for a read start command to be input. The read start command is given from the corresponding POS terminal 20. For example, when the POS terminal 20 settles a transaction with the previous customer, the POS terminal 20 outputs a read start command to the scanner 10. When the read start command is input, the processor 11 determines YES in ACT1 and proceeds to ACT2. In ACT2, the processor 11 uses the function of the control unit 118 to output activation signals to the first imaging device 161, the second imaging device 162, the lighting device 163, and the synchronization signal output circuit 164.

[0041] In the first imaging device 161 and the second imaging device 162, to which the activation signal has been input, the CCD imaging elements are turned on. In the lighting device 163, the light source is turned on. The synchronization signal output circuit 164 starts intermittently outputting a synchronization signal. The synchronization signal is input to the first imaging device 161, the second imaging device 162, and the lighting device 163. The first imaging device 161, having received the synchronization signal, sequentially writes data of the image formed on the CCD imaging element to the first image memory 121 in synchronization with the synchronization signal. The second imaging device 162, having received the synchronization signal, sequentially writes data of the image formed on the CCD imaging element to the second image memory 122 in synchronization with the synchronization signal. The lighting device 163, having received the synchronization signal, causes the light source to emit light at a predetermined intensity in synchronization with the synchronization signal. In other words, the synchronization signal is a signal that synchronizes the imaging timing of the first imaging device 161 and the imaging timing of the second imaging device 162. The synchronization signal also serves to synchronize the image capture timing with the light emission timing of the illumination device 163 .

[0042] The processor 11 acquires, as ACT3, an image stored in the first image memory 121 using the function of the acquisition unit 111, the so-called first image. The processor 11 also acquires, as ACT4, an image stored in the second image memory 122 using the function of the acquisition unit 111, the so-called second image. The first image and the second image are images captured by the first imaging device 161 and the second imaging device 162 in synchronization with a synchronization signal. That is, the processor 11 acquires the first image captured by the first imaging device 161 and the second image captured by the second imaging device 162 at the same imaging timing.

[0043] In ACT5, processor 11 reads barcode 51 from the first image using the function of reading unit 112. In ACT6, processor 11 checks whether barcode 51 was successfully read. If barcode 51 was not successfully read from the first image, processor 11 determines NO in ACT6 and returns to ACT3. In this way, processor 11 sequentially acquires the first image and second image captured in synchronization with the synchronization signal from first image memory 121 and second image memory 122, and repeats the process of reading barcode 51 from the first image. As a result, if barcode 51 was successfully read, processor 11 determines YES in ACT6 and proceeds to ACT7.

[0044] In ACT7, processor 11 determines whether or not a price change label 53 is attached to the product using the function of determination unit 113. Specifically, processor 11 searches for flag sticker 54 from the first image from which barcode 51 was read. In ACT8, processor 11 confirms whether or not flag sticker 54 was detected.

[0045] If the product does not have a price change label 53 attached, the flag sticker 54 will not be detected. If the flag sticker 54 cannot be detected, the processor 11 determines NO in ACT 8 and proceeds to ACT 9. In ACT 9, the processor 11 uses the function of the output unit 117 to output the data of the barcode 51 to the POS terminal 20 via the terminal interface 17.

[0046] If a price change label 53 is attached to a product, the flag sticker 54 will generally be detected. If the flag sticker 54 is detected, the processor 11 determines YES in ACT8 and proceeds to ACT10. The processor 11 executes sticker detection processing in ACT10. The sticker detection processing will be described later.

[0047] When the processor 11 completes the processing of ACT9 or ACT10, it proceeds to ACT11. In ACT11, the processor 11 checks whether a reading end command has been input. The reading end command is given from the corresponding POS terminal 20. For example, when a closing operation is performed in the POS terminal 20 to instruct the customer to end the registration of the products to be purchased, the POS terminal 20 outputs a reading end command to the scanner 10. If a reading end command has not been input, the processor 11 determines NO in ACT11 and returns to ACT3. The processor 11 executes the processing from ACT3 onwards in the same manner as described above.

[0048] When the reading end command is input, the processor 11 determines YES in ACT11 and proceeds to ACT12. In ACT11, the processor 11 outputs a stop signal to the first imaging device 161, the second imaging device 162, the lighting device 163, and the synchronization signal output circuit 164 using the function of the control unit 118. In the first imaging device 161 and the second imaging device 162 to which the stop signal is input, the CCD imaging elements are turned off. In the lighting device 163, the light source is turned off. In the synchronization signal output circuit 164, the output of the synchronization signal is stopped. With this, the processor 11 ends the information processing of the procedure shown in the flowchart of FIG. 4. The processor 11 waits again for the reading start command to be input.

[0049] 5 is a flowchart showing the specific steps of the sticker detection process. When the sticker detection process begins, processor 11 starts timer 14 in ACT 21. Processor 11 also uses the function of synthesis unit 114 to synthesize the first image acquired in the process of ACT 3 and the second image acquired in the process of ACT 4 in ACT 22. Processor 11 uses the function of transmission unit 115 in ACT 23 to transmit data of the synthesized image of the first and second images to image recognition server 30 via communication interface 15.

[0050] Image recognition server 30 functions as a server-side receiving unit, a server-side recognition unit, and a server-side transmitting unit. When image recognition server 30 receives image data via communication network 40 using the function of the server-side receiving unit, it recognizes the price change information displayed on price change label 53 from the image data using the function of the server-side recognition unit. Once the price change information has been recognized, image recognition server 30 uses the function of the server-side transmitting unit to send a recognition success response command via communication network 40 to scanner 10, the source of the image data. The recognition success response command includes the recognized price change information.

[0051] Here, the image received by image recognition server 30 is a composite image created by joining together a first image and a second image using the function of composition unit 114 of scanner 10. Image recognition server 30 recognizes the composite image by separating it into a first image and a second image. For example, composite image data transmitted from scanner 10 to image recognition server 30 includes information on the number of pixels (Px, Py) of the first image and the number of pixels (Px, Py) of the second image. Image recognition server 30 separates the composite image into the first image and the second image based on the information on the number of pixels (Px, Py) and performs recognition processing.

[0052] For example, the image recognition server 30 first performs recognition processing on the second image, and if the price change information cannot be recognized, performs recognition processing on the first image. Alternatively, the image recognition server 30 first performs recognition processing on the first image, and if the price change information cannot be recognized, performs recognition processing on the second image. If price change labels 53 are often attached to the second side 502 of the product 50, the former method can speed up the recognition speed. Conversely, if price change labels 53 are often attached to the first side 501 of the product 50, the latter method can speed up the recognition speed.

[0053] When the image recognition server 30 is able to recognize the price change information displayed on the price change label 53 from the first or second image, it sends a response command indicating successful recognition to the scanner 10 that sent the image data.

[0054] In ACT 24, the processor 11 of the scanner 10 that sent the composite image data checks, using the function of the receiving unit 116, whether or not a response command indicating successful recognition has been received from the image recognition server 30. If a response command has not been received, the processor 11 determines NO in ACT 24 and proceeds to ACT 25. In ACT 25, the processor 11 checks whether or not the timer 14 has timed out. If the timer 14 has not timed out, the processor 11 determines NO in ACT 25 and proceeds to ACT 26.

[0055] In ACT26, the processor 11 acquires the first image stored in the first image memory 121 using the function of the acquisition unit 111. In ACT27, the processor 11 acquires the second image stored in the second image memory 122 using the function of the acquisition unit 111. The first and second images are images captured by the first and second imaging devices 161 and 162 in synchronization with a synchronization signal. That is, in ACT26 and ACT27, the processor 11 acquires the first image captured by the first imaging device 161 and the second image captured by the second imaging device 162 at the same imaging timing. The processor 11 then repeats the processing from ACT22 onward in the same manner as described above. Therefore, until the image recognition server 30 recognizes price change information or the timer 14 times out, a composite image of the first and second images captured at the same imaging timing is repeatedly transmitted from the scanner 10 to the image recognition server 30.

[0056] When the processor 11 receives a response command indicating successful recognition from the image recognition server 30 via the communication interface 15 using the function of the receiving unit 116, it determines YES in ACT24 and proceeds to ACT28. In ACT28, the processor 11 uses the function of the output unit 117 to output the barcode data read in the processing of ACT5 and the price change information included in the response command indicating successful recognition to the POS terminal 20 via the terminal interface 17.

[0057] On the other hand, if the timer 14 times out without receiving a response command indicating successful recognition from the image recognition server 30, the processor 11 determines YES in ACT 25 and proceeds to ACT 29. In ACT 29, the processor 11 uses the function of the output unit 117 to output the barcode data read in the processing of ACT 5 to the POS terminal 20 via the terminal interface 17.

[0058] When the processing of ACT28 or ACT29 is completed, the processor 11 ends the sticker detection processing and proceeds to the processing of ACT11 described above.

[0059] The reading system 100 equipped with the scanner 10 and image recognition server 30 that operate in this manner can achieve the following effects. First, when a reading start command is given to the scanner 10 from the POS terminal 20 prior to registering the first item purchased by a customer, the first imaging device 161, second imaging device 162, lighting device 163, and synchronization signal output circuit 164 of the scanner 10 are activated. In this state, the operator picks up each item that the customer will purchase and holds the first side 501, to which the barcode label 52 is affixed, over the reading window 101. The operator may be a store clerk or a customer.

[0060] When the first side 501 bearing the barcode label 52 is held over the reading window, the scanner 10 captures an image of the first side 501 by the first imaging device 161. The second imaging device 162 captures an image of the second side 502. The first imaging device 161 and the second imaging device 162 perform imaging operations in synchronization with a synchronization signal output from the synchronization signal output circuit 164. Therefore, the first image written to the first image memory 121 and the second image memory 122 are images captured at the same timing. The illumination device 163 illuminates the vicinity of the reading window 101 in synchronization with the imaging timing of the first imaging device 161 and the second imaging device 162. The illumination time of the illumination device 163 is equal to or slightly longer than the imaging time of the first imaging device 161 and the second imaging device 162. Therefore, the first and second images are clear images provided with a sufficient amount of light.

[0061] Scanner 10 reads barcode 51 printed on barcode label 52 using the first image. Scanner 10 also checks whether or not a flag sticker 54 is attached near barcode label 52. If no flag sticker 54 is attached, i.e., if the barcode 51 of a product that is not subject to a price change is read, scanner 10 outputs the data of that barcode 51 to POS terminal 20. As a result, POS terminal 20 registers the product sales data at the price obtained from the data of barcode 51.

[0062] When flag sticker 54 is attached, i.e., when barcode 51 of a product whose price is subject to a price change is read, scanner 10 synchronises the first and second images captured in synchronization with a synchronization signal, and then transmits the composite image from scanner 10 to image recognition server 30.

[0063] Image recognition server 30 recognizes the price change information displayed on price change label 53 from the composite image. Once the price change information is recognized, scanner 10 outputs the price change information on price change label 53 along with the data of barcode 51 to POS terminal 20. As a result, POS terminal 20 registers the product sales data at a price obtained by changing the price obtained from the data of barcode 51 using the price change information.

[0064] Thus, in the reading system 100, when registering a product subject to a price change that has both a barcode label 52 and a price change label 53, the scanner 10 reads the barcode 51, and the image recognition server 30 recognizes the price change information displayed on the price change label 53. In this case, the scanner 10 combines the first and second images captured at the same time and transmits them to the image recognition server 30. Therefore, the scanner 10 does not transmit the first image captured by the first imaging device 161 and the second image captured by the second imaging device 162 asynchronously to the image recognition server 30. This eliminates the risk of incorrect image recognition due to the image order being reversed in the image recognition server 30. Even in the case of the scanner 10, which reads information on multiple products by holding them successively over the reading window 101, there is absolutely no possibility of erroneous recognition occurring due to an image of another product being sandwiched between images of one product.

[0065] Thus, the recognition process of the first image captured by the first imaging device 161 of the scanner 10 and the second image captured by the second imaging device 162 can be entrusted to the image recognition server 30. As a result, a high-performance code reading system can be configured.

[0066] Furthermore, the illumination device 163 only needs to emit light for a fixed period of time in synchronization with the synchronization signal. Therefore, there is no need for the illumination device 163 to emit light continuously from the start of reading to the end of reading, for example, which has the advantage of eliminating unnecessary illumination.

[0067] [Second embodiment] Next, a second embodiment will be described with reference to Figures 6 and 7. Incidentally, Figures 1 to 3 described in the first embodiment are also used in the second embodiment, and therefore their description will be omitted.

[0068] Figures 6 and 7 are flowcharts showing the main information processing procedures executed by the processor 11 of the scanner 10 in accordance with the code reading program in the second embodiment. Figure 6 corresponds to Figure 4 described in the first embodiment, and Figure 7 corresponds to Figure 5. Therefore, the same processing steps as in the first embodiment are denoted by the same reference numerals.

[0069] As can be seen by comparing FIG. 6 with FIG. 4, the second embodiment differs from the first embodiment in that processor 11 of scanner 10 omits the processing in ACT4. In principle, the operator holds a surface bearing a barcode 51 over reading window 101. Therefore, once processor 11 captures an image of first imaging device 161, which captures an image of a product held over reading window 101 through reading window 101, i.e., a first image, in ACT3, processor 11 executes a barcode reading process using that first image in ACT5. Furthermore, processor 11 executes a search process for flag sticker 54 using that first image in ACT7. If flag sticker 54 is detected as a result, processor 11 executes a sticker detection process, the steps of which are specifically shown in FIG. 7.

[0070] 7 and 5, in the second embodiment, after starting the timer 14 in ACT21, a first image captured by the first imaging device 161 is captured in synchronization with a synchronization signal in ACT31, and a second image captured by the second imaging device 162 is also captured in synchronization with the same synchronization signal in ACT32. Then, the processor 11 combines the first image and the second image in ACT22. The subsequent processing is the same as in the first embodiment.

[0071] As described above, in the second embodiment, first, a barcode reading process and a search process for the flag sticker 54 are performed using the first image. Then, when the flag sticker 54 is detected, a composite image of the first image and the second image captured by the first imaging device 161 and the second imaging device 162 is transmitted to the image recognition server 30 in synchronization with a synchronization signal. Even with this configuration, the effects described in the first embodiment can be achieved.

[0072] Furthermore, when the barcode of a product that is not subject to a price change is read, the step of capturing the second image in scanner 10 is omitted. For example, it is considered that only a small proportion of products sold in a supermarket are subject to a price change and are therefore marked with a price change label 53. Therefore, the second embodiment has the advantage of simplifying unnecessary processing steps in scanner 10.

[0073] Although the first and second embodiments have been described above, the embodiments are not limited to these.

[0074] The number of imaging devices provided in the reading device may be three or more. For example, the scanner 10 of the above embodiment may be provided with an additional imaging device capable of capturing an image of the third side of a product held over the reading window 101. In this case, the acquisition unit 111 acquires the first, second, and third images captured in synchronization with the synchronization signal. The synthesis unit 114 synthesizes the first, second, and third images. The transmission unit 115 transmits the image synthesized by the synthesis unit 114 to the image recognition server 30. This makes it possible to recognize the price change information of the price change label 53 even if the price change label 53 is attached to a third side other than the first side 501 or the second side 502.

[0075] If a sufficient amount of light can be obtained, for example, from natural light, in the space where the product is held over the reading window 101, the lighting device 163 may be omitted. Alternatively, the control unit 118 may control the lighting device 163 not to operate.

[0076] In the above embodiment, an example was given in which scanner 10 has the function of combining unit 114, combines the first image and the second image, and then transmits the combined image to image recognition server 30. In another embodiment, instead of combining the first image and the second image, the first image and the second image may be associated with each other by, for example, adding information identifying a synchronization signal to each of the first image and the second image, and transmission unit 115 may transmit the associated first image and second image to image recognition server 30. Even in this case, image recognition server 30 can prevent erroneous recognition by recognizing the associated first image and second image as images captured at the same time.

[0077] In the above embodiment, the scanner 10 and the POS terminal 20 are connected by a communication cable. In another embodiment, the code reading device may be a device in which the scanner 10 and the POS terminal 20 are integrated, such as a self-service checkout terminal.

[0078] Scanner 10 may be equipped with devices such as a keyboard, touch panel, and display, and may be capable of registering products such as fresh food products that do not have barcodes. In this case, for example, when a key operation is used to instruct scanner 10 that a price change label 53 is attached to a product, scanner 10 uses the functions of acquisition unit 111, reading unit 112, and transmission unit 115 to transmit a composite image of a first image and a second image captured at the same time to image recognition server 30. Even with such a configuration, a high-performance image recognition system can be provided.

[0079] The image recognized by the image recognition server 30 is not limited to the price change information displayed on the price change label 53. For example, a label displaying the expiration date may be attached to a product, and the discount rate may be changed depending on the length of time remaining until the expiration date. In this case, the image recognized by the image recognition server 30 is the expiration date information displayed on the label. However, because the expiration date information also results in a price change, it can also be referred to as price change information.

[0080] Furthermore, the image recognized by the image recognition server 30 may be an image of the product's appearance. In recent years, there has been technology for identifying a product based on the features of an image of the product's appearance. Therefore, the scanner 10 of this embodiment is applied to a system equipped with the image recognition server 30, which recognizes multiple images of the product's appearance captured from multiple directions using multiple imaging devices. Even in this case, multiple images captured at the same time are transmitted from the scanner 10 to the image recognition server 30 in association with each other, making it possible to configure a recognition system with high recognition accuracy. In this case, the functions of the reading unit 112 and the determining unit 113 are unnecessary.

[0081] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. The original claims are set forth below. [C1] a synchronization signal output unit that outputs a synchronization signal; a first imaging unit that captures an image of an object to be read that is held over a reading window through the reading window in synchronization with the synchronization signal; a second imaging unit that captures an image of the object to be read that is held over the reading window in synchronization with the synchronization signal, without the object passing through the reading window; an acquisition unit that acquires a first image of the object to be read that is captured by the first imaging unit in synchronization with the synchronization signal, and a second image of the object to be read that is captured by the second imaging unit in synchronization with the synchronization signal; a transmitting unit that associates the first image and the second image acquired by the acquiring unit and transmits them to an image recognition server that recognizes an image of the object to be read; A reading device comprising: [C2] a synthesis unit that synthesizes the first image and the second image acquired by the acquisition unit to create one image; Further comprising: The reading device according to [C1], wherein the transmission unit transmits the image created by the synthesis unit to the image recognition server. [C3] a decision unit that decides whether to transmit an image from the first image to the image recognition server; Further comprising: The reading device according to [C2], wherein when the decision unit decides to transmit the image, the synthesis unit synthesizes the first image and the second image to create one image. [C4] a decision unit that decides whether to transmit an image from the first image to the image recognition server; Further comprising: A reading device described in [C2], wherein when the decision unit decides to transmit the image, the acquisition unit acquires the first image captured by the first imaging unit in synchronization with the synchronization signal and the second image captured by the second imaging unit in synchronization with the synchronization signal. [C5] an illumination unit that illuminates a space in which the object to be read is held over the reading window in synchronization with the synchronization signal; The reading device according to any one of [C1] to [C4], further comprising: [C6] A reading method for a reading device including a first imaging unit that captures an image of an object to be read held over a reading window through the reading window, and a second imaging unit that captures an image of the object to be read held over the reading window without passing through the reading window, Synchronizing the imaging timing of the first imaging unit with the imaging timing of the second imaging unit; acquiring a first image of the object to be read captured by the first imaging unit and a second image of the object to be read captured by the second imaging unit at the same imaging timing; a reading method in which the acquired first image and second image are associated with each other and transmitted to an image recognition server that recognizes an image of the object to be read. [Explanation of symbols]

[0082] 10...scanner, 11...processor, 12...main memory, 13...auxiliary storage device, 14...timer, 15...communication interface, 161...first imaging device, 162...second imaging device, 163...lighting device, 163...synchronization signal output circuit, 17...terminal interface, 18...system transmission path, 20...POS terminal, 30...image recognition server, 40...communication network, 50...product, 51...barcode, 52...barcode label, 53...price change label, 54...flag sticker, 111...acquisition unit, 112...reading unit, 113...determination unit, 114...combination unit, 115...transmission unit, 116...reception unit, 117...output unit, 118...control unit.

Claims

1. a synchronization signal output unit that outputs a synchronization signal; a first imaging unit provided inside a housing in which the reading window is provided, the first imaging unit capturing an image of an object to be read that is held over the reading window through the reading window in synchronization with the synchronization signal; a second imaging unit provided outside the housing, which captures an image of the object to be read that is held over the reading window in synchronization with the synchronization signal, without the image passing through the reading window; an acquisition unit that acquires a first image of the object to be read that is captured by the first imaging unit in synchronization with the synchronization signal, and a second image of the object to be read that is captured by the second imaging unit in synchronization with the synchronization signal; a transmitting unit that associates the first image and the second image acquired by the acquiring unit and transmits them to an image recognition server that recognizes an image of the object to be read; A reading device comprising:

2. a synthesis unit that synthesizes the first image and the second image acquired by the acquisition unit to create one image; Further comprising: The transmission unit transmits the image created by the synthesis unit to the image recognition server.

2. The reading device according to claim 1.

3. a decision unit that decides whether to transmit an image from the first image to the image recognition server; Further comprising: The reading device according to claim 2 , wherein when the determination unit determines to transmit the image, the combining unit combines the first image and the second image to create one image.

4. a decision unit that decides whether to transmit an image from the first image to the image recognition server; Further comprising:

3. The reading device of claim 2, wherein when the decision unit decides to transmit the image, the acquisition unit acquires the first image captured by the first imaging unit in synchronization with the synchronization signal and the second image captured by the second imaging unit in synchronization with the synchronization signal.

5. an illumination unit that illuminates a space in which the object to be read is held over the reading window in synchronization with the synchronization signal; 5. The reading device according to claim 1, further comprising:

6. A reading method for a reading device including a first imaging unit provided inside a housing in which a reading window is provided, and which captures an image of an object to be read that is held over the reading window through the reading window, and a second imaging unit provided outside the housing, which captures an image of the object to be read that is held over the reading window without passing through the reading window, Synchronizing the imaging timing of the first imaging unit with the imaging timing of the second imaging unit; acquiring a first image of the object to be read captured by the first imaging unit and a second image of the object to be read captured by the second imaging unit at the same imaging timing; a reading method in which the acquired first image and second image are associated with each other and transmitted to an image recognition server that recognizes an image of the object to be read.

Images