Reading device
The integrated reading device addresses design burdens and operator confusion by using a unified audio output for multiple product identification methods, enhancing usability and simplifying device design.
Patent Information
- Application Number
- JP2021040234
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-12
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2041-03-12
AI Technical Summary
Existing product identification systems face design burdens and operator discomfort due to separate devices emitting recognition sounds at different locations, leading to increased complexity and confusion when multiple product identification methods are used.
A reading device integrates a first device for code symbol recognition and a second device for object recognition, with a unified audio output unit that emits a recognition sound at the same location, reducing the need for multiple speakers and eliminating confusion.
The unified audio output system simplifies device design and ensures consistent sound notification for operators, reducing design complexity and operator discomfort across different product identification methods.
Smart Images

Figure 0007594469000001 
Figure 0007594469000002 
Figure 0007594469000003
Abstract
Description
[Technical field]
[0001] The present embodiment relates to a reading device. [Background technology]
[0002] Conventionally, in a sales data registration process for registering information on products to be sold, multiple methods for identifying products are sometimes used in combination (for example, Patent Document 1). The product identification methods used in combination include, for example, product identification by code symbol recognition such as a barcode, and product identification by object recognition. Product identification by code symbol recognition is performed by decoding a code symbol included in an image (captured image) output by an imaging unit. Product identification by object recognition is performed by calculating a feature amount of the product's appearance based on the captured image, and querying a database for this calculated feature amount.
[0003] When multiple methods are used in combination as described above, conventionally, for the sake of distributing the processing load, each method is shared by separate devices, such as a vertical scanner and a POS terminal. In this case, each device is provided with a speaker for emitting a sound (recognition sound) to notify the operator that a product has been recognized. Since the speaker must be located in a position where the operator can hear the sound it emits, there are many restrictions on the design of the housing, and it is a component that places a large design burden. Having multiple such components increases the design burden, which is not desirable.
[0004] In addition, since different devices emit recognition sounds when the code symbol is decoded and when features are obtained through object recognition, the operator may hear the alarm sound coming from different places at times even though he or she is holding all the products over the imaging unit in the same way, which causes discomfort and confusion for the operator.
[0005] Although the above explanation uses a POS terminal and a vertical scanner as an example, this is not limited to such a configuration, and a common problem exists when multiple methods for identifying products are handled by separate entities (not integrated). Summary of the Invention [Problem to be solved by the invention]
[0006] The problem to be solved by the present invention is to provide a reading device that can emit a recognition sound at the same location regardless of the product identification method in a configuration in which a plurality of product identification methods are separately performed. [Means for solving the problem]
[0007] The reading device of the embodiment includes a first device and a second device. Obtaining a captured image by imaging The imaging unit and the front Recording The second device includes a first recognition unit that recognizes a commodity from the captured image and a voice output unit that emits a voice when the first recognition unit recognizes the commodity. The second device is separate from the first device and includes a second recognition unit that recognizes a commodity from the captured image using a method different from that of the first recognition unit. When the imaging unit obtains a captured image by imaging, the imaging unit outputs the captured image to the first recognition unit and the second recognition unit in sequence. When the first recognition unit receives the captured image output from the imaging unit, the first recognition unit recognizes a commodity based on information obtained by decoding a code symbol included in the captured image. When the second recognition unit receives the captured image output from the imaging unit, the second recognition unit recognizes a commodity based on features of an object shown in the captured image. The second device includes a second sound generating unit that outputs sound data for sounding the sound output unit when the second recognition unit recognizes a product. The first device includes a first sound generating unit that outputs sound data for sounding the sound output unit when the first recognition unit recognizes a product, an input unit that imports the sound data output by the second sound generating unit into the first device, and a sound mixer that inputs the sound data imported by the input unit and the sound data output by the first sound generating unit into the sound output unit. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a perspective view illustrating an example of a checkout device according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing a basic configuration of the checkout device. [Diagram 3]FIG. 3 is a diagram showing the characteristic configuration and data flow of a vertical scanner and a POS terminal. [Figure 4] FIG. 4 is a diagram showing the characteristic configuration and data flow of the vertical scanner and POS terminal according to the second embodiment. [Diagram 5] FIG. 5 is a perspective view showing an example of the configuration of a self-checkout device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] (First embodiment) An embodiment of the reading device will be described in detail below with reference to the accompanying drawings. FIG. 1 is a perspective view showing an example of a checkout device 1 according to this embodiment. The checkout device 1 is an example of a reading device, and includes a POS (Point Of Sales) terminal 10 and a vertical scanner 101 connected to the POS terminal 10. The POS terminal 10 is an example of a second device, and is used for registering sales data in, for example, supermarkets and convenience stores. The vertical scanner 101 is an example of a first device, and is used by connecting it to the POS terminal 10.
[0010] The vertical scanner 101 is a device that accepts input of information (product information) related to a product, and recognizes the product by reading information from an image (captured image) obtained by imaging, or accepts product information manually input by an operator. The POS terminal 10 registers and settles the product related to one transaction. The POS terminal 10 also recognizes the product by performing general object recognition (object recognition) based on the captured image input from the vertical scanner 101. Note that in this embodiment, as an example, a case will be described in which the target product (target product) of the general object recognition is a product, but the target product may be an item other than a product.
[0011] The POS terminal 10 is placed on the upper surface of the drawer 21 on the checkout table 41. The opening operation of the drawer 21 is controlled by the POS terminal 10. The POS terminal 10 includes a keyboard 22, a first display 23, a second display 24, and a touch panel 26. The keyboard 22 is provided on the upper surface of the POS terminal 10 and is operated by an operator (a store clerk). The first display 23 is, for example, a liquid crystal display, and is provided on the back side of the keyboard 22 as seen from the operator who operates the keyboard 22, and mainly displays various information intended for the operator. The touch panel 26 is provided overlapping the display surface of the first display 23, and accepts various operations according to the display contents of the first display 23. The second display 24 is provided further back than the first display 23 and is rotatably provided upright. The second display 24 is directed to the front side in FIG. 1, but can be rotated to be directed to the back side in FIG. 1, and is mainly used for displaying various information intended for customers.
[0012] The counter table 151 is in the form of a horizontally long table, and is arranged to form an L shape together with the checkout table 41 on which the POS terminal 10 is placed. A shopping basket 153 for storing products is placed on the counter table 151. The shopping basket 153 is not limited to a so-called basket shape, and may be a tray or the like. Alternatively, the shopping basket 153 may be in the form of a box or a bag. The shopping basket 153 includes a first shopping basket 154 carried by a customer, and a second shopping basket 155 placed at a position sandwiching the vertical scanner 101 from the first shopping basket 154.
[0013] The vertical scanner 101 is installed in the center of the counter table 151 and on the back side when viewed from the standing position of an operator. The vertical scanner 101 is connected to the POS terminal 10 so as to be able to transmit and receive data. The vertical scanner 101 includes a thin rectangular housing 102 and a reading window 103 provided on the front side of the housing 102, and has an imaging unit 113 (see FIG. 2) built in the housing 102 and on the back side of the reading window 103. In addition, an operation display unit 104 is attached to the upper part of the housing 102.
[0014] The operation display unit 104 includes a first display 106 having a touch panel 105 laminated on its surface. The vertical scanner 101 includes a keyboard 107 on the right side of the first display 106. The vertical scanner 101 includes a card reading groove 108 of a card reader 111 (see FIG. 2) on the right side of the keyboard 107. The vertical scanner 101 includes a second display 109 that provides information to a customer on the left rear side of the back surface of the operation display unit 104 when viewed from the operator's standing position.
[0015] The first display 106 is, for example, a liquid crystal display, and mainly displays various information for the operator. The touch panel 105 accepts various operations according to the display contents of the first display 106. The second display 109 is, for example, a liquid crystal display, and is mainly used to display various information for customers.
[0016] Products related to one transaction are stored in the first shopping basket 154. The operator who operates the vertical scanner 101 moves the products in the first shopping basket 154 to the second shopping basket 155. In the process of moving the products, the operator holds the products over the reading window 103 of the vertical scanner 101. At this time, the imaging unit 113 (see FIG. 2) arranged in the reading window 103 captures an image of the products.
[0017] 2 is a block diagram showing a basic configuration of the checkout terminal 1 according to the present embodiment. The checkout terminal 1 includes a POS terminal 10 and a vertical scanner 101 connected to the POS terminal 10.
[0018] The POS terminal 10 includes a microcomputer (control unit 60) that executes information processing. The control unit 60 includes a CPU (Central Processing Unit) 61 that executes various arithmetic processing and controls each unit, a ROM (Read Only Memory) 62, and a RAM (Random Access Memory) 63 that are connected via a bus.
[0019] In addition, the drawer 21, the keyboard 22, the first display 23, the touch panel 26, and the second display 24 are connected to the CPU 61 of the POS terminal 10 via various input / output circuits.
[0020] A hard disk drive (HDD) 64 is connected to the CPU 61 of the POS terminal 10. The HDD 64 stores a program 641 and various files. The program 641 stored in the HDD 64 is executed by the CPU 61 in whole or in part when the POS terminal 10 is started. An example of the program 641 stored in the HDD 64 is a program 641 for processing product sales data. An example of a file stored in the HDD 64 is a product master file 642 and a dictionary file 643. The product master file 642 and the dictionary file 643 are distributed from the store computer SC at a predetermined timing, such as before the store opens, and are stored in the HDD 64. The sales master file and the like are also stored in the HDD 64. The HDD 64 may be any storage device, and may be a storage device composed of other storage media, such as a solid state drive (SSD).
[0021] The product master file 642 is a file that stores information used for sales registration for each product displayed and sold in a store, and stores product information such as product name and price in association with a product code that enables the product to be identified. The dictionary file 643 stores reference values of feature quantities of multiple products in association with the product code.
[0022] A communication I / F (Interface) 25 for executing data communication with the store computer SC is connected to the CPU 61 of the POS terminal 10 via an input / output circuit. The store computer SC is installed in the back yard of the store or the like. The HDD of the store computer SC stores a product master file 642 to be distributed to the POS terminal 10.
[0023] Furthermore, a connection I / F 65 that enables data transmission and reception with the vertical scanner 101 is connected to the CPU 61 of the POS terminal 10. The vertical scanner 101 is connected to the connection I / F 65. A printer 66 that prints on receipts and the like is also connected to the CPU 61 of the POS terminal 10. The printer 66 prints the transaction details of one transaction on a receipt under the control of the CPU 61.
[0024] The vertical scanner 101 includes a microcomputer (control unit 160) in which a CPU 161, a ROM 162, and a RAM 163 are connected via a bus. The ROM 162 stores a program 164 according to this embodiment. The CPU 161 is connected to an illumination unit 112, an imaging unit 113, an audio output unit 114, etc. via various buses and I / Fs, and controls the operation of each of these units. The control unit 160 is connected to the POS terminal 10 via a connection I / F 175.
[0025] The audio output unit 114 is a sound circuit and a speaker for generating sounds such as a preset warning sound. The lighting unit 112 is configured, for example, by arranging a plurality of LEDs (Light Emitting Diodes) in a line. The lighting unit 112 emits pulsed light in response to a light emission control signal input from the control unit 160, and illuminates the imaging area of the imaging unit 113. Note that the lighting unit 112 may be configured with other light emitting elements.
[0026] The imaging unit 113 is an imaging device including an image sensor (also called an imaging element) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) and optical elements such as a lens. The imaging unit 113 sequentially reads frame images into the RAM 163 at a frame rate (the number of frames read per second) based on an imaging control signal.
[0027] Moreover, the imaging unit 113 outputs image data obtained by imaging (that is, the captured image) to the control unit 160 of the vertical scanner 101 and the control unit 60 of the POS terminal 10 in sequence.
[0028] Also, an operation display unit 104 for store clerks and a second display unit 109 for customers are connected to the CPU 161 via the connection I / Fs 175 and 176. The operation display unit 104 and the second display unit 109 are connected to the CPU 61 of the POS terminal 10 via the connection I / F 176 and the connection I / F 65 of the POS terminal 10.
[0029] 3 is a diagram showing the characteristic configurations and data flows of the vertical scanner 101 and the POS terminal 10. The vertical scanner 101 further includes a USB terminal 171 and an analog audio connector 172 (an example of an input unit). The control unit 160 of the vertical scanner 101 functions as an imaging control unit 611, a product code recognition unit 612 (an example of a first recognition unit), a scan sound generation unit 613 (an example of a first sound generation unit), and an audio mixer 614.
[0030] The imaging control unit 611 controls the imaging unit 113 and outputs an image captured by the imaging unit 113 (captured image) to the product code recognition unit 612. The product code recognition unit 612 decodes a code symbol, such as a barcode or a two-dimensional code, included in the captured image to obtain a product code.
[0031] When the product code recognition unit 612 decodes the code symbol, the scan sound generation unit 613 outputs to the voice mixer 614 voice data for the voice output unit 114 to emit a recognition sound in order to notify the operator that the product has been recognized. Here, the recognition sound is a sound for notifying the operator that the product has been recognized. The voice mixer 614 outputs the input voice data to the voice output unit 114. The voice output unit 114 emits a sound in response to the input of the voice data.
[0032] The product code recognition unit 612 refers to the product master file 642 to obtain information (product information) on the product that corresponds to the product code obtained from the code symbol.
[0033] The control unit 60 of the POS terminal 10 functions as an object recognition unit 601 (an example of a second recognition unit), and includes a POS sound source 602 (an example of a second sound generation unit).
[0034] The object recognition unit 601 performs a general object recognition process (so-called object recognition process). In one example of the general object recognition process, the object recognition unit 601 first extracts a feature amount indicating an external feature of the commodity 300 from a captured image of the commodity 300 captured by the imaging unit 113. In extracting the feature amount, the object recognition unit 601 first acquires the captured image of the imaging unit 113 via the USB terminal 171, and detects an image area representing the commodity 300 included in the captured image.
[0035] In detecting the image area, the object recognition unit 601 extracts contour lines and the like from an image obtained by binarizing the captured image. Alternatively, the object recognition unit 601 detects the commodity 300 based on the difference between the contour lines extracted from a background image prepared in advance and the contour lines extracted from the captured image. Here, the background image is an image captured by the imaging unit 113 of a background that does not include the commodity 300. In this way, the object recognition unit 601 detects the image area in which the commodity 300 is depicted by extracting contour lines that are not included in the contour lines of the background image from the captured image.
[0036] When the image area is detected, the object recognition unit 601 extracts feature amounts of the product 300 from the image area of the product 300 detected from the captured image. The feature amounts are information that parameterizes external features of the product 300, such as its shape, surface color, pattern, and unevenness.
[0037] When the feature amounts are extracted from the captured image of the product, the object recognition unit 601 compares the extracted feature amounts with reference values of the feature amounts stored in the dictionary file 643, and calculates the similarity between each reference value and the feature amount of the product 300. Then, the object recognition unit 601 determines, for example, that the product code associated with the reference value having the highest similarity to the feature amount of the product 300 is the product code of the product 300, and ends the generic object recognition process.
[0038] When the object recognition unit 601 outputs a signal indicating that a product has been recognized by the general object recognition process, the POS sound source 602 outputs analog voice data for a recognition sound. The analog voice data output by the POS sound source 602 is input to the voice mixer 614 via the analog voice connector 172. The voice mixer 614 outputs the input voice data to the voice output unit 114. The voice output unit 114 produces a voice in response to the input of the voice data.
[0039] The object recognition unit 601 refers to the product master file 642 to acquire information (product information) on a product that corresponds to the product code obtained by the general object recognition process.
[0040] In this way, according to the present embodiment, in a configuration in which a plurality of methods for identifying products are performed separately, it is possible to provide a reading device that can emit a recognition sound at the same location regardless of the method of identifying the product. In other words, in both cases where a product is recognized by recognizing a code symbol and where a product is recognized by a general object recognition process, a recognition sound can be emitted by the audio output unit 114 provided in the vertical scanner 101.
[0041] As a result, one audio output unit 114 can perform the functions of two speakers that were previously required, and therefore, according to this embodiment, the design burden of the housing can be reduced.
[0042] In addition, this allows the operator to obtain the same result, that is, hear the recognition sound from the same place (audio output unit 114) in response to the same action of holding the commodity over the reading window 103, regardless of which commodity identification method is used. Therefore, according to this embodiment, it is possible to eliminate the causes of discomfort and confusion that existed in the past.
[0043] In the present embodiment, an example in which the reading device is configured by the POS terminal 10 and the vertical scanner 101 has been described, but the present invention is not limited to such a configuration. For example, the reading device may be a self-checkout device.
[0044] In addition, in this embodiment, an example has been described in which the POS terminal 10 is equipped with the object recognition unit 601 and the POS sound source 602, but the present invention is not limited to this. For example, an information processing device having a general computer configuration such as a personal computer may be equipped with the object recognition unit 601 and the POS sound source 602.
[0045] Furthermore, in this embodiment, an example has been described in which the vertical scanner 101 performs imaging and code symbol recognition processing, but this is not limited to the above embodiment, and for example, the imaging and code symbol recognition processing may be performed by a handheld scanner, a stationary scanner, or a mobile terminal equipped with a camera (a smartphone or a tablet terminal).
[0046] Second embodiment Next, a second embodiment of the reading device will be described. Since this embodiment is a modification of the first embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the duplicated description will be omitted. Figure 4 is a diagram showing the characteristic components and data flow of the vertical scanner 101 and the POS terminal 10 according to the second embodiment.
[0047] In this embodiment, the POS sound source 602 outputs digital voice data as voice data for recognition sound. The voice data output by the POS sound source 602 is input to the voice mixer 614 via the USB terminal 171.
[0048] According to this embodiment, it is possible to achieve the same effects as the first embodiment.
[0049] Third embodiment Next, a third embodiment of the reading device will be described. Since this embodiment is a modification of the first embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the duplicated description will be omitted. Fig. 5 is a perspective view showing an example of the configuration of a self-checkout device 200 according to this embodiment.
[0050] The main body 202 of the self-checkout equipment 200 includes a first display 106 having a touch panel 105 disposed on its surface, and a product reading unit 210 that reads a product image to recognize (identify) the type of product, etc. The product reading unit 210 reads the product image by the imaging unit 113 when a customer holds a code symbol attached to a product over a reading window 103 of the product reading unit 210. The main body 202 of the self-checkout equipment 200 also includes a change dispenser 201 for depositing bills for settlement and receiving change bills.
[0051] Furthermore, the self-checkout equipment 200 is provided with a product placement table 203 on the right side of the main body 202 for placing unpaid products in a basket, and a product placement table 204 on the left side of the main body 202 for placing paid products. The product placement table 204 is provided with a bag hook 205 for hanging a bag in which paid products are to be placed, and a temporary placement table 206 for temporarily placing paid products before putting them in a bag. The product placement tables 203 and 204 are provided with weighing devices 207 and 208, respectively, and have the function of confirming that the weight of the products is the same before and after payment.
[0052] Here, the self-checkout terminal 200 is an example of a reading terminal that incorporates a first terminal and a second terminal, and performs a registration process for registering information on a commodity recognized by the first recognition unit (commodity code recognition unit 612) or the second recognition unit (object recognition unit 601) as sales data, and a settlement process for the sales data. The first terminal has a function equivalent to the vertical scanner 101 in the previous embodiment, and the second terminal has a function equivalent to the POS terminal 10 in the previous embodiment.
[0053] According to the self-checkout terminal 200, the same effects as those of the first embodiment can be achieved.
[0054] Although several embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]
[0055] 1 ...Checkout device (reading device) 10 ... POS terminal (second device) 21 ... Drawer, 22 ... Keyboard 23 ... first display unit, 24 ... second display unit, 26 ... touch panel 41 …Check-out counter 60...control unit, 61...CPU, 62...ROM, 63...RAM 64...HDD 65 …Connection I / F 66 ...Printer 101...Vertical scanner (first device) 102...housing, 103...reading window 104: operation display unit, 105: touch panel, 106: first display, 107: keyboard 108: card reading groove, 109: second display, 111: card reader 112: lighting section, 113: imaging section, 114: audio output section 151: Counter, 153~155: Shopping basket 160: control unit, 161: CPU, 162: ROM, 163: RAM 171...USB terminal (input part in modified example) 172…Analog audio connector (input) 175,176...Connection I / F 200...Self-checkout device (reader) 201...change dispenser, 202...main body, 203, 204...product placement table, 205...Bag hook, 206...Temporary stand, 207...Weighing machine, 210...Product reading unit 300…Products (goods) 601: object recognition unit (second recognition unit), 602: POS sound source (second sound generation unit) 611: Imaging control unit; 612: Product code recognition unit (first recognition unit); 613: Scan sound generating unit (first sound generating unit), 614: Sound mixer 641... program, 642... product master file, 643... dictionary file [Prior art documents] [Patent documents]
[0056] [Patent Document 1] JP 2016-091360 A
Claims
1. A reading device including a first device having an imaging unit that obtains an image by imaging, a first recognition unit that recognizes a commodity from the image, and a voice output unit that emits a voice when the first recognition unit recognizes the commodity, and a second device that is separate from the first device and has a second recognition unit that recognizes the commodity from the image by a method different from that of the first recognition unit, When the imaging unit obtains a captured image by imaging, the imaging unit sequentially outputs the captured image to the first recognition unit and the second recognition unit, the first recognition unit, upon receiving a captured image output from the imaging unit, recognizes a commodity based on information obtained by decoding a code symbol included in the captured image; the second recognition unit, upon receiving an output of a captured image from the imaging unit, recognizes a commodity based on a feature amount of an object shown in the captured image; the second device includes a second sound generating unit that outputs sound data for making the sound output unit sound when the second recognition unit recognizes a commodity, The first device is a first sound generating unit that outputs sound data for making the sound output unit sound when the first recognition unit recognizes a product; an input unit that inputs audio data output by the second audio generating unit into the first device; an audio mixer that inputs the audio data taken in by the input unit and the audio data output by the first audio generating unit to the audio output unit; A reading device comprising:
2. the second sound generating unit outputs sound data which is analog data; The input section is a connector for inputting analog voice data.
2. The reading device according to claim 1.
3. the second sound generating unit outputs sound data which is digital data; The input unit is a USB terminal.
2. The reading device according to claim 1.
4. a self-checkout device having the first device and the second device built therein, and performing a registration process for registering information on a commodity recognized by the first recognition unit or the second recognition unit as sales data, and a settlement process for the sales data. A reading device according to any one of claims 1 to 3.
Citation Information
Patent Citations
Information processor, store system and program
JP2013156933A
Commodity sales data processing apparatus, reader, and program
JP2016091360A
