Article registration device and information processing program

Abstract

To provide technology that can improve the reading accuracy of wireless tags.SOLUTION: An article registration device includes an antenna, a projector, and a camera. The antenna communicates with wireless tags attached to articles placed on a placement platform. The projector projects an image based on data about the articles read from the wireless tags onto a projection surface via the antenna. The camera captures the user's operation on the image projected onto the projection surface. The projection surface is positioned within the range of radio waves emitted from the antenna on the placement platform. The projector and camera are positioned outside the range of radio waves emitted from the antenna.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a product registration device and an information processing program. [Background technology]

[0002] In recent years, merchandise registration devices have been used that attach wireless tags such as RFID (Radio Frequency Identification) tags that record merchandise data related to the merchandise, such as the product name, product number, and price, to merchandise items and register purchased merchandise by reading these wireless tags. In such merchandise registration devices, a display device that presents the read merchandise data to shoppers may be placed within the receiving area of ​​a reader that reads the wireless tag.

[0003] Display devices generally contain a large amount of metal, and therefore, if placed within the receiving area of ​​a reader, they reflect radio waves, leading to a deterioration in the accuracy of reading wireless tags. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-90780 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a product registration device and an information processing program that can improve the accuracy of reading wireless tags. [Means for solving the problem]

[0006] In one embodiment, the product registration device includes an antenna, a projector, and a camera. The antenna communicates with a wireless tag attached to a product placed on a mounting table. The projector projects an image onto a projection surface based on data about the product read from the wireless tag via the antenna. The camera captures an image of a user's operation on the image projected onto the projection surface. The projection surface is located within a radiation range of radio waves from the antenna on the mounting table. The projector and camera are located outside the radiation range of radio waves from the antenna. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram of a checkout system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing the main configuration of the product registration device according to the embodiment. [Figure 3] FIG. 3 is a plan view illustrating an example of the appearance of the commodity registration device according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram for explaining an example of the positional relationship of the main parts of the product registration device according to the embodiment. [Figure 5] FIG. 5 is a schematic diagram for explaining a modified example of the positional relationship of the main parts of the commodity registration device according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a projected image displayed on the projection screen of the commodity registration device according to the embodiment. [Figure 7] FIG. 7 is a block diagram showing a modified example of the main configuration of the commodity registration device according to the embodiment. [Figure 8] FIG. 8 is a perspective view showing an example of the appearance of the commodity registration device shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Embodiment) Hereinafter, embodiments will be described with reference to the drawings. Note that the scale of each part in each drawing used in the following description of the embodiments may be changed as appropriate. Also, for the sake of explanation, each drawing used in the following description of the embodiments may omit components.

[0009] (Configuration example) FIG. 1 is a block diagram of a checkout system S according to an embodiment. The checkout system S includes multiple product registration devices 10 and multiple settlement devices 20. The multiple product registration devices 10 and the multiple settlement devices 20 are connected via a LAN (Local Area Network). The LAN may be a wired LAN, a wireless LAN, or a combination of wired and wireless. While FIG. 1 shows an example in which the checkout system S includes two product registration devices 10 and two settlement devices 20, the number of product registration devices 10 and settlement devices 20 included in the checkout system S is not particularly limited. Furthermore, the number of product registration devices 10 and the number of settlement devices 20 do not need to be the same and may be different from each other.

[0010] The product registration device 10 is a device that allows a customer CS, who is a shopper, to register purchased products. Purchased products refer to products that the customer CS purchases. Purchased products refer to products that the customer CS has placed in a shopping cart, for example. Purchased products may also refer to products registered by the processor 11. The checkout device 20 is a device that executes the checkout process for purchased products. The checkout device can also be referred to as an accounting machine, payment terminal, accounting device, accounting terminal, etc.

[0011] For example, a customer CS places the products they wish to purchase in a shopping basket or the like at a store, and places the shopping basket or the like with the products in it on the loading platform of the product registration device 10. The product registration device 10 reads the wireless tags attached to the purchased products in the shopping basket and acquires data related to each purchased product. The data related to the products is also referred to as product data. The product data includes, for example, a product code. The product code is identification information that can uniquely identify the transacted product. The product data may include the product price. The product price is the price per product. The product data may also include the product count. The product count is the number of products included in one transaction. The product registration device 10 displays an image based on the acquired product data on a projection screen provided in the product registration device 10. The wireless tag is also simply referred to as a tag.

[0012] After product registration using the product registration device 10 is complete, the customer CS performs the settlement process using the settlement device 20. The settlement device 20 performs the settlement process based on the registration information transmitted from the product registration device 10 via a LAN, for example, in response to a start operation from the customer CS or in response to detection of the customer CS by a sensor or the like. The customer CS performs the settlement process using an electronic commerce (EC) method, such as cash payment, credit card payment, electronic money payment, point payment, or code payment. Code payment, also known as mobile payment or smartphone payment, can be used by, for example, linking a code to a credit card or electronic money in advance in a product purchase app installed on an information terminal such as a smartphone owned by the customer CS. Upon completion of the settlement, the settlement device 20 issues a receipt. The registration information may include not only information such as the breakdown of purchased products and the total price, but also other information necessary for printing the receipt. For example, the registration information may include promotional information for printing the receipt. The customer CS receives the issued receipt. The receipt may be printed on paper or may be an electronic receipt.

[0013] FIG. 2 is a block diagram showing the main configuration of the product registration device 10 according to the embodiment. The product registration device 10 includes a processor 11, a main memory 12, an auxiliary storage device 13, a LAN interface 14, an RFID reader 15, an input / output interface 17, an antenna 18, and a system transmission path 19. The system transmission path 19 includes an address bus, a data bus, a control signal line, etc. The system transmission path 19 interconnects the processor 11 with the main memory 12, the auxiliary storage device 13, the LAN interface 14, the RFID reader 15, and the input / output interface 17. The RFID reader 15 and the antenna 18 are interconnected by a wired cable, etc. The processor 11, the main memory 12, and the auxiliary storage device 13 connected via the system transmission path 19 constitute a computer of the product registration device 10. The product registration device 10 is connected to a camera 110 and a projector 120 via the input / output interface 17. In FIG. 2, the interface is indicated as "I / F."

[0014] The processor 11 corresponds to the central part of the computer. The processor 11 controls each part to realize various functions of the product registration device 10 and the data processing device according to this embodiment in accordance with an operating system or a control program. The processor 11 is, for example, a CPU (Central Processing Unit). The processor 11 may be, for example, an MPU (Micro Processing Unit), an SoC (System on a Chip), a DSP (Digital Signal Processor), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field-Programmable Gate Array). Alternatively, the processor 11 may be a combination of two or more of these. The processor 11 is an example of a processing circuit.

[0015] The main memory 12 corresponds to the main storage portion of the computer. The main memory 12 includes a nonvolatile memory area and a volatile memory area. The main memory 12 stores an operating system or application programs in the nonvolatile memory area. The main memory 12 may store data required for the processor 11 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is rewritten by the processor 11 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0016] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 13. The auxiliary storage device 13 stores data used by the processor 11 when performing various processes, data created by the processes in the processor 11, etc. The auxiliary storage device 13 may also store the application programs described above.

[0017] The auxiliary storage device 13 may store a product master. The product master may be updated as needed, for example, based on updates to the product master stored in a store server or the like. The store server is a device capable of communicating with the product registration device 10 and the checkout device 20 via a network. The store server may be a server used in a cloud service. The network may include a wireless network or a wired network. The network may include, for example, a LAN, Bluetooth (registered trademark), Wi-Fi (registered trademark), etc.

[0018] The application programs stored in the main memory 12 or the auxiliary storage device 13 include a registration program that describes information processing executed by the product registration device 10. There are no particular limitations on the method for installing the registration program in the main memory 12 or the auxiliary storage device 13. The registration program can be recorded on a removable recording medium, or can be distributed via communication over a network and installed in the main memory 12 or the auxiliary storage device 13. The recording medium can be in any form, such as a CD-ROM or memory card, as long as it can store a program and is readable by the device.

[0019] The LAN interface 14 is a communication device for communicating with the settlement device 20 via a LAN.

[0020] The RFID reader 15 processes communication between the RFID tag and the antenna 18 and reads the RFID tag attached to the product. The RFID reader 15 outputs the product data stored in the RFID tag read from the RFID tag to the processor 11. The RFID tag is an example of a wireless tag. The wireless tag is not limited to an RFID tag, and may be an IC tag including an IC chip and an antenna. The wireless tag is a passive wireless tag that operates using radio waves transmitted from the antenna 18 as its energy source. The wireless tag transmits a signal including information stored in the IC chip of the wireless tag via the antenna by performing backscatter modulation on an unmodulated signal. The information stored in the wireless tag may include uniquely identifiable identification information. The product is an example of an item to which a wireless tag is attached. The RFID reader 15 is an example of a wireless tag reader that reads data related to the item from the wireless tag attached to the item.

[0021] The RFID reader 15 converts an analog signal input from the antenna 18 into a digital signal. The RFID reader 15 acquires information based on radio waves from a radio tag received by the antenna 18. For example, the RFID reader 15 acquires identification information of a radio tag from the digital signal using known technology. The RFID reader 15 acquires tag data in time series based on radio waves from a radio tag received by the antenna 18. For example, the RFID reader 15 can acquire phase data in time series from a digital signal using known technology. The RFID reader 15 can acquire Doppler frequency data in time series from a digital signal using known technology. The RFID reader 15 can acquire RSSI data in time series from a digital signal using known technology.

[0022] The input / output interface 17 is an interface for connecting the product registration device 10 to an external device. The input / output interface 17 includes a connector for a wired cable. For example, the input / output interface 17 is an interface for connecting the product registration device 10 to the camera 110 and the projector 120.

[0023] The antenna 18 communicates with the wireless tag. The antenna 18 moves under the control of a driving unit (not shown). The driving unit is connected to the processor 11, for example, via a system transmission line 19. For example, the driving unit includes a stage on which the antenna 18 is placed and a motor for driving the stage, but the driving unit may also include other components. The driving unit may move the antenna 18 along a horizontal direction on a horizontal plane. The driving unit may move the antenna 18 in a circumferential direction around a rotation axis along the vertical direction on a horizontal plane. Moving the antenna 18 includes moving the position of the antenna 18. The driving unit moves the antenna 18 from a start position to an end position. The start position and the end position are predetermined positions. The start position and the end position may be arbitrary positions. For example, when the driving unit moves the antenna 18 in a circumferential direction, the start position is a position where the rotation angle is 0°. The position where the rotation angle is 0° can be set as appropriate. The end position is a position where the rotation angle of the antenna 18 is 360°. The drive unit moves the antenna 18 around the rotation axis in the circumferential direction. In this example, the movement range of the antenna 18 is a rotation angle range from 0° to 360°. The end position is not limited to a position where the rotation angle is 360°. The end position may be a position where the rotation angle is any value less than 360°.

[0024] The RFID reader 15 may read wireless tags using multiple antennas 18. In this case, the drive unit moves each of the antennas 18. The relative positions of the antennas 18 are set so that they are spaced apart by any angle in the circumferential direction around the rotation axis. The movement ranges of the multiple antennas 18 may be different. For example, if the RFID reader 15 uses two antennas 18, each of the two antennas 18 rotates 180° in the circumferential direction around the rotation axis, but the movement ranges of the two antennas 18 are different. The multiple antennas 18 may be fixed at predetermined positions.

[0025] The camera 110 is a device that has a photographing function and acquires photographed image data by photographing.

[0026] Projector 120 is a device that irradiates light onto a projection surface and displays an image on the projection surface.

[0027] The hardware configuration of the product registration device 10 is not limited to the above configuration. The product registration device 10 allows the above components to be omitted or changed, and new components to be added, as appropriate.

[0028] The processor 11 acquires data related to the products read from the wireless tags by the RFID reader 15 via the antenna 18 that communicates with the wireless tags attached to the products placed on the placing table. For example, the processor 11 reads the product code from the wireless tag. The processor 11 references the product master stored in the auxiliary storage device 13 and acquires product data for the products corresponding to the product code. The product data includes data such as the product name and price associated with the product code. The processor 11 may also reference the product master stored in the store server and acquire the product data for the products corresponding to the product code. The processor 11 temporarily stores the product data for each purchased product in the main memory 12.

[0029] Processor 11 generates data for projecting an image based on the product data onto a projection surface. Data for projecting an image based on the product data onto a projection surface is also referred to as display data. Processor 11 outputs the display data to projector 120. The image based on the product data includes an image showing a product list. The image showing the product list is also referred to as a product list image. The product list may include information on the product name, unit price, quantity, and price of the purchased products. The image based on the product data may include an image showing the number of read tags, number of items purchased, total amount, etc. The number of read tags indicates the number of wireless tags read by RFID reader 15. The number of items purchased indicates the number of purchased products. The total amount indicates the total amount of the purchased products. Projector 120 obtains display data including an image based on the product data from processor 11 and projects the image based on the product data onto a projection surface.

[0030] The processor 11 may generate data for projecting an operation image that can be operated by a customer onto a projection surface and output the data to the projector 120. The data for projecting the operation image onto the projection surface is also referred to as display data. The operation image may include, for example, an operation button for acquiring an operation by a customer. The operation by a customer is, for example, a touch operation. The touch operation includes an operation of touching or pressing an area where an image of an operation target such as an operation button is displayed with a finger or the like. The operation buttons include, for example, a start reading button, a delete button, a start checkout button, etc. The start reading button is a button used by a customer to instruct the start of reading a wireless tag. The delete button is a button used by a customer to instruct the deletion of a purchased item. The start checkout button is a button used by a customer to instruct the start of checkout. The projector 120 acquires display data including the operation image from the processor 11 and projects the operation image onto the projection surface.

[0031] The processor 11 detects the customer's operation on the image projected on the projection surface captured by the camera 110. The camera 110, for example, captures the customer's operation on the image projected on the projection surface. The camera 110 outputs the captured image data to the processor 11. The processor 11 detects the customer's operation based on the image data. The processor 11 acquires an instruction corresponding to the customer's operation based on the detection result. The instruction includes, for example, a read start instruction, a delete instruction, a settlement start instruction, etc. The read start instruction is an instruction to start reading the wireless tag by the RFID reader 15. The read start instruction may be an instruction to start emitting radio waves to the antenna 18. The delete instruction is an instruction to delete the product data of the registered purchased product. The settlement start instruction is an instruction to start the settlement process for one transaction.

[0032] FIG. 3 is a plan view showing an example of the appearance of the commodity registration device 10 according to the embodiment. As shown in Fig. 3, the product registration device 10 is equipped with a platform Ta on which to place purchased products or a product basket BK containing purchased products. The product basket BK is an example of a container for containing items. In Fig. 3, the bottom of the drawing is the front position where customer CS stands. The left-right direction of customer CS standing in this front position is the left-right direction (X-axis direction) of the product registration device 10, the direction in which customer CS is facing is the depth direction (Y-axis direction), and the direction perpendicular to these is the up-down direction (Z-axis direction) of the product registration device 10.

[0033] A guide mark Ga indicating the position where the product or product basket BK should be placed may be provided on the placement table Ta of the product registration device 10. As shown in Fig. 3, the guide mark Ga is provided in the center of the placement table Ta. The guide mark Ga is an example of a positioning mark that indicates the position where the product or a container containing the product should be placed in order to read the wireless tag attached to the product.

[0034] The reading area Ara indicates the reading range of the RFID reader 15. The reading area Ara indicates the range in which a wireless tag can be read by the RFID reader 15. The reading area Ara indicates the range in which radio waves can be emitted from the antenna 18. The range in which radio waves can be emitted from the antenna 18 is also referred to as the radiation range of radio waves from the antenna 18. The reading area Ara can be set, for example, to include the entire mounting table Ta. The reading area Ara is set to include at least the area surrounded by the guide mark Ga and the projection surface Sc.

[0035] The mounting table Ta of the product registration device 10 includes a projection surface Sc. The projection surface Sc is positioned, for example, in the X-axis direction of the product registration device 10, close to the outer periphery of a guide mark Ga provided on the mounting table Ta, in front of the right side of the customer CS standing in front of the product registration device 10. The mounting table Ta and the projection surface Sc are made of a non-metallic material. The mounting table Ta is, for example, a transparent plate such as glass or a transparent wooden board. The projection surface Sc is, for example, a transparent plate such as glass or a transparent wooden board with a light-control film such as a rear transmission film laminated thereon. The projection surface Sc is not limited to this, and may be configured to project an image projected by the projector 120. The projection surface Sc may be configured to capture an image of the customer CS's operations on the projection surface Sc using a camera 110 installed below the projection surface Sc.

[0036] Here, the proximity of the outer periphery of the guide mark Ga to the projection surface Sc means that the product or product basket BK placed on the placement surface of the placement stand Ta according to the guide mark Ga and the projection surface Sc are within the same field of view of the customer CS.

[0037] 3, the projection surface Sc in the XY axis direction is located on the right front side of the area on the placement surface surrounded by the guide mark Ga, but this is not limited to this. The projection surface Sc also functions as an operation unit for inputting instructions to the product registration device 10. Therefore, the projection surface Sc may be located in a position that is easy for the customer CS to operate.

[0038] 3, the projection surface Sc is positioned so that its surface is flush with the mounting surface of the mounting stand Ta, but this is not limiting. The projection surface Sc may be positioned on any plane ranging from the same plane as the mounting surface of the mounting stand Ta to a plane at eye level of the customer CS, for example.

[0039] FIG. 4 is a schematic diagram for explaining an example of the positional relationship of the main parts of the commodity registration device 10 according to the embodiment. The product registration device 10 includes a stand Ta on which a shopping basket BK is placed. The customer CS places the purchased products or the shopping basket BK containing the purchased products within the range indicated by the guide marks Ga on the stand Ta. The RFID reader 15 of the product registration device 10 reads the RFID tags attached to each purchased product via the antenna 18 and outputs the read data related to the products to the processor 11. The processor 11 temporarily stores the product data for each purchased product in the main memory 12 and generates display data based on the product data. The display data is an example of an image based on the data related to the products. The display data may include operation buttons for acquiring operations by the customer CS. The processor 11 outputs the display data to the projector 120. The projector 120 projects the acquired display data onto a projection screen Sc on the stand Ta. The projection screen Sc is positioned within the radiation range of radio waves from the antenna 18 on the stand Ta.

[0040] The antenna 18 is disposed below the mounting table Ta. The antenna 18 communicates with a wireless tag attached to a product placed on the mounting table Ta. The antenna 18 may, for example, move on a moving stage disposed below the antenna 18.

[0041] The product registration device 10 includes an RFID reader 15 arranged below the antenna 18. The RFID reader 15 is arranged outside the radiation range of radio waves from the antenna 18. The area outside the radiation range of radio waves from the antenna 18 is also simply referred to as outside the radiation range. The area outside the radiation range includes, for example, a position where radio waves from the antenna 18 cannot be received. The area outside the radiation range includes, for example, a position in a direction opposite to the radiation direction of radio waves from the antenna 18. For example, if the radiation direction of radio waves from the antenna 18 is upward, the area outside the radiation range includes a position below the antenna 18. The positional relationship between the antenna 18 and the RFID reader 15 is not limited to this. The RFID reader 15 does not have to be arranged below the antenna 18, but may be arranged outside the radiation range of radio waves from the antenna 18.

[0042] The product registration device 10 includes a camera 110 arranged below the antenna 18. The camera 110 is arranged outside the radiation range of radio waves from the antenna 18. The camera 110 is arranged below the position where the antenna is arranged. The camera 110 may be installed below the projection surface Sc. The camera 110 is installed in a position where it can capture images of the operations of the customer CS on the image projected on the projection surface Sc. For example, the camera 110 is installed facing upward so as to capture images of the projection surface Sc from below. The relative positions of the antenna 18 and the camera 110 are not limited to this. The camera 110 does not have to be located below the antenna 18, but may be located outside the radiation range of radio waves from the antenna 18.

[0043] The camera 110 captures an image of the operation of the customer CS on the operation buttons projected on the projection surface Sc. The camera 110 outputs the captured image data to the processor 11. The processor 11 may, for example, perform image recognition processing based on the image data to determine at what position or at what height on the projection surface Sc the operation of the customer CS was performed. The processor 11 may determine the operation by the customer CS based on the display data projected on the projection surface Sc and the position information at which the operation of the customer CS was performed.

[0044] The camera 110 captures an image of an operation by the customer CS on the projection screen Sc and outputs the image data to the processor 11. The processor 11 determines the operation by the customer CS. This allows the merchandise registration device 10 to make the projection screen Sc function as a touch panel.

[0045] The camera 110 may output identification information of the operation button operated by the customer CS and information indicating that the operation button has been operated to the processor 11. The processor 11 may determine the operation by the customer CS based on the information acquired from the camera 110.

[0046] The product registration device 10 includes a projector 120 disposed below the antenna 18. The projector 120 is disposed outside the radiation range of radio waves from the antenna 18. The projector 120 is disposed below the position where the antenna is disposed. The projector 120 may be disposed below the projection surface Sc. The projector 120 is disposed at a position where it can project display data onto the projection surface Sc. For example, the projector 120 is disposed so that it irradiates the projection surface Sc with light from below upward (vertically). The projector 120 is disposed so that the light-irradiated portion faces the projection surface Sc. The positional relationship between the antenna 18 and the projector 120 is not limited to this. The projector 120 is not limited to being disposed below the antenna 18, but may be disposed outside the radiation range of radio waves from the antenna 18.

[0047] According to this example, the product registration device 10 includes an antenna 18 that communicates with a wireless tag attached to a product placed on a placing stand Ta, a projector 120 that projects an image based on data about the product read from the wireless tag via the antenna 18 onto a projection screen Sc, and a camera 110 that captures the operations of the customer CS on the image projected onto the projection screen Sc, and the projection screen Sc is positioned within the radiation range of radio waves from the antenna 18 on the placing stand Ta, while the projector 120 and the camera 110 are positioned outside the radiation range of radio waves from the antenna 18. The projector 120 projects an image based on display data output from the processor 11 onto the projection screen Sc. The camera 110 outputs image data capturing an operation of the customer CS on the image projected on the projection screen Sc to the processor 11. This allows the product registration device 10 to function as a display device using the projector 120 and the camera 110 without placing a display device including metal within the radiation range of radio waves from the antenna 18. Because the projector 120 and the camera 110 are placed outside the radiation range of radio waves from the antenna 18, the product registration device 10 can be configured so that metal is not placed within the radiation range of radio waves from the antenna 18. For example, when radio waves are radiated upward from the antenna 18, the projector 120 and the camera 110 are placed below the position where the antenna 18 would normally radiate them. This prevents the product registration device 10 from affecting radio waves due to the placement of metal within the radiation range of radio waves from the antenna 18, thereby suppressing deterioration in the accuracy of reading wireless tags by the RFID reader 15. In this way, the merchandise registration device 10 can improve the accuracy of reading wireless tags. Furthermore, the customer CS can visually confirm information about the purchased items registered in the product registration device 10 based on the image projected onto the projection screen Sc on the placing table Ta. The customer CS can easily visually confirm both the items placed on the placing table Ta and the information about the registered purchased items. The customer CS can also operate the product registration device 10 by performing operations on the image projected onto the projection screen Sc. The product registration device 10 can acquire instructions from the customer CS based on the operations of the customer CS captured by the camera 110. Therefore, the product registration device 10 can achieve touch panel-like operability based on the image projected onto the projection screen Sc. This allows the product registration device 10 to maintain the convenience of operation for the customer CS.

[0048] (Variation) FIG. 5 is a schematic diagram for explaining a modified example of the positional relationship of the main parts of the commodity registration device 10 according to the embodiment.

[0049] In the example of FIG. 5, the merchandise registration device 10 includes a mirror 130 in addition to the components shown in FIG. The mirror 130 is placed so as to face the portion irradiated with light from the projector 120. The mirror 130 may be, for example, a half mirror.

[0050] The product registration device 10 includes a mounting table Ta, similar to the example in Fig. 4. The projection surface Sc is located within the radiation range of radio waves from an antenna 18 on the mounting table Ta. The antenna 18 is located below the mounting table Ta, similar to the example in Fig. 4.

[0051] 4, the product registration device 10 includes an RFID reader 15 disposed below the antenna 18. The RFID reader 15 is disposed outside the radiation range of the radio waves from the antenna 18.

[0052] As in the example of FIG. 4, the product registration device 10 includes a camera 110 disposed below the antenna 18. The camera 110 is disposed outside the radiation range of radio waves from the antenna 18. The camera 110 is installed in a position where it can capture images of operations of the customer CS on the image projected on the projection surface Sc. For example, the camera 110 is installed facing upward so as to capture images of the projection surface Sc from below. The camera 110 may also be installed so that its light-receiving portion faces the mirror 130. In this case, the camera 110 may receive light reflected by the mirror 130 and capture images of operations of the customer CS on the image projected on the projection surface Sc.

[0053] The product registration device 10 includes a projector 120 disposed below the antenna 18. The projector 120 is disposed outside the radiation range of radio waves from the antenna 18. The projector 120 is disposed below the position where the antenna is disposed. The projector 120 may be disposed below the projection surface Sc. The projector 120 is disposed at a position where it can project display data onto the projection surface Sc. For example, the projector 120 is disposed so that light irradiated horizontally onto the projection surface Sc is reflected by a mirror 130, and the light is irradiated upward (vertically) onto the projection surface Sc from below. The projector 120 is disposed so that the light irradiated portion faces the mirror 130. The projector 120 reflects light for projecting an image irradiated from the side via the mirror 130 upward, thereby projecting the image onto the projection surface Sc. The light for projecting an image is also referred to as an image, image data, or display data. The light irradiated from the projector 120 is reflected by the mirror 130, and the optical path is directed upward. As a result, light from the projector 120 is reflected by the mirror 130, and the display data is projected onto the projection surface Sc.

[0054] According to this example, the projector 120 projects an image that is irradiated from the side onto the projection surface Sc by reflecting it upward via the mirror 130. Therefore, compared to when light from the projector 120 is irradiated from below the projection surface Sc, it is possible to reduce the glare experienced by the customer CS viewing the projection surface Sc.

[0055] In this example, the product registration device 10 can also function as a display device using the projector 120 and the camera 110, without placing a display device including metal within the radiation range of the radio waves from the antenna 18. Because the projector 120 and the camera 110 are placed outside the radiation range of the radio waves from the antenna 18, the product registration device 10 can be configured so that no metal is placed within the radiation range of the radio waves from the antenna 18. Therefore, the product registration device 10 can prevent the influence of metal placed within the radiation range of the radio waves from the antenna 18 on the radio waves, and can suppress deterioration in the accuracy of reading wireless tags by the RFID reader 15. In this way, the product registration device 10 can improve the accuracy of reading wireless tags. Furthermore, the customer CS can visually confirm information about the purchased products registered in the product registration device 10 based on the image projected onto the projection surface Sc on the placing table Ta, so the customer CS can easily visually confirm both the products placed on the placing table Ta and the registered information about the purchased products. Furthermore, the customer CS can operate the product registration device 10 by performing operations on the image projected onto the projection surface Sc. Therefore, the product registration device 10 can maintain convenience for the customer CS in operation.

[0056] (Display example) FIG. 6 is a diagram illustrating an example of a projected image displayed on the projection screen of the commodity registration device according to the embodiment. 6 shows a projection image Ima. The projection image Ima is an image based on display data output from the processor 11 to the projector 120. The projection image Ima is an image formed by projecting light containing the display data emitted from the projector 120 onto the projection surface Sc. The projected image Ima includes a product list display area Ra, a tag number display area Rb, a purchase number display area Rc, a total price display area Rd, and a read start button Ba.

[0057] The product list display area Ra is an area where an image based on product data read from a wireless tag by the RFID reader 15 via the antenna 18 is projected. The product list display area Ra projects an image based on product data read from a wireless tag attached to a product placed in the shopping basket BK. The product list display area Ra displays, for example, a product list. For example, the processor 11 may determine whether a wireless tag read by the RFID reader 15 is located inside the shopping basket BK based on machine learning or the like. For example, the processor 11 may acquire multiple tag data sets at multiple positions of the antenna 18 for each wireless tag read by the RFID reader 15. For example, the processor 11 may acquire multiple tag data sets, such as phase data, Doppler frequency data, or RSSI data, at multiple positions of the antenna 18 for each wireless tag. The processor 11 may determine the location of the wireless tag based on the tag data using a learning model created by machine learning or the like. The processor 11 registers the product corresponding to the wireless tag determined to be located inside the shopping basket BK as a purchased product. The product corresponding to the wireless tag determined to be inside the shopping basket BK is also referred to as a purchased product or a registered product. The processor 11 registers the purchased product based on the information about the product read from the wireless tag. If multiple antennas 18 are fixed in predetermined positions, the processor 11 may determine whether the wireless tag read by the RFID reader 15 is inside the shopping basket BK based on the phase difference.

[0058] Note that, among the wireless tags read by the RFID reader 15, images based on the product data of wireless tags located outside the product basket BK may be projected onto a display area different from the product list display area Ra. The processor 11 may project images based on the product data of all wireless tags read by the RFID reader 15 onto a display area different from the product list display area Ra.

[0059] The customer CS may delete a product based on the product list projected in the product list display area Ra. Product deletion may be performed, for example, by the customer CS selecting a product included in the product list. The selection operation may include, for example, designating a product to be deleted from the product list by a touch operation or the like. Product deletion may be performed by the customer CS touching a delete button or the like included in the projection image Ima. For example, the camera 110 captures an image of the customer CS's operation on the projection image Ima from below the projection surface Sc. The camera 110 outputs the captured image data to the processor 11. The processor 11 may identify the product to be deleted based on, for example, position information on the projection surface Sc where the customer CS performed a touch operation or the like and position information on the product to be deleted included in the product list on the projection surface Sc based on the image data. The processor 11 may determine that a deletion instruction has been acquired based on position information on the projection surface Sc where the customer CS performed a touch operation or the like and position information on the delete button on the projection surface Sc.

[0060] The tag count display area Rb is an area for displaying the number of tags that have been read. The number of tags that have been read may be the number of tags located inside the shopping basket BK, or may be a number indicating the total number of tags located inside the shopping basket BK and the number of tags located outside the shopping basket BK.

[0061] The purchase number display area Rc is an area that displays the number of purchased items. The purchase number indicates the number of tags located inside the shopping basket BK that are read by the RFID reader 15. The purchase number display area Rc may also be an area that displays the number of purchased items registered by the processor 11.

[0062] The total price display area Rd is an area that displays the total price. The total price indicates the total price of the products corresponding to the tags located inside the shopping basket BK that are read by the RFID reader 15. The total price display area Rd may also be an area that displays the total price of the purchased products registered by the processor 11.

[0063] The read start button Ba is a button for instructing the start of reading of a wireless tag. For example, when issuing an instruction to start reading, the customer CS performs a touch operation on the read start button Ba. The camera 110 captures an image of the customer CS's operation on the read start button Ba from below the projection surface Sc. The camera 110 outputs the captured image data to the processor 11. The processor 11 may determine that a read start instruction has been acquired based on, for example, position information of the projection surface Sc where the customer CS performed a touch operation, etc., and position information of the read start button Ba on the projection surface Sc, based on the image data. Based on the acquisition of the read start instruction, the processor 11 starts reading of the wireless tag by the RFID reader 15. For example, the processor 11 causes the antenna 18 to emit radio waves. The processor 11 may also start moving the antenna 18.

[0064] The projected image Ima may be an image formed by light containing display data emitted from the projector 120, reflected by the mirror 130, and projected onto the projection surface Sc.

[0065] (Variation) Fig. 7 is a block diagram showing a modified example of the main configuration of the product registration device 10 according to the embodiment. Fig. 8 is a perspective view showing an example of the appearance of the product registration device 10 shown in Fig. 7. Note that the same reference numerals as in Fig. 2 are used for the same configurations and operations as those in the product registration device 10 shown in Fig. 2, and descriptions thereof will be omitted.

[0066] The product registration device 10 includes a processor 11, a main memory 12, an auxiliary storage device 13, a LAN interface 14, an RFID reader 15, an input / output interface 17, an antenna 18, a system transmission path 19, a cash deposit / withdrawal device 305, a scanner 306, a printer 307, a card reader 308, a touch panel 309, and a display 310. The system transmission path 19 includes an address bus, a data bus, a control signal line, and the like. The processor 11, the main memory 12, and the auxiliary storage device 13 are connected via the system transmission path 19 to form a computer for the product registration device 10. The product registration device 10 is connected to a camera 110 and a projector 120 via the input / output interface 17. In FIG. 7, the interface is indicated as "I / F."

[0067] 8, the commodity registration device 10 comprises a first housing 312 and a second housing 313. The first housing 312 comprises the depositing and dispensing device 305 and the scanner 306. The second housing 313 is placed on an upper surface 314 of the first housing 312, and comprises the printer 307, card reader 308, and touch panel 309.

[0068] Furthermore, a placing table Ta for placing products or a product basket BK is installed, for example, on the right side as viewed from the front of the product registration device 10. At least one of a product and a product basket BK is placed on the placing table Ta when the product registration device 10 executes the registration process for purchased products. A projection surface Sc and a guide mark Ga are arranged on the placing table Ta.

[0069] The depositing and dispensing device 305 includes a coin slot 315, a banknote slot 316, a banknote dispensing port 317, and a coin dispensing unit 318. The depositing and dispensing device 305 stores banknotes inserted into the banknote slot 316 in a banknote storage unit (not shown). The depositing and dispensing device 305 also stores coins inserted into the coin slot 315 in the coin storage unit (not shown). Then, in response to a change dispensing request from the processor 11, the depositing and dispensing device 305 dispenses banknote change to the banknote dispensing port 317. In response to a change dispensing request from the processor 11, the depositing and dispensing device 305 also dispenses coin change to the coin dispensing unit 318.

[0070] The scanner 306 is, for example, an image sensor such as a CCD (Charge Coupled Device) or an optical scanner as an imaging unit for reading a code symbol for code payment.

[0071] Printer 307 has a printing unit (not shown) built into second housing 313 and a receipt issuing port 320 provided on the front surface 319 of second housing 313. Printer 307 prints a receipt and issues it from receipt issuing port 320 under the control of processor 11.

[0072] Card reader 308 is disposed on top surface 314 of first housing 312, to the left of second housing 313. Card reader 308 reads and writes information from a credit card, membership card, or the like inserted through card insertion slot 321. Card reader 308 may also have a wireless communication function for wirelessly communicating with a credit card or smartphone equipped with a contactless IC chip or IC tag to enable contactless payment, also known as touch payment, contactless, or electronic money payment.

[0073] The touch panel 309 is a device that combines an input device and a display device, and is attached to the upper part of the second housing 313. The display device is configured, for example, with a liquid crystal panel, and displays information relating to the operating status of the product registration device 10 in the form of images and text. The input device outputs information to the processor 11 based on the position touched by the customer CS.

[0074] The commodity registration device 10 also includes a cylindrical display pole 322 erected on the rear side of the upper surface 314 of the first housing 312. The display pole 322 has a light emitting unit 323 at its upper tip.

[0075] The light-emitting unit 323 is equipped with multiple LEDs (Light Emitting Diodes) that emit blue light and multiple LEDs that emit red light. Note that the reason for using multiple LEDs is to obtain sufficient light emission intensity; therefore, a single LED of each color may be used as long as the intensity can be maintained with a single LED. The light-emitting unit 323 may use LEDs of colors other than blue and red, or other light-emitting elements. The light-emitting unit 323 is provided at the top end of the tall display pole 322, so it is easily visible not only to the customer CS who operates the product registration device 10, but also to store staff such as attendants in the checkout area.

[0076] For example, when the merchandise registration device 10 is available and waiting for a customer CS, the light emitting unit 323 emits light in a first light emitting state, for example, flashing blue, to indicate this. Furthermore, when an error occurs or when the customer CS operating the merchandise registration device 10 touches a store clerk call button or the like on the touch panel 309, the light emitting unit 323 emits light in a second light emitting state, for example, flashing red, to notify the store clerk of a call.

[0077] The display pole 322 also has a display 310 that displays images and text below the light-emitting unit 323. The display 310 is configured, for example, with a liquid crystal panel. The display 310 displays, for example, the content of an error that has occurred in the product registration device 10.

[0078] In this type of product registration device 10, customer CS places purchased products or a shopping basket BK containing the purchased products within the reading range of RFID reader 15, indicated by guide mark Ga, on placement stand Ta. RFID reader 15 then reads the RFID tags attached to each purchased product and outputs the read product data to processor 11. Processor 11 temporarily stores the product data for each purchased product in main memory 12, and generates display data based on the product data and outputs it to projector 120. Projector 120 projects the display data onto projection surface Sc.

[0079] The customer CS checks the image projected on the projection screen Sc and instructs the start of payment based on the operation image projected on the projection screen Sc. The customer CS, for example, touches a payment start button or the like projected on the projection screen Sc. The camera 110 captures the touch operation by the customer CS on the operation image projected on the projection screen Sc. The camera 110 outputs the captured image data to the processor 11. The processor 11 detects the customer's operation based on the image data. The processor 11 calculates the total amount, etc. based on the product data registered for one transaction, and generates registration information including information such as the breakdown of the products purchased in the transaction to be processed and the total amount. The processor 11 may, for example, display a payment guide based on the registration information on the touch panel 309.

[0080] The customer CS follows the displayed guide to carry out the settlement process using an electronic commerce (EC) method such as cash settlement, credit card payment, electronic money payment, points payment, or code payment. When the settlement is completed, the processor 11 issues a receipt using the printer 307 in accordance with the registered information. The processor 11 also saves the registered information after the settlement in the auxiliary storage device 13 as transaction history information.

[0081] 2, the product registration device 10 can be configured so that no metal is placed within the radiation range of radio waves from the antenna 18. For example, if radio waves are radiated upward from the antenna 18, the projector 120 and the camera 110 are placed below the position of the antenna 18. Therefore, the product registration device 10 can prevent the influence of metal placed within the radiation range of radio waves from the antenna 18 on the radio waves, and can suppress deterioration in the accuracy of reading wireless tags by the RFID reader 15. In this way, the product registration device 10 can improve the accuracy of reading wireless tags.

[0082] (Other embodiments) The merchandise registration device may be realized by one device as explained using merchandise registration device 10 as an example, or may be realized by multiple devices with distributed functions.

[0083] When the functions of the merchandise registration device 10 are provided to a cloud server, the functions of the merchandise registration device 10 may be realized by a system including a tablet terminal communicably connected to the cloud server.

[0084] Furthermore, in the above-described embodiment, the product registration device 10 and the settlement device 20 are configured as separate entities, but the product registration device 10 may also be an integrated product sales data processing device that includes the functions of the settlement device 20.

[0085] The above-described embodiments may be applied to a method executed by an apparatus, a program that can cause a computer of the apparatus to execute each function, or a recording medium that stores the program.

[0086] Each of the one or more circuits constituting the processing circuit performs one or more of the multiple processes. When the processing circuit is composed of a single circuit, the single circuit performs all of the multiple processes. When the processing circuit is composed of multiple circuits, each of the multiple circuits performs a part of the multiple processes. The part of the multiple processes may be one of the multiple processes, or two or more of the multiple processes. When the processing circuit is composed of multiple circuits, the multiple circuits may be included in a single device or may be distributed across multiple devices.

[0087] The program may be transferred in a state where it is stored in the device according to the embodiment, or in a state where it is not stored in the device. In the latter case, the program may be transferred via a network or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is a computer-readable medium. The recording medium may be in any form, such as a CD-ROM or a memory card, as long as it is capable of storing the program and is computer-readable.

[0088] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0089] The above embodiment may be expressed as follows. (1) an antenna for communicating with a wireless tag attached to a product placed on a placing table; a projector that projects an image based on the data related to the product read from the wireless tag via the antenna onto a projection surface; a camera that captures an image of a user's operation on the image projected on the projection surface; Equipped with the projection surface is disposed within a radiation range of radio waves from the antenna on the mounting table; the projector and the camera are disposed outside a radiation range of radio waves from the antenna; Product registration device. (2) The projector and the camera are disposed below a position where the antenna is disposed. (1) A product registration device. (3) The projector projects an image projected from the side via a mirror by reflecting the image upward onto the projection surface. (1) A product registration device. (4) To the computer: a function of acquiring data relating to the product read from the wireless tag attached to the product placed on the placing table by a wireless tag reader via an antenna that communicates with the wireless tag; a function of outputting data to a projector for projecting an image based on the data related to the product onto a projection surface; a function of detecting a user's operation on an image captured by a camera and projected onto the projection surface; An information processing program that makes it possible to execute the above. [Explanation of symbols]

[0090] 10...product registration device, 11...processor, 12...main memory, 13...auxiliary storage device, 14...LAN interface, 15...RFID reader, 17...input / output interface, 18...antenna, 19...system transmission path, 20...payment device, 110...camera, 120...projector, 130...mirror, 305...deposit / withdrawal device, 306...scanner, 307...printer, 308...card reader, 309...touch panel, 310...display, 312...first housing, 313...second housing, 314...top, 3 15...coin slot, 316...banknote slot, 317...banknote withdrawal slot, 318...coin withdrawal section, 319...front side, 320...receipt issuing slot, 321...card insertion slot, 322...display pole, 323...light emitting section, Ara...reading area, Ba...reading start button, BK...product basket, CS...customer, Ga...guide mark, Ima...projected image, Ra...product list display area, Rb...tag number display area, Rc...purchase number display area, Rd...total amount display area, S...checkout system, Sc...projection surface, Ta...placing base.

Claims

1. an antenna for communicating with a wireless tag attached to the product placed on the placing table; a projector that projects an image based on the data related to the product read from the wireless tag via the antenna onto a projection surface; a camera that captures an image of a user's operation on the image projected on the projection surface; Equipped with the projection surface is disposed within a radiation range of radio waves from the antenna on the mounting table; the projector and the camera are disposed outside a radiation range of radio waves from the antenna; Product registration device.

2. The projector and the camera are disposed below a position where the antenna is disposed. The product registration device according to claim 1 .

3. the projector projects an image projected from the side via a mirror by reflecting the image upward onto the projection surface; The product registration device according to claim 1 .

4. On the computer, a function of acquiring data relating to the product read from the wireless tag attached to the product placed on the placing table by a wireless tag reader via an antenna that communicates with the wireless tag; a function of outputting data to a projector for projecting an image based on the data related to the product onto a projection surface; a function of detecting a user's operation on an image captured by a camera and projected onto the projection surface; An information processing program that makes it possible to execute the above.

Images