Information processing apparatus, information processing system, and program

Abstract

To provide a server, a system, and a program which allow a shop clerk to easily discriminate whether an article is an article to be purchased or an article to be not purchased.SOLUTION: An information processing apparatus according to an embodiment of the present invention has take-in article grasping means for, based on an article specifying information of an article taken in a fitting room, grasping the take-in article, purchased article grasping means for, based on the article specifying information of a purchased article subjected to article purchase processing by a purchase processing device installed in the fitting room, grasping the purchase article, determination means for determining a non-purchased article from the take-in article and the purchased article, and display transmission means for transmitting, to a display provided in the vicinity of the fitting room, display information for use in being displayed so as to make it possible to discriminate the purchased article and the non-purchased article.SELECTED DRAWING: Figure 18

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device, an information processing system, and a program. [Background technology]

[0002] In recent years, in apparel stores (hereinafter referred to as "stores") that sell clothing and other items, customers bring multiple items into a fitting room to try on and decide which items to purchase and which not. When paying for the items, store clerks may have difficulty determining which items to purchase and which not. Furthermore, in the future, when customers themselves pay for the items they purchase in the fitting room, store clerks may have difficulty distinguishing between items that have been paid for (items to be purchased) and items that have not been paid for (items not to be purchased). Summary of the Invention [Problem to be solved by the invention]

[0003] The problem to be solved by the present invention is to provide a server, a system, and a program that enable a store clerk to easily distinguish between products to be purchased and products not to be purchased. [Means for solving the problem]

[0004] The information processing device of the embodiment comprises a brought-in item identification means for identifying brought-in items based on item identification information of the brought-in items brought into a fitting room; a purchased item identification means for identifying purchased items based on item identification information of the brought-in items that have been processed for purchase by a purchase processing device installed in the fitting room; a determination means for determining non-purchased items that will not be purchased from the brought-in items and the purchased items; and a display transmission means for transmitting display information to a display installed near the fitting room to display the purchased items and non-purchased items in a distinguishable manner. [Brief explanation of the drawings]

[0005] [Figure 1]FIG. 1 is an explanatory diagram showing the layout of an apparel store and customer movements. [Figure 2] FIG. 2 is an explanatory diagram showing another layout of an apparel store and customer movement. [Figure 3] FIG. 3 is a system diagram showing the system. [Figure 4] FIG. 4 is a block diagram showing the hardware configuration of the digital mirror. [Figure 5] FIG. 5 is a diagram showing a display example of the digital mirror. [Figure 6] FIG. 6 is a diagram showing another display example of the digital mirror. [Figure 7] FIG. 7 is a diagram showing yet another display example of the digital mirror. [Figure 8] FIG. 8 is a block diagram showing the hardware configuration of the server. [Figure 9] FIG. 9 is a memory map showing the memory configuration of the customer master. [Figure 10] FIG. 10 is a memory map showing the memory configuration of the customer file. [Figure 11] FIG. 11 is a memory map showing the memory configuration of the fitting room information section. [Figure 12] FIG. 12 is a block diagram showing the hardware configuration of the gate. [Figure 13] FIG. 13 is a block diagram showing the hardware configuration of the payment machine. [Figure 14] FIG. 14 is a block diagram showing the hardware configuration of the display device. [Figure 15] FIG. 15 is a sequence diagram showing the main processing flow between the digital mirror, server, gate, accounting machine, and display. [Figure 16] FIG. 16 is a functional block diagram showing the functional configuration of the information processing system. [Figure 17] FIG. 17 is a flowchart showing the control process of the digital mirror. [Figure 18] FIG. 18 is a flowchart showing the control process of the server. [Figure 19]FIG. 19 is a flowchart showing the gate control process. [Figure 20] FIG. 20 is a flowchart showing the control process of the payment machine. [Figure 21] FIG. 21 is a flowchart showing the control process of the display device. [Figure 22] FIG. 22 is a diagram showing a display example of the display device. DETAILED DESCRIPTION OF THE INVENTION

[0006] An embodiment will be described below with reference to the drawings. In the embodiment, a server will be described as an example of an information processing device. Also, a checkout machine will be described as an example of a purchase processing device. Also, in the embodiment, the information processing device, a gate, and a purchase processing device constitute an information processing system. Note that the present invention is not limited to the embodiment described below.

[0007] FIG. 1 is a diagram showing the layout of an apparel store according to an embodiment. An apparel store is a store that sells clothing (products) (hereinafter, an apparel store may be simply referred to as a "store"). Customers bring products displayed in the store into a fitting room to try them on (products brought into the fitting room are referred to as "brought-in products") and purchase products they like or that fit them. In the embodiment, customers register and pay for the products they wish to purchase in the fitting room (products for which product registration and payment have been made are referred to as "purchased products"). When a customer leaves the fitting room, a store clerk sorts the products that the customer brings with them into purchased products and products that the customer will not purchase (products not purchased are referred to as "non-purchased products").

[0008] In FIG. 1, store M has an entrance / exit Ma, a product display area Mb, a fitting area Mc, and a backyard Md. Customers enter and exit store M through entrance / exit Ma. A digital mirror 1 is installed near entrance / exit Ma inside store M. A gate 5 is installed near the entrance / exit of fitting area Mc. A server 3 (information processing device) is installed in the backyard Md.

[0009] The digital mirror 1 comprises a half mirror (not shown), a display unit 18 (see FIG. 4), and a camera 19 (see FIG. 4). When the display unit 18 is not displayed, the digital mirror 1 functions as a mirror that reflects the image of the customer. When the display unit 18 is displayed, the digital mirror 1 functions as a display. The display unit 18 is provided on the back side of the half mirror (the opposite side from where the customer stands), and displays information to customers standing in front of the digital mirror 1. The camera 19 captures an image of the face of a customer standing in front of the digital mirror 1. The functions and display of the digital mirror 1 will be described later with reference to FIGS. 5 to 7.

[0010] The product display area Mb has multiple shelves D on which various products are displayed. All products displayed on the shelves D have attached thereto wireless tags (not shown), such as RFID tags. The wireless tags store individual product codes (product identification information) that uniquely identify the products to which they are attached, and transmit tag information including the individual product codes. The individual product codes include product codes that identify the types of products.

[0011] The fitting area Mc is equipped with multiple fitting rooms E (four in this embodiment). The fitting rooms E are private rooms where customers bring in and try on items. A gate 5 is provided at the entrance and exit of the fitting area Mc. A store clerk is stationed near the gate 5 to collect items that customers will not purchase. A display 9 is provided near the store clerk. The display 9 displays the items that customers will purchase and the items that customers will not purchase. The store clerk checks the display on the display 9 to determine which items will not be purchased. The display 9 is an information terminal such as a laptop PC (Personal Computer) or a tablet terminal, but the display 9 may also be a wearable terminal that the store clerk can wear on their arm or a portable terminal that the store clerk can carry.

[0012] A cash register 7 is installed in fitting room E. The cash register 7 is a device that registers and settles for products purchased by customers. Also, a digital mirror 1 similar to the digital mirror 1 installed near entrance Ma is installed in fitting room E.

[0013] A customer visiting store M enters through entrance Ma and stands in front of the digital mirror 1 installed near entrance Ma (arrow Ya). Camera 19 then captures the customer's face. The captured facial image is compared with facial images pre-registered in server 3 to identify the customer and register them as a store visitor. The customer then moves to product display area Mb (arrow Yb) and selects an item to try on from shelf D. The customer then moves to digital mirror 1 (arrow Yc) and operates digital mirror 1 to search for an available fitting room E. Digital mirror 1 displays the number of an available fitting room E. The number of the available fitting room E is also displayed on the customer's mobile terminal 4 (see Figure 3). The customer then proceeds to fitting area Mc (arrow Yd) and passes through gate 5 with the item. Gate 5 receives tag information transmitted from the wireless tag attached to the brought-in item (items that have passed through gate 5 are also called brought-in items) and identifies the brought-in item from the individual item code included in the tag information.

[0014] After passing through gate 5, the customer heads toward the designated fitting room E (arrow Ye) and enters the fitting room. The customer tries on the items they brought with them. While doing so, the customer can see their image in the digital mirror 1 installed in the fitting room E. After trying on the items, the customer decides which items to purchase and which not. The customer then holds the wireless tags of the items they wish to purchase close to the cash register 7 to register the items. After registering all the items they wish to purchase, the customer operates the cash register 7 to pay for the items. After paying, the customer leaves fitting room E with all of the items they brought with them and heads toward gate 5 (arrow Yf). The customer then passes through gate 5. At this time, server 3 keeps track of which items the customer has paid for (purchased items) and which items they have not paid for (non-purchased items). Based on the information received from server 3, display 9 displays the purchased and non-purchased items separately. A salesperson then looks at the display 9 and collects the non-purchased items, placing them in collection box B.

[0015] FIG. 2 shows the layout of store M when there is one fitting room E. In this case, gate 5 is installed at the entrance and exit of fitting room E. The rest of the layout is the same as in FIG. 1. In the case of FIG. 2, customers pass through gate 5 when entering and exiting fitting room E.

[0016] Next, we will explain each device installed in store M. Figure 3 is a system diagram showing a system 90 including a server 3 and an information processing system 10. As shown in Figure 3, system 90 has a digital mirror 1, server 3, gate 5, payment machine 7, and display 9. Information processing system 10 has server 3, gate 5, and payment machine 7. Digital mirror 1, server 3, gate 5, payment machine 7, and display 9 are connected to each other via a communication line L such as a LAN (Local Area Network) so that they can communicate with each other. In addition, a mobile terminal 4 carried by a customer is connected to server 3 via a network NW such as the Internet so that they can communicate with each other.

[0017] The digital mirror 1 has a surface made up of a half mirror and functions as a full-length mirror for a customer positioned in front of the digital mirror 1. The digital mirror 1 also has a display unit 18 on the back of the half mirror. A customer positioned in front can see the display on the display unit 18 through the half mirror. The digital mirror 1 also has a camera 19. The camera 19 captures an image of the face of the customer positioned in front through the half mirror. The camera 19 may also be located above the digital mirror 1 (outside the half mirror). In the embodiment, the digital mirror 1 is located near the entrance Ma and in each fitting room E, but it may also be located near the entrance to the product display area Mb or the fitting area Mc (outside the fitting area Mc), for example.

[0018] Furthermore, based on the customer's operation, the digital mirror 1 displays an available fitting room E. Specifically, the digital mirror 1 displays the fitting room number of the available fitting room E.

[0019] The server 3 manages sales data of products at the store M. The server 3 also manages customers who enter the store M. Specifically, the server 3 captures a facial image of the customer who enters the store using the camera 19 of the digital mirror 1 near the entrance Ma, analyzes the facial image to calculate feature amounts, compares the facial image with pre-stored feature amounts of customers to identify the customer, and creates a customer file 332 (see FIG. 10) of the customer who entered the store.

[0020] The server 3 also keeps track of available fitting rooms E and notifies the customer of the fitting room E to enter. Specifically, the server 3 sends fitting room information indicating the fitting room number of an available fitting room E to the digital mirror 1. The digital mirror 1 displays the fitting room number based on the received fitting room information. The server 3 also sends the fitting room number to the mobile device 4 carried by the customer. The mobile device 4 displays the fitting room number received from the server 3. The customer looks at the fitting room number displayed on the digital mirror 1 or mobile device 4 and recognizes the fitting room E they wish to use.

[0021] Server 3 also keeps track of the products brought into fitting room E by the customer based on the individual item code (brought-in product information), which is product identification information received from gate 5. Server 3 also keeps track of the purchased products paid for at accounting machine 7 based on the product information received from accounting machine 7 and the individual item code (product identification information) included in the payment information. The individual item code that identifies the purchased product is purchased product information.

[0022] The server 3 also determines which of the items brought into the fitting room E are non-purchased items based on the brought-in product information of the purchased items brought into the fitting room E and the purchased product information of the purchased items paid for at the cash register 7. The server 3 also sends display information to the display 9 to cause the display 9 to separately display the purchased items and non-purchased items purchased by the customer.

[0023] Gate 5 receives tag information transmitted from wireless tags attached to items brought in by customers entering fitting area Mc in FIG. 1 (fitting room E in FIG. 2). Gate 5 acquires the individual item code included in the received tag information and sends entry information including the individual item code (brought-in item information) to server 3. Gate 5 also receives tag information transmitted from wireless tags attached to brought-in items brought in by customers leaving fitting area Mc or fitting room E. Gate 5 acquires the individual item code included in the received tag information and sends exit information including the individual item code to server 3. Gate 5 is equipped with an entrance / exit sensor 60 (see FIG. 12), and based on the output from this sensor, it can determine whether the customer has passed through gate 5 to enter fitting area Mc (or fitting room E) or whether they have passed through gate 5 to exit fitting area Mc (or fitting room E). If it determines that the customer has entered fitting area Mc (or fitting room E), it sends entry information including the individual item code and information indicating that the customer has entered the fitting room to server 3. If it determines that the customer has exited fitting area Mc (or fitting room E), it sends exit information including the individual item code and information indicating that the customer has left the fitting room to server 3.

[0024] The payment machine 7 is installed in each fitting room E. By holding a wireless tag over the antenna 79 (see FIG. 13), the payment machine 7 executes a product registration process (an example of a product purchase process) for the product to which the wireless tag is attached. The product registration process refers to the process of reading the product information (product name, product price, etc.) of the product from the product master 742 (see FIG. 13), displaying it on the display unit 78 (see FIG. 13), and storing the product information in the product information section 731 (see FIG. 13). The payment machine 7 also executes a payment process (an example of a product purchase process) for the registered product. The payment process refers to the process of displaying the total price for the product stored in the product information section 731 on the display unit 78 and performing monetary processing for the transaction (non-cash monetary processing in this embodiment) based on the medium used. The payment process also includes the process of storing the product information of the processed product and payment information (total price, medium used for payment, etc.) in the transaction information section 732 (see FIG. 13).

[0025] The payment machine 7 also transmits to the server 3 the product information relating to the product for which payment has been processed and the payment information (including the individual product code of the product for which payment has been processed).

[0026] The display device 9 is, for example, a personal computer, a tablet terminal, a mobile terminal, or a wearable terminal. The display device 9 receives display information from the server 3 and displays information on purchased items and non-purchased items separately.

[0027] Next, the hardware configuration of the digital mirror 1 will be described. FIG. 4 is a block diagram showing the hardware configuration of the digital mirror 1. As shown in FIG. 4, the digital mirror 1 includes a CPU (Central Processing Unit) 11, which is an example of a processor, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, and a memory unit 14. The CPU 11 is the main controller. The ROM 12 stores various programs. The RAM 13 loads various data. The memory unit 14 stores various programs. The CPU 11, ROM 12, RAM 13, and memory unit 14 are connected to one another via a data bus 15. The CPU 11, ROM 12, and RAM 13 constitute a control unit 100. That is, the control unit 100 executes the control processing of the digital mirror 1, which will be described later, by the CPU 11 operating in accordance with the control programs stored in the ROM 12 and memory unit 14 and loaded in the RAM 13.

[0028] The RAM 13 has an image storage unit 131, a product information unit 132, and a fitting room number unit 133. The image storage unit 131 stores facial images of customers captured by the camera 19. The product information unit 132 stores product information of products sold at store M that has been searched and extracted by customer operations. The fitting room number unit 133 stores fitting room information received from the server 3, indicating the fitting room number of an available fitting room E.

[0029] The memory unit 14 is composed of a non-volatile memory such as an HDD (Hard Disc Drive) or flash memory that retains stored information even when the power is turned off. The memory unit 14 has a control program unit 141 that stores a control program. The memory unit 14 also has a product master 142. The product master 142 stores product information such as the product name, price (unit price), attributes, etc. of the product for each product identification information that identifies the product (product code that identifies the type of product).

[0030] The control unit 100 is also connected to an operation unit 17 , a display unit 18 , and a camera 19 via a data bus 15 and a controller 16 .

[0031] The operation unit 17 is a touch panel provided on the display unit 18. The operation unit 17 includes a store entry key 171, a fitting room key 172, a product key 173, and a history viewing key 174. The store entry key 171 is operated by a customer when they enter the store M through the entrance Ma. When the store entry key 171 is operated, the control unit 100 activates the camera 19 to capture an image of the customer's face and sends the captured image to the server 3. The fitting room key 172 is operated by a customer when they wish to try on an item and want to search for an available fitting room E. When the fitting room key 172 is operated, the control unit 100 queries the server 3 for an available fitting room E. When the control unit 100 receives information about available fitting rooms from the server 3, it displays the corresponding fitting room number on the display unit 18.

[0032] The product key 173 is operated when a customer searches for a desired product. For example, if a customer cannot find the desired product in the store (product display area Mb), the customer operates the product key 173 to have the server 3 search for the desired product. The server 3 extracts the searched product. The control unit 100 receives product information of the products extracted by the server 3 and stores it in the product information unit 132. The control unit 100 also displays the extracted products on the display unit 18. If the customer finds a desired product among the displayed products, the customer specifies (selects) the product. The control unit 100 then notifies the store clerk of the information about the specified product. The store clerk receives the notification and hands the specified product to the customer. The history view key 174 is operated when the customer wants to call up a product they have purchased in the past, or a product they have searched for or specified by operating the product key 173. By operating the history view key 174, the customer can call up and view their past history from the customer master 342 (see FIG. 8). The display unit 18 is, for example, a liquid crystal display, and displays information to the customer. The camera 19 captures an image of the customer's face.

[0033] The control unit 100 is also connected to the communication unit 22 via a data bus 15. The communication unit 22 is connected to the server 3, gate 5, accounting machine 7, and display 9 via a communication line L so as to be able to send and receive information and data.

[0034] Here, we will explain the functions of the digital mirror 1. Fig. 5 is a diagram showing the digital mirror 1 in a state where the display unit 18 is not displaying anything. In this case, the half mirror 181 of the digital mirror 1 reflects the image 182 of a customer positioned in front of the digital mirror 1 (it functions as a full-length mirror). Although not shown, in the state shown in Fig. 5, the display unit 18 displays images of a store entry key 171, a fitting room key 172, a product key 173, and a history viewing key 174 on part of the digital mirror 1 (in a position that does not obstruct the full-length mirror).

[0035] Furthermore, when the product key 173 or the history viewing key 174 is operated, product images 183 of products extracted as a result of the search or product images 183 of products viewed in the past are displayed on the display unit 18, as shown in Fig. 6. The customer can specify the product by touching the image of the desired product from the displayed product images 183.

[0036] 7, when the fitting room key 172 is operated, the display unit 18 displays a fitting room number 184 indicating the available fitting room E received from the server 3. The customer checks the displayed available fitting room number 184 and heads to the specified fitting room E.

[0037] The functions of the digital mirror 1 shown in Figures 5 to 7 can be achieved not only by the digital mirror 1 installed near the entrance Ma, but also by other digital mirrors 1 installed in the store M or fitting rooms E.

[0038] FIG. 8 is a block diagram showing the hardware configuration of the server 3. As shown in FIG. 8, the server 3 includes a CPU 31, which is an example of a processor, a ROM 32, a RAM 33, a memory unit 34, and the like. The CPU 31 is the main controller. The ROM 32 stores various programs. The RAM 33 expands various data. The memory unit 34 stores various programs. The CPU 31, the ROM 32, the RAM 33, and the memory unit 34 are connected to one another via a data bus 35. The CPU 31, the ROM 32, and the RAM 33 constitute a control unit 300. That is, the control unit 300 executes the control processing of the server 3, which will be described later, by the CPU 31 operating in accordance with the control program stored in the ROM 32 or the memory unit 34 and expanded in the RAM 33.

[0039] The RAM 33 includes a facial image storage unit 331, a customer file 332, a fitting room information unit 333, and a sales management unit 334. The facial image storage unit 331 stores information about facial images captured by the camera 19 and received from the digital mirror 1. The customer file 332 reads and stores various information about customers identified based on the facial images stored in the facial image storage unit 331 from a customer master 342. The customer file 332 will be described later with reference to FIG. 10. The fitting room information unit 333 manages the usage status of each fitting room E installed in the fitting area Mc in real time. For example, a human presence sensor (not shown) is installed in fitting room E, and if the human presence sensor detects a person, information indicating presence (for example, flag "1" indicating presence) is stored in the fitting room E, and if the human presence sensor does not detect a person, information indicating absence (for example, flag "0" indicating absence) is stored in the fitting room E. The fitting room information unit 333 will be described later in FIG. 11. The sales management unit 334 manages sales by storing the sales of store M, which is the accumulated sales data of paid products based on the product information and payment information received from each payment machine 7.

[0040] The memory unit 34 is composed of a non-volatile memory such as an HDD or flash memory that retains stored information even when the power is turned off. The memory unit 34 includes a control program unit 341 that stores a control program, a customer master 342, and a product master 343. The customer master 342 stores customer information (such as name, address, telephone number, email address for a mobile terminal (e.g., mobile terminal 4), product (clothing) size suitable for the customer, past product purchase history and browsing history, etc.) for each customer who has registered as a member. The customer master 342 will be described later with reference to FIG. 9. The product master 343 stores product information for products sold at store M (such as a product code that identifies the type of product, product name, product price, product attribute information (color, size), etc.).

[0041] The control unit 300 is also connected to an operation unit 37 and a display unit 38 via a data bus 35 and a controller 36. The operation unit 37 is a keyboard used to operate the server 3. The display unit 38 displays information to the operator operating the server 3.

[0042] The control unit 300 is also connected to a communication unit 39 via a data bus 35. The communication unit 39 is connected to the digital mirror 1, gate 5, accounting machine 7, and display 9 via a communication line L so as to be able to send and receive information and data. The control unit 300 is also connected to a communication unit 40 via the data bus 35. The communication unit 40 is connected to the mobile terminal 4 via a network NW so as to be able to send and receive information and data.

[0043] Next, the customer master 342 will be described. FIG. 9 is a memory map showing the memory configuration of the customer master 342. The customer master 342 has a customer ID section 3421, a customer information section 3422, and a facial feature section 3423. The customer ID section 3421 stores a customer ID (Identification) that identifies each customer for each customer. The customer master 342 stores customer information for each customer in association with the customer ID stored in the customer ID section 3421. The facial feature section 3423 stores feature amounts indicating the facial features of each customer in association with the customer ID stored in the customer ID section 3421. The facial feature amounts are, for example, vector information indicating the features of each face part (eyes, nose, mouth, ears, chin, facial contour, etc.) calculated using known general object recognition based on a captured face image.

[0044] Generic object recognition technology is described, for example, in "Yanai Keiji, 'Current Status and Future of Generic Object Recognition,' Transactions of the Information Processing Society of Japan, Vol. 48, No. SIG16 [searched August 10, 2010], Internet <URL: http: / / mm.cs.uec.ac.jp / IPSJ-TCVIM-Yanai.pdf>."

[0045] Next, the customer file 332 will be described. FIG. 10 is a memory map showing the memory configuration of the customer file 332. When a customer's face is photographed by the camera 19 in the digital mirror 1 (or another digital mirror 1) installed near the entrance Ma of the store M, the feature amounts of the facial features calculated based on the photographed facial image are compared with the feature amounts stored in the face feature section 3423 of the customer master 342. The customer ID stored in the customer ID section 3421 that stores the feature amount with the highest similarity is determined, and a customer file 332 for the customer associated with that customer ID is created. A customer file 332 is created for each customer photographed by the camera 19. Note that if a customer whose face has already had a customer file 332 created is photographed again, the customer file 332 for that customer is not created again while the customer is in the store M, because the customer file 332 for that customer has already been created.

[0046] As shown in FIG. 10 , the customer file 332 has a customer ID section 3321, a facial feature section 3322, a customer information section 3323, a fitting room section 3324, a carry-in item section 3325, and a payment item section 3326. The customer ID section 3321 stores a customer ID that identifies each customer for each customer. The facial feature section 3322 stores features that indicate the facial features of the customer, which are stored in the facial feature section 3423 in association with the same customer ID (the customer ID stored in the customer ID section 3421) as the customer ID stored in the customer ID section 3321. The customer information section 3323 stores the customer information of the customer, which is stored in the customer information section 3422 in association with the same customer ID (the customer ID stored in the customer ID section 3421) as the customer ID stored in the customer ID section 3321.

[0047] The fitting room section 3324 stores fitting room information indicating the fitting room number of fitting room E used by the customer whose customer ID is stored in the customer ID section 3321. When the customer operates the fitting room key 172 displayed on the digital mirror 1, the control section 100 queries the server 3 for availability information for fitting rooms E and receives fitting room information for available fitting rooms E. Meanwhile, the camera 19 captures an image of the customer's face and compares the features to determine one customer ID. The control section 100 stores the received fitting room information in a customer file 332 created for the determined customer ID (specifically, in the fitting room section 3324 associated with the determined customer ID).

[0048] The brought-in item section 3325 stores brought-in item information related to items brought into fitting room E by a customer identified by the customer ID stored in the customer ID section 3321. Specifically, the brought-in item section 3325 stores an individual item code that uniquely identifies the item, which is included in tag information transmitted from a wireless tag attached to the brought-in item brought into fitting room E and received by the antenna 59 of gate 5 (see FIG. 12 ) when the customer passes through gate 5 to enter fitting room E after the fitting room number is displayed on display section 18.

[0049] The payment product unit 3326 stores purchased product information for products for which payment has been processed by the payment machine 7. Specifically, when the payment machine 7 sends product information and payment information to the server 3, it also sends fitting room information indicating the fitting room number of the fitting room E in which the payment machine 7 is installed. Based on the product information and payment information received from the payment machine 7 and the fitting room information received at the same time, the server 3 stores purchased product information (individual product code) based on the received product information and payment information in the payment product unit 3326 associated with the received fitting room information stored in the fitting room unit 3324.

[0050] Next, the fitting room information section 333 will be described. FIG. 11 is a memory map showing the memory configuration of the fitting room information section 333. As shown in FIG. 11, the fitting room information section 333 has a fitting room number section 3331 and a usage information section 3332. The fitting room number section 3331 stores a fitting room number that identifies fitting room E. The usage information section 3332 stores information indicating the usage status of the fitting room E (whether it is in use or not) in association with the fitting room number stored in the fitting room number section 3331 (for example, flag information, where flag "1" indicates that fitting room E is in use and flag "0" indicates that fitting room E is not in use).

[0051] From here, the hardware of the gate 5 will be described. FIG. 12 is a block diagram showing the hardware configuration of the gate 5. As shown in FIG. 12, the gate 5 includes a CPU 51, which is an example of a processor, a ROM 52, a RAM 53, a memory unit 54, etc. The CPU 51 is the main controller. The ROM 52 stores various programs. The RAM 53 expands various data. The memory unit 54 stores various programs. The CPU 51, ROM 52, RAM 53, and memory unit 54 are connected to one another via a data bus 55. The CPU 51, ROM 52, and RAM 53 constitute a control unit 500. That is, the control unit 500 executes the control processing of the gate 5, which will be described later, by the CPU 51 operating in accordance with the control program stored in the ROM 52 or the memory unit 54 and expanded in the RAM 53.

[0052] RAM 53 includes a tag information section 531 and a brought-in product information section 532. Tag information section 531 stores tag information received by antenna 59. Brought-in product information section 532 stores an individual product code (brought-in product information) included in the tag information stored in tag information section 531.

[0053] The memory unit 54 is configured by a nonvolatile memory such as a HDD, flash memory, etc., which retains stored information even when the power is turned off. The memory unit 54 includes a control program unit 541 that stores a control program.

[0054] The control unit 500 is also connected to an operation unit 57, a display unit 58, an antenna 59, and an entrance / exit sensor 60 via a data bus 55 and a controller 56. The operation unit 57 is a keyboard used to operate the gate 5. The display unit 58 displays information to the operator operating the gate 5. The antenna 59 receives tag information, including individual item codes, transmitted from wireless tags attached to products passing through the gate 5. The entrance / exit sensor 60 is a sensor that detects whether a customer is passing through the gate 5 to enter the fitting area Mc or exiting the fitting area Mc. For example, the entrance / exit sensor 60 is a sensor that can detect the direction of passage through the gate 5, and detects whether a customer is entering or exiting the fitting area Mc based on the direction of passage.

[0055] The control unit 500 is also connected to the communication unit 61 via a data bus 55. The communication unit 61 is connected to the digital mirror 1, server 3, accounting machine 7, and display 9 via a communication line L so as to be able to send and receive information and data.

[0056] Next, the hardware of the payment machine 7 will be described. Figure 13 is a block diagram showing the hardware configuration of the payment machine 7. As shown in Figure 13, the payment machine 7 is equipped with a CPU 71, which is an example of a processor, a ROM 72, a RAM 73, a memory unit 74, etc. The CPU 71 is the main controller. The ROM 72 stores various programs. The RAM 73 expands various data. The memory unit 74 stores various programs. The CPU 71, ROM 72, RAM 73, and memory unit 74 are connected to one another via a data bus 75. The CPU 71, ROM 72, and RAM 73 constitute a control unit 700. In other words, the control unit 700 executes the control processing of the payment machine 7, which will be described later, by the CPU 71 operating in accordance with the control programs stored in the ROM 72 and memory unit 74 and expanded in the RAM 73.

[0057] The RAM 73 includes a product information section 731 and a transaction information section 732. The product information section 731 includes: The transaction information section 732 stores the product information (including the individual product code) of the product for which the product registration process has been performed. The transaction information section 732 stores the product information (including the individual product code) and payment information of the product for which the payment process has been performed.

[0058] The memory unit 74 is composed of non-volatile memory such as a HDD or flash memory that retains stored information even when the power is turned off. The memory unit 74 includes a control program unit 741 that stores control programs, a product master 742, and a fitting room number unit 743. The product master 742 stores product information for products sold at store M. The fitting room number unit 743 stores the fitting room number of fitting room E in which the payment machine 7 is installed.

[0059] The control unit 700 is also connected to an operation unit 77, a display unit 78, an antenna 79, a reader / writer 80, and a printer 81 via a data bus 75 and a controller 76. The operation unit 77 is a keyboard operated by a customer entering the fitting room E, and is, for example, a touch panel provided on the display unit 78. The operation unit 77 has a start key 771 and a payment key 772. The start key 771 is pressed to start registering an item to be purchased from among the items brought into the fitting room E. Pressing the start key 771 enables the control unit 700 to start the product registration process for the item to be purchased. The payment key 772 is pressed when processing payment for an item that has been registered. Pressing the payment key 772 causes the control unit 100 to process payment for the item that has been registered.

[0060] The display unit 78 displays information to customers performing product registration and payment operations. The antenna 79 receives tag information from wireless tags attached to products for which product registration has been performed. The payment machine 7 receives tag information from wireless tags brought within a predetermined distance (e.g., a few centimeters) of the antenna 79, for example, using well-known near-field communication (NFC) technology. That is, the antenna 79 receives tag information from wireless tags attached to products for which product registration has been performed by bringing the product close to the antenna 79, but does not receive tag information from wireless tags attached to products that are in the fitting room E but for which product registration has not been performed,

[0061] The reader / writer 80 acquires information for performing the payment process (such as customer information and a media number identifying the media) from the media used for the payment process (such as a credit card or a mobile terminal that performs code payment). The printer 81 issues a receipt on which product information and payment information for the purchased products that have been paid for are printed.

[0062] The control unit 700 is also connected to the communication unit 82 via a data bus 75. The communication unit 82 is connected to the digital mirror 1, server 3, gate 5, and display 9 via a communication line L so as to be able to send and receive information and data.

[0063] Next, the hardware of the display device 9 will be described. FIG. 14 is a block diagram showing the hardware configuration of the display device 9. As shown in FIG. 14, the display device 9 includes a CPU 91, which is an example of a processor, a ROM 92, a RAM 93, a memory unit 94, and the like. The CPU 91 is the main controller. The ROM 92 stores various programs. The RAM 93 expands various data. The memory unit 94 stores various programs. The CPU 91, ROM 92, RAM 93, and memory unit 94 are connected to one another via a data bus 95. The CPU 91, ROM 92, and RAM 93 constitute a control unit 900. That is, the control unit 900 executes the control processing of the display device 9, which will be described later, by the CPU 91 operating in accordance with the control program stored in the ROM 92 or the memory unit 94 and expanded in the RAM 93.

[0064] The RAM 93 includes a display information unit 931. The display information unit 931 stores display information received from the server 3, including purchase product information indicating purchase products to be purchased and non-purchase product information indicating non-purchase products not to be purchased.

[0065] The memory unit 94 is configured by a non-volatile memory such as a HDD, flash memory, etc., which retains stored information even when the power is turned off. The memory unit 94 includes a control program unit 941 that stores a control program.

[0066] Furthermore, the control unit 900 is connected to an operation unit 97 and a display unit 98 via a data bus 95 and a controller 96. The operation unit 97 is a keyboard operated by an operator (store clerk) who operates the display device 9, and is, for example, a touch panel provided on the display unit 98. The display unit 98 displays information (for example, display information) to the store clerk who operates the display device 9.

[0067] The control unit 900 is also connected to a communication unit 99 via a data bus 95. The communication unit 99 is connected to the digital mirror 1, server 3, gate 5, and accounting machine 7 via a communication line L so as to be able to send and receive information and data.

[0068] Next, we will explain the main processing flow between each device in the system 90. FIG. 15 is a sequence diagram showing the main processing flow between the digital mirror 1, server 3, gate 5, cashier 7, and display 9 that make up the system 90. As shown in FIG. 15, when a customer enters store M, the store entry key 171 displayed on the digital mirror 1 is operated (T1). The digital mirror 1 then activates the camera 19 to capture an image of the customer's face (T2). The digital mirror 1 then transmits the captured facial image and store entry information to the server 3 (T3). The server 3 stores the received facial image and store entry information (T4). The server 3 then compares the feature values ​​calculated based on the stored facial image with the feature values ​​stored in the customer master 342 (face feature section 3423), identifies the customer for whom the feature value with the highest similarity is stored, and creates and stores a customer file 332 for that customer (T5).

[0069] Furthermore, when the product key 173 or history viewing key 174 displayed on the digital mirror 1 is operated (T11), the digital mirror 1 receives the corresponding product from the server 3 and displays the product. The customer specifies (selects) one or more products from the displayed products (T12). The digital mirror 1 transmits a product code that identifies the type of specified product and a facial image captured by the camera 19 to the server 3 (T13). Having received the product code and facial image, the server 3 identifies the customer from the facial image and displays information about the product specified by the customer on a display unit (not shown). The store clerk then picks up the specified product from the shelf D and delivers it to the customer.

[0070] Furthermore, when the fitting room key 172 displayed on the digital mirror 1 is operated (T21), the digital mirror 1 transmits a facial image captured by the camera 19 and inquires of the server 3 about available fitting rooms E (T22). The server 3 searches the fitting room information section 333 to extract available fitting rooms E (T23). The server 3 then identifies the customer based on the received facial image and stores the extracted fitting room number of fitting room E in the fitting room section 3324 of the customer file 332 already created for that customer (T24). The server 3 then transmits fitting room information indicating the stored fitting room number to the inquiring digital mirror 1 (T25), and simultaneously transmits the fitting room information to the customer's mobile device 4 (T26). Upon receiving the fitting room information, the digital mirror 1 displays the fitting room number included in the received fitting room information on the display section 18 (T27). The mobile device 4 that received the fitting room information also displays the fitting room number.

[0071] When the fitting room number is displayed, the customer proceeds to fitting area Mc with the items they want to try on and passes through gate 5. Gate 5 receives tag information transmitted from the wireless tags attached to the items carried by the passing customer (T28). Gate 5 also detects the customer's entry into fitting room E using entrance / exit sensor 60, and transmits entry information to server 3 including the individual item code of the item (i.e., brought-in item information) extracted from the received tag information and information indicating the customer's entry (T29). Upon receiving the entry information, server 3 stores the brought-in item information included in the entry information in brought-in item section 3325 (T30).

[0072] A customer who enters fitting room E tries on the items they brought with them, decides which items to purchase, and operates payment machine 7 to register the items they wish to purchase. Payment machine 7 executes the product registration process for the items for which the product registration process has been performed (T31). During the product registration process, payment machine 7 uses antenna 79 to write transaction completion information, indicating that product registration has been performed (essentially, that payment has been performed), to the wireless tag attached to the item for which payment has been processed. When payment key 772 is operated (T32), payment machine 7 executes payment for the registered items (T33). During this payment process, payment machine 7 issues a receipt from printer 81 on which product information and payment information for the paid item are printed.

[0073] The payment machine 7 transmits the product information (including the individual product code) of the product for which payment has been processed, the payment information, and the fitting room information stored in the fitting room number section 743 to the server 3 (T34). Based on the received product information, payment information, and fitting room information, the server 3 stores the purchased product information (the individual product code of the purchased product) in the payment product section 3326 of the customer whose fitting room information is stored (T35).

[0074] After trying on the items and paying for the items they wish to purchase, the customer leaves fitting room E with the items they brought in (removing the brought-in items from fitting room E) and passes through gate 5. Gate 5 receives tag information from the brought-in items as they pass through (T36). Gate 5 detects the customer's exit using entrance / exit sensor 60, and sends exit information to server 3 including the individual item code of the item contained in the received tag information and information indicating the customer's exit (T37). Server 3 searches the brought-in item section 3325 based on the individual item code contained in the received exit information, and determines which items will not be purchased based on the customer's brought-in item information (information stored in the brought-in item section 3325) that has the same individual item code and the purchased item information (information stored in the payment item section 3326) that has been registered (T38). The server 3 then transmits to the display 9 display information, including purchased product information and non-purchased product information that identifies non-purchased products, to cause the display 9 to distinguish between purchased products and non-purchased products and display them on the display unit 98 (T39). Based on the received display information, the display 9 distinguishes between purchased products and non-purchased products and displays non-purchased products on the display unit 98 so that the non-purchased products can be recognized (T40).

[0075] Next, the functional configuration of the server 3, gate 5, and payment machine 7 (that is, the information processing system 10) will be described. Figure 16 is a functional block diagram showing the functional configuration of the server 3, gate 5, and payment machine 7.

[0076] The control unit 300 of the server 3 functions as a brought-in product grasping means 301, a purchased product grasping means 302, a judgment means 303, and a display transmission means 304 by following the control program stored in the ROM 32 or the control program section 341 of the memory unit 34.

[0077] The brought-in product identification means 301 identifies the brought-in products based on the individual product codes of the brought-in products brought into the fitting room E. Specifically, the brought-in product identification means 301 stores the brought-in product information (individual product codes) included in the entry information received from the gate 5 in the brought-in product section 3325 based on the entry information.

[0078] The purchased product identification means 302 identifies the purchased products based on the individual product codes of the purchased products that have been processed for purchase at the cash register 7 installed in the fitting room E, among the identified brought-in products. Specifically, the purchased product identification means 302 stores the individual product codes of the purchased products that have been processed for purchase at the cash register 7 in the payment product section 3326.

[0079] As an example, the purchased product identification means 302 stores the individual product code of a product that has been registered in the payment machine 7 in the payment product section 3326. As another example, the purchased product identification means 302 stores the individual product code of a product that has been registered and paid for in the payment machine 7 in the payment product section 3326.

[0080] The determination means 303 determines non-purchased items from the brought-in items and purchased items. Specifically, the determination means 303 determines non-purchased items based on the brought-in item information of the items brought into the fitting room E by the customer and the purchased item information of the items for which payment has been processed (i.e., the item registration process). More specifically, the determination means 303 determines non-purchased items based on the brought-in item information stored in the brought-in item section 3325 and the purchased item information stored in the paid-for item section 3326. The determination means 303 determines that items other than the items identified by the purchased item information stored in the paid-for item section 3326 (items that have not been registered) from the brought-in item information stored in the brought-in item section 3325 are non-purchased items.

[0081] The display transmission means 304 transmits display information to the display device 9 provided near the fitting room E, which causes the display device 9 to distinguish between purchased items and non-purchased items. Specifically, the display transmission means 304 transmits display information to the display device 9, which causes the display device 9 to distinguish between purchased items identified by the purchased item information and non-purchased items identified by the non-purchased item information.

[0082] In addition, the control unit 500 of the gate 5 functions as an entry information creation means 501, an entry information transmission means 502, an exit information creation means 503, and an exit information transmission means 504 by following the control program stored in the ROM 52 or the control program section 541 of the memory unit 54.

[0083] The entry information creation means 501 creates brought-in product information (including individual item codes) indicating the brought-in products brought into the fitting room E based on tag information indicating the products transmitted from wireless tags affixed to the brought-in products brought into the fitting room E and received by the antenna 59 of the gate 5. Specifically, the exit information creation means 503 creates, based on the tag information received by the antenna 59 of the gate 5, entry information including the brought-in product information (including individual item codes) of the products brought into the fitting room E by the customer and information indicating that the customer has entered the room.

[0084] The entry information transmitting means 502 transmits to the server 3 the brought-in item information indicating the brought-in items into the fitting room E, based on the tag information indicating the items transmitted from the wireless tag attached to the items brought into the fitting room E and received by the antenna 59 of the gate 5. Specifically, the entry information transmitting means 502 transmits to the server 3 the entry information (including the individual item code) created by the entry information creating means 501.

[0085] Based on the tag information received by the gate 5, the exit information generating means 503 generates exit information including information on the items the customer is taking out of the fitting room E and information indicating that the customer has left the room.

[0086] The room exit information transmitting means 504 transmits the room exit information created by the room exit information creating means 503 to the server 3 .

[0087] The control unit 700 of the payment machine 7 also functions as a purchase processing unit 701 and a purchase transmission unit 702 by following the control programs stored in the ROM 72 and the control program unit 741 of the memory unit 74 .

[0088] The purchase processing means 701 performs purchase processing for purchased items among the items brought into the fitting room E. The purchase processing means 701 performs product registration processing for purchased items among the items brought into the fitting room E. The purchase processing means 701 performs product registration processing and payment processing for purchased items among the items brought into the fitting room E.

[0089] The purchase sending means 702 sends purchase product information of the purchased product to the server 3. Specifically, the purchase sending means 702 sends purchase product information (including individual product codes) of the registered product to the server 3. More specifically, the purchase sending means 702 sends purchase product information of the registered product and the paid product to the server 3.

[0090] Next, we will explain the control of the digital mirror 1. FIG. 17 is a flowchart showing the control process of the digital mirror 1. The control unit 100 of the digital mirror 1 determines whether the store entry key 171 has been operated (S11). If it determines that the store entry key 171 has been operated (Yes in S11), the control unit 100 uses the camera 19 to capture an image of the face of the customer who operated the store entry key 171 located in front of the digital mirror 1 (S12). The control unit 100 then stores the captured facial image in the image storage unit 131. Next, the control unit 100 transmits information about the facial image stored in the image storage unit 131 and store entry information indicating that the customer has entered the store to the server 3 (S13). The control unit 100 then returns to S11.

[0091] Furthermore, if it is determined that the store entry key 171 has not been operated (No in S11), the control unit 100 determines whether the product key 173 or the history viewing key 174 has been operated (S14). If it is determined that the product key 173 or the history viewing key 174 has been operated (Yes in S14), the control unit 100 receives information about the searched and extracted product from the server 3 and stores it in the product information unit 132 (S15). Then, the control unit 100 displays the stored product information of the product on the display unit 18 so that the product can be selected (S16). Next, the control unit 100 determines whether the customer has specified a desired product from the displayed products (S17). The control unit 100 waits until a product is specified (No in S17), and if a product is specified (Yes in S17), the control unit 100 transmits a product code identifying the specified product and a facial image captured by the camera 19 to the server 3 (S18). Then, the control unit 100 returns to S11.

[0092] If it is determined that the operation was not a product key 173 or history viewing key 174 operation (No in S14), the control unit 100 determines whether the fitting room key 172 was operated (S21). If it is determined that the fitting room key 172 was operated (Yes in S21), the control unit 100 inquires of the server 3 about available fitting rooms E (S22). The control unit 100 then determines whether a response has been received from the server 3 (S23). The control unit 100 waits until a response is received (No in S23). If a response is received (Yes in S23), the control unit 100 stores fitting room information indicating the fitting room number of the available fitting room E in the fitting room number section 133 (S24). The control unit 100 then displays the stored fitting room number on the display unit 18 (S25). The control unit 100 then returns to S11. Also, if it is determined that the fitting room key 172 has not been operated (No in S21), the control unit 100 returns to S11.

[0093] In this embodiment, the digital mirror 1 is a full-length mirror that is normally used by customers, and when a customer who has selected a product from the product display area Mb operates the fitting room key 172 to use fitting room E, the fitting room number of an available fitting room E can be displayed.

[0094] Next, the control of the server 3 will be described. FIG. 18 is a flowchart showing the control process of the server 3. As shown in FIG. 18, the control unit 300 of the server 3 determines whether it has received store entry information and a facial image from the digital mirror 1 (S31). If it determines that it has received store entry information and a facial image (Yes in S31), the control unit 300 stores the received facial image in the facial image storage unit 331 (S32). The control unit 300 then calculates facial features based on the stored facial image using generic object recognition technology (S33). The control unit 300 then compares the calculated features with the features stored in the facial feature unit 3423, and identifies the customer ID stored in the customer ID unit 3421 that stores the feature with the highest similarity (i.e., identifies the customer) (S34). The control unit 300 then creates a customer file 332 for the customer associated with the customer ID (S35). That is, the control unit 300 reads the feature amount stored corresponding to the identified customer ID from the facial feature unit 3423 and stores it in the facial feature unit 3322, and reads the customer information from the customer information unit 3422 and stores it in the customer information unit 3323. Also, corresponding to the customer ID, the control unit 300 creates a fitting room unit 3324, a brought-in item unit 3325, and a payment item unit 3326. Then, the control unit 300 returns to S31.

[0095] If it is determined that the store entry information and facial image have not been received (No in S31), the control unit 300 determines whether the product key 173 or the history viewing key 174 has been operated and the product code of the product selected by the customer and the facial image captured by the camera 19 have been received from the digital mirror 1 (S36). If it is determined that the product code and facial image have been received (Yes in S36), the control unit 300 displays information about the product identified by the received product code on a display unit (not shown) that the store clerk can view (S37). The control unit 300 then returns to S31. The store clerk delivers the displayed product to the customer.

[0096] If it is determined that the received message is not a product code and a facial image (No in S36), the control unit 300 determines whether it has received an inquiry about fitting room E and a facial image (S41). If it is determined that it has received an inquiry about fitting room E and a facial image (Yes in S41), the control unit 300 searches for an available fitting room E based on the availability information stored in the fitting room information unit 333 (specifically, the flag information stored in the usage information unit 3332) (S42). The control unit 300 then extracts an available fitting room E. The control unit 300 then transmits fitting room information indicating the fitting room number of the extracted fitting room E to the digital mirror 1 (S43). The control unit 300 then returns to S31.

[0097] Furthermore, if it is determined that the inquiry about fitting room E and the reception of a facial image are not received (No in S41), the control unit 300 determines whether entry information has been received from gate 5 (S44). If it is determined that entry information has been received (Yes in S44), the brought-in product identification means 301 stores the brought-in product information included in the entry information in the brought-in product section 3325 (S45). The control unit 300 then returns to S31.

[0098] If the control unit 300 determines that the received information is not entry information (No in S44), it determines whether it has received product information, payment information, and fitting room information from the cashier 7 (S51). If it determines that the received product information, payment information, and fitting room information have been received (Yes in S51), the purchased product tracking means 302 associates the received fitting room information with the stored customer ID and stores the purchased product information in the payment product unit 3326 (S52). The control unit 300 then updates the sales data stored in the sales management unit 334 based on the received product information and payment information (S53). The control unit 300 then returns to S31.

[0099] If the control unit 300 determines that the received information is not product information, payment information, or fitting room information (No in S51), it determines whether it has received room exit information from the gate 5 (S54). If it determines that it has received room exit information (Yes in S54), it searches the brought-in product section 3325 based on the individual item code included in the room exit information to identify the customer ID for which the same individual item code is stored, and reads the brought-in product information stored in the brought-in product section 3325 and the purchased product information stored in the paid-in product section 3326 (S55). The determination unit 303 then determines non-purchased product information related to non-purchased products based on the read brought-in product information and purchased product information (S56). The display transmission unit 304 then transmits display information (purchased product information, non-purchased product information, customer ID, and fitting room information) to the display 9 so that purchased and non-purchased products can be distinguished and displayed clearly (S57). The control unit 300 then returns to S31. Moreover, if it is determined that the received information is not room exit information (No in S54), the control unit 300 returns to S31.

[0100] In this embodiment, the server 3 can determine the non-purchased items that were brought into the fitting room E but not purchased based on the brought-in item information of the brought-in items and the purchased item information of the purchased items, and display the information on the purchased and non-purchased items separately on the display 9. The store clerk can easily collect the non-purchased items based on the information on the purchased and non-purchased items displayed on the display 9.

[0101] Furthermore, the server 3 of the embodiment displays information about purchased and non-purchased items separately on the display 9, allowing the store clerk to correctly collect the non-purchased items. Therefore, if the customer returns the non-purchased item that the store clerk forgot to collect to the appropriate shelf D, the burden on the store clerk of moving the item to the correct location is reduced, thereby reducing the impact on the security system (for example, patrols) within the store M that the store clerk works on.

[0102] In addition, the server 3 of the embodiment creates a customer file 332 for a customer who enters the store M and stores the fitting room information of the fitting room E used by the customer in the fitting room section 3324, so that if the customer leaves something behind in the fitting room E, the customer can be easily identified.

[0103] Next, the control of gate 5 will be described. FIG. 19 is a flowchart showing the control process of gate 5. As shown in FIG. 19, the control unit 500 of gate 5 determines whether it has received tag information and information indicating that a customer has entered the room, as detected by the entrance / exit sensor 60 (S61). If it determines that it has received the entry information and tag information (Yes in S61), the control unit 500 stores the received tag information in the tag information unit 531. Then, the control unit 500 stores the individual item code extracted from the stored tag information in the brought-in product information unit 532. Then, the entry information creation means 501 creates entry information including the stored individual item code and entry information (S62). Then, the entry information transmission means 502 transmits the created entry information to the server 3 (S63). Then, the control unit 500 returns to S61.

[0104] Furthermore, if it is determined that the information received is not information about entering the room and tag information (No in S61), the control unit 500 determines whether the information about the customer leaving the room detected by the entrance / exit sensor 60 and tag information have been received (S64). If it is determined that the information about the customer leaving the room and tag information have been received (Yes in S64), the control unit 500 stores the received tag information in the tag information unit 531. The control unit 500 then stores the individual item code extracted from the stored tag information in the brought-in item information unit 532. The exit information creation means 503 then creates exit information including the stored individual item code and exit information (S65). The exit information transmission means 504 then transmits the created exit information to the server 3 (S66). The control unit 500 then returns to S61.

[0105] Next, we will explain the control of the payment machine 7. Figure 20 is a flowchart showing the control process of the payment machine 7. When the start key 771 is operated, the process of the flowchart shown in Figure 20 becomes possible. The customer performs a product registration operation by bringing the wireless tag attached to the product to be purchased close to the antenna 79. The control unit 700 determines whether the antenna 79 has received tag information (S71). If it is determined that tag information has been received (Yes in S71), the purchase processing means 701 extracts an individual product code from the received tag information and executes product registration processing for that product based on the individual product code (S72). During this product registration processing (while the wireless tag is still located close to the antenna 79), the control unit 700 uses the antenna 79 to write payment completion information indicating that the product registration processing (i.e., payment processing) has been completed to the wireless tag that received the tag information in S71. The control unit 700 then returns to S71.

[0106] If it is determined that the received information is not tag information (No in S71), the control unit 700 determines whether the payment key 772 has been operated (S73). If it is determined that the payment key 772 has been operated (Yes in S73), the purchase processing means 701 executes payment processing for the purchased item based on the product information stored in the product information section 731 (S74). The control unit 700 then stores the product information and payment information for the paid item in the transaction information section 732. The purchase transmission means 702 then transmits to the server 3 the product information and payment information stored in the transaction information section 732, as well as fitting room information indicating the fitting room number of the fitting room E, which is stored in the fitting room number section 743 (S75). The control unit 700 then returns to S71.

[0107] Next, the control of the display device 9 will be described. FIG. 21 is a flowchart showing the control process of the display device 9. As shown in FIG. 21, the control unit 900 of the display device 9 determines whether display information (purchased product information, non-purchased product information, customer ID, fitting room information) has been received from the server 3 (S81). If it is determined that display information has been received (Yes in S81), the control unit 900 stores the received display information in the display information unit 931 (S82). The control unit 900 then separates the purchased product information and non-purchased product information contained in the received display information and displays them on the display unit 98 (S83). The control unit 900 then returns to S81.

[0108] Here, an example of the display displayed by the control unit 900 in S83 is shown. Fig. 22 is a diagram showing an example of the display on the display unit 98 of the display device 9. As shown in Fig. 22, the display unit 98 displays the customer ID 981 of the customer to be displayed and the fitting room number 982 of the fitting room used by the customer, as well as an area 983 displaying purchased items (purchased items) and an area 984 displaying items not to be purchased (non-purchased items), each surrounded by a rectangular frame. Area 983 displays names 9831 of purchased items (items A and B in this embodiment), and area 984 displays names 9841 of non-purchased items (items C and D in this embodiment). A store clerk who sees this display collects the non-purchased items displayed in area 984 from the items brought out of fitting room E by the customer and places them in collection box B.

[0109] In this way, the display 9 displays the items to be collected (non-purchased items) separately from the purchased items, so that the store clerk can easily collect the displayed items to be collected.

[0110] As described above, the server 3 of the embodiment comprises: a brought-in item identification means 301 that identifies brought-in items based on the individual item codes of the brought-in items brought into the fitting room E; a purchased item identification means 302 that identifies purchased items based on the product identification information of the brought-in items that have undergone product registration processing and payment processing for purchase at the cash register 7 installed in the fitting room E; a judgment means 303 that determines which non-purchased items will not be purchased from the brought-in items and purchased items; and a display transmission means 304 that transmits display information to a display 9 installed near the fitting room E to display purchased items and non-purchased items in a distinguishable manner.

[0111] According to the server 3 of this embodiment, it is possible to determine non-purchased items that were brought into the fitting room E but not purchased based on information on the brought-in items brought into the fitting room E and information on the purchased items, and to distinguish between the purchased and non-purchased items and display the information on the display 9 in a distinguishable manner.

[0112] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments and modifications may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. These embodiments and modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims.

[0113] For example, the embodiment has been described using the layout of Fig. 1. However, this is not limiting, and for example, as shown in Fig. 2, if there is one fitting room E, the gate 5 may be provided at the entrance / exit of the fitting room E.

[0114] In addition, in the embodiment, the server 3 is configured to keep track of brought-in items, keep track of purchased items, determine non-purchased items, and send display information, as well as to create a customer file 332 upon store entry registration, search for available fitting rooms E, and search for items. However, the creation of the customer file 332, the search for fitting rooms E, and the search for items may be performed by other devices and are not required components of the server 3.

[0115] In the embodiment, the determination means 303 determines that an item that has not been registered or paid for by the payment device 7 is a non-purchased item. However, this is not limiting, and an item that has not been registered by the payment device 7 may be determined to be a non-purchased item. In other words, the determination means 303 may not use whether a payment process has been completed when determining whether an item is a non-purchased item. [Explanation of symbols]

[0116] 1. Digital Mirror 3 Server 4. Mobile devices 5 Gate 7. Cashier 9 Display 10 Information Processing Systems 17 Control section 18 Display 19 Camera 59 Antenna 79 Antenna 90 Systems 100 control section 133 Fitting Room Number Section 300 control section 301 Means of understanding brought-in goods 302 Purchasing Item Grasp Method 303 Judgment means 304 Display and transmission means 332 Customer File 333 Fitting Room Information Department 500 control section 501 Entry information creation means 502 Entry information transmission means 503 Exit Information Creation Method 504 Exit information transmission means 532 Brought-in Product Information Department 700 control section 701 Purchase Processing Method 702 Purchase Transmission Method 900 control section 931 Display information section 3325 Carry-in Products Department 3326 Payment Products Department E. Fitting Room [Prior art documents] [Patent documents]

[0117] [Patent Document 1] Japanese Patent Application Publication No. 2023-138888

Claims

1. a brought-in product identification means for identifying the brought-in product based on product identification information of the brought-in product brought into the fitting room; a purchase item identification means for identifying the purchased items based on the product identification information of the purchased items that have been purchased by a purchase processing device installed in the fitting room among the brought-in products; a determining means for determining non-purchased items from the brought-in items and the purchased items; a display transmitting means for transmitting display information to a display provided near the fitting room, the display information causing the purchased item and the non-purchased item to be distinguishable from each other; An information processing device comprising:

2. the purchased product grasping means grasps the purchased product for which product registration processing for purchasing the product has been performed in the purchase processing device, The determining means determines that the product that has not been registered is a non-purchased product. The information processing device according to claim 1 .

3. the purchased product grasping means grasps the purchased product for which product registration processing and payment processing for purchasing the product have been performed in the purchase processing device, the determining means determines that a product for which the product registration process and the payment process have not been performed is a non-purchased product; The information processing device according to claim 1 .

4. the determining means makes the determination on the condition that the customer has left the fitting room.

4. The information processing device according to claim 1.

5. Computers as information processing devices a brought-in product identification means for identifying the brought-in product based on product identification information of the brought-in product brought into the fitting room; a purchase item identification means for identifying the purchased items based on the product identification information of the purchased items that have been purchased by a purchase processing device installed in the fitting room among the brought-in products; a determining means for determining non-purchased items from the brought-in items and the purchased items; a display transmitting means for transmitting display information to a display provided near the fitting room, the display information causing the purchased item and the non-purchased item to be distinguishable from each other; A program that can function as a

6. An information processing system including a gate provided near the entrance of a fitting room, a purchase processing device provided in the fitting room, and an information processing device, The gate is The antenna and an entrance information transmitting means for transmitting, to the information processing device, brought-in product information indicating the brought-in product that has been brought into the fitting room, based on wireless tag information indicating the product and transmitted from a wireless tag attached to the product and received by the antenna; Equipped with The purchase processing device includes: a purchase processing means for processing the purchase of one or more of the brought-in products; a purchase transmitting means for transmitting purchase product information of the purchased product to the information processing device; Equipped with The information processing device includes: a brought-in commodity grasping means for storing the brought-in commodity information received from the gate; a purchased product grasping means for storing the purchased product information received from the purchase processing device; a determining means for determining non-purchased items that will not be purchased based on the brought-in item information and the purchased item information; a display transmitting means for transmitting display information to a display unit provided adjacent to the fitting room, the display information causing the purchased item and the non-purchased item to be distinguishable from each other; An information processing system comprising:

Images