Information processing device, warning method, and program
The information processing device addresses the issue of damaging customer confidence by selectively displaying anti-shoplifting images on electronic shelf labels near potential shoplifters, effectively deterring theft without affecting other customers.
Patent Information
- Application Number
- JP2023084486
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Existing anti-shoplifting measures displayed on digital signage can damage the confidence of good customers, as they are exposed to anti-shoplifting images.
An information processing device that detects potential shoplifters, identifies their location, and selectively displays images on electronic shelf labels near them to deter shoplifting without exposing these images to other customers.
Prevents shoplifting while maintaining the confidence of good customers by ensuring anti-shoplifting images are not visible to them, reducing the need for constant monitoring by store clerks.
Smart Images

Figure 2024168083000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device, a warning method, and a program. [Background technology]
[0002] Patent Document 1 discloses a technique for preventing shoplifting, in which an image captured by a surveillance camera in a store is displayed on a digital signage display installed in the store when a predetermined condition is met. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2021 / 033703 Summary of the Invention [Problem to be solved by the invention]
[0004] In Patent Document 1, images of anti-shoplifting measures are displayed on a digital signage display installed in a store. Therefore, there is a possibility that the images of the anti-shoplifting measures may be seen by honest customers, which may damage their impression.
[0005] Non-limiting examples of the present disclosure contribute to providing an information processing device, a warning method, and a program that can issue a warning to customers who are likely to shoplift without damaging the image of honest customers. [Means for solving the problem]
[0006] An information processing device according to one embodiment of the present disclosure includes a detection unit that detects customers to be watched who are likely to shoplift from customers in a store, a location acquisition unit that acquires the location of the customers to be watched within the store, an identification unit that identifies display devices in the vicinity of the customers to be watched based on the location of the customers to be watched and location information of display devices within the store, and an image display unit that displays an image to discourage shoplifting on display devices in the vicinity of the customers to be watched.
[0007] A warning method according to one embodiment of the present disclosure includes an information processing device that detects a customer to be watched who is likely to shoplift from among customers in a store, obtains the location of the customer to be watched within the store, identifies display devices in the vicinity of the customer to be watched based on the location of the customer to be watched and location information of display devices within the store, and displays an image to discourage shoplifting on the display devices in the vicinity of the customer to be watched.
[0008] A program according to one embodiment of the present disclosure causes an information processing device to execute a process of detecting a customer to be watched who may shoplift from customers in a store, obtaining the location of the customer to be watched within the store, identifying display devices in the vicinity of the customer to be watched based on the location of the customer to be watched and location information of display devices within the store, and displaying an image to discourage shoplifting on the display devices in the vicinity of the customer to be watched.
[0009] In addition, these comprehensive or specific aspects may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention
[0010] According to an embodiment of the present disclosure, a warning can be issued to customers who are likely to shoplift without damaging the image of honest customers.
[0011] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings, in which such advantages and / or benefits are provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of which are provided to obtain one or more identical features. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a diagram showing a configuration example of a shoplifting prevention system according to a first embodiment; [Diagram 2] A diagram showing a first example of a screen of an electronic shelf label [Diagram 3] A diagram showing a second example of the screen of an electronic shelf label [Figure 4] A diagram showing a third example of the electronic shelf label screen [Diagram 5] A fourth example of the screen of an electronic shelf label [Figure 6] A diagram showing the fifth example of the screen of an electronic shelf label [Figure 7] A diagram showing the sixth example of the screen of an electronic shelf label [Figure 8] A diagram showing the seventh example of the screen of the electronic shelf label [Figure 9] FIG. 1 is a diagram showing an example of a block configuration of an information processing device; [Figure 10] A diagram showing an example of the block configuration of an electronic shelf label [Figure 11] A diagram showing an example of the data structure of notification information [Figure 12] Flowchart showing an example of operation of an information processing device [Figure 13] Flowchart showing an example of the operation of an electronic shelf label DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.
[0014] It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0015] <System configuration diagram> Fig. 1 is a diagram showing an example of the configuration of an anti-shoplifting system according to a first embodiment. As shown in Fig. 1, the anti-shoplifting system 1 has an information processing device 11, an electronic shelf label 12 (shown in an enlarged view), and a camera 13. The information processing device 11, the electronic shelf label 12, and the camera 13 shown in Fig. 1 are connected to each other via a network N1 such as a wireless LAN (Local Area Network). In addition to the anti-shoplifting system 1, Fig. 1 also shows a store A1a such as a convenience store and its backyard A1b.
[0016] The information processing device 11 is, for example, a personal computer or a server. The information processing device 11 is placed, for example, in a backyard A1b of the store A1a. The information processing device 11, for example, manages product inventory and displays images of the inside of the store A1a captured by a camera 13 on a display provided in the information processing device 11. The information processing device 11 also controls images displayed by the electronic shelf labels 12.
[0017] The electronic shelf label 12 is attached to, for example, the front of a shelf board of a product shelf installed in the store A1a, and displays product information about the product placed on the product shelf. For example, the electronic shelf label 12 displays product information such as the product name and price of the product placed on the product shelf under the control of the information processing device 11.
[0018] Furthermore, when a product placed on a product shelf is out of stock, the electronic shelf label 12 displays out-of-stock information such as the expected arrival date of the product under the control of the information processing device 11. Furthermore, when a product that should be placed on a product shelf is not placed there (when there is a misdisplayed product), the electronic shelf label 12 displays information related to the misdisplay, such as the position and product name of the misdisplayed product, under the control of the information processing device 11.
[0019] Furthermore, the electronic shelf label 12 displays an image for preventing shoplifting under the control of the information processing device 11.
[0020] The camera 13 is installed, for example, on the ceiling or wall of the store A1a and captures images inside the store A1a.
[0021] <Example of an electronic shelf label screen> First screen example Fig. 2 is a diagram showing an example of a first screen of the electronic shelf label 12. In Fig. 2, the same components as in Fig. 1 are given the same reference numerals. Fig. 2 shows a customer A2a who is to be watched.
[0022] The information processing device 11 receives image data (moving image data) from the camera 13. The information processing device 11 determines whether or not the image in the received image data includes a customer who may be likely to shoplift.
[0023] For example, the information processing device 11 analyzes the behavior of a customer and determines whether or not the customer is likely to shoplift.
[0024] There are various known methods for analyzing customer behavior, so we will not go into detail here; for example, techniques are known that use the customer's line of sight, facial direction, and arm movements.
[0025] Furthermore, if information such as an image of a customer who has shoplifted in the past is recorded, the information processing device 11 may determine whether or not the customer is a customer who may shoplift, depending on whether or not the customer captured by the camera 13 has shoplifted in the past. In this case, the information processing device 11 estimates whether or not the customer has shoplifted by determining whether the customer's face matches the face of a customer who has shoplifted using face recognition technology, or by determining whether the customer matches the face of a customer who has shoplifted using non-facial information such as the customer's gait or clothing.
[0026] Based on these technologies, customers who are determined to be likely to shoplift or who have shoplifted in the past may be referred to as "suspect customers." Similarly, hereinafter, customers other than the suspect customers may be referred to as "customers."
[0027] When the image from the camera 13 includes the customer A2a to be watched, the information processing device 11 identifies the position of the customer A2a to be watched within the store A1a based on the image from the camera 13. When the information processing device 11 identifies the position of the customer A2a to be watched, it displays an image to discourage shoplifting on the displays of the electronic shelf labels 12 in the vicinity of the identified position (within a predetermined distance from the identified position).
[0028] For example, the information processing device 11 displays an image for discouraging shoplifting, such as "Surveillance camera in operation," on the display of one or more electronic shelf labels 12 in front of the watchful customer A2a, as shown in FIG.
[0029] In this way, the information processing device 11 identifies the location of the watch target customer A2a and displays an image for discouraging shoplifting on the display of the electronic shelf label 12 around the identified location. This prevents the image for discouraging shoplifting from reaching the customer's eyes, and thus prevents the image from damaging the customer's impression.
[0030] Furthermore, since images for preventing shoplifting are displayed on the display of the electronic shelf label 12, the work of store staff monitoring the watchful customer A2a is reduced.
[0031] -Second screen example Fig. 3 is a diagram showing a second example screen of the electronic shelf label 12. In Fig. 3, the same components as in Fig. 1 are given the same reference numerals. Fig. 3 shows a customer A3a who should be watched and a store clerk A3b.
[0032] When the image from the camera 13 includes the customer A3a to be watched, the information processing device 11 identifies the position of the store clerk A3b based on the image from the camera 13.
[0033] When the information processing device 11 identifies the position of the store clerk A3b, it displays an image calling attention to shoplifting on the displays of the electronic shelf labels 12 in the vicinity of the identified position of the store clerk A3b.
[0034] For example, the information processing device 11 displays an image such as a warning on the display of one or more electronic shelf labels 12 in front of the store clerk A3b, as shown in FIG.
[0035] In this way, when a customer A3a to be watched visits the store A1a, the information processing device 11 identifies the location of the store clerk A3b. The information processing device 11 displays an image that calls attention to shoplifting on the display of the electronic shelf label 12 around the identified location. This prevents the image intended to discourage shoplifting from reaching the customer's eyes, and prevents the image from damaging the customer's impression.
[0036] Furthermore, the store clerk A3b only needs to monitor the customer A3a to be alerted when an image alerting the customer to be careful about shoplifting is displayed on the display of the electronic shelf label 12. Therefore, when an image alerting the customer to be careful about shoplifting is not displayed, the store clerk A3b can reduce the work of monitoring the customer A3a to be alerted and can perform other tasks.
[0037] When there are multiple store clerks, the information processing device 11 may identify the position of the store clerk who is near the customer A3a to be watched. The information processing device 11 may then display an image on the display of the electronic shelf label 12 around the store clerk who is near the customer A3a to be watched, warning the clerk to be careful of shoplifting. This allows the store clerk who is near the customer A3a to be watched to monitor the customer A3a to be watched, and the other store clerks can perform other tasks.
[0038] Third screen example Fig. 4 is a diagram showing a third example screen of the electronic shelf label 12. In Fig. 4, the same components as in Fig. 1 are given the same reference numerals. Fig. 4 shows a customer A4a who is to be watched and a customer A4b.
[0039] When the information processing device 11 has determined that the customer A4a is a target of vigilance based on the image from the camera 13, it determines whether or not there is a customer in the vicinity of the customer A4a. When the information processing device 11 has determined that there is a customer in the vicinity of the customer A4a, it displays an image of product information on the display of the electronic shelf label 12, rather than displaying an image to prevent shoplifting.
[0040] For example, as shown in FIG. 4, when a customer A4b is present in the vicinity of a customer A4a to be watched, the information processing device 11 displays an image of product information, such as the price of the product, on the display of the electronic shelf label 12.
[0041] Shoplifting is less likely to occur when there are people nearby. Therefore, when customer A4b is near customer A4a, the information processing device 11 displays images of product information on the displays of the electronic shelf labels 12 in the vicinity of customer A4a, rather than images intended to discourage shoplifting. This prevents customer A4b from seeing the images intended to discourage shoplifting, thereby preventing customer A4b from being negatively affected.
[0042] The information processing device 11 may change whether to display an image for discouraging shoplifting or the strength of the message displayed in the image for discouraging shoplifting depending on the number of people around the watchful customer A4a. For example, since the more people around, the more difficult it becomes to commit shoplifting, it may be possible to not display an image for discouraging shoplifting if the number of people is sufficiently large, or to weaken the strength of the message as the number of people increases.
[0043] Fourth screen example Fig. 5 is a diagram showing a fourth example screen of the electronic shelf label 12. In Fig. 5, the same components as in Fig. 1 are given the same reference numerals. Fig. 5 shows a customer A5a who is to be watched.
[0044] When there is a product shelf that requires work by a store clerk, such as replenishing products or correcting product display, the information processing device 11 displays an image related to the work of the store clerk on the display of the electronic shelf label 12 of the product shelf that requires work by the store clerk. For example, the information processing device 11 displays an image related to the work of the store clerk, such as "Please replenishing products" or "Please correct the incorrect display of products."
[0045] However, when a customer A5a to be watched is present near a product shelf that requires a store clerk to work, the information processing device 11 displays an image to discourage shoplifting on the display of the electronic shelf label 12 of the product shelf that requires a store clerk to work. In this case, it is not necessary to display an image related to the work of the store clerk. However, if the display of the electronic shelf label 12 is large enough, both an image to discourage shoplifting and an image related to the work of the store clerk may be displayed on the display.
[0046] For example, even if a product is out of stock or incorrectly displayed on a product shelf in front of a customer A5a to be watched, the information processing device 11 displays an image to discourage shoplifting, such as "Surveillance camera in operation," on the display of the electronic shelf tag 12 of the product shelf in front of the customer A5a to be watched where the product is out of stock or incorrectly displayed, as shown in Figure 5.
[0047] In this way, even if there is a product shelf that requires work by a store clerk, if a customer A5a to be watched is present around the product shelf, the information processing device 11 displays an image to deter shoplifting on the display of the electronic shelf label 12. This gives priority to deterring shoplifting over work by the store clerk. Also, an image indicating that work by a store clerk is required is displayed on the display of the electronic shelf label 12 of a product shelf that requires work and is located away from the customer A5a to be watched. This allows the store clerk to work while deterring shoplifting.
[0048] Fifth screen example Fig. 6 is a diagram showing a fifth example screen of the electronic shelf label 12. In Fig. 6, the same components as in Fig. 1 are given the same reference numerals. Fig. 6 shows a customer A6a who is to be watched and a customer A6b.
[0049] When the information processing device 11 determines that the customer A6b is near the alert target customer A6a, the information processing device 11 displays a weaker message on the display of the electronic shelf label 12 than the display content of the first screen example.
[0050] For example, as shown in FIG. 6, the information processing device 11 displays a message on the display of the electronic shelf label 12, such as “Please pay at the register or via automatic payment,” in order to avoid disappointing customer A6b and to discourage shoplifting among target customers A6a.
[0051] In this way, even if the information processing device 11 determines that customer A6b is near customer A6a to be watched, the information processing device 11 displays an image to deter shoplifting on the display of the electronic shelf label 12. In this case, the information processing device 11 displays an image to deter shoplifting more indirectly. This allows the information processing device 11 to alert customer A6a to shoplifting without damaging customer A6b's impression, even if customer A6b is near customer A6a to be watched.
[0052] -6th screen example Fig. 7 is a diagram showing a sixth example screen of the electronic shelf label 12. In Fig. 7, the same components as in Fig. 1 are given the same reference numerals. Fig. 7 shows a customer A7a who is to be watched.
[0053] The information processing device 11 identifies the moving direction of the customer A7a to be watched, based on the image from the camera 13. The information processing device 11 displays an image to discourage shoplifting on the display of the electronic shelf label 12 located in the moving direction of the customer A7a to be watched and within a predetermined distance from the customer A7a to be watched.
[0054] For example, customer A7a who is a target of vigilance moves in the direction of arrow A7b in Fig. 7. In this case, the information processing device 11 displays an image to discourage shoplifting, such as "Surveillance camera in operation," on the display of the electronic shelf label 12 located in the direction of arrow A7b and within a predetermined distance from customer A7a who is a target of vigilance.
[0055] In this way, the information processing device 11 displays images to discourage shoplifting on the display of the electronic shelf label 12 along the movement of the customer A7a under watch. This allows the information processing device 11 to alert the moving customer A7a under watch to shoplifting without damaging the impression of the customer A6b.
[0056] 7th Screen Example Fig. 8 is a diagram showing a seventh example screen of the electronic shelf label 12. In Fig. 8, the same components as in Fig. 1 are given the same reference numerals. Fig. 8 shows a customer A8a who is to be watched and a customer A8b.
[0057] The information processing device 11 determines an electronic shelf label 12 that displays an image that discourages shoplifting based on the relative positions of the customer A8a and customer A8b to be alerted. For example, the information processing device 11 determines an electronic shelf label 12 that is likely to be in the field of view of the customer A8a to be alerted and is unlikely to be in the field of view of the customer A8b.
[0058] For example, in the example of Fig. 8, customer A8b is on the left side of customer A8a who is to be watched when viewed from the front. In this case, the information processing device 11 displays an image to discourage shoplifting, such as "Surveillance camera in operation," on the display of the electronic shelf label 12 on the side of customer A8a who is to be watched where customer A8b is not, that is, on the right side of customer A8a who is to be watched.
[0059] In this way, the information processing device 11 determines the electronic shelf label 12 that will display an image that will deter shoplifting, based on the relative positions of the customer A8a and customer A8b to be watched. For example, for customer A8a to be watched, the information processing device 11 determines the electronic shelf label 12 on the side where customer A8b is not present as the electronic shelf label 12 that will display an image that will deter shoplifting. This allows the information processing device 11 to alert customer A7a to shoplifting without damaging the impression of customer A6b.
[0060] When determining an electronic shelf label 12 that displays an image that discourages shoplifting while considering the customer's field of vision, it is possible to determine the electronic shelf label 12 while considering either the customer A8a or the customer A8b. For example, if emphasis is placed on warning the customer A8a, an electronic shelf label 12 that is likely to be within the field of vision of the customer A8a should be selected, whereas if emphasis is placed on the impression of the customer A8b, an electronic shelf label 12 that is unlikely to be within the field of vision of the customer A8b should be selected.
[0061] When considering the customer's field of view, the presence or absence of obstructions may be taken into consideration. For example, even if an electronic shelf label 12 is close to a customer, the customer is unlikely to see an electronic shelf label 12 located on the opposite side across an obstruction such as a shelf or a wall. Therefore, the area obstructed by the obstruction may be excluded from the customer's field of view.
[0062] <Image display priority> The priority of the images to be displayed on the display of the electronic shelf label 12 may be based on the following priorities. In the following, the smaller the number, the higher the priority.
[0063] ·Priority 1 The information processing device 11 displays images (information) for customers on the displays of the electronic shelf labels 12 around the customer. For example, the information processing device 11 displays images for customers, such as product information (e.g., product name, price information, best-before date or expiration date information, etc.) and arrival information, on the displays of the electronic shelf labels 12 around the customer.
[0064] Even if a customer who is a target of caution is near the customer, the information processing device 11 does not display an image to discourage shoplifting on the display of the electronic shelf label 12. In addition, the information processing device 11 does not display images for store clerks, such as images for replenishing products or displaying incorrect products, on the display of the electronic shelf label 12.
[0065] ·Priority 2 When a customer to be watched is in the store A1a and there are no other customers around the customer to be watched, the information processing device 11 displays an image to discourage the customer to shoplift on the display of the electronic shelf label 12. When a customer to be watched is in the store A1a and there are no other customers around the customer to be watched and there are store clerks around the customer to be watched, the information processing device 11 may display an image to alert the store clerk to be careful about shoplifting on the display of the electronic shelf label 12.
[0066] ·Priority 3 When there are no customers or customers to be watched in the vicinity of the store clerk, the information processing device 11 displays images for the store clerk, such as restocking products and incorrect displays, on the displays of the electronic shelf labels 12 in the vicinity of the store clerk.
[0067] In this way, by setting the priority, the information processing device 11 can prevent shoplifting by the customers to be watched, while preventing damage to the customers' impression. Also, the information processing device 11 can prevent a decrease in the work efficiency of the store clerk.
[0068] <Block diagram> Block diagram of information processing device 11 Fig. 9 is a diagram showing an example of a block configuration of the information processing device 11. As shown in Fig. 9, the information processing device 11 includes a control unit 11a, a storage unit 11b, a communication unit 11c, and a display unit 11d.
[0069] The control unit 11a controls the entire information processing device 11. The control unit 11a may be configured by a processor such as a CPU (central processing unit).
[0070] The control unit 11a includes a camera image analysis unit 11aa, an electronic shelf label display information generation unit 11ab, and a notification information generation unit 11ac. The control unit 11a may realize the functions of the above-mentioned units according to a program (application) stored in the storage unit 11b.
[0071] The camera image analysis unit 11aa extracts people from images of the inside of the store A1a captured by the camera 13. The camera image analysis unit 11aa analyzes the behavior of the people from the extracted images of the people, and determines whether the people are customers or customers to be watched.
[0072] Furthermore, the camera image analysis unit 11aa extracts a person's face image from an image of the inside of the store A1a captured by the camera 13. The camera image analysis unit 11aa determines whether or not the person captured by the camera 13 is a customer to be watched, based on the extracted face image and face images of people who have previously shoplifted stored in the memory unit 11b. The camera image analysis unit 11aa also determines whether or not the person captured by the camera 13 is a store clerk, based on the extracted face image and face images of store clerks stored in the memory unit 11b. Note that the person who has previously shoplifted may be a person who shoplifted in the store A1a, or may be a person who shoplifted in another store.
[0073] When the camera image analysis unit 11aa determines (detects) a customer who needs to be watched out for, it detects the moving direction of the customer who needs to be watched out for from the image of the customer who needs to be watched out for.
[0074] In addition, the camera image analysis unit 11aa detects missing products or incorrect display from images of product shelves captured by the camera 13.
[0075] The electronic shelf label display information generating unit 11ab generates display information and generates notification information (notification signal) including the display information. The display information and the notification information will be described in detail with reference to FIG.
[0076] The memory unit 11b stores an operating system (OS) program and application programs executed by the control unit 11a. The memory unit 11b also stores various data necessary for processing by the control unit 11a. For example, the memory unit 11b stores position information of the electronic shelf labels 12 in the store A1a. The memory unit 11b stores map information within the store A1a. The memory unit 11b stores facial image data of people who have previously shoplifted. The memory unit 11b stores facial image data of store clerks. The memory unit 11b may be, for example, a solid state drive (SSD), a random access memory (RAM), a flash memory, a read only memory (ROM), and / or a hard disk drive (HDD).
[0077] The communication unit 11c communicates with the electronic shelf label 12 and the camera 13 via, for example, a wireless LAN.
[0078] The display unit 11d displays an image on a display (a display included in the information processing device 11) based on the digital image data output from the control unit 11a. The display is, for example, a liquid crystal display.
[0079] The camera image analysis unit 11aa may include a detection unit that detects customers, customers to be warned, and store clerks based on an image from the camera 13, a position acquisition unit that acquires the positions of the customers, customers to be warned, and store clerks in the store A1a based on the image from the camera 13 and map information within the store, and an electronic shelf label identification unit that identifies the electronic shelf labels 12 located around the customers, customers to be warned, and store clerks based on the positions of the customers, customers to be warned, and store clerks and position information of the electronic shelf labels 12 in the store A1a. The control unit 11a may include an image display unit that displays a predetermined image on the electronic shelf labels located around the customers, customers to be warned, and store clerks. The image display unit may include an electronic shelf label display information generation unit 11ab and a notification information generation unit 11ac.
[0080] Block diagram of Electronic Shelf Label 12 Fig. 10 is a diagram showing an example of a block configuration of the electronic shelf label 12. As shown in Fig. 10, the electronic shelf label 12 includes a control unit 12a, a storage unit 12b, a communication unit 12c, and a display unit 12d.
[0081] The control unit 12a controls the entire electronic shelf label 12. The control unit 12a may be configured with a processor such as a CPU, for example.
[0082] The control unit 12a includes a notification information analysis unit 12aa and a display image selection unit 12ab. The control unit 12a may realize the functions of the above-mentioned units according to a program stored in the storage unit 12b.
[0083] The notification information analysis unit 12aa analyzes the notification information (see FIG. 11) transmitted from the information processing device 11. The display image selection unit 12ab selects image data to be displayed on the display of the electronic shelf label 12, which is stored in the storage unit 12b, based on the analysis result of the notification information by the notification information analysis unit 12aa.
[0084] The storage unit 12b stores the OS program and application programs executed by the control unit 12a. The storage unit 12b also stores various data required for processing by the control unit 12a. For example, the storage unit 12b stores image data to be displayed on the display of the electronic shelf label 12. The storage unit 12b may be, for example, an SSD, a RAM, a flash memory, a ROM, and / or a HDD.
[0085] The communication unit 12c communicates with the information processing device 11 via, for example, a wireless LAN.
[0086] The display unit 12d displays an image on a display (a display provided in the electronic shelf label 12) based on the digital image data output from the control unit 12a. The display is, for example, a liquid crystal display.
[0087] <Data configuration example> 11 is a diagram showing an example of the data configuration of the notification information. The notification information includes a shelf label ID, display selection information, display information, and identification information.
[0088] The notification information is transmitted from the information processing device 11 to the electronic shelf label 12. For example, the notification information is transmitted from the information processing device 11 to the electronic shelf label 12 when the information processing device 11 determines (detects) a customer to be watched from an image from the camera 13 and changes the image on the display of the electronic shelf label 12. The electronic shelf label 12 changes the image on the display based on the notification information transmitted from the information processing device 11.
[0089] 10, image data to be displayed on the display of the electronic shelf label 12 is stored in the storage unit 12b of the electronic shelf label 12. The electronic shelf label 12 changes (switches) the image to be displayed on the display based on the notification information. For example, the electronic shelf label 12 switches to an image related to product information of the product, an image related to a shortage or replenishment of a product, an image related to a misdisplay, and an image related to anti-shoplifting measures based on the notification information.
[0090] The shelf label ID is an identifier that identifies the electronic shelf label 12. A unique shelf label ID is assigned to each electronic shelf label 12. The information processing device 11 generates notification information including the shelf label ID of the electronic shelf label 12 for which the image on the display is to be changed. The electronic shelf label 12 receives notification information that matches the shelf label ID assigned to the electronic shelf label 12.
[0091] The display selection information is information that controls the display of an image based on the display information described below. The display selection information indicates, for example, whether or not a customer is present around the electronic shelf label 12, whether or not a customer to be watched is present around the electronic shelf label 12, and whether or not a store clerk is present around the electronic shelf label 12. The display selection information may be indicated by 3 bits, for example, as shown in FIG. 11.
[0092] The display information is information that instructs an image to be displayed on the display of the electronic shelf label 12. For example, the display information is information that instructs the display of the electronic shelf label 12 to display any one of an image related to product information of a product, an image related to a shortage or replenishment of a product, an image related to a misdisplay, and an image related to anti-shoplifting measures.
[0093] The electronic shelf label 12 controls the display of an image instructed by the display information based on the display selection information. For example, if the display information is information instructing the display of an image relating to anti-shoplifting measures, and the display selection information indicates that there are no customers around the electronic shelf label 12, that there is a customer to be watched, and that there is no store clerk, the electronic shelf label 12 displays "Surveillance camera in operation" on the display (see, for example, FIG. 2). Also, for example, if the display information is information instructing the display of an image relating to anti-shoplifting measures, and the display selection information indicates that there are customers and customers to be watched around the electronic shelf label 12, and that there is no store clerk, the electronic shelf label 12 displays "Please pay at the cash register or via automatic payment" on the display (see, for example, FIG. 6).
[0094] In other words, it may be considered that the image displayed on the electronic shelf label 12 is determined by the display selection information and the display information. The display selection information and the display information may be considered as one piece of information that determines the image to be displayed on the electronic shelf label 12.
[0095] The identification information indicates the end of one piece of notification information. When there are a plurality of electronic shelf labels 12 whose images are to be changed, the information processing device 11 may transmit the notification information successively.
[0096] <Example of operation> Operation example of the information processing device 11 12 is a flowchart showing an example of the operation of the information processing device 11. The information processing device 11 repeatedly executes the process of the flowchart shown in FIG.
[0097] The information processing device 11 receives image data from the camera 13 (S1).
[0098] The information processing device 11 analyzes the image of the image data received in S1 (S2). For example, the information processing device 11 analyzes the behavior and face of a person included in the image.
[0099] Based on the analysis result of S2, the information processing device 11 determines whether the person included in the image of the image data is a customer, a customer to be watched, or a store clerk (S3).
[0100] The information processing device 11 generates display selection information and display information based on the determination result of S3 (S4). For example, when the image of the image data includes a customer and a customer to be alerted, but does not include a store clerk, the information processing device 11 generates display selection information indicating that a customer and a customer to be alerted are present, and that a store clerk is not present. The information processing device 11 generates display information instructing the display of an image relating to anti-shoplifting measures.
[0101] The information processing device 11 identifies the position of the person in the store A1a based on the determination result of S3, based on the image (image including a person) used in the determination of S3 and map information of the store A1a. The information processing device 11 identifies the shelf ID of the electronic shelf label 12 that displays (changes display) the image, based on the identified position information of the person in the store A1a and the position information of the electronic shelf label 12 in the store A1a stored in the storage unit 11b (S5).
[0102] Furthermore, the information processing device 11 identifies the direction of movement of the person in the store A1a based on the result of the determination in S3, based on the image (image including the person) used in the determination in S3 and map information of the store A1a. The information processing device 11 identifies the shelf ID of the electronic shelf label 12 that displays (changes display) the image, based on the identified direction of the person in the store A1a and the position information of the electronic shelf label 12 in the store A1a stored in the storage unit 11b (S5).
[0103] The information processing device 11 generates notification information including the display selection information and display information generated in S4, and the shelf ID and identification information specified in S5, and transmits the notification information to the electronic shelf label 12 (S6).
[0104] It should be noted that the order of the processes of the information processing device 11 is not limited to the above. For example, the order of the process of S4 and the process of S5 may be interchanged.
[0105] Example of Electronic Shelf Label 12 in action 13 is a flowchart showing an example of the operation of the electronic shelf label 12. The electronic shelf label 12, for example, repeatedly executes the process of the flowchart shown in FIG.
[0106] The electronic shelf label 12 receives the notification information (S11).
[0107] The electronic shelf label 12 determines whether or not the notification information received in S11 includes the shelf label ID of the electronic shelf label 12 (S12).
[0108] If the notification information does not include the shelf label ID of the electronic shelf label 12 (No in S12), the electronic shelf label 12 ends the process of this flowchart.
[0109] If the notification information includes the shelf label ID of the electronic shelf label 12 (Yes in S12), the electronic shelf label 12 refers to the memory unit 12b and acquires image data to be displayed on the display based on the display selection information and display information that exist between the shelf label ID and the identification information of the electronic shelf label 12 in the notification information (S13).
[0110] The electronic shelf label 12 displays an image based on the image data acquired in S13 on the display (S14).
[0111] <Summary of the embodiment> As described above, the information processing device 11 detects customers to be watched who are likely to shoplift, based on images from the camera 13 installed within the store A1a, obtains the position of the customers to be watched within the store A1a based on the images from the camera 13 and map information within the store A1a, identifies electronic shelf tags 12 located in the vicinity of the customers to be watched based on the position of the customers to be watched and positional information of electronic shelf tags 12 within the store A1a, and displays images to discourage shoplifting on the electronic shelf tags 12 located in the vicinity of the customers to be watched.
[0112] In this way, the information processing device 11 identifies the location of the watch target customer A2a and displays an image for discouraging shoplifting on the display of the electronic shelf label 12 around the identified location. This prevents the image for discouraging shoplifting from reaching the customer's eyes, and thus prevents the image from damaging the customer's impression.
[0113] <Modification> Variation 1 In response to a customer's request, the information processing device 11 may guide the customer to the location of the product that the customer wants on the display of the electronic shelf label 12. For example, the information processing device 11 may display an arrow on the display of the electronic shelf label 12 to guide the customer to the location of the product that the customer wants.
[0114] When providing information on the location of a product, if a customer to be watched is present at the product guide location (guidance destination) and the customer is at a predetermined distance or more from the customer to be watched, the information processing device 11 displays an image to discourage shoplifting on the displays of the electronic shelf labels 12 around the customer to be watched. When a customer approaches within a predetermined distance of the customer to be watched, the information processing device 11 does not display an image to discourage shoplifting on the displays of the electronic shelf labels 12 around the customer to be watched, but displays an image related to product information.
[0115] This allows the information processing device 11 to alert customers to be on the lookout for shoplifting, and to display product information at a location that introduces products that customers want, without damaging the customer's impression.
[0116] In addition, shoplifting is less likely to occur when there are people nearby. Therefore, when a customer approaches within a predetermined distance of a customer to be watched, shoplifting is prevented even if images related to product information are displayed on the displays of the electronic shelf labels 12 around the customer to be watched.
[0117] Variation 2 In the third screen example, when a customer is in the vicinity of a customer to be watched, the information processing device 11 does not display an image to discourage shoplifting on the displays of the electronic shelf labels 12 in the vicinity of the customer to be watched.
[0118] In the operation of this third screen example, when the information processing device 11 detects a customer to be watched based on the image from the camera 13, the information processing device 11 may notify a mobile terminal carried by the store clerk that the customer to be watched has visited the store. For example, the information processing device 11 may notify that a customer to be watched has visited the store by vibrating the mobile terminal carried by the store clerk so that the customer and the customer to be watched are not aware of this.
[0119] As a result, when a customer is near a customer to be watched, images to discourage shoplifting are not displayed on the displays of the electronic shelf tags 12 near the customer to be watched, but the customer to be watched can be monitored by store staff.
[0120] Variation 3 In the second screen example, the information processing device 11 displays an image on the displays of the electronic shelf labels 12 around the store clerk, warning the clerk to be careful about shoplifting.
[0121] A store clerk who sees the image alerting the clerk to be careful about shoplifting may, for example, perform a predetermined operation on a predetermined button provided on the electronic shelf label 12. The electronic shelf label 12 notifies the information processing device 11 that the predetermined button operation has been performed. When the information processing device 11 receives a notification from the electronic shelf label 12 that the predetermined button operation has been performed, it displays an image to discourage shoplifting on the displays of the electronic shelf labels 12 in the vicinity of the customer to be watched for, rather than an image alerting the clerk to be careful about shoplifting.
[0122] This allows the information processing device 11 to display an image that discourages shoplifting, based on the judgment of the store clerk.
[0123] Variation 4 In the second screen example, the information processing device 11 displays an image on the displays of the electronic shelf labels 12 around the store clerk, warning the clerk to be careful about shoplifting.
[0124] In the operation of this second screen example, for example, when a store clerk is tasked with a higher priority than displaying products, such as handling the cash register or being called by a customer, the information processing device 11 may display an image to discourage shoplifting on the displays of the electronic shelf labels 12 around the customer to be watched, rather than displaying an image to warn the store clerk to be careful about shoplifting. On the other hand, when a store clerk is performing a low-priority task, the information processing device may display an image to warn the store clerk to be careful about shoplifting on the displays of the electronic shelf labels 12 around the customer to be watched, rather than displaying an image to discourage shoplifting.
[0125] For example, the information processing device 11 may notify the store clerk that a high priority task has occurred by a means other than the display of the electronic shelf label 12. For example, the information processing device 11 may notify a mobile terminal carried by the store clerk. The information processing device 11 may also notify the store clerk that a high priority task has occurred, for example, from a speaker provided in the store A1a. The information processing device 11 may also display an image to discourage shoplifting on the display of the electronic shelf label 12 near the customer to be watched. This allows the store clerk to handle the high priority task and discourage shoplifting.
[0126] Variation 5 The location where the electronic shelf label 12 is installed is not limited to a product shelf. For example, the electronic shelf label 12 may be installed at the entrance of a place other than a place where products are displayed, such as a restroom.
[0127] When the information processing device 11 detects from the image of the camera 13 that a customer to be watched has entered a place other than the display area, it may display an image to discourage shoplifting, such as "Please do not bring in unpaid items" on the display of the electronic shelf label 12. This discourages shoplifting that is carried out after bringing items to a place other than the display area.
[0128] Furthermore, when the product is clothing or the like, a fitting room or the like may be selected as a location other than the product display area.
[0129] Also, an image to discourage shoplifting may be displayed when it is detected that the location where the watchful customer has entered is an unnatural location for carrying a displayed product. For example, when a customer carries a product to a cash register or a clothing product to a fitting room, the product is carried to a location other than the display location, but it cannot necessarily be said that shoplifting is highly likely to occur. Therefore, in such a case, an image to discourage shoplifting may not be displayed on the electronic shelf label 12, or a message included in the displayed image may be weakened. On the other hand, when a product is carried to a location unlikely for normal business transactions, such as a toilet, it is estimated that shoplifting is highly likely to be carried out, so an image to discourage shoplifting may be displayed on the electronic shelf label 12, or a message included in the displayed image may be strengthened.
[0130] Variation 6 When a customer to be watched stays in the same place for a certain period of time or longer, the information processing device 11 may change the content displayed on the display of the electronic shelf label 12. For example, the information processing device 11 may change the message to a stronger one that discourages shoplifting. The information processing device 11 may also output audio guidance from the electronic shelf label 12 that discourages shoplifting. This further discourages the occurrence of shoplifting.
[0131] In addition, in the case of particularly malicious individuals, such as habitual shoplifters, measures such as reporting the individual to the police may be taken.
[0132] Variation 7 The information processing device 11 may display an image to discourage shoplifting on the electronic shelf labels 12 of products that have been shoplifted in the past. On the other hand, the information processing device 11 may not display an image to discourage shoplifting on the electronic shelf labels 12 of products that have not been shoplifted in the past, even if a customer to be watched is present in the vicinity.
[0133] It is estimated that merchandise that has not been shoplifted in the past is unlikely to be shoplifted in the future, while merchandise that has been shoplifted in the past is likely to be shoplifted in the future. By displaying an image that discourages shoplifting on the electronic shelf labels 12 of merchandise that is likely to be shoplifted in the future, the occurrence of shoplifting is efficiently prevented while reducing the opportunities for customers to see the image that discourages shoplifting.
[0134] The information processing device 11 may change the electronic shelf label 12 of an item that has been shoplifted frequently in the past to a stronger message that discourages shoplifting. The information processing device 11 may also output audio guidance that discourages shoplifting from the electronic shelf label 12. This more strongly discourages the occurrence of shoplifting of an item that has been shoplifted frequently in the past.
[0135] Variation 8 The information processing device 11 may determine whether or not a customer is likely to shoplift, based on the following person behavior.
[0136] (1) A person who frequently looks around (2) A restless person (3) A person carrying a large bag
[0137] This allows the information processing device 11 to appropriately determine whether or not the customer is likely to shoplift.
[0138] It should be noted that for individuals who satisfy multiple of the above conditions, stronger measures may be taken.
[0139] Variation 9 In the fifth screen example, the information processing device 11 displays, on the display of the electronic shelf label 12, a second message that is weaker than the first message for deterring shoplifting.
[0140] In the operation of the fifth screen example, the information processing device 11 may alternately display an image related to product information of the product and an image of the second message in a time-division manner. For example, the information processing device 11 may alternately display an image related to product information shown on the electronic shelf label 12 in Fig. 4 and an image of a second message such as "Please pay at the register or via automatic payment" shown on the electronic shelf label 12 in Fig. 6 in a time-division manner.
[0141] This allows the information processing device 11 to present product information to customers who are near the customer to be watched, and to alert the customer to shoplifting without damaging the customer's impression.
[0142] Variation 10 In a ninth modification, the information processing device 11 may make the display time of the image related to the product information of the product and the display time of the image of the second message uneven.
[0143] For example, the information processing device 11 may change the display time depending on the possibility of the wary customer shoplifting. For example, if the wary customer is a wary customer who has shoplifted in the past, the information processing device 11 may display the image of the second message for a longer time than the image related to the product information of the product. If the wary customer is a wary customer who has not shoplifted in the past, the information processing device 11 may display the image of the product information of the product for a longer time than the image of the second message.
[0144] This allows the information processing device 11 to appropriately prevent shoplifting and provide product information to customers.
[0145] Variation 11 In the above-described embodiment, a customer who may shoplift is considered to be a "customer to be wary of." However, a "customer to be wary of" may be a customer who has other characteristics as long as the information processing device 11 determines that the customer matches the characteristics of a person who should be wary of. For example, a person who may negatively affect the customer's impression, such as a drunk person or a person who shouts loudly in a store, may also be treated as a "customer to be wary of."
[0146] In this case, the message displayed on the electronic shelf label 12 or the mobile terminal carried by the store clerk may be changed depending on the type of customer to be watched. For example, if the customer to be watched is drunk, it is difficult for other customers to deal with the situation, so a message is displayed on the mobile terminal carried by the store clerk. Also, for example, if the customer to be watched is a loud-mouthed person, a message such as "Please be quiet in the store" is displayed on the display of the electronic shelf label 12.
[0147] Variation 12 The strength of the message sent to the target customers can be various. For example, a strong message may include more direct expressions such as "shoplifting" or "crime," while a weak message may be a message such as "security guards on patrol" that does not directly include expressions such as "shoplifting."
[0148] The strength of the message may also be changed by changing the format of the message. For example, a strong message may be displayed with a bold font or a red background color, which is more likely to attract the customer's attention.
[0149] Furthermore, the number of electronic shelf labels 12 displaying the message may vary depending on the range of the message intensity. For example, a stronger message may be displayed on a larger number of electronic shelf labels 12.
[0150] The strength of the message may be changed depending on the number of media for notifying the message. For example, when a strong message is issued, the message may be notified by voice in addition to being displayed on the display, and when a weak message is issued, the message may be only displayed on the display.
[0151] The user may change the setting of which message is to be stronger. Note that the strength of messages to be sent to store clerks may also be set in a similar manner. However, since facts are more important than impressions in messages to store clerks, messages may always include direct expressions.
[0152] Variation 13 In the above-described embodiment, images captured by a camera are used to detect a person and to identify the direction of movement of the person, and the electronic shelf label 12 is used as a device for displaying a message. However, these devices may be other devices. For example, detection and tracking of a person may be realized by wireless communication using a mobile terminal or the like owned by the person, and messages may be displayed using other display devices such as signage or projectors installed in a store.
[0153] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the claims. It is understood that such modified or altered examples also belong to the technical scope of the present disclosure. In addition, the components and modified examples in the embodiments may be arbitrarily combined within the scope of the present disclosure.
[0154] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuit", "... assembly", "... device", "... unit", or "... module".
[0155] The present disclosure can be realized by software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiment may be realized partially or entirely as an LSI, which is an integrated circuit, and each process described in the above embodiment may be controlled partially or entirely by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip that includes some or all of the functional blocks. The LSI may have input and output of data. Depending on the degree of integration, the LSI may be called an IC, a system LSI, a super LSI, or an ultra LSI.
[0156] The method of integration is not limited to LSI, but may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Also, after LSI manufacturing, a programmable FPGA (Field Programmable Gate Array) or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.
[0157] Furthermore, if a new integrated circuit technology that can replace LSI appears due to the progress of semiconductor technology or a derivative technology, it is possible to integrate the functional blocks using that technology. The application of biotechnology is also a possibility. [Industrial Applicability]
[0158] The present disclosure is useful in anti-shoplifting systems. [Explanation of symbols]
[0159] 1. Shoplifting prevention system 11 Information processing equipment 12 Electronic shelf label 13. Camera N1 Network A1a store A1b Backyard
Claims
1. A detection unit that detects customers who are likely to shoplift from customers in the store; a position acquisition unit that acquires a position of the customer to be watched within the store; an identification unit that identifies a display device located near the customer to be watched based on a position of the customer to be watched and position information of the display device within the store; an image display unit that displays an image for preventing shoplifting on a display device located near the customer to be watched; An information processing device having the above configuration.
2. The detection unit further detects a store clerk in the store, The position acquisition unit acquires a position of the store clerk within the store, The identification unit identifies display devices in the vicinity of the store clerk based on the image and the map information; The image display unit displays an image on a display device located near the store clerk to alert the store clerk to shoplifting. The information processing device according to claim 1 .
3. The detection unit detects customers in the store other than the alert target customers, The position acquisition unit acquires positions of customers other than the alert target customer within the store, the image display unit does not display an image for preventing shoplifting on a display device in the vicinity of the watch target customer when a customer other than the watch target customer is present in the vicinity of the watch target customer; The information processing device according to claim 1 .
4. the image display unit displays an image related to the work of a store clerk on a display device that is not in the vicinity of the customer to be watched; The information processing device according to claim 1 .
5. The detection unit detects customers in the store other than the alert target customers, The position acquisition unit acquires positions of customers other than the alert target customer within the store, the image display unit displays images with different contents for preventing shoplifting on display devices in the vicinity of the watchful customer based on whether or not there are customers other than the watchful customer in the vicinity of the watchful customer. The information processing device according to claim 1 .
6. A movement direction identification unit that identifies a movement direction of the customer to be watched, The image display unit displays an image for preventing shoplifting on the display device along the movement direction. The information processing device according to claim 1 .
7. The detection unit detects customers in the store other than the alert target customers, the position acquisition unit acquires a position of the customer within the store based on the image and the map information; the image display unit determines the display device on which an image for preventing shoplifting is to be displayed based on a location of the customer and a location of the customer to be watched. The information processing device according to claim 1 .
8. An information processing device, Detect customers in the store who are likely to shoplift, Acquire the location of the customer to be watched within the store; Identifying display devices located in the vicinity of the customer to be watched based on the location of the customer to be watched and location information of the display devices within the store; displaying an image for preventing shoplifting on a display device located near the customer to be watched; Warning method.
9. In the information processing device, Detect customers in the store who are likely to shoplift, Acquire the location of the customer to be watched within the store; Identifying display devices located in the vicinity of the customer to be watched based on the location of the customer to be watched and location information of the display devices within the store; displaying an image for preventing shoplifting on a display device located near the customer to be watched; A program that executes a process.
Citation Information
Patent Citations
Display control device, display control method, program, and display control system
WO2021033703A1
