Processing device, processing method, and program

Abstract

To reduce a problem in a technique of displaying information to a customer shopping in a store that the customer does not notice the displayed information.SOLUTION: According to the present invention, there is provided a processing device including: recognition means of recognizing that a product is picked up; position identification means of identifying a position where the product is displayed and that becomes empty when the product is picked up; and display control means of displaying information related to the product picked up at a position corresponding to the position where the product is displayed.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a processing device, a processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a technique for displaying information about products displayed and sold in a store (sale prices, freshness of perishable foods, etc.) on a mobile terminal.

[0003] Patent Document 2 discloses a shelf terminal that detects which products have been removed from a shelf and which products have been returned to the shelf by reading the product unique identification information from the IC tag attached to the product. The shelf terminal determines that a product has been removed when the product unique identification information changes from readable to unreadable, and determines that a product has been returned to the shelf when the product unique identification information changes from unreadable to readable. The shelf terminal also transmits the read result from the IC tag to a server, receives advertising information from the server, and displays the advertising information on a display. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-254519 [Patent Document 2] Japanese Patent Application Laid-Open No. 2008-90745 Summary of the Invention [Problem to be solved by the invention]

[0005] Providing useful information to customers shopping in a store is expected to increase sales, etc. However, if the information is not displayed in an appropriate location, a problem may arise in which customers do not notice the displayed information. Neither Patent Document 1 nor Patent Document 2 discloses this problem or a means for solving it.

[0006] An object of the present invention is to alleviate the problem of customers not noticing displayed information in a technology that displays information to customers while they are shopping in a store. [Means for solving the problem]

[0007] According to the present invention, A recognition means for recognizing that a customer has picked up a product; a position specifying means for specifying the position where the product picked up by the customer was displayed; a display control means for displaying provided information including information related to the product picked up by the customer at a position corresponding to the position where the product picked up by the customer was displayed; A processing device is provided having:

[0008] Further, according to the present invention, The computer Recognize when a customer picks up a product, Identifying the display location of the product picked up by the customer; A processing method is provided in which provided information including information related to the product picked up by the customer is displayed at a position corresponding to the position where the product picked up by the customer was displayed.

[0009] Further, according to the present invention, Computer, A means of recognition that recognizes when a customer picks up a product; a position specifying means for specifying the position where the product picked up by the customer was displayed; a display control means for displaying provided information including information related to the product picked up by the customer at a position corresponding to the position where the product picked up by the customer was displayed; A program is provided to function as a [Effects of the Invention]

[0010] According to the present invention, in a technology for displaying information to customers while they are shopping in a store, the problem of customers not noticing the information being displayed can be alleviated. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 2 is a diagram illustrating an example of a hardware configuration of a processing device according to the present embodiment. [Figure 2] FIG. 2 is a functional block diagram of a processing apparatus according to an embodiment of the present invention; [Figure 3] FIG. 10 is a diagram for explaining an example of a position where information is displayed on a product shelf according to the present embodiment. [Figure 4] FIG. 10 is a diagram for explaining an example of a position where provided information is displayed in this embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of a configuration for realizing the functions of the processing device according to the present embodiment. [Figure 6] 10 is a flowchart showing an example of a processing flow of the processing device of the present embodiment. [Figure 7] FIG. 2 is a functional block diagram of a processing apparatus according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0012] First Embodiment First, an overview of the processing device of this embodiment will be described. When the processing device of this embodiment recognizes that a customer has picked up a product displayed on a shelf, it identifies the location where the product was displayed and displays provided information including information related to the product at the location corresponding to the location where the product was displayed.

[0013] In this way, the processing device of this embodiment displays the provided information at "the position corresponding to the position where the product was displayed" at "the moment the customer picks up the product," thereby alleviating the problem of the customer not noticing the displayed provided information.

[0014] Next, the configuration of the processing device will be described in detail. First, an example of the hardware configuration of the processing device will be described. The functional units of the processing device of this embodiment are realized by any combination of hardware and software, centered around a CPU (Central Processing Unit) of any computer, memory, programs loaded into the memory, a storage unit such as a hard disk that stores the programs (this can store programs that are pre-loaded when the device is shipped, as well as programs downloaded from storage media such as CDs (Compact Discs) or servers on the Internet), and a network connection interface. Those skilled in the art will understand that there are many variations in the implementation methods and devices.

[0015] FIG. 1 is a block diagram illustrating an example of the hardware configuration of a processing device of this embodiment. As shown in FIG. 1, the processing device has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. Note that the peripheral circuit 4A may not be included. Note that the processing device may be configured as a single device that is physically and / or logically integrated, or may be configured as multiple devices that are physically and / or logically separated. When configured as multiple devices that are physically and / or logically separated, each of the multiple devices may have the above hardware configuration.

[0016] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to transmit and receive data to and from each other. The processor 1A is an arithmetic processing device such as a CPU or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. Examples of input devices include a keyboard, mouse, microphone, touch panel, physical buttons, camera, etc. Examples of output devices include a display, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0017] Next, the functional configuration of the processing device will be described. Fig. 2 shows an example of a functional block diagram of the processing device 10. As shown in the figure, the processing device 10 has a recognition unit 11, a position identification unit 12, a provided information acquisition unit 13, a display control unit 14, and a display unit 15.

[0018] The recognition unit 11 recognizes that a customer has picked up a product displayed on a shelf. The position identification unit 12 identifies the position where the product picked up by the customer was displayed, specifically, where it was displayed within the product display area. The recognition unit 11 and the position identification unit 12 can achieve this recognition and position identification using, for example, any of the following recognition / identification processing examples 1 to 3. Note that the recognition unit 11 and the position identification unit 12 may also achieve this recognition and position identification using other processing examples.

[0019] "Recognition and identification processing example 1" A code (such as a barcode or two-dimensional code) is attached to the outer surface of a product. The product is then displayed on a display area with the code facing downwards. In other words, the code attached to a product displayed on a display area faces the display area. The display area is an object on which the product is displayed, such as, but not limited to, a shelf. The display area is made of a material that transmits electromagnetic waves (such as transparent glass or plastic). In other words, the display area transmits electromagnetic waves.

[0020] The code reader continues the process of reading the codes of the products displayed on the display section through the display section. The code reader, for example, repeats the process of irradiating electromagnetic waves through the display section toward the products displayed on the display section, receiving the reflected waves, analyzing the codes based on the received reflected waves, and converting them into information (code reading process). Alternatively, the code reader, for example, repeats the process of photographing the products displayed on the display section through the display section, extracting the codes assigned to the products from the image, and analyzing the extracted codes and converting them into information (code reading process).

[0021] The recognition unit 11 acquires the read result from the code reader. Then, based on the read result, the recognition unit 11 recognizes that the customer has picked up the product. For example, when the recognition unit 11 is no longer able to read the code of a product that it had previously been able to read, it recognizes that the customer has picked up the product.

[0022] Next, the position identification process will be described. For example, multiple code readers may be installed corresponding to one display section where multiple products are displayed. In this case, the recognition unit 11 acquires the read results from each of the multiple code readers and recognizes that a customer has picked up a product based on each read result. Then, when a code of a product that had previously been read becomes unreadable, the position identification unit 12 identifies the position where the code reader (first code reader) that had read the code irradiates electromagnetic waves as the display position of the product picked up by the customer. Note that information indicating the positions where each of the multiple code readers irradiates electromagnetic waves (the irradiated positions within the display area of ​​the products on the display section) (such as coordinates in a two-dimensional coordinate system with an arbitrary point in the display area as the origin) may be generated in advance and stored in the processing device 10. Then, the position identification unit 12 may identify the display position of the product picked up by the customer based on the information and information identifying the first code reader.

[0023] Alternatively, the code reader may sequentially irradiate electromagnetic waves to multiple positions in the area where products are displayed on the display section while switching the electromagnetic wave irradiation direction, thereby sequentially reading the codes of multiple products. Then, when the position identification unit 12 becomes unable to read the code of a product that had been read up until then, the position identification unit 12 may identify the display position of the product picked up by the customer based on the electromagnetic wave irradiation direction (first electromagnetic wave irradiation direction) used to read the code. Information indicating the correspondence between the electromagnetic wave irradiation direction of the code reader and the positions irradiated with electromagnetic waves in each direction (irradiated positions in the area where products are displayed on the display section) may be generated in advance and stored in the processing device 10. Then, the position identification unit 12 may identify the display position of the product picked up by the customer based on the information and the first electromagnetic wave irradiation direction.

[0024] Alternatively, the code reader (camera) may be installed in a position and orientation that allows it to capture multiple products at once. The code reader may then extract multiple codes from the image and analyze each of the extracted codes. In this case, the position identifying unit 12 identifies the position in the image of a code that was previously readable but is now unreadable, and then converts the identified position in the image to a position in the area where the products are displayed on the display section based on pre-prepared information indicating the correspondence between coordinates in the image and coordinates of the area where the products are displayed on the display section (information indicating where in the image the first point of the area where the products are displayed on the display section is located).

[0025] "Recognition and identification processing example 2" A camera (a camera that captures moving images) is installed on the display section to capture images of the products displayed from above the display section. The recognition unit 11 recognizes the products in the image based on the features of the product's appearance and tracks each recognized product within the image. The recognition unit 11 then recognizes that a customer has picked up a product based on the product's behavior. For example, the recognition unit 11 may recognize a person's hand in the image, and if the position of the product changes while the person's hand is in contact with the product, it may recognize that the customer has picked up the product.

[0026] The position identifying unit 12 first identifies the position in the image where the product picked up by the customer was located before being picked up. For example, when tracking each product recognized in the image as described above, the change in the position of each product in the image over time may be recorded as history data. Based on this information, the position identifying unit 12 may then identify the position in the image where the product picked up by the customer was located before being picked up. Then, based on pre-prepared "information indicating the correspondence between coordinates in the image and coordinates of the area on the display section where the products are displayed (information indicating where in the image the first point of the area on the display section where the products are displayed)," the position identifying unit 12 converts the position in the image where the product picked up by the customer was located before being picked up into a position on the area on the display section where the products are displayed.

[0027] "Recognition and identification processing example 3" A weight sensor is installed on the display section to measure the weight of the products displayed. A plurality of weight sensors are installed corresponding to one display section where a plurality of products are displayed. That is, the weight of the products displayed on the display section is measured by the plurality of weight sensors. The recognition unit 11 recognizes that a customer has picked up a product based on the measurement value of the weight sensor. For example, when the total measurement value of the plurality of weight sensors changes to a smaller value than before, the recognition unit 11 recognizes that a customer has picked up a product.

[0028] The position identification unit 12 identifies the display position of the product picked up by the customer based on the change in the measurement value of each of the multiple weight sensors. When a display section is supported by multiple weight sensors and the weight of the products displayed on the display section is measured, the manner in which the measurement value of each of the multiple weight sensors changes will differ based on the distance relationship between the display position of the product picked up by the customer and the position of each of the multiple weight sensors. For example, if four weight sensors are installed at the four corners of the display section, a weight sensor that is relatively close to the display position of the product picked up by the customer will show a relatively large change (decrease) in the measurement value. For example, based on this relationship, it is possible to identify the display position of the product picked up by the customer.

[0029] Returning to FIG. 2, the provided information acquisition unit 13 acquires provided information including information related to the product picked up by the customer. The information related to the product may include at least one of the timing when the product picked up by the customer was put on display, the timing when the product picked up by the customer went on sale, and the timing when the product picked up by the customer was processed. In addition, the information related to the product may include advertisements for the product, campaign information for the product, how to use the product (how to cook, how to use, etc.), advertisements for products similar to the product, campaign information for products similar to the product, how to use products similar to the product, the timing of discounts for each product (the time of day when discount labels are affixed), etc.

[0030] Here, a description will be given of an example of an acquisition process performed by the provided information acquisition unit 13. The provided information acquisition unit 13 can acquire the provided information by any of the following acquisition process examples 1 to 3. Note that the provided information acquisition unit 13 may also acquire the provided information by other process examples.

[0031] "Acquisition processing example 1" As explained in the above example 1 of the recognition and identification process, a code is assigned to each product, and a process of reading the code using a code reader is performed. The code indicates information related to the product. In this case, the code reader reads the code of each product on display and acquires information related to each product. The processing device 10 then stores the acquired information related to each product in a storage device within the processing device 10.

[0032] The provided information acquisition unit 13 acquires information related to the product picked up by the customer from the product-related information stored in the storage device. For example, the provided information acquisition unit 13 may acquire information related to a product that can no longer be acquired by the code reader (because the customer picked up the product) from the product-related information stored in the storage device. Alternatively, the processing device 10 may store the acquired information related to each product in the storage device by linking it to information indicating the display position of each product. Then, the provided information acquisition unit 13 may acquire information related to the product linked to the display position (the position identified by the position identification unit 12) where the product picked up by the customer was displayed.

[0033] "Acquisition processing example 2" A product information database is created in advance, in which product-related information (information for each product) is registered in association with product identification information (information for identifying products from each other, product code, etc.). Then, when the provided information acquisition unit 13 acquires the product identification information of a product picked up by a customer, it refers to the product information database and acquires information related to the product associated with the acquired product identification information. The product information database may be present within the processing device 10, or may be present in an external device configured to be able to communicate with the processing device 10.

[0034] There are no particular restrictions on the means for acquiring product identification information. In the above-mentioned recognition / identification processing example 1, a code may indicate product identification information. In the above-mentioned recognition / identification processing example 2, a product identification information may be identified based on the external appearance features of the product contained in the image. In the above-mentioned recognition / identification processing example 3, a product identification information may be identified based on the change in the measurement value of a weight sensor and the weight of each product.

[0035] "Acquisition processing example 3" A product information database is created in advance, in which product-related information (information for each individual product) is registered and linked to individual identification information. The individual identification information is information for distinguishing between multiple identical products (multiple products with the same product code). When the provided information acquisition unit 13 acquires the individual identification information of a product picked up by a customer, it references the product information database and acquires information related to the product linked to the acquired individual identification information. The product information database may be located within the processing device 10, or may be located in an external device configured to be able to communicate with the processing device 10. There are no particular limitations on the means for acquiring the individual identification information. In the above-mentioned recognition / identification processing example 1, a code may represent the individual identification information. In the above-mentioned recognition / identification processing example 2, a code may represent the individual identification information. In the above-mentioned recognition / identification processing example 2, a code may represent the individual identification information based on the appearance features of the product included in the image.

[0036] 2, the display control unit 14 controls the display unit 15 to display the provided information acquired by the provided information acquisition unit 13 at a position corresponding to the position where the product picked up by the customer was displayed. The display unit 15 is a display, a projection device, or the like.

[0037] The product shelf of this embodiment is provided with at least one position for displaying information. Figure 3 shows an example of a product shelf 100. In the example shown, information can be displayed on a display section 101, a back section 102, and a display 103 (display unit 15).

[0038] The display section 101 may be a display (display unit 15), or a projection device (display unit 15) may be installed at a position and orientation that projects an image onto the display section 101. The projection device may project two-dimensional information or three-dimensional information (information that appears three-dimensional). The projection device may project from the front side of the display section 101 or from the back side of the display section 101. A projection device may be installed for each display section 101, or one projection device may be installed for multiple display sections 101.

[0039] Similarly, the spine portion 102 may be a display (display unit 15), or a projection device (display unit 15) may be installed at a position and orientation that projects an image onto that portion. The projection device may project two-dimensional information or three-dimensional information (information that appears three-dimensional). The projection device may project from the front side of the spine portion 102 or from the back side of the spine portion 102. A projection device may be installed for each spine portion 102, or one projection device may be installed for multiple spines 102. Note that the spines 102 on all multiple rows may be capable of displaying information. However, there is a possibility that the spines 102 on the lower rows may be difficult to view due to the display portions 101 on the upper rows, etc. Therefore, only the spines 102 on the upper rows (for example, only the topmost spine 102) may be capable of displaying information.

[0040] Here, an example of the relationship between the display position of the product picked up by the customer and the display position of the provided information will be described.

[0041] For example, the display control unit 14 may display the provided information at the position where the product picked up by the customer was displayed, as shown in Fig. 4. In Fig. 4(A), six products 200 are displayed on the display section 101. In Fig. 4(B), the customer picks up one of the six products 200. The provided information is then displayed at the position where the picked-up product 200 was displayed.

[0042] In addition, if the product shelf 100 is divided into multiple levels as shown in Figure 3 and a display 103 is installed on each level, the display control unit 14 may display the provided information on the display 103 corresponding to the level where the product picked up by the customer was displayed.

[0043] In addition, as shown in Figure 3, if the product shelf 100 is divided into multiple levels and the spine 102 of all levels is capable of displaying information, the display control unit 14 may display the provided information on the spine 102 of the level that includes the position where the product picked up by the customer was displayed.

[0044] In addition, as shown in Figure 3, if the product shelf 100 is divided into multiple levels and only the spine 102 of the topmost level among the multiple levels is capable of displaying information, the display control unit 14 may display the provided information on the spine 102 of the topmost level of the product shelf 100, which includes the position where the product picked up by the customer was displayed.

[0045] The display control unit 14 displays the provided information at a position corresponding to the position where the product picked up by the customer was displayed, in response to the recognition unit 11 recognizing that the customer has picked up the product. That is, the display control unit 14 displays the provided information at a position corresponding to the position where the product was displayed, in response to the customer picking up the product.

[0046] Furthermore, the product shelf 100 may have a plurality of positions for displaying information, and the display control unit 14 may display different information at the plurality of positions.

[0047] As described above, there are multiple means for realizing recognition by the recognition unit 11 and location identification by the location identification unit 12, and there are also multiple means for displaying the provided information. Any combination can be adopted in this embodiment. Just to be sure, an example of realization will be described below in which the above-mentioned recognition / identification processing example 1 is adopted as a means for realizing recognition by the recognition unit 11 and location identification by the location identification unit 12, that is, a means for reading a code through the display section 101 from the back side of the display section 101, and a configuration in which the provided information is displayed on the display section 101 by projecting it from the back side of the display section 101. Note that this explanation is intended to illustrate that this configuration is technically feasible, and the means for realization are not limited to this configuration.

[0048] 5, a mirror 303 whose orientation is controlled by a rotation controller 304, a projection device 302, and a code reader 301 are installed on the back side of the display section 101 (the side opposite to the side on which the products 200 are displayed). A controller 305 comprehensively controls the code reader 301, the projection device 302, and the rotation controller 304.

[0049] The code reader 301 uses the reflection of the mirror 303 to read the codes of the products 200 displayed on the display section 101. Then, by controlling the attitude of the mirror 303 to control the direction of the reflected electromagnetic waves, the process of reading the codes of the multiple products 200 displayed on the display section 101 in order is realized.

[0050] Similarly, the projection device 302 uses reflection from the mirror 303 to project information onto the display section 101. Then, by controlling the attitude of the mirror 303, the direction of the reflected electromagnetic waves is controlled, thereby realizing projection of information onto a desired position on the display section 101.

[0051] Next, an example of the processing flow of the processing device 10 will be described with reference to the flowchart of FIG.

[0052] First, when the recognition unit 11 recognizes that "a customer has picked up a product" (Yes in S10), the position identification unit 12 identifies the position where the product was displayed (S11). Furthermore, the provided information acquisition unit 13 acquires provided information including information related to the product (S12). Note that the processing order of S11 and S12 is not limited to the example shown in the figure. Next, the display control unit 14 displays the provided information acquired in S12 at a position corresponding to the "position where the product was displayed" identified in S11 (S13). Thereafter, the same process is repeated.

[0053] According to the processing device 10 of the present embodiment described above, the provided information can be displayed at the "position corresponding to the position where the product was displayed" at the "timing when the customer picks up the product." Such a processing device 10 can alleviate the problem of customers not noticing the provided information being displayed.

[0054] Furthermore, according to the processing device 10 of this embodiment, it is possible to display the provided information at the "position where the product that the customer picked up was displayed," as shown in Fig. 4. Such a processing device 10 further reduces the problem that the customer does not notice the displayed provided information.

[0055] Furthermore, the processing device 10 of this embodiment can distinguish between multiple identical products (multiple products with the same product code) that are displayed, and provide customers with information related to each product (such as when it was displayed, when it went on sale, when it was processed, etc.). In this way, the processing device 10 can provide customers with more useful information.

[0056] <Second embodiment> The processing device 10 of this embodiment differs from the first embodiment in that it acquires identification information (information that identifies customers) of a customer who has picked up a product and displays information to be provided that is generated for that customer.

[0057] 7 shows an example of a functional block diagram of the processing device 10 of this embodiment. This differs from the example of the functional block diagram of the processing device 10 of the first embodiment in that a customer identification information acquisition unit 16 is included.

[0058] The customer identification information acquisition unit 16 acquires the customer identification information of the customer. For example, the customer identification information acquisition unit 16 may acquire the customer identification information of the customer through biometric authentication processing. In the biometric authentication processing, biometric information is acquired from a customer present in the store. Then, information matching the acquired biometric information is searched for in the customer database through a matching process based on the acquired biometric information and a customer database in which the biometric information of each customer is previously registered in association with the customer identification information.

[0059] Examples of biometric information include, but are not limited to, facial information, fingerprint information, voiceprint information, and iris information. The biometric information may be acquired without the customer's knowledge using a camera installed in the store, or may be acquired by the customer operating an input device installed in the store, such as a fingerprint sensor, microphone, or camera. These input devices may be installed on each product shelf.

[0060] Alternatively, the customer identification information acquisition unit 16 may acquire customer identification information from a reader that communicates with customer devices (smartphones, smartwatches, mobile phones, tablet devices, IC (integrated circuit) tags, IC cards, etc.) via short-range wireless communication and acquires customer identification information stored in the customer devices. The reader may be installed on each product shelf. In this case, the customer performs an action such as holding their customer device over a predetermined position (the position of the reader's antenna).

[0061] Alternatively, the customer identification information acquisition unit 16 may acquire the customer identification information from a code reader that reads a code (such as a barcode or a two-dimensional code) indicating the customer identification information displayed on a customer device (such as a smartphone, smartwatch, mobile phone, or tablet terminal). The code reader may be installed on each product shelf. In this case, the customer displays the code on their own customer device and holds the code over the code reader to have it read.

[0062] The provided information acquisition unit 13 acquires provided information based on customer registration information that is registered in association with customer identification information. The customer registration information is stored in any server. The customer registration information is information that each customer registers themselves. Examples of registration means include, but are not limited to, using an app or a website. An example of customer registration information is described below.

[0063] "Customer registration information example 1" The customer registration information may include desired information that indicates the information that the customer wishes to display. Information that can be displayed when the product is picked up includes multiple types of information. For example, the information may include when the product was put on display, when the product went on sale, when the product was processed, advertisements for the product, campaign information for the product, how to use the product (how to cook, how to use, etc.), advertisements for similar products, campaign information for similar products, how to use similar products, and when each product will be discounted (the time of day when discount labels will be attached).

[0064] A customer registers in advance information (desired information) that the customer desires to be displayed when picking up a product from among the multiple types of information that can be displayed as described above.

[0065] In this case, the provided information acquisition unit 13 acquires, as provided information, "information desired to be displayed by the customer" indicated by the desired information in the customer registration information from among the multiple types of information that can be displayed as described above related to the product picked up by the customer. Then, the display control unit 14 displays only the information that the customer wants to display.

[0066] "Customer registration information example 2" The customer registration information may include a shopping list (a list of products to be purchased). A customer creates and registers a shopping list before going shopping. In this case, the provided information acquisition unit 13 acquires the shopping list as provided information. Then, the display control unit 14 displays the shopping list as provided information.

[0067] The processing device 10 may recognize the products that each customer has added to the shopping cart using any means such as image recognition processing. The display control unit 14 may then display the products included in the shopping list in a manner that allows the customer to distinguish whether they are "products added to the shopping cart" or "products not added to the shopping cart." For example, the display control unit 14 may highlight "products not added to the shopping cart" or display a list of only "products not added to the shopping cart."

[0068] In this case, the display control unit 14 may perform a process of "displaying a shopping list at a predetermined position on the product shelf (display section 101, spine section 102, display 103, etc.) in response to acquisition of customer identification information," instead of or in addition to the process of "displaying provided information at a position corresponding to the display position of the product picked up by the customer in response to recognition that the customer has picked up a product." Alternatively, the display control unit 14 may perform a process of "displaying a shopping list at a predetermined position on the product shelf (display section 101, spine section 102, display 103, etc.) in response to recognition that the customer has picked up a product and detection of the customer's approach to the product shelf by a human presence sensor."

[0069] Here, a modified example of the processing device 10 of this embodiment will be described. The processing device 10 may further include a store clerk identification information acquisition unit. The store clerk identification information acquisition unit acquires store clerk identification information that identifies store clerks from each other. The store clerk identification information acquisition unit can acquire the store clerk identification information using the same processing as the customer identification information acquisition unit 16.

[0070] When the store clerk identification information is acquired, the display control unit 14 displays information related to the product and that should be notified to the store clerk in a predetermined position on the product shelf (display section 101, spine section 102, display 103, etc.). The information that should be notified to the store clerk is, for example, information that identifies a product among the displayed products whose remaining time until the expiration date or best-before date falls below a reference time.

[0071] For example, as explained in the above-mentioned recognition / identification process example 1, when a code is assigned to each product and the code is read by a code reader, the code may indicate the best-before date or expiration date of each product. Then, based on the information, the processing device 10 may identify products on display whose remaining time until the best-before date or expiration date is less than a reference time.

[0072] The display control unit 14 can display information highlighting a product at a position on the display section 101 corresponding to a "product whose remaining time until its expiration date or best-before date is less than a reference time" (the display position of the product, around the product, etc.).

[0073] In this modified example, the display control unit 14 can display information to be notified to the store clerk, such as a description, in a predetermined position on the product shelf (display section 101, spine section 102, display 103, etc.) in response to the acquisition of store clerk identification information.

[0074] Other configurations of the processing apparatus 10 of this embodiment are the same as those of the first embodiment.

[0075] The processing device 10 of this embodiment described above achieves the same effects as those of the first embodiment. Furthermore, the processing device 10 can acquire the identification information of a customer who has picked up a product and display information to be provided that is generated for that customer. Such a processing device 10 can display information that is customized and suited to each customer. Therefore, the processing device 10 can provide more useful information to customers.

[0076] Furthermore, the processing device 10 can identify customers and store clerks, and when a store clerk is present (when store clerk identification information is acquired), it can display information for the store clerk on the product shelf. In this way, the technology for displaying information on the product shelf can be used not only for customers but also for store clerks.

[0077] <Modification> A modified example applicable to all the embodiments will be described. The display control unit 14 can erase (end display) the provided information displayed in a predetermined position on the product shelf (display section 101, spine section 102, display 103, etc.) at a predetermined end timing. Examples of the end timing include "when a predetermined time has elapsed since the start of display," "when a customer who picked up a product leaves the area," and "when a predetermined input is made to a predetermined input device (touch panel, physical button, microphone, etc.) installed on the product shelf." The fact that a customer has left the area can be detected by any means, such as analyzing an image captured of the area or using the sensing results of a human presence sensor.

[0078] Another modification will be described. The display control unit 14 may display the provided information on a customer device (smartphone, smartwatch, mobile phone, tablet terminal, etc.). For example, the display control unit 14 may transmit the provided information to the customer device via short-range wireless communication. After operating the customer device to view the provided information, the customer can save or delete the information in the customer device.

[0079] Another modified example will be described. In the above embodiment, an example was described in which products were displayed on display section 101 such as a shelf board, but other display methods are also possible. For example, a display method in which products are hung from hooks is exemplified. In this case, at least one position (such as a display installed in the price tag area) is provided to display information in association with the display location, and similar processing is performed.

[0080] In this specification, "acquisition" may include "a device going to retrieve data stored in another device or storage medium (active acquisition)" based on user input or program instructions, such as receiving data by making a request or inquiry to another device, or accessing and reading out another device or storage medium. Furthermore, "acquisition" may also include "inputting data output from another device to a device (passive acquisition)" based on user input or program instructions, such as receiving data that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also include selecting and acquiring data or information from received data or information, and "generating new data by editing data (converting it to text, rearranging data, extracting some data, changing the file format, etc.), and acquiring the new data."

[0081] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. 1. A means of recognizing that a customer has picked up a product; a position specifying means for specifying the position where the product picked up by the customer was displayed; a display control means for displaying provided information including information related to the product picked up by the customer at a position corresponding to the position where the product picked up by the customer was displayed; A processing device having: 2. The processing device according to 1, wherein the display control means displays the provided information at the location where the product picked up by the customer was displayed. 3. A processing device as described in 1 or 2, wherein the display control means, upon recognizing that the customer has picked up the product, displays the provided information at a position corresponding to the position where the product picked up by the customer was displayed. 4. A processing device described in any one of 1 to 3, wherein the information related to the product includes at least one of the timing when the product picked up by the customer was put on display, the timing when sales of the product picked up by the customer began, and the timing when the product picked up by the customer was processed. 5. The method further comprises a customer identification information acquisition means for acquiring customer identification information of the customer; 5. The processing device according to any one of 1 to 4, wherein the display control means displays the provided information acquired based on customer registration information registered in association with the customer identification information. 6. The customer registration information includes preference information indicating the information the customer wishes to display; The processing device described in 5, wherein the display control means displays, as the provided information, information that the customer wishes to display, as indicated by the desired information, from among information related to the product picked up by the customer. 7. The customer registration information includes a shopping list; 7. The processing device according to 5 or 6, wherein the display control means displays the shopping list as the provided information. 8. The product has a code on the outside, the product is displayed on a display member with the code facing downward; the recognition means recognizes that the customer has picked up the product based on a reading result of a code reader that reads the code through the display member; 8. The processing device according to any one of 1 to 7, wherein the position specifying means specifies the position where the product picked up by the customer was displayed based on the reading result. 9. The computer Recognize when a customer picks up a product, Identifying the display location of the product picked up by the customer; A processing method for displaying provided information including information related to the product picked up by the customer at a position corresponding to the position where the product picked up by the customer was displayed. 10. Computer A means of recognition that recognizes when a customer picks up a product; a position specifying means for specifying the position where the product picked up by the customer was displayed; a display control means for displaying provided information including information related to the product picked up by the customer at a position corresponding to the position where the product picked up by the customer was displayed; A program that functions as a

[0082] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0083] 1A processor 2A Memory 3A input / output I / F 4A peripheral circuit 5A Bus 10 Processing equipment 11 Recognition part 12 Location identification part 13 Provided information acquisition department 14 Display control unit 15 Display section 16 Customer Identification Information Acquisition Unit 100 product shelves 101 Display area 102 Back part 103 Display 200 items 301 Code Reader 302 Projection device 303 Mirror 304 Rotation Controller 305 Controller

Claims

1. A recognition means for recognizing that the product has been picked up; a position specifying means for specifying a position where the picked-up product was displayed and where, as a result of the product being picked up, none of the products are displayed; a display control means for displaying information related to the picked-up product at a position corresponding to the position where the picked-up product was displayed; A processing device having:

2. The processing device according to claim 1, wherein the display control means, when the person who picked up the product leaves the location, hides the information related to the product that was displayed at a position corresponding to the position where the picked-up product was displayed.

3. 3. The processing device according to claim 1, wherein the display control means displays information at a position where the picked-up product was displayed.

4. The processing device according to any one of claims 1 to 3, wherein the display control means, in response to recognition that the product has been picked up, displays information at a position corresponding to the position at which the picked-up product was displayed.

5. The product further includes a customer identification information acquisition means for acquiring customer identification information of a person who picks up the product, The processing device according to claim 1 , wherein the display control means displays information acquired based on customer registration information that is registered in association with the customer identification information.

6. The customer registration information indicates information that the customer wishes to display, 6. The processing device according to claim 5, wherein the display control means displays information that the person who picked up the product desires to be displayed, from among information related to the product that has been picked up.

7. the customer registration information includes a shopping list; 7. The processing device according to claim 5, wherein the display control means displays the shopping list.

8. A code is provided on the outer surface of the product, The product is displayed on a display member with the code facing downward, the recognition means recognizes the product picked up based on the reading result of a code reader that reads the code through the display member; The processing device according to claim 1 , wherein the position specifying means specifies a display position of the picked-up product based on the reading result.

9. The computer Recognizing that the product has been picked up, Identifying a position where the picked-up product was displayed and where, as a result of the product being picked up, none of the products are displayed; A processing method for displaying information related to a product picked up at a position corresponding to the position where the picked up product was displayed.

10. Computer, A means for recognizing that the product has been picked up; a position specifying means for specifying a position where the picked-up product was displayed and where, as a result of the product being picked up, none of the products are displayed; a display control means for displaying information relating to the picked-up product at a position corresponding to the position where the picked-up product was displayed; A program that functions as a

Images