Product management device, product management method, and program

Abstract

The present invention provides a technology for enabling management of a plurality of identical products according to individual differences thereof.　Provided is a product management device comprising: an acquisition means that acquires sensor information containing information relating to a plurality of displayed identical products; a state estimation means that estimates, on the basis of the sensor information, an individual state of each of the plurality of individual identical displayed products; an extraction means that extracts, on the basis of the individual state of each of the plurality of identical products, from the plurality of individual identical products, a specific product that is an individual product having a relatively different individual state; and an output means that outputs specific product information relating to the specific product.

Description

Technical Field

[0001] The present disclosure relates to technologies for managing individual products and the like.

Background Art

[0002] Patent Document 1 describes a technique for determining discount information based on the state of a product and its expiration date.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Even the same product may have individual differences. If products with individual differences are not priced and displayed appropriately, it may affect their sales. Therefore, it is difficult to manage a plurality of products with individual differences.

[0005] An example of the object of the present disclosure is to provide a technology that enables a plurality of identical products to be managed according to their respective individual differences.

Means for Solving the Problems

[0006] A product management apparatus according to an aspect of the present disclosure includes an acquisition unit that acquires sensor information including a plurality of identical products displayed, a state estimation unit that estimates the individual state of each individual product among the plurality of identical products displayed based on the sensor information, an extraction unit that extracts, from the plurality of identical products, an individual product having a relatively different individual state as a specific product based on the individual state of each individual product among the plurality of identical products, and an output unit that outputs specific product information regarding the specific product.

[0007] A product management method in one aspect of this disclosure involves a computer acquiring sensor information including multiple identical products on display, estimating the individual state of each of the multiple identical products on display based on the sensor information, extracting individual products from the multiple identical products that have relatively different individual states based on the individual states of each of the multiple identical products as specific products, and outputting specific product information relating to the specific products.

[0008] A recording medium in one aspect of the present disclosure stores a program that causes a computer to perform the following processes: acquire sensor information including multiple identical products on display; estimate the individual state of each of the multiple identical products on display based on the sensor information; extract individual products from the multiple identical products that have relatively different individual states based on the individual states of each of the multiple identical products as specific products; and output specific product information relating to the specific products. [Effects of the Invention]

[0009] One example of the benefits of this disclosure is that multiple identical products can be managed according to the individual differences of each product. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing the configuration of the product management device in the first embodiment. [Figure 2] This is a flowchart illustrating the operation of the product management device in the first embodiment. [Figure 3] This is a block diagram showing the configuration of the product management device in the second embodiment. [Figure 4] This figure shows an example of price information in the second embodiment. [Figure 5] This figure shows an example of output in the second embodiment. [Figure 6] This is a flowchart illustrating the operation of the product management device in the second embodiment. [Figure 7] This is a block diagram showing the configuration of the product management device in modified example 1. [Figure 8] This is a block diagram showing the configuration of the product management device in modified example 2. [Figure 9] This figure shows an example of the output in modified example 2. [Figure 10] This figure shows the hardware configuration in which the product management device described in this disclosure is implemented using a computer device and its peripheral devices. [Modes for carrying out the invention]

[0011] Embodiments of this disclosure will be described in detail with reference to the drawings.

[0012] In the following embodiments of this disclosure, each product management device may be implemented as a combination of a terminal device used by a customer or employee in a store, a terminal device and a server connected to the terminal device via a network, or by a server. The user of the terminal device may be, for example, a store employee or a customer.

[0013] Furthermore, each product management device manages products displayed on shelves or in boxes in the store's sales area, products kept as inventory in the store's back room, or products displayed in markets where procurement takes place. These products are referred to as displayed products. In the following embodiments and modifications, the processing mainly concerns products displayed on shelves in the store's sales area, but the descriptions in each embodiment and modification may be appropriately interpreted to apply to other displayed products. In addition, multiple identical products are grouped together and displayed in one to several locations. Identical products are products of the same type. Products of the same type are, for example, products with the same product identification information. Product identification information is information that identifies the type of product, such as an identification number included in a barcode.

[0014] In each of the following embodiments and each modification, the management of products refers to management related to the sale of products, such as price setting (change), determination of display locations, and sales management. In the sale of products, there may be differences in ease of sale and difficulty of sale depending on individual differences. Therefore, it is required that management according to the individual differences of products be carried out. For example, the individual differences of products with large quality changes over time affect the purchasing activities of customers and the sales activities of products. Products with large quality changes over time are, for example, foods. In addition, generally, electrical appliances have smaller quality changes over time compared to foods. Therefore, in each of the following embodiments and each modification, mainly, the management of foods, which are products with large quality changes over time, will be described. However, the products to be managed are not particularly limited and may be products other than foods.

[0015] [First Embodiment] FIG. 1 is a block diagram showing the configuration of the product management device 100 in the first embodiment. Referring to FIG. 1, the product management device 100 includes an acquisition unit 101, a state estimation unit 102, an extraction unit 103, and an output unit 104.

[0016] Next, the configuration of the product management device 100 in the first embodiment will be described in detail.

[0017] In FIG. 1, an acquisition unit 101 is an example of acquisition means for acquiring sensor information including a plurality of identical products displayed. The plurality of identical products displayed are, for example, products displayed on product shelves or boxes in a store's sales floor, products stored as inventory in the store's backyard, or products displayed in a market where purchases are made. The sensor information including the plurality of identical products displayed is sensor information including some or all of the plurality of identical products displayed. The sensor information is two-dimensional data or three-dimensional data. Also, the sensor information may be a combination of two-dimensional data and three-dimensional data. The two-dimensional data is, for example, image data captured by a camera. The three-dimensional data is, for example, data including distance acquired by a distance measurement sensor. The distance measurement sensor is, for example, a TOF (Time Of Flight) distance measurement sensor, but is not limited thereto. Hereinafter, an example in which mainly an image is used as the sensor information will be described, but when three-dimensional data or a combination of an image and three-dimensional data is used as the sensor information, the processing may be performed in the same manner as in the case of an image. The image including the plurality of identical products displayed may include product information regarding the displayed products such as barcodes or labels.

[0018] The acquisition unit 101 acquires sensor information including a plurality of identical products displayed from a sensor. The sensor is, for example, a camera that detects two-dimensional data or a distance measurement sensor that detects three-dimensional data. Alternatively, the acquisition unit 101 may acquire sensor information including a plurality of identical products displayed from a storage unit that is transmitted from the sensor and stored. The camera may be a sensor installed in a store or a sensor provided in a terminal device. The sensor installed in the store is connected to the product management device 100 via a network, for example. The timing at which the acquisition unit 101 acquires the sensor information is not particularly limited. For example, the acquisition unit 101 acquires the sensor information according to a user's instruction. Alternatively, the acquisition unit 101 may acquire the detected sensor information at a predetermined time interval.

[0019] The state estimation unit 102 is an example of a state estimation means that estimates the individual state of each of the multiple identical products on display based on sensor information. Below, we will mainly describe an example in which the state estimation unit 102 estimates the individual state of each of the multiple identical products on display based on images. The individual state is at least one of the following, for example, the size of the individual product, the color of the individual product, the presence or absence of scratches on the individual product, the shape of the individual product, the presence or absence of bumps on the individual product, the expiration date of the individual product, or the arrival date of the individual product. In addition, each individual state may include the degree of scratches on the individual product or the degree of bumps on the individual product. Here, the degree may be, for example, the size or the number. Also, the degree of scratches on the individual product may be poor color.

[0020] For example, the state estimation unit 102 estimates the size, color, presence or absence of damage, and shape of individual products based on the image acquired by the acquisition unit 101. For example, the state estimation unit 102 first identifies multiple identical products on display. For example, identifying multiple identical products on display means identifying the product identification information of multiple identical products on display. Next, the state estimation unit 102 detects individual products based on the image acquired by the acquisition unit 101. Here, individual product detection refers to the image region of each individual product within the image. Known image recognition techniques can be used for individual product detection. For example, the state estimation unit 102 detects the contour of individual products in the image. Then, the state estimation unit 102 estimates the individual state of each individual product based on the pixel information of each individual product. The state estimation unit 102 may estimate the individual state of each individual product by other methods.

[0021] An example of how the state estimation unit 102 identifies multiple identical products on display will be described. First, the case in which the acquisition unit 101 acquires an image taken by a camera in the store will be described. In this case, the state estimation unit 102 identifies multiple identical products on display that are included in the image, for example, based on the position and shooting direction of the camera installed in the store. For example, the identification information of the camera installed in the store, the camera's position, the shooting direction information, and the identification information of the products arranged within the range captured by the camera's position and shooting direction are pre-associated and stored in a storage unit (not shown). The storage unit (not shown) may be provided inside the product management device or outside, connected to the product management device in a manner that allows communication. By referring to the storage unit, the state estimation unit 102 may identify multiple identical products included in the image from the identification information of the camera from which the acquisition unit 101 acquired the image. If the camera's shooting direction can be changed, the acquisition unit 101 acquires the image, the identification information of the camera from which the image was acquired, and the camera's shooting direction. Note that the identification of multiple identical products on display that are included in the image may be performed by methods other than those described above.

[0022] Next, another example of how the state estimation unit 102 identifies multiple identical products on display will be described. For example, the acquisition unit 101 may acquire the product identification information of the product included in the captured image input by the user on the terminal device at the time of shooting, and associate it with the image. For example, the acquisition unit 101 may acquire an image of a product specified by the user's operation of the terminal device from a camera in the store. In this case, the acquisition unit 101, by referring to the storage unit, instructs a camera capable of capturing the specified product to capture an image including multiple identical products on display, based on the product identification information of the product specified by the user's operation of the terminal device. If the camera's shooting direction can be changed, the shooting instruction will include the shooting direction. Next, the acquisition unit 101 acquires an image of the product specified by the user's operation of the terminal device, which includes multiple identical products on display. Then, the state estimation unit 102 identifies the multiple identical products on display based on the image captured by the camera in the store acquired by the acquisition unit 101, and the product specified by the user's operation of the terminal device associated with the image. Furthermore, for example, the acquisition unit 101 acquires from the terminal device information representing the product specified by the user's operation of the terminal device, and an image taken by the terminal device that includes multiple identical products on display. The state estimation unit 102 may then identify multiple identical products on display based on the image taken by the terminal device's camera and the product specified by the user's operation of the terminal device, which is associated with the image, acquired by the acquisition unit 101.

[0023] Furthermore, other examples of how the state estimation unit 102 can identify multiple identical products on display will be described. The state estimation unit 102 may identify products by the characters on price tags on product shelves or barcode information contained in an image containing multiple identical products on display, or in another image acquired in association with an image containing multiple identical products on display. For example, the state estimation unit 102 may recognize characters contained in an image using character recognition. The state estimation unit 102 may identify the names of the multiple identical products on display from among the recognized characters, specifically those names contained in a product information database associated with the product name and product identification information. Alternatively, for example, the state estimation unit 102 may read barcodes contained in an image. The state estimation unit 102 may identify the string read from the barcode as the product identification number of the multiple identical products on display.

[0024] In the estimation of individual states by the state estimation unit 102, following the identification of multiple identical products displayed in the image as described above, the state estimation unit 102 detects the image region of the individual product.

[0025] The state estimation unit 102 detects each of the multiple identical products displayed, which were identified in the aforementioned specific processing, from the acquired image, for example, using deep learning or other image analysis methods. Specifically, the state estimation unit 102 detects the image regions of multiple identical products included in the acquired image. From the detected image regions of multiple identical products, the state estimation unit 102 detects the image region of each individual product. For example, the state estimation unit 102 only needs to detect the contour of each individual product.

[0026] In the estimation of individual states by the state estimation unit 102, following the identification of multiple identical products displayed in the image and the detection of the image region of individual products, the state estimation unit 102 estimates the individual state of each product.

[0027] The state estimation unit 102 estimates at least one of the following as the individual state from the image area data of the individual product: the size of the individual product, the shape of the individual product, and the color of the individual product. The information representing the size of the individual product and the information representing the shape of the individual product may be information representing the outline of the individual product. The information representing the color may be RGB values, brightness, saturation, etc. Here, in an image containing multiple identical products on display, there may be cases where only a part of the individual product is visible. In this case, the state estimation unit 102 estimates the state of the product from the image area of ​​the individual product that is visible in the image. Furthermore, the individual state may include information indicating that the entire individual product is not visible, i.e., that the estimation of the individual state is incomplete.

[0028] Furthermore, the state estimation unit 102 may further estimate the individual state based on the information representing the contour of the individual product or the information representing the color of the individual product. For example, the state estimation unit 102 may estimate the presence or absence of bumps and indentations as information representing the shape of the individual product. Since it is assumed that shadows are cast in indentations of a product, the state estimation unit 102 may estimate the presence or absence of bumps and indentations of an individual product by determining that pixels with lower brightness than surrounding pixels are indentations, based on the information representing the color of pixels in the image area of ​​the individual product. Alternatively, for example, the state estimation unit 102 may estimate the presence or absence of scratches on an individual product by determining that areas of pixels with significantly different RGB values ​​from surrounding pixels are scratches, based on the information representing the color of pixels in the image area of ​​the individual product. Note that the estimation of the presence or absence of bumps and indentations of an individual product, and the estimation of the presence or absence of scratches on an individual product, may be performed by the extraction unit 103 described later.

[0029] Furthermore, the state estimation unit 102 may use a pre-trained model to estimate the individual state based on the images acquired by the acquisition unit 101. For example, the pre-trained model is generated in advance by performing a machine learning training process using images of products without defects, products with defects, products with good color, products with poor color, products with good shape, and products with poor shape as training data. In estimating the individual state, the state estimation unit 102 inputs the product image to the pre-trained model. The pre-trained model outputs the individual state of the product, such as whether or not it has defects, the quality of its color, and the quality of its shape, which are included in the image area of ​​the individual product. The state estimation unit 102 then uses the output individual state as the estimation result.

[0030] The state estimation unit 102 may estimate the expiration date or arrival date as the individual state of an individual product based on the image acquired by the acquisition unit 101. The state estimation unit 102 may estimate the expiration date or arrival date of an individual product by, for example, recognizing the characters printed on the label of the individual product included in the image. Alternatively, the state estimation unit 102 may acquire the expiration date or arrival date of an individual product associated with a two-dimensional code by, for example, reading a two-dimensional code printed on the label of an individual product included in the image.

[0031] Furthermore, the state estimation unit 102 may add environmental information regarding the environment in which the product is displayed to the individual state. Environmental information regarding the environment in which the product is displayed may include, for example, temperature or humidity received from a sensor (not shown). Environmental information may also include the presence or absence of sunlight. This environmental information changes depending on where the product is displayed. In general, even the same product may be displayed in different environments. Examples of places where products are displayed include products displayed indoors, products displayed outdoors, and products displayed in a refrigerator.

[0032] In this case, the state estimation unit 102 identifies the display location of individual products. That is, the state estimation unit 102 only needs to identify the location where an image containing multiple identical products on display was taken. If the camera used by the acquisition unit 101 to acquire the image is a camera installed in the store, the state estimation unit 102 may identify the display location of the products included in the acquired image from the information indicating the camera's position and shooting direction in the acquired image, based on pre-stored information on the camera's position and shooting direction, and information on the location captured by that camera's position and shooting direction. Alternatively, for example, the state estimation unit 102 may identify the display location based on the image and the shooting location information entered by the user at the time of shooting, which was acquired by the acquisition unit 101.

[0033] Up to this point, we have described an example in which images are used as sensor information, but the state estimation unit 102 may also estimate the individual state based on three-dimensional data including multiple individual products on display. Alternatively, the state estimation unit 102 may estimate the individual state based on an image including multiple individual products on display and three-dimensional data including multiple individual products on display. When the state estimation unit 102 estimates the individual state using three-dimensional data, it becomes possible to estimate the size, volume, and indentation of individual products with greater accuracy.

[0034] The extraction unit 103 is an example of an extraction means that extracts individual products from a group of identical products based on the individual state of each of those products, selecting those products with relatively different individual states as specific products. Specific products are individual products with relatively different individual states among a group of identical products. Products with relatively different individual states may be products with inferior individual states or products with superior individual states among a group of identical products. The product management device 100 manages products for specific products and individual products other than specific products. For example, the extraction unit 103 extracts individual products with relatively poor individual states as specific products by comparing the individual states of each of the group of identical products. Alternatively, the extraction unit 103 may extract individual products with good individual states as specific products by comparing the individual states of each of the group of identical products. By extracting specific products with relatively different individual states based on the individual states of each of the group of identical products, the extraction unit 103 can extract specific products while taking into account the overall state of the group of identical products, which changes depending on the time and timing.

[0035] For example, even if products have the same expiration date, their sales potential can differ depending on whether the expiration dates of other similar products displayed around them are closer or further away. For instance, a product with an expiration date of October 5th is likely to sell well if many of the surrounding products have an expiration date of October 3rd. On the other hand, a product with the same expiration date of October 5th is likely to sell poorly if many of the surrounding products have an expiration date of October 7th.

[0036] Similarly, even if products are at the same ripeness, their ease of sale can vary depending on the ripeness of other identical products displayed around them at the time of sale. Also, products such as fresh produce can change in size and color depending on the season. For example, a banana that has just begun to develop brown spots and is ripe is likely to sell well if many of the surrounding bananas are brown, as it will have a relatively long shelf life. On the other hand, a banana that has just begun to develop brown spots and is ripe is likely to sell poorly if many of the surrounding bananas are not fully ripe and are greenish-yellow, as it will have a relatively short shelf life.

[0037] For these products whose ease of selling changes relatively, the extraction unit 103 extracts specific products that have relatively different individual conditions, thereby enabling appropriate management of individual products in accordance with the overall condition and individual differences of multiple identical products that change depending on the time of year, timing, etc.

[0038] Alternatively, for example, the extraction unit 103 may extract specific products by comparing a criterion based on the individual condition of each individual product with the individual condition of each individual product. The criterion based on the individual condition of each individual product is a criterion calculated based on the overall individual conditions of each individual product, which are each of the multiple identical products displayed in the image. The criterion based on the individual condition of each individual product is a relative criterion for each of the multiple identical products displayed in the image. For example, it is the average value of the individual conditions of each individual product among the multiple identical products displayed. The relative criterion may be calculated by the condition estimation unit 102 or the extraction unit 103. For example, the extraction unit 103 extracts specific products that are likely to sell well by comparing the criterion with the individual condition of each individual product. For example, specific products that are likely to sell well are products that are of appropriate size, large products, products without defects, products with good color, or products with good shape. Products that are of appropriate size are products whose size is within a predetermined range. Alternatively, the extraction unit 103 may extract specific products that are unlikely to sell well based on the criterion. For example, certain products that are unlikely to sell well include those that are not the right size, are too small, are damaged, have poor color, or are misshapen.

[0039] The criteria may be a standard value or range of standard values ​​for each individual condition of the same product. For example, the criteria may be a standard value or range of standard values ​​representing the size, shape, or color of an individual product. In addition to relative criteria, the extraction unit 103 may also use absolute criteria to extract specific products. An absolute criterion is a pre-set absolute criterion. For example, an absolute criterion may be a pre-set range of pixel values ​​that represent an appropriate color for a banana.

[0040] Furthermore, if the individual state estimated by the state estimation unit 102 is binary identification information indicating suitability of size, size (large or small), quality of color, or quality of shape, or binary identification information indicating the presence or absence of scratches or bumps, then no criteria are required. The binary identification information may be, for example, the presence or absence of a flag. In this case, the extraction unit 103 can extract individual products that are unsuitable in size, have poor color, poor shape, or have scratches or bumps as specific products, based on information indicating that they are unsuitable in size, have poor color, have poor shape, or have scratches or bumps. If the state estimation unit 102 estimates values ​​or multiple levels representing the size, color, shape, degree of scratches, or degree of bumps of an individual product as the individual state, the extraction unit 103 extracts specific products by comparing each value or level with a criterion for determining whether an individual product is a specific product in a predetermined state.

[0041] The output unit 104 is an example of an output means for outputting specific product information about a specific product. The output unit 104 also outputs specific product information to a user, such as a store employee or customer. For example, the output unit 104 outputs specific product information to the display unit of a terminal device used by a customer or store employee in the store.

[0042] The output unit 104 may output as specific product information that there are specific products with relatively different individual states. Alternatively, the output unit 104 may output as specific product information information that identifies a specific product and the individual state of the specific product. Identifying information for a specific product may be, for example, an image in which a symbol indicating the specific product is superimposed on an image containing multiple identical products. Identifying information for a specific product may be, for example, an image in which the specific product is circled in an image containing multiple identical products. The output unit 104 may output as specific product information information and information related to the management of the specific product. For example, the output unit 104 may output to the customer as specific product information information that identifies a specific product and the price set for the specific product. Also, for example, the output unit 104 may output to the store clerk as specific product information information that identifies a specific product and the appropriate display location for the specific product. The output examples of the output unit 104 are not limited to these.

[0043] For example, the output unit 104 may project specific product information onto the product display area, which is the image capture range. That is, the output unit 104 outputs specific product information to a projector capable of projecting images onto the product display area, which is the image capture range. Alternatively, for example, the output unit 104 may superimpose the specific product information onto an image of the displayed specific product.

[0044] Alternatively, the specific product information output by the output unit 104 may include identification information for the specific product. The identification information for the specific product may be information that allows a specific product to be identified from other identical products. For example, the identification information for the specific product may be an identification number. The identification information for the specific product may also be an image of the specific product. In this case, the image of the specific product may include the external characteristics of the specific product.

[0045] The operation of the product management device 100 configured as described above will be explained with reference to the flowchart in Figure 2.

[0046] Figure 2 is a flowchart illustrating the overview of the operation of the product management device 100 in the first embodiment. Note that the processing shown in this flowchart may be executed based on program control by a processor.

[0047] As shown in Figure 2, first, the acquisition unit 101 acquires sensor information including multiple identical products on display (step S101).

[0048] Next, the state estimation unit 102 estimates the individual state of each of the multiple identical products on display based on the sensor information (step S102).

[0049] Next, the extraction unit 103 extracts individual products from the individual products based on the individual status of each of the multiple identical products, selecting individual products with relatively different individual statuses as specific products (step S103).

[0050] Next, the output unit 104 outputs specific product information relating to a specific product (step S104).

[0051] With this, the product management device 100 completes its series of operations.

[0052] The product management device in the above-described embodiment comprises an acquisition unit, a state estimation unit, an extraction unit, and an output unit. The acquisition unit acquires sensor information including multiple identical products on display. The state estimation unit estimates the individual state of each of the multiple identical products on display based on the sensor information. The extraction unit extracts individual products from the multiple identical products that have relatively different individual states, based on the individual states of each of the multiple identical products, as specific products. The output unit 104 then outputs specific product information relating to the specific products.

[0053] As a result, the product management device in this embodiment can manage multiple identical products according to their individual differences. This allows the product management device in this embodiment to streamline tasks related to managing products according to their individual differences. For example, the product management device in this embodiment can streamline tasks related to managing products that are considered difficult to sell due to their individual differences, so that they can be sold appropriately.

[0054] [Second Embodiment] Next, a second embodiment of this disclosure will be described in detail with reference to the drawings. To the extent that this description of the embodiment does not become unclear, any information that overlaps with the previous description will be omitted.

[0055] Figure 3 is a block diagram showing the configuration of a product management device according to a second embodiment of the present disclosure. The product management device 200 of the second embodiment includes a price setting unit 205 in addition to the configuration of the first embodiment.

[0056] The pricing unit 205 is an example of a pricing means that sets the price of a specific product based on price information representing the relationship between the price of the same product and its individual status, and the individual status of the specific product. The price information representing the relationship between the price of the same product and its individual status is set in advance, for example, weekly, daily, or hourly. The pricing unit 205 sets the price of the specific product by referring to the price information based on the individual status of the specific product extracted by the extraction unit 103. The price information may be stored in the product management device 200 or in a database connected to the product management device 200 via a network. Setting a price includes changing the price from a pre-set price.

[0057] Figure 4 shows an example of price information representing the relationship between the price of the same product and its individual condition. Figure 4 shows the price of the same product according to its individual condition. According to Figure 4, if the individual condition is normal, that is, if it is not extracted as a specific product, the price of the individual product is 120 yen. In addition, Figure 4 shows the price according to color, size, and presence or absence of damage. Figure 4 is just one example of price information, and price information is not limited to these examples.

[0058] The extraction unit 103 may extract individual products that are in the individual state indicated in the price information, based on the price information and the individual state estimated by the state estimation unit 102.

[0059] Furthermore, the pricing unit 205 may set the price of an individual product according to the difference between a standard and the individual condition of the specific product. The standard may be a standard based on the individual condition of the individual product. In this case, the pricing unit 205 should determine the price of the specific product based on price information that represents the relationship between the price of the same product and the difference between the standard and the individual condition of the specific product.

[0060] The output unit 104 outputs the price of a specific product as specific product information related to that product. An example of outputting the price of a specific product is shown in Figure 5.

[0061] In Figure 5, the price is displayed for each product. Products may be represented by images acquired by the acquisition unit 101, or by illustrations based on images acquired by the acquisition unit 101. As shown in Figure 5, for potatoes that normally cost 90 yen, the prices of 75 yen and 85 yen are superimposed on the product images of potatoes whose colors are relatively different from the other multiple identical products on display. Also, the price of 80 yen is displayed for potatoes that are relatively small compared to the other multiple identical products on display. Furthermore, the price of 75 yen is displayed for potatoes with blemishes. These are the prices of specific products, i.e., specific product information. As shown in Figure 5, the prices of products other than specific products may also be displayed. Also, since the individual status and the price of identical products may change over time, as shown in Figure 5, the time when the price was set may be displayed so that the user can understand when the price was set.

[0062] Alternatively, the output unit 104 may output the identification information and price of a specific product as specific product information. The output unit 104 may also output the reason for setting the price of the specific product. For example, in self-scan shopping where customers register purchased items while browsing the store, the output unit 104 may output the identification information and price of a specific product to a list of purchased items. Alternatively, for example, the output unit 104 may output the identification information and price of a specific product as specific product information to a sticker issuing device. In this case, the output unit 104 may output a two-dimensional code containing the identification information and price of a specific product as specific product information to the sticker issuing device. Alternatively, for example, the output unit 104 may output a two-dimensional code containing the identification information and price of a specific product as specific product information to a printing device using edible ink.

[0063] Furthermore, the pricing unit 205 may set a price range for a specific product based on price information and the individual status of that product. In this case, the price information includes a price range as the price of the same product. When the pricing unit 205 sets a price range, the output unit 104 outputs the price range for the specific product to the user using the product management device 200.

[0064] For example, the output unit 104 outputs a price range for a specific product to a store employee who is a user of the product management device 200. The store employee, who is a user of the product management device 200, may then determine the price of the specific product within the output price range.

[0065] Furthermore, when the pricing unit 205 sets a price range, in order to set a more appropriate price, the pricing unit 205 may determine the price according to the individual state estimated based on the sensor information acquired again. Below, an example of determining the price using an image as the sensor information will be described. When the pricing unit 205 determines the price according to the individual state estimated based on the sensor information acquired again, in the following description, "image" may be read as sensor information, "shooting" as "detection," and "shooting instruction" as "detection instruction."

[0066] In this case, the output unit 104 further outputs a shooting instruction to the user, such as a store clerk or customer, in addition to the price range of the specific product, to take a picture of the specific product. The shooting instruction is an instruction to photograph the specific product from closer than an image containing multiple identical products on display. The shooting instruction may also be an instruction to photograph the specific product from multiple directions. The acquisition unit 101 further acquires the specific product image taken based on the shooting instruction. The state estimation unit 102 re-estimates the individual state based on the acquired specific product image. Then, the pricing unit 205 sets the price of the specific product based on price information representing the relationship between the price of identical products and the individual state, and the individual state of the specific product. The pricing unit 205 may further set the price of the specific product within the previously set price range. The output of the shooting instruction for the specific product and the re-estimation of the individual state may be performed when the individual state of the specific product has not been sufficiently estimated. When the individual state of an individual product has not been sufficiently estimated, for example, it is estimated that part or most of the individual product is hidden in an image containing multiple identical products.

[0067] The output of shooting instructions and the re-estimation of individual status processes allow for a more accurate estimation of individual statuses. Therefore, the output of shooting instructions and the re-estimation of individual status processes enable more appropriate management of individual products according to their individual statuses.

[0068] The operation of the product management device 200 configured as described above will be explained with reference to the flowchart in Figure 6.

[0069] Figure 6 is a flowchart showing an example of the operation of the product management device 200 in the second embodiment. Note that the processing shown in this flowchart may be executed based on program control by a processor.

[0070] As shown in Figure 6, first, the acquisition unit 101 acquires an image containing multiple identical products on display (step S201).

[0071] Next, the state estimation unit 102 estimates the individual state of each of the multiple identical products on display based on the image (step S202).

[0072] Next, the extraction unit 103 extracts specific products from the individual products for which pricing is to be set (step S203). If no specific products for which pricing is to be set are extracted in step S203, the output unit 104 outputs that no specific products were extracted, and the product management device 200 may terminate its operation.

[0073] Next, the pricing unit 205 sets a price range for a specific product based on its individual status and price information (step S204).

[0074] Next, the output unit 104 outputs the price range for the specific product and the instruction to take an image of the specific product, which were set in step S204 (step S205).

[0075] Next, the acquisition unit 101 acquires a specific product image taken by the user based on the shooting instruction (step S206).

[0076] Next, the state estimation unit 102 re-estimates the individual state based on the specific product image (step S207).

[0077] Next, the pricing unit 205 sets the price of the specific product based on the re-estimated individual condition and price information of the specific product (step S208).

[0078] Then, the output unit 104 outputs the price of the specified product (step S209).

[0079] With this, the product management device 200 completes its series of operations.

[0080] The product management device in the above-described embodiment comprises an acquisition unit, a state estimation unit, an extraction unit, an output unit, and a price setting unit. The acquisition unit acquires sensor information including multiple identical products on display. The state estimation unit estimates the individual state of each of the multiple identical products on display based on the sensor information. The extraction unit extracts individual products from the multiple identical products that have relatively different individual states as specific products based on the individual states of each of the multiple identical products. The price setting unit sets the price of the specific product based on price information representing the relationship between the price of the identical product and its individual state, and the individual state of the specific product. The output unit 104 then outputs specific product information regarding the specific product.

[0081] As a result, the product management device in this embodiment can manage multiple identical products according to their individual differences.

[0082] In particular, the product management device in this embodiment can set prices according to individual differences among multiple identical products. For example, by appropriately setting prices according to individual differences in products, it is possible to improve customer satisfaction and acceptance of the price of purchased products. Also, for example, by appropriately setting prices according to individual differences in products, products that are difficult to sell due to individual differences become easier to sell.

[0083] Furthermore, the product management device in this embodiment can improve the efficiency of store clerks' work related to pricing based on individual differences in products. In other words, the product management device in this embodiment makes it easy for store clerks, as users, to find specific products that can be priced among multiple identical products.

[0084] Furthermore, the product management device in this embodiment can help customers find the product they want to purchase from among identical products that have individual differences. That is, individual products with relatively different individual conditions are extracted as specific products, and the price or price range is output as specific product information, so that, for example, customers can easily find products that are cheaper.

[0085] [Example 1] Next, a modified example 1 of the second embodiment will be described.

[0086] Figure 7 is a block diagram showing the configuration of the product management device 200A according to Modification 1 of the second embodiment. In addition to the configuration of the product management device 200 in the second embodiment, the product management device 200A in Modification 1 may also include a change request receiving unit 206.

[0087] The change request receiving unit 206 is an example of a change request receiving means that receives price change requests, which are price change requests for specific products for which specific product information has been output by the output unit 104. In this case, the specific product information includes the price or price range. The change request receiving unit 206 receives price change requests from users who have the price or price range of a specific product output from a touch panel display provided on a terminal device, for example. The user who inputs the price change request is a store employee or a customer. The price change request may also include the reason for the change request. For example, if the reason for the change request is the appearance of the product, the change request receiving unit 206 may accept an image including the part of the product that is the reason for the change request as the reason for the change request.

[0088] The pricing unit 205 sets the price of a specific product based on the price change request received by the change request reception unit 206, price information, the individual status of the specific product, and a pre-set price tolerance range. The price tolerance range is the range of prices that are allowed in pricing a product. The pricing unit 205 sets the price or price range of the specific product within the price tolerance range. The price tolerance range may be pre-set for each product. Alternatively, the price tolerance range may be set for all products or product categories, such as being within a predetermined percentage of the base price.

[0089] The change request receiving unit 206 receives price change requests, and the price setting unit 205 sets the prices. In this modified example, the product management device 200A enables more appropriate pricing of individual products according to their individual status. As a result, for example, the product management device 200A can improve customer satisfaction and acceptance of the price of individual products. Furthermore, for example, the product management device 200A can support store staff in setting more appropriate prices for individual products according to their individual status.

[0090] [Differentiation 2] Next, a modified example of this disclosure, Part 2, will be described.

[0091] Figure 8 is a block diagram showing the configuration of a product management device according to Modification 2 of this disclosure. The product management device 300 of Modification 2 includes a business support information generation unit 307 in addition to the configuration of the first embodiment.

[0092] The business support information generation unit 307 generates business support information corresponding to the individual status of each of the multiple identical products on display. This business support information includes, for example, information about the price of the individual product, information about the display location of the individual product, and information about the sales of the individual product. The output unit 104 outputs the business support information.

[0093] The business support information generation unit 307 generates, for example, information related to setting prices for individual products. For example, the business support information is information that supports the price setting work by store staff, or more specifically, the price reduction work by store staff. The business support information generation unit 307 that generates information related to the prices of individual products has the function of the price setting unit 205 in the second embodiment. In this case, the business support information generation unit 307 generates business support information that includes a specific product for which a price should be set and the price to be set, based on price information that represents the relationship between the price and individual status of the same product and the individual status of a specific product. In addition, the business support information generation unit 307 may also generate business support information that includes the reason for setting the price, in addition to the specific product for which a price should be set and the price to be set.

[0094] Furthermore, the business support information generation unit 307 generates information regarding the display locations of individual products, for example. For example, the business support information is information that supports the work of store employees in displaying products. More specifically, the business support information is information that supports the work of identifying clearance items that should be displayed on dedicated shelves. Clearance items are products that are marked down because they are not expected to sell. Based on display location information that represents the display location according to a pre-set individual condition, and the individual condition of a specific product whose display location should be changed, the business support information generation unit 307 outputs business support information that includes the specific product whose display location should be changed and the display location of the specific product. In addition, the display location information may include not displaying products that are in an individual condition that makes them unsaleable, as information that represents the display location according to an individual condition. An individual condition that makes a product unsaleable is, for example, a product that is heavily damaged or has a high degree of damage.

[0095] In other words, the output unit 104 outputs information regarding the display location of a specific product based on display location information that represents the display location according to the individual condition of the product. By having the business support information generation unit 307 generate information regarding the display location of individual products and the output unit 104 output information regarding the display location of a specific product, the product management device 300 can streamline the management of display locations by store staff according to individual differences in products. In other words, the product management device 300 can reduce the effort required of store staff to check for individual differences in products and to consider display locations according to differences in the condition of the products.

[0096] Furthermore, the business support information generation unit 307 generates sales information, for example, regarding the sales of individual products. The business support information generation unit 307 that generates sales information is also called the sales information generation unit. The sales information generation unit is an example of a sales information generation means that identifies the sales performance of individual products based on sensor information and individual status in the store, and generates sales information that associates the sales performance and individual status of the identified individual products. First, the sales information generation unit identifies individual products that have been taken from the shelves based on the changes over time in sensor information including multiple identical products on display. Products taken from the shelves are presumed to be products purchased by customers. Alternatively, individual products that have been taken from the shelves for a certain period of time may be identified based on the changes over time in sensor information including multiple identical products on display. The sales information generation unit generates sales information based on the individual status of the individual products that have been taken from the shelves and the individual status of the remaining individual products. Furthermore, the sales information generation unit may identify sales trends according to the individual status based on the individual status of the individual products that have been taken from the shelves and the individual status of the remaining individual products. Furthermore, the sales information generation unit may generate sales trends according to individual conditions as sales information. In this case, the output unit 104 may output sales information according to the user's request.

[0097] Figure 9 shows an example of the output of business support information. In Figure 9, the business support information displays the price and display location corresponding to the individual condition of a specific product. As shown in Figure 9, the price of 75 yen is displayed for potatoes with relatively different colors, and the price of 75 yen is displayed for potatoes with blemishes in the image of the specific product. In addition, the specific product, which is the potato with relatively different colors and the potato with blemishes, is circled for identification. Furthermore, Figure 9 also displays business instructions for the specific product as business support information. As with Figure 5, the product may be shown as an image acquired by the acquisition unit 101, or as an illustration based on an image acquired by the acquisition unit 101. Also, as with Figure 5, since the individual condition and the price of the same product may change over time, the time at which the price and display location were set may be displayed so that the user can understand when the price and display location were set.

[0098] The business support information generation unit 307 generates sales information that associates the individual status of individual products with the sales of those products, and the output unit 104 outputs the sales information. This allows the product management device 300 to provide store employees with sales information that is tailored to individual differences. In other words, the product management device 300 can provide store employees with information related to the sale of products that is tailored to individual differences such as product procurement and display.

[0099] [Hardware configuration] Some or all of the components of each apparatus or system in each embodiment of the present disclosure described above can be realized by any combination of an information processing device 1000 and a program, for example, as shown in Figure 10. The information processing device 1000 includes, as an example, the following configuration.

[0100] ·CPU(Central Processing Unit)1001 • ROM (Read Only Memory) 1002 ·RAM(Random Access Memory)1003 • Program 1004 loaded into RAM1003 • Storage device 1005 for storing program 1004 • Drive device 1007 for reading and writing recording medium 1006 • Communication I / F 1008 connected to communication network 1009 • Input / output interface 1010 for data input and output. • Bus 1011 connecting each component Note that I / F is an abbreviation for Interface.

[0101] Each component of each device or system in each embodiment is realized by the CPU 1001 acquiring and executing a program that realizes its function. The program that realizes the function of each component of each device is, for example, stored in advance in the storage device 1005 or RAM 1003 and read by the CPU 1001 as needed. The program 1004 may be supplied to the CPU 1001 via a communication network, or it may be stored in advance in the recording medium 1006 and read by the drive device 1007 and supplied to the CPU 1001.

[0102] There are various variations in how each device is implemented. For example, each device or system may be implemented by any combination of a separate information processing device 1000 and a program for each component. Alternatively, the multiple components of each device may be implemented by any combination of a single information processing device 1000 and a program.

[0103] Furthermore, some or all of the components of each device or system are realized by general-purpose or dedicated circuits, including processors, or combinations thereof. Examples of circuits include CPUs, GPUs (Graphics Processing Units), FPGAs (Field Programmable Gate Arrays), and LSIs (Large Scale Integrations). An LSI is, for example, a dedicated LSI for AI (Artificial Intelligence) processing. These may consist of a single chip or multiple chips connected via a bus. Some or all of the components of each device may be realized by combinations of the aforementioned circuits and programs.

[0104] When some or all of the components of each device or system are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-and-server system or a cloud computing system.

[0105] Although the present invention has been described above with reference to the embodiments described, the present invention is not limited to the above embodiments. Various modifications to the configuration and details of the present invention can be made that will be understood by those skilled in the art within the scope of the present invention.

[0106] For example, the product management device may be modified to include a business support information generation unit 307 in the product management device 200 of the second embodiment or the product management device 200A of Modification 1.

[0107] Furthermore, although multiple operations are described sequentially in flowchart format, the order in which they are described does not limit the order in which they must be performed. Therefore, when implementing each embodiment, the order of the multiple operations may be changed to the extent that it does not impair the content. [Explanation of symbols]

[0108] 100 Product management device 101 Acquisition Department 102 State Estimation Unit 103 Extraction part 104 Output section 200 Product management device 205 Pricing Department 200A product management device 206 Change Request Reception Department 300 Product management device 307 Business support information generation department 1000 Information Processing Devices 1001 CPU 1002 ROM 1003 RAM 1004 Program 1005 Storage device 1006 Recording media 1007 Drive unit 1008 Communication I / F 1009 Communication Network 1010 Input / Output Interface 1011 Bus

Claims

1. An acquisition means for acquiring sensor information including multiple identical products on display, A state estimation means that estimates the individual state of each of the multiple identical products on display, based on the aforementioned sensor information, which indicates at least one of the following: size, color, presence or absence of scratches, and shape. An extraction means for extracting individual products from among multiple identical products, based on the individual state of each of the individual products, that have relatively different individual states, as a specific product; An output means for outputting specific product information relating to the aforementioned specific product, A product management device equipped with the following features.

2. The system further comprises pricing means for setting the price of a specific product based on price information representing the relationship between the price of the same product and the individual status of the specific product, and the individual status of the specific product. The output means outputs the price of the specified product as specified product information relating to the specified product. The product management device according to claim 1.

3. The pricing means sets a price range for the specific product based on the price information and the individual status of the specific product. The output means outputs the price range of the specified product as the specified product information. The product management device according to claim 2.

4. The output means further outputs a detection instruction to the user, which is the sensor information of the specific product, which is the sensor information of the specific product. The product management device according to claim 1.

5. The acquisition means further acquires the specific product sensor information detected based on the detection instruction, The state estimation means re-estimates the individual state based on the specific product sensor information. The product management device according to claim 4.

6. A change request receiving means that receives a price change request for the specified product, including the price change request and the reason for the change, for the specified product whose specified product information has been output by the output means. Furthermore, The pricing means sets the price based on the price change request. The product management device according to claim 2.

7. The output means projects the specific product information onto the detection range of the sensor information. The product management device according to claim 1.

8. The system further comprises a business support information generation means for generating business support information corresponding to the individual status of each of multiple identical products, The output means outputs the business support information as the specific product information. The product management device according to claim 1.

9. Computers Sensor information including multiple identical products on display is acquired. Based on the sensor information, the individual condition of each of the multiple identical products on display is estimated, which indicates at least one of the following: size, color, presence or absence of scratches, and shape. Based on the individual state of each of the individual products among multiple identical products, individual products with relatively different individual states are extracted from the multiple identical products as specific products. Output specific product information for the aforementioned specific product. Product management method.

10. Sensor information including multiple identical products on display is acquired. Based on the sensor information, the individual condition of each of the multiple identical products on display is estimated, which indicates at least one of the following: size, color, presence or absence of scratches, and shape. Based on the individual state of each of the individual products among multiple identical products, individual products with relatively different individual states are extracted from the multiple identical products as specific products. Output specific product information for the aforementioned specific product. A program that instructs a computer to perform a process.

Images