Product Management System

Abstract

This product management system can detect the number of products with specific attributes among the displayed products. [Solution] The system includes a camera 1 that photographs labeled products 4 displayed in the display area 3, and a product count detection unit that detects the number of products 4 based on the number of specific colored labels 10 that appear in the image captured by the camera 1.

Description

Technical Field

[0001] The present invention relates to a product management system.

Background Art

[0002] As a product management system, for example, the one described in Patent Document 1 is already known. This product management system (referred to as "product monitoring system" in Patent Document 1) includes a photographing device (referred to as "monitoring camera" in Patent Document 1) that photographs products displayed on a display stand. Based on the image photographed by the photographing device, the area of the exposed portion of the base of the display stand, which is the base area, is measured. Based on the base area, a decrease in the number of products displayed is determined.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a configuration where the number of products is detected based on the base area of the display stand, it is impossible to detect the number of products having a specific attribute among the products displayed (for example, tomatoes produced by a specific producer among the tomatoes displayed).

[0005] An object of the present invention is to provide a product management system capable of detecting the number of products having a specific attribute among the products displayed.

Means for Solving the Problems

[0006] The present invention is characterized by comprising: a photographing device for photographing labeled products displayed in a display area; and a product quantity detection unit for detecting the number of specific labels of a specific color that appear in the image captured by the photographing device.

[0007] According to this configuration, if a specific label (e.g., a green label) is attached to a product with a specific attribute (e.g., tomatoes produced by a specific producer), the product count detection unit can detect the number of products with that attribute. This makes it possible to realize a product management system that can detect the number of products with a specific attribute among the products on display.

[0008] Furthermore, in the present invention, multiple colors are defined as the specified colors, and it is preferable that the product quantity detection unit detects the number of products for each of the specified label colors.

[0009] With this configuration, if different colored labels are attached to each product attribute (for example, each producer), the product quantity detection unit will be able to detect the number of products for each attribute. This makes it possible to realize a product management system that can detect the number of products for each attribute.

[0010] Furthermore, in the present invention, it is preferable to include an alarm unit that issues an alarm when the number of items detected by the item quantity detection unit is below a predetermined threshold.

[0011] This configuration enables a product management system that triggers an alert when the number of displayed products becomes relatively low. This allows the person responsible for replenishing products (e.g., the producer) to replenish the products at the appropriate time.

[0012] Furthermore, in the present invention, a plurality of colors are defined as the specified colors, and the product quantity detection unit includes a threshold setting unit that detects the number of products for each of the specified label colors and sets the threshold, and the threshold setting unit is preferably configured to set the threshold for each of the specified label colors.

[0013] With this configuration, by attaching specific colored labels to each product attribute (for example, each producer), a product management system can be realized in which quantity detection and alerts are triggered for each product attribute. This makes it easier to properly manage each product when multiple types of products are displayed.

[0014] Furthermore, in the present invention, it is preferable that the specific label displays at least one of the following: product name, price, place of production, and producer name.

[0015] This configuration allows for the display of at least one of the following information on a product: product name, price, place of origin, or producer name. Therefore, there is no need to create a separate label for displaying such information. This reduces the cost of product management (sales).

[0016] Furthermore, the present invention includes a label detection unit for detecting the specific label appearing in the image, and the product quantity detection unit is configured to detect the number of products based on the number of specific labels detected by the label detection unit. Preferably, the label detection unit detects as the specific label an area of ​​the specific color in the image that is larger than or equal to a predetermined area.

[0017] This configuration allows for the detection of specific labels in areas of a particular color that are smaller than a predetermined area. This enables accurate detection of specific labels.

[0018] Furthermore, the present invention includes a label detection unit that detects the specific label appearing in the image, and the product quantity detection unit is configured to detect the number of products based on the number of specific labels detected by the label detection unit. Preferably, the label detection unit detects a region of a specific color in the image that has a predetermined shape as the specific label.

[0019] According to this configuration, it is possible to realize a configuration in which an area of a specific color that is not of a predetermined shape is not detected as a specific label. Thereby, the specific label can be detected with high accuracy.

[0020] Furthermore, in the present invention, it is preferable that a plurality of the imaging devices corresponding to the plurality of the display areas are provided, and the product number detection unit detects the number of the products for each of the imaging devices.

[0021] According to this configuration, if different display areas are provided for each attribute of the product (for example, for each type of vegetable), the number of products can be detected for each attribute by the product number detection unit. Thereby, it is possible to realize a product management system that can detect the number of products for each attribute. [[ID=十一]]

Brief Description of the Drawings

[0022] [Figure 1] It is a diagram showing an overview of the product management system. [Figure 2] It is a diagram showing the correspondence relationship between each imaging device, the color of the specific label, and the attribute of the product. [Figure 3] It is a diagram showing an example when the first label is detected. [Figure 4] It is a block diagram of the product management system.

Embodiments for Carrying Out the Invention

[0023] Embodiments for carrying out the present invention will be described based on the drawings.

[0024] 〔Overall Configuration of the Product Management System〕 As shown in FIG. 1, the product management system S in the present embodiment includes a plurality of imaging devices 1 and a management server 2. Each imaging device 1 and the management server 2 are connected to each other via a predetermined network.

[0025] Each camera 1 is configured to capture an overhead view of the products 4 displayed in the display area 3. Each camera 1 may be composed of a known camera. The display area 3 may or may not be included in the product management system S.

[0026] While not particularly limited, in this embodiment, the display area 3 is a display stand provided within a store selling various food products, and the product 4 is a vegetable or fruit. In this embodiment, the display area 3 consists of a first area 5 and a second area 6. That is, in this embodiment, two display areas 3 are provided.

[0027] Furthermore, a first imaging device 7 and a second imaging device 8 are provided to correspond to these two display areas 3. The first imaging device 7 photographs the products 4 displayed in the first area 5. The second imaging device 8 photographs the products 4 displayed in the second area 6. Both the first imaging device 7 and the second imaging device 8 are imaging devices 1. In other words, in this embodiment, two imaging devices 1 are provided.

[0028] Thus, the product management system S is equipped with multiple imaging devices 1 corresponding to multiple display areas 3.

[0029] However, the present invention is not limited to the above-described configuration. The number of display areas 3 may be one or three or more. Similarly, the number of photographic devices 1 provided in the product management system S may be one or three or more.

[0030] As shown in Figure 1, product 4 displayed in area 1, area 5, is specifically a tomato. Also, product 4 displayed in area 2, area 6, is specifically a cucumber.

[0031] Furthermore, one product 4 could be, for example, a single tomato, or a package containing multiple tomatoes. In other words, the unit of product 4 can be changed as appropriate.

[0032] [Specific Label] As shown in Figure 1, each product 4 has a specific label 10 attached to it. The specific label 10 is a label of a specific color. In other words, the product management system S is equipped with a camera 1 that photographs the labeled products 4 displayed in the display area 3. One specific label 10 is attached to each product 4.

[0033] In this embodiment, multiple colors are designated as specific colors. Specifically, green, blue, yellow, and red are designated as specific colors. However, the present invention is not limited to this. There may be only one specific color, two or three specific colors, or five or more specific colors.

[0034] As shown in Figure 1, in this embodiment, each product 4 is affixed with one of the following labels: a first label 11, a second label 12, a third label 13, or a fourth label 14. The first label 11 is a green specific label 10. The second label 12 is a blue specific label 10. The third label 13 is a yellow specific label 10. The fourth label 14 is a red specific label 10.

[0035] Figure 2 shows the correspondence between each imaging device 1, the color of the specific label 10, and the attributes of the product 4 in this embodiment. Note that "Camera No." in Figure 2 refers to the identification number assigned to each imaging device 1. The camera no. of the first imaging device 7 is "1," and the camera no. of the second imaging device 8 is "2."

[0036] As shown in Figure 2, the first camera 7 corresponds to a tomato, and the second camera 8 corresponds to a cucumber. That is, the first camera 7 photographs product 4, which is a tomato. The second camera 8 photographs product 4, which is a cucumber.

[0037] Furthermore, as shown in Figure 2, tomatoes grown by producer A are marked with a green specific label 10 (in other words, the first label 11). Tomatoes grown by producer B are marked with a blue specific label 10 (in other words, the second label 12). Tomatoes grown by producer C are marked with a yellow specific label 10 (in other words, the third label 13).

[0038] Additionally, cucumbers grown by producer D are marked with a red special label 10 (in other words, the fourth label 14). Cucumbers grown by producer A are marked with a blue special label 10 (in other words, the second label 12). Cucumbers grown by producer E are marked with a yellow special label 10 (in other words, the third label 13).

[0039] The product name (for example, "tomato" or "cucumber") is a specific example of an attribute of product 4. Also, who the producer is (producer name) is a specific example of an attribute of product 4.

[0040] As shown in Figure 3, the specific label 10 is rectangular. However, the present invention is not limited to this. The specific label 10 may be circular, for example.

[0041] Furthermore, it is preferable that the specific label 10 displays at least one of the following: product name, price, place of origin, and producer name.

[0042] [Detection of the number of items] As shown in Figure 4, the management server 2 has a storage unit 20, a label detection unit 21, and a product count detection unit 22. The storage unit 20 stores the correspondence shown in Figure 2.

[0043] The label detection unit 21 is configured to detect specific labels 10 that appear in images captured by each imaging device 1. In other words, the product management system S includes a label detection unit 21 that detects specific labels 10 that appear in images. The detection of specific labels 10 will be described in detail below.

[0044] As shown in Figure 4, each imaging device 1 sends the captured image to the management server 2. The image is associated with device identification information. This device identification information indicates which imaging device 1 captured the image.

[0045] Furthermore, the label detection unit 21 includes a first label detection unit 31. The first label detection unit 31 is configured to detect the first label 11 that appears in the image sent to the management server 2. More specifically, the first label detection unit 31 extracts the color region of the first label 11 (i.e., the green region) in the image, and detects the region among the extracted regions that is larger than a predetermined area and has a predetermined shape as the first label 11. The "predetermined area" is a value set based on the size of the first label 11 (specific label 10). The "predetermined shape" is a shape set based on the shape of the first label 11 (specific label 10), and in this embodiment, it is a rectangle.

[0046] For example, the top of Figure 3 shows an example of an image taken by the first imaging device 7. This image shows two first labels 11, three second labels 12, and one third label 13. The image also shows the stem 9 of a tomato included in product 4. The tomato stem 9 is assumed to be green.

[0047] In the example shown in Figure 3, the first label detection unit 31 extracts the color region of the first label 11 (i.e., the green region) in the image captured by the first imaging device 7. As a result, the region where the first label 11 is located and the region where the tomato stem 9 is located are extracted, as shown in the lower part of Figure 3.

[0048] In this example, the area containing the first label 11 among the extracted regions is assumed to be at least a predetermined size. Also, as shown in the lower part of Figure 3, the area containing the first label 11 is rectangular.

[0049] Furthermore, in this example, the area containing the tomato stem 9 within the extracted region is assumed to be less than a predetermined area. Also, as shown in the lower part of Figure 3, the area containing the tomato stem 9 is not rectangular.

[0050] Therefore, in this example, the first label detection unit 31 detects the region where the first label 11 exists as the first label 11. Furthermore, the first label detection unit 31 does not detect the region where the tomato stem 9 exists as the first label 11. As a result, in this example, two first labels 11 are detected.

[0051] As shown in Figure 4, the first label detection unit 31 sends information indicating the number of detected first labels 11 to the first product count detection unit 41 in the product count detection unit 22. At the same time, the first label detection unit 31 also sends the above-mentioned device identification information to the first product count detection unit 41 along with this information.

[0052] Here, as shown in Figure 4, the product count detection unit 22 acquires the correspondence (see Figure 2) stored in the storage unit 20. Then, the first product count detection unit 41 generates product count detection information based on the correspondence, the information indicating the number of first labels 11 detected by the first label detection unit 31, and the device identification information. The product count detection information is information indicating the attributes of product 4 and the number of product 4 on display. As a result, the first product count detection unit 41 detects the number of product 4.

[0053] For example, in the example shown in Figure 3, the product count detection information generated by the first product count detection unit 41 is information indicating the number of tomatoes produced by producer A. That is, the first product count detection unit 41 detects the number of tomatoes produced by producer A.

[0054] As explained above, the first label detection unit 31 detects the number of first labels 11, and the first product quantity detection unit 41 detects the number of products 4 based on that number.

[0055] As shown in Figure 4, the label detection unit 21 has a first label detection unit 31, as well as a second label detection unit 32, a third label detection unit 33, and a fourth label detection unit 34. The product count detection unit 22 has a first product count detection unit 41, as well as a second product count detection unit 42, a third product count detection unit 43, and a fourth product count detection unit 44.

[0056] Similar to the first label detection unit 31 and the first product count detection unit 41, the second label detection unit 32 detects the number of second labels 12, and the second product count detection unit 42 detects the number of products 4 based on that number (in other words, it generates the product count detection information described above). For example, the second product count detection unit 42 detects the number of tomatoes whose producer is Mr. B based on the number of second labels 12 visible in the image captured by the first camera 7. Also, for example, the second product count detection unit 42 detects the number of cucumbers whose producer is Mr. A based on the number of second labels 12 visible in the image captured by the second camera 8.

[0057] Similarly, the third label detection unit 33 detects the number of third labels 13, and the third product count detection unit 43 detects the number of products 4 based on that number (in other words, it generates the product count detection information described above). For example, the third product count detection unit 43 detects the number of tomatoes whose producer is Mr. C based on the number of third labels 13 visible in the image captured by the first camera 7. Also, for example, the third product count detection unit 43 detects the number of cucumbers whose producer is Mr. E based on the number of third labels 13 visible in the image captured by the second camera 8.

[0058] Similarly, the fourth label detection unit 34 detects the number of fourth labels 14, and the fourth product count detection unit 44 detects the number of products 4 based on that number (in other words, it generates the product count detection information described above). For example, the fourth product count detection unit 44 detects the number of cucumbers whose producer is Mr. D based on the number of fourth labels 14 that appear in the image captured by the second imaging device 8.

[0059] With the configuration described above, the number of specific labels 10 in the image is detected by the label detection unit 21 for each color of the specific label 10. The product count detection unit 22 then detects the number of products 4 for each color of the specific label 10 based on the number of specific labels 10 detected by the label detection unit 21 for each color. The product count detection unit 22 also detects the number of products 4 for each imaging device 1.

[0060] Specifically, the product management system S includes a product count detection unit 22 that detects the number of products 4 based on the number of specific labels 10, which are labels of a specific color, that appear in the image captured by the camera 1. The product count detection unit 22 is configured to detect the number of products 4 based on the number of specific labels 10 detected by the label detection unit 21. The label detection unit 21 also detects specific labels 10 as areas of a specific color in the image that are larger than a predetermined area. Furthermore, the label detection unit 21 also detects specific labels 10 as areas of a specific color in the image that have a predetermined shape.

[0061] [Issued] As shown in Figure 4, the management server 2 has an alarm unit 23. The alarm unit 23 acquires the detection result from the product count detection unit 22. The alarm unit 23 then issues an alarm if the number of products 4 detected by the product count detection unit 22 is below a predetermined threshold. At this time, as shown in Figures 1 and 4, the alarm unit 23 issues an alarm to the user's information terminal 50 (for example, a smartphone or tablet). As shown in Figure 1, the information terminal 50 is connected to the management server 2 via a predetermined network.

[0062] Thus, the product management system S includes an alarm unit 23 that issues an alarm when the number of products 4 detected by the product quantity detection unit 22 is below a predetermined threshold.

[0063] Furthermore, there may be one user or multiple users. In this embodiment, the users are the five producers A, B, C, D, and E mentioned above. Also, there may be one information terminal 50 or multiple information terminals. In this embodiment, there are five information terminals 50. The information terminals 50 may or may not be included in the product management system S.

[0064] As shown in Figure 4, the management server 2 has a threshold setting unit 24. The threshold setting unit 24 sets the thresholds described above. The threshold setting unit 24 is configured to be able to set a threshold for each color of a specific label 10. In other words, the product management system S is equipped with a threshold setting unit 24 for setting thresholds.

[0065] While not particularly limited, the threshold setting unit 24 may be configured to allow setting a threshold for each imaging device 1. Furthermore, the threshold setting unit 24 may be configured to set a threshold in response to human operation via a predetermined input device (not shown).

[0066] The following describes in detail how the alarm is issued by the alarm unit 23 in this embodiment.

[0067] The alarm generation unit 23 obtains a threshold from the threshold setting unit 24. The alarm generation unit 23 also obtains the above-mentioned product count detection information from the product count detection unit 22. The alarm generation unit 23 decides whether or not to issue an alarm by comparing the threshold with the number of products 4 indicated by the product count detection information. At this time, the number of products 4 is compared with a threshold set corresponding to the color of the specific label 10 attached to the product 4. Note that the decision to issue an alarm may be made for each color of the specific label 10, or for each imaging device 1.

[0068] If the alarm generation unit 23 decides to generate an alarm, it determines which of the multiple information terminals 50 will be the target of the alarm based on the attributes of the product 4 indicated by the product quantity detection information.

[0069] For example, in the example shown in Figure 3, let's assume that the threshold corresponding to the first label 11 (green) is set to "2". In this example, since the number of items 4 detected by the first item count detection unit 41 is two, the alarm generation unit 23 decides to issue an alarm. Since item 4 is a tomato produced by Mr. A, the alarm generation unit 23 decides to issue an alarm to Mr. A's information terminal 50. The alarm generation unit 23 then issues an alarm to Mr. A's information terminal 50.

[0070] Thus, it is preferable for the alarm unit 23 to issue an alert to the producer of the detected product 4 if the number of product 4 is below a threshold.

[0071] While not particularly limited, the alarm issued by the alarm unit 23 may, for example, announce the attributes and quantity of product 4. Alternatively, the alarm issued by the alarm unit 23 may be, for example, a message display or voice guidance.

[0072] Furthermore, the alarm unit 23 may be configured to display the image captured by the camera 1 on the information terminal 50 in conjunction with the alarm. Also, the alarm unit 23 may be configured not to issue an alarm if the length of time from the current time to the scheduled closing time of the store where the display area 3 is located is less than or equal to a predetermined time (for example, 15 minutes or less).

[0073] With the configuration described above, if a specific label 10 (for example, a green label) is attached to a product 4 having a specific attribute (for example, tomatoes produced by a specific producer), the number of products 4 having that attribute can be detected by the product count detection unit 22. This makes it possible to realize a product management system S that can detect the number of products 4 having a specific attribute among the displayed products 4.

[0074] [Other Embodiments] (1) Individuals who are not subject to alerts from the alerting unit 23 (e.g., consumers) may be registered as users. Such users may be able to view the product count detection information generated by the product count detection unit 22.

[0075] (2) The alarm unit 23 does not need to be provided.

[0076] (3) The threshold setting unit 24 does not have to be configured to allow setting a threshold for each color of the specific label 10. That is, the threshold may be set uniformly regardless of the color of the specific label 10.

[0077] (4) Product 4 may have labels other than specific label 10 attached to it.

[0078] Furthermore, the configurations disclosed in the above-described embodiments (including other embodiments, the same applies hereinafter) can be applied in combination with configurations disclosed in other embodiments, as long as no inconsistencies arise. In addition, the embodiments disclosed herein are illustrative, and the embodiments of the present invention are not limited thereto, and can be modified as appropriate without departing from the object of the present invention. [Industrial applicability]

[0079] This invention can be used in product management systems. [Explanation of Symbols]

[0080] 1: Imaging device 3: Display Area 4: Product 10: Specific Labels 21: Label detection unit 22: Item Count Detection Unit 23: Reporting Department 24: Threshold setting section S: Product Management System

Claims

1. A camera that photographs labeled products displayed in the display area, A product management system comprising: a product quantity detection unit that detects the number of products based on the number of specific labels of a specific color that appear in an image captured by the aforementioned photographing device.

2. Multiple colors are designated as the aforementioned specific colors. The product quantity detection unit detects the number of products for each color of the specific label, as described in claim 1.

3. The product management system according to claim 1 or 2, further comprising an alarm unit that issues an alarm when the number of products detected by the product quantity detection unit is below a predetermined threshold.

4. Multiple colors are designated as the aforementioned specific colors. The product quantity detection unit detects the number of products for each color of the specific label, The system includes a threshold setting unit for setting the aforementioned threshold, The product management system according to claim 3, wherein the threshold setting unit is configured to set the threshold for each color of the specific label.

5. The product management system according to claim 1 or 2, wherein the specific label displays at least one of the following: product name, price, place of origin, and producer name.

6. The system includes a label detection unit that detects the specific label shown in the image, The product quantity detection unit is configured to detect the number of products based on the number of specific labels detected by the label detection unit. The product management system according to claim 1 or 2, wherein the label detection unit detects an area of ​​a specific color in the image that is larger than or equal to a predetermined area as the specific label.

7. The system includes a label detection unit that detects the specific label shown in the image, The product quantity detection unit is configured to detect the number of products based on the number of specific labels detected by the label detection unit. The product management system according to claim 1 or 2, wherein the label detection unit detects a region of a specific color in the image that has a predetermined shape as the specific label.

8. The system comprises multiple imaging devices corresponding to multiple display areas, The product quantity detection unit detects the number of products for each of the imaging devices, as described in claim 1 or 2.

Images