Article counting device, article counting system, article counting method, and program

Abstract

To easily count the number of articles.SOLUTION: An article counting device comprising: an information acquisition unit that acquires accommodation space information related to a size of a virtual accommodation space in which an article is accommodated in a three dimensional space and article information related to a size of the article; a detection unit that detects article space information related to a size of a region occupied by the article in the virtual accommodation space; and a specifying unit that specifies the number of articles present in the virtual accommodation space according to a first feature amount corresponding to the article space information and a second feature amount corresponding to the article information.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an article counting device, an article counting system, an article counting method, and a program. [Background technology]

[0002] BACKGROUND ART Techniques for counting the number of items to manage the items and the like are known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-14502 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology of Patent Document 1 requires measuring the weight of the items to be counted, which is time-consuming. While it is possible to process images of the items to be counted, this requires complex image processing and the use of a large amount of data for each item, which can make it difficult to simply count the number of items.

[0005] The present invention has been made in consideration of these points, and has as its object to make it possible to count the number of articles easily. [Means for solving the problem]

[0006] In a first aspect of the present invention, an item counting device is provided, comprising: an information acquisition unit that acquires storage space information related to the size of a virtual storage space in which items are stored in three-dimensional space and item information related to the size of the items; a detection unit that detects item space information related to the size of the area occupied by the items in the virtual storage space; and an identification unit that identifies the number of items present in the virtual storage space based on a first feature corresponding to the item space information and a second feature corresponding to the item information.

[0007] The storage device may further include a code acquisition unit that acquires information about the item code from an image captured of the item code corresponding to the item, and the information acquisition unit may acquire the storage space information associated with the acquired item code.

[0008] The system may further include a code acquisition unit that acquires information about the item code from an image captured of the item code corresponding to the item, and the information acquisition unit may acquire the item information associated with the acquired item code.

[0009] The system may further include a code acquisition unit that acquires information about the item code from an image that captures the item code corresponding to the item, and the information acquisition unit may acquire the storage space information and the item information associated with the acquired item code.

[0010] The detection unit may set the item space information as a value obtained by multiplying the virtual storage space by a filling rate at which the items are filled.

[0011] The identification unit may set at least one of the one-dimensional (length), two-dimensional (area), and three-dimensional (volume) parameters of the area occupied by the item as the first feature, set the parameter corresponding to the first feature among the one-dimensional, two-dimensional, and three-dimensional parameters of the item as the second feature, and identify the number of the items based on the number obtained by dividing the first feature by the second feature.

[0012] The storage space information includes information indicating the size of the virtual storage space and information indicating the position of the virtual storage space based on the display position of the item code, and the detection unit may identify the range of the virtual storage space based on the size of the virtual storage space and the position of the virtual storage space.

[0013] The storage space information may include information relating to the size of the storage space of a storage case that is installed in real space and that stores the item. The detection unit may detect the item spatial information based on a measurement result of a distance measurement device that measures a distance from the item counting device to the item.

[0014] The code acquisition unit may acquire information about the item code from the captured image of the item and the item code, and the detection unit may detect the item spatial information based on the extraction results obtained by extracting the area occupied by the item from the captured image using image processing.

[0015] The system may further include a display control unit that causes a captured image of the item to be displayed on a display unit, and the display control unit may cause an image showing the virtual storage space to be superimposed on the captured image on the display unit.

[0016] The display control unit may superimpose the number of the items identified by the identification unit on the captured image.

[0017] The information acquisition unit may further acquire information on the inventory quantity from a memory unit that stores information on the inventory quantity of the items, and if the number of the items identified by the identification unit does not match the inventory quantity, the display control unit may superimpose a display indicating that the number of the items does not match the inventory quantity on the captured image.

[0018] The information acquisition unit may further acquire information on the inventory quantity from a memory unit that stores information on the inventory quantity of the items, and if the number of the items identified by the identification unit does not match the inventory quantity, the display control unit may display the number of items superimposed on the captured image in a display format different from the display format that displays the number of items on the display unit when the number of items matches the inventory quantity.

[0019] The information acquisition unit may further acquire information on the inventory quantity from a memory unit that stores information on the inventory quantity of the items, and if the number of the items identified by the identification unit does not match the inventory quantity, the display control unit may superimpose the virtual storage space on the captured image in a display format that is different from the display format used to display the virtual storage space on the display unit when the number of the items matches the inventory quantity.

[0020] The information acquisition unit may further acquire information on a characteristic image indicating the characteristics of the item, and the identification unit may identify the number of the items in the captured image on the condition that the item space information detected by the detection unit includes at least one of the characteristic images.

[0021] In a second aspect of the present invention, there is provided an item counting system for counting the number of items, comprising: a first storage device that stores the storage space information in association with an item code; a second storage device that stores the item information in association with the item code; an imaging device that captures an image including the item code; and the item counting device of the first aspect that acquires the image and uses the storage space information and the item information to identify the number of items contained in the image.

[0022] In a third aspect of the present invention, there is provided an item counting system for counting the number of items, comprising: a first storage device that stores the storage space information; a second storage device that stores the item information; an imaging device that captures an image including the items; and the item counting device of the first aspect that, based on the captured image, determines the number of items included in the captured image using the storage space information and the item information.

[0023] In a fourth aspect of the present invention, there is provided an item counting method executed by a computer for counting the number of items, comprising the steps of acquiring storage space information related to the size of a virtual storage space in which items are stored in three-dimensional space and item information related to the size of the items, detecting item space information related to the size of the area occupied by the items in the virtual storage space, and identifying the number of items present in the virtual storage space based on a first feature corresponding to the item space information and a second feature corresponding to the item information.

[0024] In a fifth aspect of the present invention, there is provided a program that, when executed by a computer, causes the computer to function as the article counting device of the first aspect. [Effects of the Invention]

[0025] According to the present invention, it is possible to easily count the number of articles. [Brief explanation of the drawings]

[0026] [Figure 1] 1 shows an example of the configuration of an item counting system S according to this embodiment. [Figure 2] 1 shows an example of the configuration of an article counting device 100 according to this embodiment. [Figure 3] 10 shows an example in which the display control unit 152 according to the present embodiment displays a captured image on the display unit 140. FIG. [Figure 4]4 shows an example in which the display control unit 152 according to the present embodiment displays the virtual accommodation space 200 on the captured image shown in FIG. 3 on the display unit 140. [Figure 5] 10 shows an example of an operation flow of the article counting device 100 according to this embodiment. [Figure 6] An example of a storage case 60 that stores an item 10 according to this embodiment is shown in real space. DETAILED DESCRIPTION OF THE INVENTION

[0027] <Configuration example of the item counting system S> 1 shows an example of the configuration of an article counting system S according to this embodiment. The article counting system S is a system that captures an image of an article code 20 corresponding to an article 10 and counts the number of articles 10 based on the captured image of the article code 20. In this embodiment, first, the article counting system S that counts the number of articles 10 based on a captured image of the articles 10 and the article code 20 will be described.

[0028] The items 10 include products, parts, materials, etc. The items 10 may be contained in boxes, bags, etc., or may be packed in packaging materials, etc. It should be noted that identical items 10 have the same size. The item counting system S may be used, for example, in combination with a management system for managing the items 10.

[0029] The item code 20 is a code including numerical or character information, such as a barcode or two-dimensional code. The item code 20 is a code corresponding to the item 10. It is desirable that the item code 20 be provided near the item 10. For example, the item code 20 is attached to the storage location of the item 10, the user's work location, etc. The item code 20 may be attached to the shelf where the item code 20 is stored, or to the item 10 itself. The item code 20 may also be written in a code table or the like that can be viewed by the user. Figure 1 shows an example in which the item code 20 is attached to the floor on which it is placed.

[0030] The item counting system S comprises a first storage device 30, a second storage device 40, and a mobile terminal 50. The first storage device 30 stores storage space information used to count the number of items 10 in association with an item code 20. The storage space information will be described later. The first storage device 30 may be an external storage device of the mobile terminal 50, or may be a storage device provided inside the mobile terminal 50. Figure 1 shows an example of an external storage device that the first storage device 30 can access via a network. One example of the first storage device 30 is cloud storage.

[0031] The second storage device 40 stores item information in association with the item code 20. The item information indicates information related to the size of the item 10. The item information may be one-dimensional information such as the height of the item 10, two-dimensional information such as the base area, or three-dimensional information indicating the size, volume, etc. In this embodiment, an example will be described in which the item information is the size of the item 10. The size of the item 10 includes, for example, information such as the height, width, and depth of the item. The item information may also include information on characteristic images that indicate the characteristics of the item 10. The characteristic images are images of the external shape of the item 10, images of marks, patterns, etc. attached to the item 10, and images of the shapes of characteristic parts of the item 10.

[0032] The second storage device 40 may be an external storage device of the mobile terminal 50, or may be a storage device provided inside the mobile terminal 50. FIG. 2 shows an example of an external storage device that the second storage device 40 can access via a network. One example of the second storage device 40 is cloud storage. Note that the second storage device 40 may be the same storage device as the first storage device 30.

[0033] The mobile terminal 50 is a mobile phone, a smartphone, a tablet, a wearable terminal, a portable PC, etc. The mobile terminal 50 has a camera (imaging device 110) for capturing an image including the item code 20. The mobile terminal 50 also has installed thereon an application for counting the number of items 10. In other words, the mobile terminal 50 has the function of the imaging device 110 and the function of an item counting device that counts the number of items 10 based on the captured image captured by the imaging device 110.

[0034] The imaging device 110 and the item counting device may be provided separately. In this case, the imaging device 110 and the item counting device are communicatively connected directly or via a network. The item counting device may be a computer such as a server instead of the mobile terminal 50. When the imaging device 110 and the item counting device are integrally formed, as in the mobile terminal 50, the mobile terminal 50 may be referred to as the item counting device.

[0035] <Configuration example of the article counting device 100> Next, the mobile terminal 50 that functions as an item counting device in the above-described item counting system S will be described. FIG. 2 shows an example of the configuration of an item counting device 100 according to this embodiment. The item counting device 100 shown in FIG. 2 is an example of a device that counts the number of items 10 based on the results of imaging the items 10 and item codes 20. The item counting device 100 includes an imaging device 110, a communication unit 120, a memory unit 130, a display unit 140, and a control unit 150.

[0036] The imaging device 110 captures an image including the item 10 and the item code 20. The imaging device 110 may capture a still image, or alternatively, may capture a moving image.

[0037] The communication unit 120 communicates with the first storage device 30 and the second storage device 40 via a communication network etc. The communication unit 120 is an interface for connecting to a communication network such as the Internet line, a wireless LAN, or a mobile phone network.

[0038] The storage unit 130 is a storage medium including a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 130 may also include a large-capacity storage device such as an HDD (Hard Disk Drive) and / or an SSD (Solid State Drive). For example, when a CPU functions as the item counting device 100, the storage unit 130 may store information such as an OS (Operating System) that causes the CPU to function, and programs. The storage unit 130 may also store various information including a database that is referenced when a program is executed.

[0039] The memory unit 130 may also store intermediate data, calculation results, thresholds, reference values, parameters, etc. that are generated (or used) by the item counting device 100 during its operation. The memory unit 130 may also supply the stored data to a requestor in response to a request from each section within the item counting device 100. The memory unit 130 may also store information stored in the first memory device 30 and the second memory device 40.

[0040] The display unit 140 displays various information. The display unit 140 may display captured images of the item 10 and the item code 20. It is desirable that the display unit 140 also functions as a display for displaying the communication status of the mobile terminal 50, the OS, the execution status of applications, etc.

[0041] The display unit 140 may have a touch panel function and operate as an input unit. The input unit receives operations, instructions, etc. from the user of the item counting device 100. The input unit may be an input device separate from the display unit 140, such as a keyboard, a mouse, or a voice input device.

[0042] The control unit 150 controls each unit of the item counting device 100. For example, the control unit 150 exchanges various pieces of information via the communication unit 120. The control unit 150 is, for example, a CPU (Central Processing Unit). The control unit 150 has a code acquisition unit 151, a display control unit 152, an information acquisition unit 153, a detection unit 154, and an identification unit 155. In other words, the CPU executes a program stored in the storage unit 130 to function as the control unit 150 having the code acquisition unit 151, the display control unit 152, the information acquisition unit 153, the detection unit 154, and the identification unit 155.

[0043] The code acquisition unit 151 controls the imaging device 110 to acquire a captured image of the item 10 and the item code 20 from the imaging device 110. The code acquisition unit 151 acquires information about the item code 20 from the captured image. The code acquisition unit 151 extracts an image of the item code 20 included in the captured image by image processing. The code acquisition unit 151 analyzes the extracted image of the item code 20 to acquire information indicated by the item code 20.

[0044] The display control unit 152 controls the display unit 140 to display various information on the display unit 140. The display control unit 152, for example, displays a captured image on the display unit. Fig. 3 shows an example in which the display control unit 152 according to this embodiment displays a captured image on the display unit 140. Fig. 3 shows an example in which four cubic articles 10 with height H, width W, and depth D are stacked in the height direction.

[0045] The information acquisition unit 153 acquires information associated with the item code 20 acquired by the code acquisition unit 151. The information acquisition unit 153 acquires item information associated with the item code 20 from the second storage device 40. The item information indicates information about the item 10 including the size of the item 10, such as the height H, width W, and depth D, for example.

[0046] The information acquisition unit 153 also acquires storage space information associated with the item code 20 from the first storage device 30. The storage space information indicates information related to the size of a virtual storage space in which the item 10 is stored in a three-dimensional space corresponding to the captured image. The storage space information includes one-dimensional information such as the height of the virtual storage space, two-dimensional information such as the base area, and three-dimensional information indicating the range, volume, etc. In this embodiment, an example will be described in which the storage space information is the range of the virtual storage space. The range of the virtual storage space has a predetermined volume. For example, the storage space information includes information indicating the size of a virtual storage space having a volume that is a constant multiple of the size of the item 10. As an example, the storage space information indicates information on a space having a volume six times that of the item 10, such as a height of 6H, a width of W, and a depth of D.

[0047] The storage space information further includes information on the position where the virtual storage space is located in three-dimensional space. For example, the storage space information includes information indicating the size of the virtual storage space and information indicating the position of the virtual storage space based on the display position of the item code 20. Alternatively, the storage space information may include information on the position of the virtual storage space based on a predetermined feature point in three-dimensional space. Furthermore, the storage space information may include information on the coordinate position of the virtual storage space in three-dimensional space corresponding to the captured image.

[0048] As an example, the position of the virtual storage space is a position a predetermined distance away from the item code 20 in a predetermined direction. The position where the virtual storage space is placed is preferably the position where the item 10 is to be placed or the position where the item 10 is already placed. If the position where the item 10 is to be placed is a position a predetermined distance away from the item code 20 in a predetermined direction, the position of the virtual storage space can be made to approximately coincide with the position of the item 10 by setting the direction and distance from the item code 20 to the above-mentioned predetermined direction and predetermined distance.

[0049] The detection unit 154 associates the captured image with three-dimensional space based on the captured image. For example, the detection unit 154 extracts a plurality of feature points captured in the captured image. If the captured image is a moving image, the detection unit 154 detects changes in the arrangement of the plurality of feature points for each of a plurality of frame images constituting the moving image, and associates the positions of pixels in the captured image with coordinate positions in three-dimensional space. If the captured image is a still image, the detection unit 154 detects changes in the arrangement of the plurality of feature points for each of a plurality of still images, and associates the positions of pixels in the captured image with coordinate positions in three-dimensional space.

[0050] Alternatively, the three-dimensional positions of a plurality of feature points may be stored in the storage unit 130. In this case, the detection unit 154 may associate the captured image with the three-dimensional space by matching the plurality of feature points extracted from the captured image with the three-dimensional positions of the plurality of feature points read from the storage unit 130.

[0051] Alternatively, if the item counting device 100 further includes a distance measurement device that measures the distance from the item counting device 100 to the measurement object, as described below, the captured image may be associated with a three-dimensional space based on the measurement results of the distance measurement device. Various methods are known for identifying the three-dimensional space corresponding to such captured images, and the item counting device 100 may identify the three-dimensional space corresponding to the captured image by using known techniques. Note that a detailed description of known techniques will be omitted.

[0052] The detection unit 154 identifies the range of the virtual storage space in three-dimensional space based on the size and position of the virtual storage space. In other words, the item counting device 100 places the virtual storage space at a position indicated by the virtual space information in three-dimensional space associated with the captured image. The display control unit 152 may display an image indicating the virtual storage space superimposed on the captured image on the display unit 140.

[0053] <Virtual Containment Space> FIG. 4 shows an example in which the display control unit 152 according to this embodiment displays a virtual storage space 200 on the captured image shown in FIG. 3 on the display unit 140. The virtual storage space 200 indicates the range of space in three-dimensional space that can store a predetermined number of items 10. FIG. 4 shows an example of a virtual storage space 200 that can store six cubic items 10 with a height H, width W, and depth D. In this case, the virtual storage space 200 is a space with a height of 6H, width W, and depth D. In other words, the storage space information indicates space information such as a height of 6H, width W, and depth D.

[0054] The detection unit 154 detects item space information related to the size of the area occupied by the item 10 in the virtual storage space 200 indicated by the storage space information. The item space information is one-dimensional information such as the height of the area occupied by the item 10, two-dimensional information such as the base area, and three-dimensional information indicating the area, volume, etc. In this embodiment, an example will be described in which the item space information is an item area 210 occupied by the item 10. The detection unit 154 extracts, for example, an image of the item 10 located in the virtual storage space 200 from the captured image. In the example of FIG. 4, the detection unit 154 extracts an area where four items 10 are stacked as the item area 210.

[0055] The detection unit 154 may set the value obtained by multiplying the virtual storage space by the fill rate of the items 10 as the item space information (item area 210). For example, if the virtual storage space has a volume equivalent to six items 10 and multiple items 10 fill approximately 50% of the space in the virtual storage space, the detection unit 154 sets 50% of the space in the virtual storage space as the item area 210. Note that the item area 210 may be larger than the virtual storage space. In other words, the items 10 may protrude from the virtual storage space. In this case, the detection unit 154 sets 100% of the space in the virtual storage space and the space protruding from the virtual storage space as the item area 210.

[0056] The detection unit 154 then acquires coordinate information of the feature amounts of the extracted item region 210 in a three-dimensional space corresponding to the captured image. The coordinate information may be relative values. The feature amounts of the item region 210 are feature amounts that indicate the size of the region, such as height, width, depth, and volume. As an example, the detection unit 154 detects the item region 210 as a space with a height of 4H, a width of W, and a depth of D.

[0057] The identification unit 155 identifies the number of items 10 present in the virtual storage space 200 based on a first feature amount corresponding to the item space information (size of the item area 210) and a second feature amount corresponding to the item information (size of the items 10). The first feature amount is at least one parameter among one-dimensional (length), two-dimensional (area), and three-dimensional (volume) parameters of the area occupied by the items.

[0058] For example, among the feature quantities such as height, width, depth, area, and volume of the virtual storage space 200, the feature quantity of the item region 210 that corresponds to the feature quantities having values ​​different from the feature quantities of the item 10, i.e., height, width, depth, area, and volume, is set as the first feature quantity. In the example of FIG. 4, among the feature quantities of the virtual storage space 200, the feature quantities having values ​​different from the feature quantities of the item 10 are height and volume. In this embodiment, the first feature quantity is set as the height of the item region 210. In the example of FIG. 4, the first feature quantity is 4H.

[0059] The second feature amount is a parameter corresponding to the first feature amount among one-dimensional, two-dimensional, and three-dimensional parameters of the article 10. In this embodiment, the second feature amount corresponding to the first feature amount is the height of the article 10. In the example of FIG. 4, the first feature amount is H. The identification unit 155 identifies the number of articles 10 based on the value obtained by dividing the first feature amount by the second feature amount. In the example of FIG. 4, the identification unit 155 identifies the number of articles as 4, since 4H / H=4. The display control unit 152 may superimpose the number of articles 10 identified by the identification unit 155 on the captured image.

[0060] As described above, the article counting device 100 according to this embodiment can count the number of articles 10 based on captured images of the articles 10 and the article codes 20. In captured images of the articles 10, the boundaries of the articles 10 may be unclear due to, for example, the patterns, colors, shadows, etc. of the articles 10. Therefore, in the past, automatically identifying the number of articles 10 from such captured images sometimes required complex image processing, etc.

[0061] Therefore, the item counting device 100 extracts an item area 210, which is the entire area of ​​the items 10 within the virtual storage space 200. The item area 210 can be extracted by extracting the items 10 from a background image, and the item counting device 100 can extract the item area 210 through simple image processing. Furthermore, since the virtual storage space 200 is a space designed to accommodate the items 10 lined up, among the feature amounts of the detected item area 210, a feature amount (first feature amount) that is larger than the feature amount (second feature amount) of one item 10 will be proportional to the number of items 10 lined up. Therefore, the identification unit 155 can easily count the number of items 10 without performing complex processing by calculating a value obtained by dividing the first feature amount by the second feature amount.

[0062] Furthermore, since the number of articles 10 is a natural number, the article counting device 100 may, for example, divide the first feature amount by the second feature amount and round the result to the nearest natural number. In other words, even if the detection of the feature amount (first feature amount) of the article area 210 has an error of less than half the feature amount (second feature amount) of the article 10, the article counting device 100 can calculate the correct number of articles 10. In this way, the article counting device 100 can accurately count the number of articles 10 even if an error occurs in the detection of the article area 210.

[0063] As described above, the article counting device 100 extracts the article area 210 within the virtual storage space 200 and counts the number of articles 10. Therefore, even if, for example, an article similar to the article 10 or an article 10 that does not need to be counted is present outside the virtual storage space 200 in the captured image, the article counting device 100 can accurately count the number of articles 10 without affecting the counting results. The operation flow of such an article counting device 100 will now be described.

[0064] <Example of Operation Flow of the Item Counting Device 100> 5 shows an example of the operation flow of the article counting device 100 according to this embodiment. First, the imaging device 110 captures an image of the article 10 and the article code 20 corresponding to the article (S10). Next, the code acquisition unit 151 acquires the image captured by the imaging device 110 and acquires information indicated by the article code (S11).

[0065] Next, the information acquisition unit 153 acquires storage space information associated with the item code 20 from the first storage device 30 (S12). Next, the information acquisition unit 153 acquires item information associated with the item code 20 from the second storage device 40 (S13). Note that the order of acquiring the storage space information and the item information may be reversed, or they may be performed almost simultaneously.

[0066] Next, the detection unit 154 associates the captured image with the three-dimensional space (S14). Next, the detection unit 154 identifies the range of the virtual storage space 200 in the associated three-dimensional space (S15). Next, the detection unit 154 detects the item area 210 occupied by the item 10 in the virtual storage space 200 (S16).

[0067] Next, the identification unit 155 identifies the number of items 10 present in the virtual storage space 200 according to the first feature amount corresponding to the size of the item area 210 and the second feature amount corresponding to the size of the items 10 indicated by the item information (S17). By executing the above operation flow, the item counting device 100 can count the number of items 10.

[0068] <Other configuration examples> In the above-described article counting device 100 according to the present embodiment, the virtual storage space 200 is located at the location where the articles 10 are located in real space, but this is not limited to this. Alternatively, the article counting device 100 may use the storage space of a storage case that stores the articles 10 installed in real space as the virtual storage space 200.

[0069] FIG. 6 shows an example of a storage case 60 in real space that stores an item 10 according to this embodiment. The storage case 60 is a case that can store a predetermined number of items 10. FIG. 6(A) shows an example in which three items 10 are stored in the storage case 60. FIG. 6(B) shows an example in which an image of the items 10 and item codes 20 stored in the storage case 60 is displayed on the display unit 140. A portion of the virtual storage space 200 that coincides with the storage space of the storage case 60 is shaded by the storage case 60.

[0070] When an item 10 is stored in such a storage case 60, part of the virtual storage space 200 is hidden by the storage case 60 and cannot be extracted as the item area 210. However, since the storage case 60 is formed to match the size of the item 10, if the part of the item area 210 that occupies the storage case 60 can be detected, the entire item area 210 can be predicted.

[0071] 6, for example, it can be determined that the virtual storage space is filled with items 10 up to the height limit where the item region 210 is detected. Similarly, it can be determined that the virtual storage space is filled with items 10 up to the height limit where at least a portion of the width or depth of the item region 210 is detected on the upper surface that is not shaded by the storage case 60.

[0072] 6, for example, by detecting a depth Y1 on the upper surface of the virtual storage space that is not shaded by the storage case 60, it can be determined that the item area 210 is up to Y1 of the depth Y0 of the virtual storage space 200. Therefore, the identification unit 155 can identify the number of items 10 by dividing Y0 by the depth value of the items 10.

[0073] Alternatively, the identification unit 155 may identify the number of articles 10 by comparing images. For example, the storage unit 130 stores n images of a storage case 60 capable of storing n articles 10, including an image of one article 10 stored therein, an image of two articles 10 stored therein, ..., an image of n articles 10 stored therein. The identification unit 155 compares the captured image with each of the n images, and identifies the number of articles 10 in the image that is closest to the captured image as the number of articles 10. In this case, the article counting device 100 can also identify the number of articles 10 without performing complex image processing.

[0074] The above description has been given of an example in which the item counting device 100 according to the present embodiment detects the item region 210 based on the extraction result obtained by extracting the item region 210 from a captured image through image processing, but the present invention is not limited to this. The item counting device 100 may further include a distance measurement device, and may detect the item region 210 based on the measurement result of the distance measurement device.

[0075] The distance measurement device irradiates the article 10 or the like with visible light, near-infrared light, infrared light, or the like, and measures the distance from the article counting device 100 (portable terminal 50) to a measurement target such as the article 10. The distance measurement device measures multiple distances from the portable terminal 50 to multiple positions on the article 10, thereby making it possible to measure the external shape of the article 10. For example, if multiple articles 10 are stacked, it is possible to measure the article area 210 occupied by the multiple articles 10.

[0076] The distance measurement device can measure the item area 210 in real space. The distance measurement device may also measure an area other than the item area 210. In this case, the distance measurement device can identify a three-dimensional space corresponding to the captured image. Furthermore, since the distance measurement device can three-dimensionally measure the item area 210 and the periphery of the item area 210, the item counting device 100 does not need to detect the item area 210 based on the captured image. Therefore, in this case, it is sufficient that the item code 20 is merely captured in the captured image.

[0077] For example, in the operation flow shown in Fig. 5, in step S14, the distance measurement device measures the item area 210 and the periphery of the item area 210 in three dimensions to identify the item area 210 and the three-dimensional coordinates of the item area 210. Then, in step S15, the detection unit 154 identifies the range of the virtual storage space 200 in three-dimensional space (S15). Note that because the distance measurement device measures the three-dimensional coordinates of the item area 210, step S16 can be omitted. The above distance measurement device is a known technology, for example, LiDAR (Light Detection And Ranging) technology, and therefore a detailed description thereof will be omitted.

[0078] In the above-described article counting device 100 according to the present embodiment, an example has been described in which the identification unit 155 identifies the number of articles 10, but the present invention is not limited to this. In addition, the identification unit 155 may compare the number of articles 10 with a predetermined number to determine whether the number is the same. The predetermined number may be a number determined in advance, or alternatively, may be stored in the memory unit 130 as the inventory number of articles 10.

[0079] For example, the information acquisition unit 153 further acquires information on the inventory quantity from the storage unit 130, which stores information on the inventory quantity of the items 10. The information acquisition unit 153 may acquire information on the inventory quantity from an external storage device, an external inventory management system, or the like via a network or the like, and store the information in the storage unit 130. The identification unit 155 then determines whether the number of items 10 is the inventory quantity. The display control unit 152 may display the determination result on the display unit 140. The control unit 150 may also store the determination result in an external storage device, or may notify the external inventory management system, or the like, of the determination result.

[0080] If the number of items 10 identified by the identification unit 155 does not match the inventory quantity, the display control unit 152 may superimpose the number of items 10 on the captured image in a display format different from the display format used to display the number of items 10 on the display unit 140 when the number of items 10 matches the inventory quantity. For example, if the number of items 10 identified by the identification unit 155 does not match the inventory quantity, the display control unit 152 may display the number of items 10 using characters of a predetermined color, larger-sized characters, predetermined decorative characters, blinking characters, or the like. The display control unit 152 may also display the number of items 10 together with a predetermined sound. This allows the user of the item counting device 100 to easily understand that the counting result of the items 10 does not match the inventory quantity.

[0081] If the number of items 10 identified by the identification unit 155 does not match the inventory quantity, the display control unit 152 may superimpose a message indicating that the number of items 10 does not match the inventory quantity on the captured image. For example, the display control unit 152 superimposes a message such as "The number of items is N in excess of the inventory quantity" or "The number of items is M in excess of the inventory quantity" on the captured image. This allows the user of the item counting device 100 to easily understand whether the count result of the items 10 is in excess of or insufficient to the inventory quantity.

[0082] Alternatively, or in addition, when the number of items 10 identified by the identification unit 155 does not match the inventory quantity, the display control unit 152 may superimpose the virtual storage space 200 on the captured image in a display format different from the display format used to display the virtual storage space 200 on the display unit 140 when the number of items 10 matches the inventory quantity. For example, when the number of items 10 identified by the identification unit 155 does not match the inventory quantity, the display control unit 152 displays the virtual storage space 200 with decoration such as a predetermined color or flashing. Furthermore, the display control unit 152 may display the virtual storage space 200 together with a predetermined sound. This allows the user of the item counting device 100 to easily understand that the counting result of the items 10 does not match the inventory quantity.

[0083] The above description has been given of an example in which the article counting device 100 according to this embodiment detects the article area 210 present in the virtual storage space 200 and determines the number of articles 10, but the present invention is not limited to this. Alternatively, the article counting device 100 may determine that the article area 210 present in the virtual storage space 200 contains an article 10, and then detect the article area 210.

[0084] For example, the storage unit 130 further stores information about a characteristic image that indicates the characteristics of the article 10. The characteristic image may be an image or a partial image of a characteristic point of the article 10, or may be an image of at least a part of a mark, pattern, color, or the like attached to the article 10. The information acquisition unit 153 further acquires such information about the characteristic image from the storage unit 130.

[0085] The identification unit 155 then identifies the number of items 10 on the condition that at least one characteristic image is included in the item area 210 detected by the detection unit 154 in the captured image. The identification unit 155 can easily determine whether or not a characteristic image is included in the item area 210 by image comparison or the like. In this way, the item counting device 100 identifies that the item area 210 includes an item 10 before identifying the number of items, thereby reducing erroneous detections due to the location of other objects in the virtual storage space 200.

[0086] The above description has been given of an example in which the item counting device 100 according to this embodiment acquires information on the item code 20 and then acquires storage space information and item information associated with the item code 20, but the present invention is not limited to this. For example, the storage space information may be stored in the first storage device 30 in association with a predetermined position or area, and the information acquisition unit 153 may acquire the storage space information in response to detecting the predetermined position or area.

[0087] The control unit 150 detects a predetermined position or area, for example, by comparing the captured image with a specified image, analyzing the captured image, or the like. This allows the information acquisition unit 153 to acquire storage space information without using the item code 20. The control unit 150 may also detect a predetermined position or area from the position of the imaging device 110, the direction in which the imaging device 110 is facing, and the measurement results of the three-dimensional space around the item 10 by a distance measurement device. This allows the information acquisition unit 153 to acquire storage space information without using the item code 20 or the captured image. In other words, the item counting device 100 can acquire storage space information without using information from the item code 20.

[0088] Alternatively, or in addition, the item counting device 100 may acquire the item information without using information on the item code 20. The control unit 150 may identify the item 10 in the captured image, for example, by comparing the captured image with an image of a predetermined item, or by image analysis of the captured image. Here, the item information may be associated with the predetermined item and stored in the first storage device 30, and the information acquisition unit 153 can acquire the item information in response to the control unit 150 detecting the predetermined item 10.

[0089] Furthermore, the control unit 150 may extract a slip, a parts list, a display label, etc. of the item 10 captured in the captured image to identify the item 10. The control unit 150 acquires information such as the name of the item 10 written on a slip, etc., using, for example, image comparison, image analysis, character conversion processing, etc. Here, the item information may be stored in the first storage device 30 in association with the name, etc. of the item 10, and the information acquisition unit 153 can acquire the item information in response to the control unit 150 detecting the name, etc. of the item 10.

[0090] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0091] 10 Goods 20 Item Code 30 1st storage device 40 2nd storage device 50 Mobile Devices 60 Storage Case 100 Item counting device 110 Imaging device 120 Communications Department 130 Storage section 140 Display section 150 control section 151 Code Acquisition Department 152 Display control unit 153 Information Acquisition Department 154 Detector 155 Specific part 200 Virtual Containment Space 210 Goods area

Claims

1. an information acquisition unit that acquires storage space information related to the size of a virtual storage space in which an item is stored in a three-dimensional space, and item information related to the size of the item; a detection unit that detects item space information related to the size of an area occupied by the item in the virtual storage space; an identification unit that identifies the number of the items present in the virtual storage space according to a first feature amount corresponding to the item space information and a second feature amount corresponding to the item information; An article counting device comprising:

2. a code acquisition unit that acquires information about the product code from a captured image of the product code corresponding to the product; the information acquisition unit acquires the storage space information associated with the acquired item code. The article counting device according to claim 1.

3. a code acquisition unit that acquires information about the product code from a captured image of the product code corresponding to the product; the information acquisition unit acquires the product information associated with the acquired product code. The article counting device according to claim 1.

4. a code acquisition unit that acquires information about the product code from a captured image of the product code corresponding to the product; the information acquisition unit acquires the storage space information and the item information associated with the acquired item code. The article counting device according to claim 1.

5. The detection unit sets a value obtained by multiplying the virtual storage space by a filling rate at which the items are filled as the item space information. The article counting device according to claim 1.

6. the identification unit determines at least one of one-dimensional (length), two-dimensional (area), and three-dimensional (volume) parameters of the area occupied by the article as the first feature amount, determines the parameter corresponding to the first feature amount among the one-dimensional, two-dimensional, and three-dimensional parameters of the article as the second feature amount, and identifies the number of the articles based on a number obtained by dividing the first feature amount by the second feature amount. The article counting device according to claim 1.

7. the storage space information includes information indicating the size of the virtual storage space and information indicating the position of the virtual storage space based on the display position of the product code, the detection unit specifies the range of the virtual storage space based on the size and position of the virtual storage space; 3. The article counting device according to claim 2.

8. The storage space information includes information related to the size of a storage space of a storage case that stores the item and is installed in real space. The article counting device according to claim 1.

9. The detection unit detects the item spatial information based on a measurement result of a distance measurement device that measures a distance from the item counting device to the item. The article counting device according to claim 1.

10. the code acquisition unit acquires information about the product code from the captured image of the product and the product code; the detection unit detects the item spatial information based on an extraction result obtained by extracting an area occupied by the item from the captured image by image processing; 3. The article counting device according to claim 2.

11. Further, a display control unit is provided that displays the captured image of the article on a display unit, the display control unit causes the display unit to display an image showing the virtual accommodation space superimposed on the captured image. The article counting device according to claim 1.

12. the display control unit displays the number of the items identified by the identification unit in a manner superimposed on the captured image; The article counting device according to claim 11.

13. the information acquisition unit further acquires information on the inventory quantity from a storage unit that stores information on the inventory quantity of the item; when the number of the items identified by the identification unit does not match the inventory quantity, the display control unit displays a display indicating that the number of the items does not match the inventory quantity superimposed on the captured image.

13. The article counting device according to claim 12.

14. the information acquisition unit further acquires information on the inventory quantity from a storage unit that stores information on the inventory quantity of the item; when the number of the items identified by the identification unit does not match the inventory quantity, the display control unit displays the number of the items superimposed on the captured image in a display format different from a display format for displaying the number of the items on the display unit when the number of the items matches the inventory quantity; 13. The article counting device according to claim 12.

15. the information acquisition unit further acquires information on the inventory quantity from a storage unit that stores information on the inventory quantity of the item; when the number of the items identified by the identification unit does not match the inventory quantity, the display control unit displays the virtual storage space superimposed on the captured image in a display format different from a display format for displaying the virtual storage space on the display unit when the number of the items matches the inventory quantity.

13. The article counting device according to claim 12.

16. The information acquisition unit further acquires information on a characteristic image that indicates a characteristic of the article, the identification unit identifies the number of the articles on the condition that the article space information detected by the detection unit includes at least one of the feature images in the captured image.

3. The article counting device according to claim 2.

17. An article counting system for counting the number of articles, a first storage device that stores the storage space information in association with an item code; a second storage device that stores the product information in association with the product code; an imaging device that captures an image including the product code; The article counting device according to any one of claims 1 to 16, wherein the captured image is acquired and the number of articles included in the captured image is identified using the storage space information and the article information; An article counting system comprising:

18. An article counting system for counting the number of articles, a first storage device that stores the accommodation space information; a second storage device that stores the product information; an imaging device that captures an image including the item; The article counting device according to any one of claims 1 to 16, wherein the number of articles included in the captured image is identified using the storage space information and the article information based on the captured image; An article counting system comprising:

19. 1. A computer-implemented item counting method for counting the number of items, comprising: acquiring storage space information relating to the size of a virtual storage space in which an item is stored in a three-dimensional space, and item information relating to the size of the item; detecting item space information relating to the size of the area occupied by the item in the virtual storage space; Identifying the number of the items present in the virtual storage space according to a first feature amount corresponding to the item space information and a second feature amount corresponding to the item information; An article counting method comprising:

20. A program that, when executed by a computer, causes the computer to function as the article counting device according to any one of claims 1 to 16.

Images