Programs, management methods, management devices, and management systems

Abstract

In an inventory management system for managing the inventory of goods, the system aims to easily grasp the registration status of goods in inventory information, enabling prompt inventory management. [Solution] A program that causes a computer to function as a management device, the management device comprising: an information acquisition unit that acquires inventory information including registered image information, inventory quantity and item name of a registered item, captured image information of a target item, a similarity information acquisition unit that acquires information of registered items similar to the characteristics of the target item as item candidate information, based on the result of comparing the captured image information and the registered image information, and a display control unit that displays the captured image information, the item candidate information, a first registration button associated with the item candidate information, and a second registration button on a display unit.

Description

Technical Field

[0001] The present invention relates to a program, a management method, a management device, and a management system for managing the inventory of articles.

Background Art

[0002] An inventory management system for managing the inventory of articles such as products, parts, and materials is known (for example, see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional inventory management systems have independently executed operations such as registering article information in inventory information, shipping articles registered in inventory information, receiving articles registered in inventory information, and checking articles registered in inventory information. In this case, for example, when registering article information in inventory information, when shipping or receiving articles, the operation may proceed without knowing whether the article has already been registered, and it may take time to manage the inventory of articles.

[0005] Therefore, the present invention has been made in view of these points, and an object of the present invention is to enable easy grasping of the registration status of article inventory information in an inventory management system for managing article inventory and to quickly perform article inventory management.

Means for Solving the Problems

[0006] In a first aspect of the present invention, a program is provided which, when executed by a computer, causes the computer to function as a management device, wherein the management device includes: an information acquisition unit that acquires registered image information including the appearance of a plurality of registered articles, inventory information including the number of items in stock and the name of the articles, and captured image information of an article; a similarity information acquisition unit that acquires information of registered articles similar to the characteristics of the article, identified based on the result of comparing the captured image information and the registered image information, as article candidate information; a display control unit that displays the captured image information, the article candidate information, a first registration button associated with the article candidate information, and a second registration button different from the first registration button on a display unit; and an inventory information control unit that starts the registration of the article in the inventory information in response to the selection of either the first registration button or the second registration button.

[0007] The inventory information control unit may, when the first registration button is selected, initiate a process to update the inventory information with the target item as the registered item, and when the second registration button is selected, initiate a process to register the target item as a new item.

[0008] The display control unit may display the captured image information, the candidate item information, the first registration button, and the second registration button together on a single screen.

[0009] The information acquisition unit may acquire the captured image information of the target item in response to receiving an operation input for acquiring an image.

[0010] The display control unit may cause the display unit to display a moving image of the target item, and the information acquisition unit may acquire the captured image information of the target item after a predetermined time has elapsed while the moving image is displayed on the display unit.

[0011] The display control unit may display a moving image of the target item on the display unit, and overlay a frame with an area smaller than the area of ​​the screen displaying the moving image onto the moving image. The information acquisition unit may then acquire an image of an object whose presence is recognized within the frame as the captured image information.

[0012] The system further includes a similar information identification unit that extracts features for identifying the target item based on the captured image information, and identifies a name representing the target item as the item name based on the extracted features of the target item. When the second registration button is selected and the registration of the target item to the inventory information is accepted, the display control unit displays an input screen for entering the inventory quantity of the target item along with the item name on the display unit. The inventory information control unit may, upon receiving confirmation of the registration of the target item to the inventory information, add the features of the target item and the inventory quantity of the target item to the inventory information, associating them with the identified item name.

[0013] The inventory information includes information relating the registered image information and inventory quantity of the registered item to the item name of the registered item, and the display control unit displays the item name of the registered item included in the item candidate information on the display unit, and makes it possible to accept selection input of the registered item, and the inventory information control unit may start the operation of receiving, issuing, and / or checking the inventory quantity of the registered item in response to receiving selection input of one registered item.

[0014] The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the comparison result, identifies information of registered articles that are similar to the characteristics of the target article as article candidate information, wherein the similarity information identification unit identifies the degree of similarity between each registered article and the target article and includes it in the article candidate information, and the display control unit displays the information of registered articles included in the article candidate information that have a similarity exceeding a threshold on the display unit in descending order of similarity, and if there are no registered articles with a similarity exceeding the threshold, the article name of the registered article may not be displayed, and the second registration button may be displayed to initiate registration of the target article to the inventory information.

[0015] The inventory information includes information on the storage location of the registered article, the information acquisition unit further acquires location information of the location where the target article was imaged, and the display control unit may, if the similarity of multiple registered articles matches within a predetermined range among the registered articles whose similarity exceeds a threshold, display the names of the multiple registered articles on the display unit in order that their storage location is closest to the location indicated by the location information of the target article.

[0016] The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the results of the comparison, identifies information of registered articles that are similar to the characteristics of the target article as the article candidate information. The similarity information identification unit may identify the degree of similarity between each registered article and the target article and include it in the article candidate information. The system may also extract one or more features from the captured image information, including shape features including the shape of the target article, character features including information of characters attached to the target article, and code features including information of codes attached to the target article, and identify the degree of similarity between the extracted features and the corresponding features of the registered article.

[0017] The display control unit may display information indicating the features used to determine the similarity of the registered article, among the shape features, character features, and code features, together with the article name of the registered article on the display unit.

[0018] The similar information identification unit extracts one or more features from the shape features, color features, and pattern features of the target article from the captured image information to be used as the shape features, and the inventory information may include setting information that specifies which of the shape features, color features, and pattern features of the target article to use when the similar information identification unit extracts the shape features.

[0019] The similarity information identification unit extracts one or more features from the shape features, character features, and code features with weights, identifies the degree of similarity between the extracted weighted features and the corresponding features of the registered items, and the inventory information may include the weight settings used by the similarity information identification unit.

[0020] The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the results of the comparison, identifies information of registered articles that are similar to the characteristics of the target article as article candidate information. The similarity information identification unit identifies the degree of similarity and a threshold for similarity between each registered article and the target article, and includes these in the article candidate information. The display control unit may display the names of the registered articles included in the article candidate information that have a similarity exceeding the threshold, in descending order of similarity.

[0021] In a second aspect of the present invention, a program is provided which, when executed by a computer, causes the computer to function as a management device, wherein the management device includes: an information acquisition unit that acquires registered character information including the characteristics of a plurality of registered articles, inventory information including the number of articles in stock, and captured image information of an article; a similarity information acquisition unit that acquires information of registered articles similar to the character information of the target article, which is identified based on the result of comparing the character information extracted from the captured image information with the registered character information, as article candidate information; a display control unit that displays the captured image information, the article candidate information, a first registration button associated with the article candidate information, and a second registration button different from the first registration button on a display unit; and an inventory information control unit that starts the registration of the target article to the inventory information in response to the selection of either the first registration button or the second registration button.

[0022] A third aspect of the present invention provides a management method for managing the inventory quantity of articles, which is performed by a computer, comprising the steps of: acquiring registered image information including the appearance of a plurality of registered articles, inventory information including the inventory quantity and article name, and captured image information of a target article; acquiring information of registered articles similar to the characteristics of the target article, which has been identified based on a comparison between the captured image information and the registered image information, as article candidate information; displaying the captured image information, the article candidate information, a first registration button associated with the article candidate information, and a second registration button different from the first registration button on a display unit; and starting the registration of the target article to the inventory information in response to the selection of either the first registration button or the second registration button.

[0023] In a fourth aspect of the present invention, there is provided a management device including: an information acquisition unit that acquires registered image information including the appearances of a plurality of registered articles, inventory information including the inventory quantity and article names, and imaging image information obtained by imaging a target article; a similarity information acquisition unit that acquires, as article candidate information, information on the registered article similar to the characteristics of the target article identified based on a result of comparing the imaging image information with the registered image information; a display control unit that causes a display unit to display the imaging image information, the article candidate information, a first registration button associated with the article candidate information, and a second registration button different from the first registration button; and an inventory information control unit that starts registration of the target article in the inventory information in response to selection of either the first registration button or the second registration button.

[0024] In a fifth aspect of the present invention, there is provided a management system for managing the inventory information of the registered articles, including: a storage device that stores the inventory information; the management device according to the fourth aspect, which acquires the inventory information of the storage device and the imaging image information of the target article and causes the display unit to display the imaging image information, the article candidate information, the first registration button, and the second registration button; and a management server that communicates with the management device and supplies the inventory information to the management device or updates the inventory information of the storage device according to a control signal received from the management device.

Advantages of the Invention

[0025] According to the present invention, in an inventory management system for managing the inventory of articles, it is possible to easily grasp the registration status of articles in the inventory information and promptly perform the inventory management of articles.

Brief Description of the Drawings

[0027] <Example configuration of management system S> Figure 1 shows an example of the configuration of the management system S according to this embodiment. The management system S is a system for managing inventory information of registered items. A user, who is an operator, can, for example, use the management system S to check whether or not a target item 30 is already registered, register a target item 30 that is not yet registered in the inventory information, grasp the inventory information of registered target items 30, or perform issuing or receiving processing for registered target items 30.

[0028] The target items 30 include goods, parts, materials, etc. The management system S is a system that can be used by any company, shop, organization, etc. that manages such target items 30. The management system S comprises a storage device 10, a management server 20, and a management device 100. The storage device 10, the management server 20, and the management device 100 are configured to communicate with each other via a network or the like.

[0029] The storage device 10 stores registered image information, which includes the appearance of multiple registered items, and inventory information, which includes the inventory quantity and item name for each registered item. Registered image information is, for example, information about images taken of registered items. Inventory information is, for example, information in which the registered image information and inventory quantity for each registered item are associated with the item name. The inventory information may also include identification information (ID) for identifying registered items. Furthermore, the inventory information may also include character information that indicates the characteristics of the registered items.

[0030] Furthermore, inventory information may include information about the storage location of the registered goods. Storage location information may, for example, be location information indicating the position of the goods within the storage location where they are kept. Location information may also be location information for the registered goods, specified by latitude and longitude. Location information for registered goods may also include information indicating the height of the registered goods.

[0031] The storage device 10 is a device connected to the management server 20. Alternatively, the storage device 10 may be a database or the like connected to a network. The storage device 10 may also be a storage unit provided in the management device 100. Furthermore, the management server 20 may also include the storage device 10.

[0032] The management server 20 communicates with the management device 100 and manages the inventory information stored in the storage device 10 according to the control signals received from the management device 100. For example, the management server 20 supplies the inventory information stored in the storage device 10 to the management device 100. The management server 20 also updates the inventory information in the storage device 10.

[0033] The management device 100 is a device that receives user input and manages the inventory quantity of the target item 30 according to the user's input. The management device 100 is, for example, a smartphone or tablet. The management device 100 has an imaging device such as a camera and is configured to manage inventory information of the target item 30 using the captured image of the target item 30. In other words, the user can handle inventory information of the target item 30 by taking an image of the target item 30.

[0034] For example, first, the management device 100 takes an image of the target item 30 and acquires image information of the target item 30 (Figure 1(1)). The management device 100 compares the image information with the registered image information of registered items included in the inventory information acquired from the management device 100 (Figure 1(2)) and identifies registered item information similar to the characteristics of the target item 30 as item candidate information (Figure 1(3)). Then, the management device 100 displays the image information, the item candidate information, a first registration button to start the inventory information update process, and a second registration button to start the inventory information registration process on the display unit (Figure 1(4)).

[0035] In this way, the management device 100 displays the image information of the target item 30 and the information of candidate items similar to the characteristics of the target item 30, so that the user can easily grasp the information of registered items similar to the target item 30 included in the inventory information. In other words, when the user manages the inventory information of the target item 30, they can determine whether or not the target item 30 is already registered in the inventory information.

[0036] It is desirable that the management device 100 be configured to accept operational inputs for receiving, issuing, and inventorying a selected registered item when the user selects one of the registered items displayed as candidate item information. This allows the user to quickly perform receiving, issuing, and inventorying of the registered target items 30.

[0037] Furthermore, the management device 100 displays, along with the captured image information and candidate item information, a first registration button and a second registration button for initiating the updating and registration of the inventory information of the target item 30. This allows, for example, if the user determines that the captured image information has not yet been registered for an item to be registered in the inventory information, they can quickly proceed to the inventory information update process. Also, for example, if the user determines that the target item 30 has not yet been registered in the inventory information, they can quickly proceed to the registration process for the target item 30. Such a management device 100 will be described next.

[0038] <Example configuration of the control device 100> Figure 2 shows an example of the configuration of the management device 100 according to this embodiment. The management device 100 is, for example, a mobile terminal, smartphone, tablet, wearable device, portable PC, etc., on which an application for managing the inventory of goods is installed. The management device 100 comprises a communication unit 110, an imaging unit 120, a storage unit 130, a display unit 140, and a control unit 150.

[0039] The communication unit 110 communicates with the management server 20 via a communication network or the like. The communication unit 110 may also communicate with the storage device 10 via a communication network or the like. The communication unit 110 is an interface for connecting to a communication network such as an internet line, wireless LAN, or mobile phone network.

[0040] The imaging unit 120 is an imaging device for capturing still images and moving images. The imaging unit 120 is configured to capture an image displayed on the display unit 140 and output it as captured image information to the storage unit 130, for example, when a user clicks the capture button. In this embodiment, an example in which the captured image information is a still image will be described.

[0041] The storage unit 130 is a storage medium including ROM (Read Only Memory) and RAM (Random Access Memory). The storage unit 130 may also include a large-capacity storage device such as an HDD (Hard Disk Drive) and / or an SSD (Solid State Drive). For example, if the computer functions as a management device 100, the storage unit 130 may store information such as the OS (Operating System) and programs that enable the computer to function. Furthermore, the storage unit 130 may store various types of information, including databases referenced during program execution.

[0042] Furthermore, the storage unit 130 may store intermediate data, calculation results, thresholds, reference values, and parameters generated (or used) by the management device 100 during its operation. The storage unit 130 may also supply the stored data to the requesting party in response to requests from various parts within the management device 100.

[0043] The display unit 140 displays information such as the target item 30 and registered items. The display unit 140 may also display captured images, etc., taken by the imaging unit 120. It is desirable that the display unit 140 also functions as a display for showing the communication status of the management device 100, the OS, the execution status of applications, etc.

[0044] The display unit 140 may have touch panel functionality and operate as the input unit 141 of the management device 100. The input unit 141 receives operations, instructions, etc., from the user of the management device 100. The input unit 141 may include separate input devices, buttons, switches, etc., from the display unit 140.

[0045] The control unit 150 controls each part of the management device 100. For example, the control unit 150 exchanges various information via the communication unit 110. The control unit 150 is, for example, a CPU (Central Processing Unit). The control unit 150 has a reception unit 151, an information acquisition unit 152, a similar information identification unit 153, a similar information acquisition unit 154, a display control unit 155, and an inventory information control unit 156. In other words, the CPU functions as a control unit 150 having a reception unit 151, an information acquisition unit 152, a similar information identification unit 153, a similar information acquisition unit 154, a display control unit 155, and an inventory information control unit 156 by executing a program stored in the storage unit 130.

[0046] The reception unit 151 receives user input entered by the user operating the input unit 141. For example, the reception unit 151 receives operation input from the user of the capture button to take an image of the target item 30. The reception unit 151 may also receive operation input from the start button to register the target item 30. Operation input may be, for example, touching or clicking the location where the button is displayed.

[0047] The information acquisition unit 152 acquires inventory information of registered items from the storage device 10. The information acquisition unit 152 transmits a predetermined control signal to the management server 20 via the communication unit 110, for example. As a result, the information acquisition unit 152 acquires the inventory information of registered items returned from the management server 20. Alternatively, the information acquisition unit 152 may directly access the storage device 10 via the communication unit 110 to acquire the inventory information of registered items. The information acquisition unit 152 may also receive various information from the management server 20.

[0048] Furthermore, the information acquisition unit 152 acquires image information of the target item 30 captured by the imaging unit 120 from the imaging unit 120 or the storage unit 130. For example, the control unit 150 controls the imaging unit 120 to capture a still image of the target item 30 in response to the reception unit 151 receiving user input for image acquisition. The information acquisition unit 152 then acquires the image information of the captured image of the target item 30.

[0049] Alternatively, the information acquisition unit 152 may acquire captured image information of the target item 30 taken by the imaging unit 120 when the display unit 140 is displaying a moving image of the target item 30 and a predetermined amount of time has elapsed while the moving image remains displayed on the display unit 140. In this case, for example, the imaging unit 120 performs a continuous imaging operation to capture still images of the target item 30 at predetermined intervals in response to user input. For example, by sequentially capturing moving images of multiple target items 30, the information acquisition unit 152 can sequentially acquire captured image information of multiple target items 30.

[0050] The similarity information identification unit 153 extracts information on one or more registered articles that are similar to the characteristics of the target article 30 from the inventory information, based on the result of comparing the captured image information with the registered image information. The similarity information identification unit 153 identifies the extracted information on one or more registered articles as article candidate information. The similarity information identification unit 153 identifies the article candidate information, for example, by comparing each of the registered image information with the captured image information. In this embodiment, an example is described in which the similarity information identification unit 153 identifies article candidate information from the result of comparing the characteristics of registered articles based on the registered image information with the characteristics of the target article 30 based on the captured image information.

[0051] The candidate item information is the result of extracting items similar to the target item 30. Therefore, if the target item 30 is already registered, the image information captured when the target item 30 was previously registered will be included in the candidate item information as registered image information. In other words, the candidate item information may include registered items that match the target item 30 among the registered items registered as inventory information.

[0052] The similar information acquisition unit 154 acquires the item candidate information identified by the similar information identification unit 153 and supplies it to the inventory information control unit 156. The similar information acquisition unit 154 may also acquire the item candidate information from the management server 20. The configuration in which the control unit 150 acquires item candidate information from the management server 20 will be described later.

[0053] The display control unit 155 controls the display unit 140 to display information, etc. on the display unit 140. For example, the display control unit 155 displays an input screen for the user to input tasks to be performed. The display control unit 155 also displays moving images, still images, etc., of the target object 30, etc., captured by the imaging unit 120 on the display unit 140.

[0054] The display control unit 155 controls the display unit 140 to display the captured image information, the item candidate information, a first registration button associated with the item candidate information, and a second registration button different from the first registration button on the display unit 140. The first registration button is a button for executing the process of updating the registered items in the inventory information. The second registration button is a button for executing the process of registering the target item 30 in the inventory information. It is desirable for the display control unit 155 to display the captured image information, the item candidate information, the first registration button, and the second registration button together on a single screen.

[0055] Figure 3 shows an example in which the display control unit 155 according to this embodiment displays captured image information 201, item candidate information 202, a first registration button 203, and a second registration button 204 on the display unit 140. Figure 3 shows an example in which captured image information 201 of a canned beverage with the words "Melon Juice" is displayed on the display unit 140. Figure 3 also shows an example in which the registered image information 205 and item names of three registered items are displayed. The item names of the three registered items are "Melon Juice," "Pineapple Juice," and "XY Coffee."

[0056] It is desirable for the display control unit 155 to reduce the display area of ​​the captured image information 201 and the registered image information 205. It is also desirable for the display control unit 155 to display the first registration button 203 corresponding to the registered item adjacent to the position where the item name of the registered item is displayed. Figure 3 shows an example in which the display control unit 155 displays three first registration buttons 203 corresponding to three registered items, adjacent to the display position of each registered item.

[0057] The user can easily identify registered items that match the target item 30 because the item name and registered image information 205 of the registered items included in the item candidate information 202 are displayed. In the example in Figure 3, for example, it is easy to see that the target item 30, "Melon Juice," is already registered in the inventory information. In this way, by taking an image of the target item 30, the user can easily determine whether or not the target item 30 is already registered in the inventory information.

[0058] For example, consider a situation where a user is registering multiple target items 30 into the inventory information. If the user determines that a target item 30 is already registered in the inventory information, they can interrupt the registration process and quickly move on to registering the next target item 30. Also, if the user determines that a target item 30 is not yet registered in the inventory information, they can quickly begin registering that item 30.

[0059] The inventory information control unit 156 starts registering the target item 30 in the inventory information depending on whether either the first registration button 203 or the second registration button 204 is selected. The first registration button 203 is a button for updating registered items. It is desirable that the first registration button 203 be displayed for each registered item.

[0060] For example, the reception unit 151 receives confirmation that the user has selected the first registration button 203 corresponding to a registration item when the user clicks the first registration button 203 adjacent to a registration item. The reception unit 151 also receives confirmation that the user has selected the second registration button 204 when the user clicks the second registration button 204.

[0061] When the first registration button 203 is selected, the inventory information control unit 156 starts the process of updating the inventory information of the target item 30 as a registered item. For example, when the first registration button 203 corresponding to a registered item "melon juice" is selected, the inventory information control unit 156 updates the captured image information 201 of the target item 30 displayed on the display unit 140 as the registered image information of the inventory information of that registered item "melon juice". The inventory information control unit 156 may also update the information of features identified based on the captured image information of the target item 30.

[0062] In this case, the inventory information control unit 156 adds the captured image information of the target item 30 to the inventory information of that registered item as registered image information. Alternatively, the inventory information control unit 156 may update the captured image information of the target item 30 as new registered image information in place of the registered image information 205 in the inventory information of that registered item.

[0063] When the second registration button 204 is selected, the inventory information control unit 156 starts the process of registering the target item 30 as a new item. The second registration button 204 is a button for registering the target item 30 as a new item. The process of registering the target item 30 will be described later.

[0064] As described above, if the user determines that the image information of the target item 30 is not registered in the inventory information of the registered item, they can quickly update the inventory information of the registered item by selecting the first registration button 203. Also, if the user determines that the target item 30 itself is not registered in the inventory information, they can quickly register the target item 30 as a new item in the inventory information by selecting the second registration button 204.

[0065] According to the management system S of this embodiment described above, the user can easily determine whether or not the target item 30 has already been registered in the inventory information by imaging the target item 30 with the management device 100, and efficiently proceed with updating and registering the inventory information. The specific operation of such a management system S will be described next.

[0066] <Example 1 of the operation flow of management system S> Figure 4 shows a first example of the operation flow of the management system S according to this embodiment. The user manages the target items 30 by running the application software installed on the management device 100. The storage device 10 stores inventory information. The inventory information is such that the registered image information and inventory quantity of the registered items are associated with the item name of the registered item.

[0067] First, the imaging unit 120 starts capturing video (S51). For example, it is desirable for the display unit 140 to display the video captured by the imaging unit 120 in near real-time. Then, the information acquisition unit 152 acquires captured image information of the target item 30 in response to the reception unit 151 receiving an operation input to acquire a still image (S52).

[0068] As a result, for example, in S51, the user can start imaging the target item 30 using the management device 100. Then, after confirming that the target item 30 is in the field of view of the imaging unit 120, the user can touch the shutter button or the like to capture a still image of the target item 30.

[0069] In addition, in S51, the display control unit 155 may display a moving image of the target item 30 on the display unit 140, while also displaying a frame with an area smaller than the area of ​​the screen displaying the moving image superimposed on the moving image. This allows the user to understand the area necessary to properly capture the target item 30.

[0070] The user, for example, moves the management device 100 or performs operations such as zooming so that most of the target item 30 is displayed within the displayed frame, thereby imaging the target item 30. The imaging unit 120 then captures a still image of the target item 30, including the area outside the frame. This makes it easier to capture the entire target item 30 in the still image captured by the imaging unit 120.

[0071] Then, in S52, the information acquisition unit 152 acquires an image of the object whose presence is recognized inside the frame as captured image information. For example, the information acquisition unit 152 identifies the object inside the frame, separated from the background, as the target article 30 in a moving or still image captured by the imaging unit 120. The information acquisition unit 152 may also crop the image of the target article 30 identified from the still image and use it as captured image information. It is desirable for the information acquisition unit 152 to acquire captured image information of the target article 30 including the area outside the frame displayed by the display unit 140. This makes it easier for the information acquisition unit 152 to acquire an image of the entire target article 30 as captured image information.

[0072] Next, the similarity information identification unit 153 extracts features for identifying the target article 30 based on the captured image information (S53). For example, the similarity information identification unit 153 extracts one or more features from the captured image information, including shape features including the shape of the target article 30, character features including information about characters attached to the target article 30, and code features including information about codes attached to the target article 30.

[0073] Shape features are the external characteristics of the target item 30. The similarity information identification unit 153 extracts one or more features from the shape features, color features, and pattern features of the target item 30 from the captured image information to determine the shape features. In this case, the inventory information may include setting information that specifies which of the shape features, color features, and pattern features of the target item 30 to use when the similarity information identification unit 153 extracts the shape features. The similarity information identification unit 153 extracts the shape features of the target item 30 using the features corresponding to the setting information.

[0074] Textual features are characteristics such as letters and marks attached to the item 30. Examples of textual features include product name, manufacturer name, brand name, and creator name. Code features are barcodes, two-dimensional codes, etc., attached to the item 30. Code features may also be information indicated by barcodes, two-dimensional codes, etc. Such code features are often information related to the item 30 and may be more useful than textual features for identifying the item 30.

[0075] Next, the information acquisition unit 152 acquires inventory information of registered items similar to the characteristics of the target item 30. The information acquisition unit 152 generates a control signal to request inventory information, for example. The information acquisition unit 152 generates a control signal that includes information on the characteristics of the target item 30 identified by the similarity information identification unit 153. Then, the information acquisition unit 152 transmits the generated control signal to the management server 20 via the communication unit 110 (S54).

[0076] In response to receiving a control signal transmitted from the communication unit 110, the management server 20 searches the storage device 10 and extracts registered items similar to the characteristics of the target item 30 (S55). Here, the management server 20 searches for and extracts registered items that match a predetermined number or more of the characteristics of the target item 30. The predetermined number is, for example, information that has been previously registered in the management server 20. Alternatively, the predetermined number may be registered in the management device 100. In this case, in S54, the information acquisition unit 152 transmits a control signal to the management server 20 that includes information on the characteristics of the target item 30 and the predetermined number of items.

[0077] The management server 20 transmits the inventory information of the extracted registered items to the management device 100 (S56). The similar information identification unit 153 identifies registered items that are similar to the characteristics of the target item 30 acquired by the information acquisition unit 152 as item candidate information (S57). As a result, the similar information acquisition unit 154 acquires the item candidate information identified by the similar information identification unit 153 (S58).

[0078] Next, the display control unit 155 displays the captured image information, the item candidate information, the first registration button associated with the item candidate information, and the second registration button on the display unit 140 (S59). An example of the display control unit 155 displaying the captured image information, the item candidate information, the first registration button, and the second registration button on the display unit 140 is illustrated in Figure 3.

[0079] Furthermore, if the item candidate information includes information on multiple registered items, it is desirable for the display control unit 155 to display the multiple registered items in a predetermined order. The predetermined order may be, for example, alphabetical order of item names, or order of registration dates from oldest to newest. It is also desirable that the predetermined order be in descending order of similarity between the registered items and the target items 30.

[0080] Here, the degree of similarity between the registered article and the target article 30 is determined by the similarity information identification unit 153. In S57, the similarity information identification unit 153 determines the degree of similarity between the registered article and the target article 30 for each registered article. For example, in S53, the similarity information identification unit 153 determines the degree of similarity between the features extracted to identify the target article 30 and the corresponding features of the registered article. The similarity information identification unit 153 may determine the degree of similarity by comparing the features of the target article 30 with the corresponding features of the registered article, or it may determine the degree of similarity according to the number of features of the registered article that match the features of the target article 30.

[0081] The similarity information identification unit 153 identifies the degree of similarity between each registered item and the target item and includes it in the item candidate information. As a result, in S59, the display control unit 155 can display multiple registered items in descending order of similarity. Figure 3 shows an example in which the item names of three registered items, "Melon Juice," "Pineapple Juice," and "XY Coffee," are displayed on the display unit 140 from top to bottom in descending order of similarity.

[0082] Furthermore, when determining similarity using multiple features, the type of feature can sometimes lead to a more accurate determination of similarity. For example, shape features may result in a high similarity rating even for different items if they share the same shape, color, pattern, etc. In the example in Figure 3, the shapes of the registered items shown in the three registered image information 205 are all cylindrical, and there is almost no difference in the similarity of the shape features.

[0083] In contrast, since character features are the characters attached to the target item 30, they are highly likely to be features related to the target item 30. Therefore, such character features are sometimes more likely to be features that identify the target item 30 than shape features. For example, in the example in Figure 3, if the character features of the three registered items are different, such as "melon juice," "pineapple juice," and "XY coffee," then there will be a difference in the degree of similarity with the character feature "melon juice" of the target item 30.

[0084] Furthermore, code features are often information directly related to the target item 30, and are more likely to be features that identify the target item 30 than character features. Therefore, the similarity information identification unit 153 may identify the similarity by assigning different weights to each feature. In this case, the similarity information identification unit 153 extracts one or more features from the shape features, character features, and code features, assigning weights to them, and identifies the similarity between the extracted weighted features and the corresponding features of the registered item.

[0085] For example, the similarity information identification unit 153 uses a value greater than the weight of the shape feature as the weight of the character feature. Furthermore, the similarity information identification unit 153 uses a value greater than the weight of the character feature as the weight of the code feature. It is desirable that the inventory information includes the weight settings used by the similarity information identification unit 153. This allows the display control unit 155 to accurately display multiple registered items in order of similarity in S59.

[0086] The display control unit 155 may display information on the display unit 140, along with the name of the registered item, indicating the features used to determine the similarity of the registered item, among the shape features, character features, and code features. This allows the user to quickly recognize which features of the target item 30 and the registered item are similar.

[0087] Furthermore, if the number of registered items is large or the similarity of the registered items is low, the item candidate information may not be meaningful to the user. Therefore, the display control unit 155 may display the names of registered items included in the item candidate information that have a similarity level exceeding a threshold on the display unit 140 in descending order of similarity. In this case, the display control unit 155 does not need to display the names of registered items with a similarity level below the threshold. The threshold is, for example, information that has been registered in advance in the management server 20 or management device 100. This allows the display control unit 155 to display item candidate information that is more meaningful to the user.

[0088] Furthermore, depending on the target item 30, there may be many or few similar registered items. For example, plain white tableware, monitors, mobile phones, etc., may have many similar registered items. Also, products with relatively low circulation volumes, newly developed products, etc., may have few similar registered items. In such cases, the similarity information identification unit 153 may identify the degree of similarity between the registered item and the target item, as well as the similarity threshold, for each registered item.

[0089] For example, a relatively large similarity threshold is set for registered items that have many similar items. Conversely, a smaller similarity threshold is set for registered items that have few similar items than for registered items that have many similar items. The threshold for each registered item is, for example, information that has been pre-registered in the management server 20 or management device 100.

[0090] Furthermore, the display control unit 155 may change the similarity threshold for each registered item so that the number of registered items displayed on the display unit 140 as item candidate information becomes a predetermined number. As a result, the display control unit 155 can display a more appropriate number of registered items on the display unit 140 as item candidate information.

[0091] In this case, there may be no registered items among the candidate item information that have a similarity exceeding the threshold. In this case, the target item 30 is highly likely to be an item that should be registered in the inventory information as a new item. Therefore, if there are no registered items with a similarity exceeding the threshold, the display control unit 155 may display a second registration button 204 to start registering the target item 30 to the inventory information without displaying the item name of the registered item. The display control unit 155 may also choose not to display the first registration button 203. This allows the user to quickly determine that the target item 30 is an unregistered item.

[0092] Next, the inventory information control unit 156 controls the inventory information in response to the user's operation input received by the reception unit 151 (S60). For example, the inventory information control unit 156 starts registering the target item 30 to the inventory information in response to the selection of either the first registration button 203 or the second registration button 204. The specific operation of S60 will be described later. The control unit 150 terminates the item management operation when the user terminates the application operation (S61: Yes).

[0093] If the user wishes to continue operating the application (S61: No), the control unit 150 returns to S51 and continues the item management operation. For example, the control unit 150 returns to S51 in response to the reception unit 151 receiving a predetermined operation input from the user. Alternatively, the control unit 150 may return to S51 in response to the elapsed time. In this way, the management system S can manage inventory information of registered items.

[0094] <Example 2 of the operation flow of management system S> Figure 5 shows a second example of the operation flow of the management system S according to this embodiment. The operation flow of the second example is an example of the specific content of S60 in the operation flow of the first example described in Figure 4. The inventory information control unit 156 generates a control signal to update the captured image information of the target item 30 as the registered image information of the registered item (S72) in response to the reception unit 151 receiving the selection of the first registration button 203 corresponding to a registered item by the user (S71: Yes).

[0095] The inventory information control unit 156 generates a control signal to add the image information of the target item 30 to the inventory information of a registered item, for example. Alternatively, the inventory information control unit 156 may generate a control signal to update the registered image information of the inventory information of a registered item with the image information of the target item 30 as new registered image information. Whether to add or update the image information of the target item 30 to the inventory information may be set in advance by the user, or it may be entered by the user via the input unit 141.

[0096] The inventory information control unit 156 transmits the control signal it has generated to the management server 20 via the communication unit 110 (S73). The management server 20 updates the inventory information in the storage device 10 according to the received control signal (S74). As a result, the management system S can add the captured image information of the target item 30 as registered image information to the inventory information. Therefore, the next time the imaging unit 120 captures the target item 30, the management system S can display the registered item corresponding to the added registered image information as item candidate information on the display unit 140.

[0097] Furthermore, the inventory information control unit 156 may update or register the registered image information of the registered items, and may also update the inventory quantity, item name, etc., of the registered items. In this case, between S71 and S72, the display control unit 155 displays the inventory quantity and item name of the registered items, and the input unit 141 enables input of the inventory quantity and item name of the registered items displayed by the display control unit 155.

[0098] Then, when the reception unit 151 receives user input regarding the inventory quantity and / or item name of a registered item, the inventory information control unit 156 generates a control signal in S72 that includes an instruction to update the received inventory quantity and / or item name of the registered item. This allows the user to efficiently update or register the registered image information of the registered item and update the inventory quantity and / or item name of the registered item.

[0099] In response to the reception unit 151 receiving the user's selection of the second registration button 204 (S71: No, S75: Yes), the display control unit 155 displays an input screen for registering the target item 30 as a new item (S76).

[0100] Here, the similarity information identification unit 153 may identify a name that represents the target item 30 based on the characteristics of the target item 30 extracted in S53. For example, the similarity information identification unit 153 may identify "white, round plate" as the item name based on shape characteristics. The similarity information identification unit 153 may also identify "plate made by Company A" as the item name based on character characteristics. Furthermore, the similarity information identification unit 153 may identify "soup bowl made by Company A" as the item name based on code information. For example, in S53, the similarity information identification unit 153 identifies the item name of the target item 30. The display control unit 155 may also display the identified item name on the input screen.

[0101] <Example of input screen 206> Figure 6 shows an example of an input screen 206 displayed on the display unit 140 by the display control unit 155 according to this embodiment. Figure 6 shows an example in which the input screen 206 is superimposed on the display screen of the display unit 140 shown in Figure 3, but is not limited to this. The display control unit 155 may display a screen different from the display screen of the display unit 140 shown in Figure 3 as the input screen. Note that Figure 6 shows an example in which the names of the registered items are "Watermelon Juice," "Pineapple Juice," and "XY Coffee," and there are no registered items that match the target item 30, and the target item 30 is an unregistered item.

[0102] When the display control unit 155 accepts the registration of a target item 30 to the inventory information, it displays an input screen 206 for entering the inventory quantity of the target item 30 on the display unit 140 along with the item name. It is desirable that the display control unit 155 also allows the input of the item name via the input unit 141 while displaying the item name. This allows the user to correct the item name to a more appropriate one. Figure 6 shows an example in which the display control unit 155 displays the item name "Melon Juice" and inventory quantity "1" on the input screen 206. The initial value of the inventory quantity may be a predetermined value.

[0103] The display control unit 155 further displays an execution button 207 for performing registration. The inventory information control unit 156, for example, when the reception unit 151 receives user input regarding the inventory quantity of the registered item and selects the execution button 207, generates a control signal to add the captured image information of the target item 30, the identified characteristics of the target item 30, and the received inventory quantity to the inventory information, associating them with the item name (S77). The inventory information control unit 156 transmits the generated control signal to the management server 20 via the communication unit 110 (S78). The management server 20 updates the inventory information in the storage device 10 by registering the target item 30 as a newly registered item in response to the received control signal (S79).

[0104] As a result, the management system S can register the captured image information of the target item 30 as registered image information in the inventory information. Therefore, the next time the imaging unit 120 images the target item 30, the management system S can display the newly registered item as item candidate information on the display unit 140. In other words, the user can register the target item 30 in the inventory information by imaging the target item 30, touching the second registration button 204, entering the inventory quantity of the target item 30, and touching the execute button 207.

[0105] The management system S according to this embodiment has been described in the example of adding or updating the image information of the target item 30 to the inventory information, or registering the target item 30 as a registered item in the inventory information, but it is not limited to this. The management system S may also manage the receipt or dispatch of registered items based on the image information of the target item 30.

[0106] For example, in S59, the display control unit 155 displays the names of registered items included in the candidate item information on the display unit 140, as shown in Figure 3, and makes it possible to accept the selection input of a registered item by the input unit 141. In other words, the display screen of the display unit 140 shown in Figure 3 is configured so that the user can select a registered item in addition to the first registration button 203 and the second registration button 204.

[0107] For example, the display screen of the display unit 140 may be configured to select a registered item corresponding to the registered image information 205 touched by the user, or it may be configured to select a registered item corresponding to the item name touched by the user. The display screen of the display unit 140 may also be configured so that when the user touches the area within the frame surrounding the registered image information 205 and the item name, the registered item corresponding to the area within the touched frame is selected.

[0108] Then, in response to the reception unit 151 receiving the input of a selected registered item, the inventory information control unit 156 initiates the operations of receiving, issuing, and / or checking the inventory quantity of the registered item. The operation of the management system S in this case will be explained next.

[0109] <Example 3 of the operation flow of management system S> Figure 7 shows a third example of the operation flow of the management system S according to this embodiment. The operation flow of the third example is an example of the specific content of S60 in the operation flow of the first example described in Figure 4. The operation flow of the third example is executed, for example, after the operation flow of the second example described in Figure 5. In other words, the operation flow of the third example is the operation flow when the user operates the input unit 141 and selects and inputs one registration item without selecting the first registration button 203 and the second registration button 204 (S71: No, S75: No).

[0110] The display control unit 155 displays a menu screen in response to the reception unit 151 receiving a selection of a registered item by the user (S81). Figure 8 shows an example in which the display control unit 155 according to this embodiment displays a menu screen on the display unit 140. The example in Figure 8 is a screen that allows the user to select the actions of "Inbound," "Outbound," and "Check Inventory Quantity." Figure 8 is an example in which the display control unit 155 displays the menu screen as a screen different from the display screen of the display unit 140 shown in Figure 3. Alternatively, the display control unit 155 may display the menu screen together with the display screen of the display unit 140 shown in Figure 3.

[0111] If the selection made by the user on the menu screen is an inbound instruction indicating that one registered item should be "stored" (S82: Yes), the reception unit 151 accepts the number of registered items to update the inventory information (S83). In this case, the display control unit 155 displays an input screen for entering the number of registered items on the display unit 140.

[0112] When the receiving unit 151 receives an inbound instruction and input of the quantity of a registered item, the inventory information control unit 156 adds the quantity received by the receiving unit 151 to the inventory quantity of the registered item in the inventory information and generates a control signal to update the inventory information in the storage device 10 (S84). The inventory information control unit 156 transmits the generated control signal to the management server 20 (S85). The management server 20 updates the inventory information in the storage device 10 according to the received control signal (S86).

[0113] If the selection made by the user on the menu screen is an outbound instruction indicating that one registered item should be "outbound" (S82: No, S87: Yes), the reception unit 151 accepts the number of registered items to update the inventory information (S88). The operation of the reception unit 151 in S88 is the same as in S83, so a redundant explanation is omitted.

[0114] When the reception unit 151 receives a dispatch instruction and input of the quantity of a registered item, the inventory information control unit 156 subtracts the quantity received by the reception unit 151 from the inventory quantity of the registered item in the inventory information and generates a control signal to update the inventory information in the storage device 10 (S89). The inventory information control unit 156 transmits the generated control signal to the management server 20 (S90). The management server 20 updates the inventory information in the storage device 10 according to the received control signal (S91).

[0115] If the selection made by the user on the menu screen indicates checking the "stock quantity" of a registered item (S82: No, S87: No, S92: Yes), the display control unit 155 displays the stock quantity of the registered item received in S56 (S93). The display control unit 155 may also display the stock quantity of the registered item on the menu screen. Furthermore, the display control unit 155 may display the stock quantity of a registered item when displaying item candidate information in S59. In this case, the "stock quantity check" option on the menu screen and the operations in S92 and S93 are not required.

[0116] As described above, the management system S allows users to easily manage inventory information for a registered item by having them image an item 30 that is identical or similar to a registered item. In the management system S according to this embodiment, an example has been described in which the management device 100 identifies the item candidate information, but it is not limited to this. Alternatively, the management server 20 may identify the item candidate information. Such a management system S will be described next.

[0117] <Example configuration of management system S> Figure 9 shows a modified example of the management system S according to this embodiment. In this modified example of the management system S, components that are substantially the same as those in the management system S according to this embodiment shown in Figure 1 are given the same reference numerals, and redundant explanations are omitted. Furthermore, the management device 100 may have the same configuration as described in Figure 2, excluding the similar information identification unit 153, and the description of the internal configuration is omitted in Figure 9.

[0118] The control unit 150 of the management device 100 controls the communication unit 110 to transmit the captured image information acquired by the information acquisition unit 152 to the management server 20. In other words, when the imaging unit 120 of the management device 100 captures an image of the target item 30, the captured image information is transmitted to the management server 20.

[0119] The management server 20 comprises a management communication unit 21, a management control unit 22, and a similar information identification unit 153. The management communication unit 21 communicates with the communication unit 110 of the management device 100 to exchange information. The management communication unit 21 also communicates with the storage device 10 to exchange signals for managing inventory information. For example, the management communication unit 21 transmits a control signal to the storage device 10 to acquire inventory information and receives the inventory information from the storage device 10. The management communication unit 21 also transmits a control signal to the storage device 10 to update the inventory information.

[0120] The management control unit 22 controls various parts within the management server 20. For example, the management control unit 22 controls the communication unit 110 to acquire captured images from the management device 100. The management control unit 22 also controls the communication unit 110 to acquire inventory information from the storage device 10.

[0121] The similarity information identification unit 153 identifies registered article information similar to the characteristics of the target article 30 as article candidate information based on the results of comparing the captured image information with the registered image information. In other words, the similarity information identification unit 153 operates in the same way as the similarity information identification unit 153 of the management device 100 shown in Figure 2. The management control unit 22 then controls the communication unit 110 to transmit the article candidate information identified by the similarity information identification unit 153 to the management device 100. As a result, the similarity information acquisition unit 154 of the management device 100 acquires the article candidate information from the management server 20 via the communication unit 110.

[0122] As described above, in the modified management system S, the management server 20 identifies the candidate item information. The display control unit 155 of the management device 100 then displays the captured image information, the candidate item information, the first registration button 203, and the second registration button 204 on the display unit 140. In this way, since the management server 20 performs operations that process relatively complex and large amounts of data, the management device 100 can easily perform inventory information management operations while running other applications. Furthermore, the management device 100 can easily perform inventory information management operations even on devices with relatively low processing power.

[0123] <Other configurations> In the management system S according to this embodiment described above, when the candidate item information includes information on multiple registered items, an example has been described in which multiple registered items are displayed on the display unit 140 in order of the degree of similarity between the registered items and the target item 30. However, the similarity of multiple registered items may be almost the same. In this case, the display control unit 155 may display the multiple registered items with almost the same similarity on the display unit 140 in another predetermined order, such as alphabetical order.

[0124] Alternatively, the display control unit 155 may display multiple registered items with almost the same similarity in a predetermined order using information about the location where the imaging unit 120 captured the target item 30. For example, a user may capture the target item 30 at its storage location. In this case, registered items similar to the target item 30 may be stored in a location close to the target item 30's storage location.

[0125] Therefore, the display control unit 155 displays multiple registered items whose similarity falls within a predetermined range, in order of proximity to the storage location of the target item 30. The predetermined range is a range that has been set in advance as a range in which the similarity is equivalent, and is, for example, items that contain the same string of characters or items that have the same shape.

[0126] In this case, the inventory information further includes information about the storage location of the registered item. The information acquisition unit 152 also acquires location information from the imaging unit 120 about the location where the target item 30 was imaged. Furthermore, when the information acquisition unit 152 acquires inventory information for the registered item, it also acquires information about the storage location of the registered item.

[0127] Then, the display control unit 155, when the similarity of multiple registered items matches within a predetermined range among the registered items whose similarity exceeds a threshold, displays the names of the multiple registered items on the display unit 140 in order of proximity of their storage location to the location indicated by the location information of the target item 30. As a result, the user will see the registered items that are most likely to be the target item 30 first, allowing them to quickly confirm whether or not the target item 30 is an item that has already been registered.

[0128] The management system S according to this embodiment described above includes an example in which the inventory information of registered items includes registered image information, but is not limited to this. Alternatively, the inventory information of registered items does not have to include registered image information. In this case, the inventory information of registered items includes registered text information that includes the characteristics of the registered item and the inventory quantity. The registered text information is information that represents the characteristics of the registered item in characters.

[0129] The similarity information identification unit 153 extracts features for identifying the target article 30 based on the captured image information and converts the extracted features into text information. Then, based on the result of comparing the text information extracted from the captured image information with registered text information, the similarity information identification unit 153 identifies information of registered articles similar to the text information of the target article 30 as article candidate information.

[0130] The inventory information control unit 156 displays the captured image information, the candidate item information, the first registration button, and the second registration button on the display unit 140. This allows the management system S to compare the target item 30 with the registered item even if the inventory information does not include an image of the registered item, and to allow the user to confirm whether the target item 30 is an item that has already been registered.

[0131] The management system S according to this embodiment described above is an example in which the management device 100 acquires inventory information or candidate item information from the management server 20, but it is not limited to this. Alternatively, the management device 100 may store inventory information in the storage unit 130 in advance. Then, the management device 100 reads the inventory information from the storage unit 130 and identifies the candidate item information.

[0132] In this case, for example, as shown in the operation of S53 in Figure 4, the similarity information identification unit 153 extracts features for identifying the target item 30 based on the captured image information, and then the information acquisition unit 152 searches the storage unit 130 to obtain inventory information of registered items similar to the features of the target item 30. The information acquisition unit 152 searches for and extracts registered items that match a predetermined number or more of the features of the target item 30, similar to the operation of the management server 20 in S55 in Figure 4. Then, the similarity information identification unit 153 identifies the information of registered items similar to the features of the target item 30 obtained by the information acquisition unit 152 as item candidate information.

[0133] As a result, the management device 100 can acquire item candidate information without going through a network or the like, and display the acquired item candidate information on the display unit 140. In other words, in this case, the management device 100 functions as a management system S.

[0134] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of Symbols]

[0135] 10 Storage device 20 Management Server 21 Management and Communications Department 22 Management and Control Unit 30 Target items 100 Management device 110 Communications Department 120 Imaging Unit 130 Storage section 140 Display section 141 Input section 150 Control Unit 151 Reception Department 152 Information Acquisition Department 153 Similar information identification department 154 Similar information acquisition unit 155 Display Control Unit 156 Inventory Information Control Unit 201 Image Information 202 Goods candidate information 203 First registration button 204 Second registration button 205 Registered Image Information 206 Input screen 207 Execute button

Claims

1. A program that, when executed by a computer, causes the computer to function as a management device, The aforementioned control device is An information acquisition unit acquires registered image information including the appearance of multiple registered items, inventory information including the number of items in stock and the name of the item, and captured image information of the target item. A similarity information acquisition unit acquires information of registered articles that are similar to the characteristics of the target article, based on the results of comparing the captured image information with the registered image information, as article candidate information. A display control unit that displays the captured image information, the candidate item information, a first registration button associated with the candidate item information, and a second registration button different from the first registration button on the display unit, An inventory information control unit initiates the registration of the target item to the inventory information in response to the selection of either the first registration button or the second registration button, Equipped with, When the first registration button is selected, the inventory information control unit starts the process of updating the inventory information as the target item. When the second registration button is selected, the inventory information control unit starts the process of registering the target item as a new item. program.

2. The display control unit displays the captured image information, the candidate item information, the first registration button, and the second registration button together on a single screen. The program according to claim 1.

3. The information acquisition unit acquires the captured image information of the target item in response to receiving an operation input for acquiring an image. The program according to claim 1.

4. The display control unit causes the display unit to display the moving image of the target item. The information acquisition unit acquires the captured image information of the target item when a predetermined time has elapsed while the moving image is displayed on the display unit. The program according to claim 1.

5. The display control unit displays a moving image of the target item on the display unit, and overlays a frame with an area smaller than the area of ​​the screen displaying the moving image onto the moving image. The information acquisition unit acquires an image of an object whose presence is recognized within the frame as the captured image information. The program according to claim 1.

6. The system further includes a similar information identification unit that extracts features for identifying the target article based on the captured image information, and identifies a name representing the target article as the article name based on the extracted features of the target article, When the second registration button is selected and the registration of the target item to the inventory information is accepted, the display control unit displays an input screen for entering the inventory quantity of the target item, along with the item name, on the display unit. The inventory information control unit, upon receiving confirmation of the registration of the target item to the inventory information, adds the characteristics of the target item and the number of the target item in stock to the inventory information, associating them with the specified item name. The program according to claim 1.

7. The aforementioned inventory information includes information that associates the registered image information and inventory quantity of the registered item with the item name of the registered item. The display control unit displays the name of the registered item included in the candidate item information on the display unit, and makes it possible to accept the selection input of the registered item. The inventory information control unit, upon receiving the input of a selection of a registered item, initiates the operation of receiving, issuing, and / or checking the inventory quantity of the registered item. The program according to claim 1.

8. The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the results of the comparison, identifies information of registered articles that are similar to the characteristics of the target article as the article candidate information. The similarity information identification unit identifies the degree of similarity between each registered article and the target article and includes it in the article candidate information. The display control unit displays information on registered articles included in the candidate article information that have a similarity exceeding a threshold, in descending order of similarity. If there are no registered articles with a similarity exceeding the threshold, the second registration button is displayed without displaying the article name of the registered article, in order to start registering the target article to the inventory information. The program according to claim 7.

9. The aforementioned inventory information includes information on the storage location of the registered items. The information acquisition unit further acquires location information of the place where the target item was imaged, The display control unit, when the similarity of multiple registered articles that exceed a threshold matches within a predetermined range, displays the article names of the multiple registered articles on the display unit in order that their storage location is closest to the location indicated by the location information of the target article. The program according to claim 8.

10. The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the results of the comparison, identifies information of registered articles that are similar to the characteristics of the target article as the article candidate information. The aforementioned similar information identification unit, For each of the registered articles, the degree of similarity between the registered article and the target article is identified and included in the article candidate information. From the captured image information, one or more features are extracted from shape features including the shape of the target article, character features including information about characters attached to the target article, and code features including information about codes attached to the target article. The degree of similarity between the extracted features and the corresponding features of the registered article is then determined. The program according to claim 1.

11. The display control unit displays information indicating the features used to determine the similarity of the registered article, among the shape features, character features, and code features, together with the article name of the registered article on the display unit. The program according to claim 10.

12. The similar information identification unit extracts one or more features from the shape features, color features, and pattern features of the target article from the captured image information and uses them as the shape features. The inventory information includes setting information that specifies which of the shape features, color features, and pattern features of the target article to use when the similar information identification unit extracts the shape features. The program according to claim 10.

13. The similarity information identification unit extracts one or more features from the shape features, character features, and code features with weights, and identifies the degree of similarity between the extracted weighted features and the corresponding features of the registered article. The aforementioned inventory information includes the weight setting values ​​used by the similar information identification unit, The program according to claim 10.

14. The system further includes a similarity information identification unit that compares the captured image information with the registered image information and, based on the results of the comparison, identifies information of registered articles that are similar to the characteristics of the target article as the article candidate information. The similarity information identification unit identifies the degree of similarity and the similarity threshold between the registered article and the target article for each registered article and includes them in the article candidate information. The display control unit causes the display unit to display the names of the registered articles that have a similarity exceeding a threshold among the registered articles included in the candidate article information, in descending order of similarity. The program according to claim 1.

15. A program that, when executed by a computer, causes the computer to function as a management device, The aforementioned control device is An information acquisition unit that acquires registered text information including the characteristics of multiple registered items, inventory information including the number of items in stock, and captured image information of the target item, A similarity information acquisition unit acquires information of registered articles that are similar to the character information of the target article, based on the result of comparing the character information extracted from the captured image information with the registered character information, as article candidate information. A display control unit that displays the captured image information, the candidate item information, a first registration button associated with the candidate item information, and a second registration button different from the first registration button on the display unit, An inventory information control unit initiates the registration of the target item to the inventory information in response to the selection of either the first registration button or the second registration button, Equipped with, When the first registration button is selected, the inventory information control unit starts the process of updating the inventory information as the target item. When the second registration button is selected, the inventory information control unit starts the process of registering the target item as a new item. program.

16. A computer-based method for managing the inventory of goods, The steps include obtaining registered image information including the appearance of multiple registered items, inventory information including the quantity in stock and the name of the item, and captured image information of the target item, A step of obtaining information of registered articles that are similar in characteristics to the target article, based on the results of comparing the captured image information with the registered image information, as article candidate information. The steps include displaying the captured image information, the candidate item information, a first registration button associated with the candidate item information, and a second registration button different from the first registration button on the display unit, If the first registration button is selected, the process of updating the inventory information as the target item is initiated, If the second registration button is selected, the process of registering the target item as a new item is initiated. A management method that includes the following features.

17. An information acquisition unit acquires registered image information including the appearance of multiple registered items, inventory information including the number of items in stock and the name of the item, and captured image information of the target item. A similarity information acquisition unit acquires information of registered articles that are similar to the characteristics of the target article, based on the results of comparing the captured image information with the registered image information, as article candidate information. A display control unit that displays the captured image information, the candidate item information, a first registration button associated with the candidate item information, and a second registration button different from the first registration button on the display unit, An inventory information control unit initiates the registration of the target item to the inventory information in response to the selection of either the first registration button or the second registration button, Equipped with, When the first registration button is selected, the inventory information control unit starts the process of updating the inventory information as the target item. When the second registration button is selected, the inventory information control unit starts the process of registering the target item as a new item. Management device.

18. A management system for managing the inventory information of the registered items, A storage device that stores the aforementioned inventory information, The management device according to claim 17, which acquires the inventory information of the storage device and the captured image information of the target item, and displays the captured image information, the item candidate information, the first registration button, and the second registration button on the display unit, A management server communicates with the management device and, in response to control signals received from the management device, supplies the inventory information to the management device or updates the inventory information in the storage device. A management system equipped with the following features.

Images