Management apparatus, management system, management method, and program

Abstract

To provide a management apparatus, a management system, a management method, and a program capable of efficiently managing items.SOLUTION: A management apparatus 10 according to the present disclosure comprises an acquisition unit 11 and a control unit 12. The acquisition unit 11 acquires an image including a target item. Then, the control unit 12 performs control so that information indicating the location of the target item is displayed as text characters on the image in association with the target item.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a management device, a management system, a management method, and a program.

Background Art

[0002] Patent Document 1 discloses a terminal device that performs AR display to color an article in order to show the user the location of the article.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, in article management, the user inputs information for indicating the location of the target article and information regarding the target article, and the information is linked. There were cases where the user could not grasp the information for indicating the location of the target article, and the information linking work was time-consuming.

[0005] With the AR display of the terminal device disclosed in Patent Document 1, the user could not grasp the information for indicating the location of the inputtable target article, and efficient article management was difficult.

[0006] An object of the present disclosure is to provide a management device, a management system, a management method, and a program capable of efficiently managing articles in view of the above-described problems.

Means for Solving the Problems

[0007] The management device according to the present disclosure is an acquisition unit that acquires an image including a target article, and A control unit that controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article; is provided.

[0008] The management system according to the present disclosure an acquisition unit that executes an acquisition process of an image including a target article; a generation unit that executes a generation process of display information so that information indicating the location of the target article can be displayed on the image corresponding to the target article as text characters; is provided.

[0009] The management method according to the present disclosure acquires an image including a target article, controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article, and the computer executes the process.

[0010] The program according to the present disclosure acquires an image including a target article, controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article, and causes the computer to execute the process.

Advantages of the Invention

[0011] According to the present disclosure, it is possible to provide a management device, a management system, a management method, and a program capable of efficiently managing articles.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Embodiments for Carrying Out the Invention

[0013] Hereinafter, the present disclosure will be described through embodiments, but the disclosure according to the claims is not limited to the following embodiments. Also, not all of the configurations described in the embodiments are essential as means for solving the problems. In each drawing, the same reference numerals are assigned to the same elements, and redundant descriptions are omitted as necessary. Of course, the right-handed xyz orthogonal coordinates shown in the drawings are for convenience in explaining the positional relationship of the components. Usually, the positive direction of the z-axis is vertically upward, and the xy plane is the horizontal plane.

[0014] Hereinafter, article management refers to grasping where the target article is placed. The target article includes goods and raw materials of goods. In each of the following embodiments, article management from when the target article is received until it is stored will be described as an example.

[0015] Generally, from when the target article is received until it is stored, the following process occurs. When the target article is received, the target article is temporarily placed at a predetermined location. At the temporary placement location, the user inputs information indicating the location of the target article and information regarding the target article, and the information is linked. Then, a carrier such as a forklift transports the target article to the storage location based on the information indicating the location of the target article. Therefore, during the period from when the target article is received until it is stored, article management indicates grasping where the target article is placed by linking the information indicating the location of the target article and the information regarding the target article.

[0016] <Embodiment 1> <Management Device> Hereinafter, the configuration of the management device according to the present disclosure will be described with reference to FIG. 1. FIG. 1 is a block diagram illustrating the management device according to the present disclosure. As shown in FIG. 1, the management device 10 includes an acquisition unit 11 and a control unit 12. The management device 10 is, for example, a handy terminal.

[0017] The acquisition unit 11 acquires an image including the target article. The acquisition unit 11 acquires, for example, an image captured by a camera of the management device 10. The image including the target article is typically an image including the target article placed on a pallet or the target article packed in a cardboard box.

[0018] The control unit 12 controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article. The information indicating the location of the target article is typically information regarding a location arbitrarily set by the user for article management or coordinate information. The information regarding a location arbitrarily set by the user for article management is, for example, a location number denoted using a character string such as L10-1 or the like. Further, the information regarding a location arbitrarily set by the user for article management is not limited to the above-described location number, and may be simply expressed text characters, symbols, numbers, or a combination thereof.

[0019] With reference to FIG. 2, the acquisition unit 11 and the control unit 12 will be described in more detail. FIG. 2 is a diagram showing images before and after AR (Augmented Reality) display. In FIG. 2, the image 100 is the image before AR display, and the image 200 is the image after AR display.

[0020] The acquisition unit 11 acquires the image 100 shown in FIG. 2. In the image 100, each article G1 to G3 is arranged on each pallet P1 to P3. Here, the target articles are the articles G1 to G3. Further, it is assumed that the location where the article G1 is arranged is the location number L1, the location where the article G2 is arranged is the location number L2, and the location where the article G3 is arranged is the location number L3. Note that the location numbers L1 to L3 are information regarding locations arbitrarily set by the user for management.

[0021] Based on the image 100 shown in FIG. 2, the control unit 12 controls to display, as text characters, the location numbers corresponding to the articles G1 to G3 on the image. As a result of the processing by the control unit 12, the image displayed to the user is the image 200 shown in FIG. 2. As shown in FIG. 2, in the image 200, the location numbers L1 to L3 are shown on each of the articles G1 to G3.

[0022] As a result, even if the user does not know the location numbers of the places where the respective articles G1 to G3 are arranged, the location numbers are displayed as in Image 200, so that the user can easily know the location numbers of the places where the respective articles G1 to G3 are arranged. For example, the user can understand from Image 200 shown in FIG. 2 that the location number of article G1 is location number L1.

[0023] And the user can easily associate the information indicating the location of the target article with the information regarding the target article. This will be described more specifically with reference to FIG. 3. FIG. 3 is a diagram showing a user interface for performing the association of the information indicating the location of the target article with the information regarding the target article.

[0024] From left to right in FIG. 3, the display of the user interface changes. That is, based on the operation of the user, the display changes in the order of Screen 110, Screen 111, and Screen 112. Screens 110, 111, and 112 are displayed on the management device 10. Here, an example of associating the information indicating the location of article G1 with the information regarding article G1 will be described. Also, as examples of the information regarding the target article, the article name and the quantity of the article will be described.

[0025] Since the user knows the location number L1 of article G1 from Image 200 shown in FIG. 2, the user inputs the location number L1 of article G1 to Screen 110 shown in FIG. 3. Although not shown in FIG. 3, the control unit 12 may be configured to display Image 200 together with Screen 110. As a result, the user can input the location number L1 of article G1 while viewing Image 200.

[0026] Next, when the user touches and operates "Start" on screen 110, screen 111 is displayed to the user. On screen 111, a message indicating that the article code is to be read is displayed to the user. The article code is identification information for identifying an article and is attached to the article or the package of the article. The user reads the article code attached to article G1 using management device 10. Thereby, the article name is associated with the location number. Of course, a configuration may be adopted in which the user inputs the article code into management device 10 and the article name is associated with the location number.

[0027] Next, screen 112 is displayed to the user. On screen 112, a message indicating that the quantity of the article is to be input is displayed to the user. The user counts the quantity of articles of article G1 and inputs the quantity of articles into screen 112. Thereby, the quantity of articles is associated with the location number. In this way, since the user can easily grasp the location number of the place where article G1 is arranged, the user can efficiently manage the articles without taking time to associate the information indicating the location of article G1 with the information regarding article G1. Similarly for article G2 and article G3 shown in FIG. 2, the user can efficiently manage the articles. Note that the information regarding the target article for which the article management has been completed may be configured to be printed.

[0028] Here, conventionally, in order for the user to be able to grasp the information indicating the location of the article, for example, the user has obtained the information indicating the location of the article by reading the barcode attached to the floor using a terminal device. However, with this conventional method, each time the temporary storage location changes, work such as reattaching the barcode occurs, which is time-consuming and not efficient.

[0029] In contrast, management device 10 according to the present disclosure controls to display, as text characters, the information indicating the location of the target article on the image corresponding to the target article. Thereby, since the user can easily grasp the information indicating the location of the target article, the user can efficiently manage the articles without taking time.

[0030] <Management method> Next, the management method according to the present disclosure will be described. FIG. 4 is a flowchart showing the management method according to the present disclosure. The main bodies of each step are the acquisition unit 11 and the control unit 12 shown in FIG. 1.

[0031] First, as shown in FIG. 4, the acquisition unit 11 acquires an image including the target article (step ST1). Next, the control unit 12 controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article (step ST2). More specifically, as shown in FIG. 2, the control unit 12 controls to display, as text characters, the location numbers on the image corresponding to the articles G1 to G3 based on the image 100 shown in FIG. 2. Then, the control unit 12 controls to display the image 200 shown in FIG. 2.

[0032] In this way, the management method according to the present disclosure controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article. Thereby, the user can easily grasp the information indicating the location of the target article, and thus can efficiently manage the articles.

[0033] <Embodiment 2> <Specification of coordinates> Hereinafter, the configuration of the management device according to the present disclosure will be described with reference to the drawings. Each functional block of the management device according to the present disclosure is the same as the management device 10 shown in FIG. 1, and includes an acquisition unit 11 and a control unit 12. The configuration of the control unit 12 will be described with reference to FIG. 5. FIG. 5 is a block diagram illustrating the control unit of the management device according to the present disclosure. The control unit 12 includes a coordinate specification unit 121 and a coordinate conversion unit 122.

[0034] With reference to FIG. 6, the coordinate specifying unit 121 and the coordinate conversion unit 122 will be specifically described. FIG. 6 is an explanatory diagram for explaining a method of specifying information indicating the location of a target article. In FIG. 6, location numbers L11 to L14 are provided so as to equally divide the temporary storage area LA. For example, in a top view of the xy plane, the area where the x coordinate is 0 to 5 and the y coordinate is 0 to 5 becomes the location number L11. In FIG. 6, the target articles are assumed to be article G11 and article G12.

[0035] First, the coordinate specifying unit 121 recognizes a predetermined position of the image as the origin. The predetermined position is typically a wall, a floor, or a ceiling. An AR marker (identification information) for performing AR display is attached to the wall, the floor, or the ceiling. Further, identification information may be written on the wall, the floor, or the ceiling. The identification information is typically an image, and preferably an image having many feature points so that the coordinate specifying unit 121 can easily recognize it.

[0036] That is, when the coordinate specifying unit 121 recognizes the identification information of the wall, the floor, or the ceiling, it recognizes the position where the identification information is attached as the predetermined position. Then, the coordinate specifying unit 121 recognizes the predetermined position of the image as the origin. In FIG. 6, the origin recognized by the coordinate specifying unit 121 is taken as the origin OR1.

[0037] Next, the coordinate specifying unit 121 specifies the position of the target article from the origin. The position of the target article is indicated by the distance and direction from the origin or the coordinates from the origin. Here, an example in which the position of the target article is indicated by the coordinates from the origin will be described.

[0038] The coordinate specifying unit 121 specifies the position of the target article from the origin by performing image analysis, for example, by converting the coordinates included in the image into spatial coordinates. As shown in FIG. 6, the coordinate specifying unit 121 specifies that the x coordinate of the article G11 is 7, the y coordinate is 2, and the z coordinate is 5 with respect to the origin OR1. Similarly, the coordinate specifying unit 121 specifies that the x coordinate of the article G12 is 2, the y coordinate is 7, and the z coordinate is 5. Here, the coordinate specifying unit 121 specifies the center points of the articles G1 and G2 from the origin, but any point of the articles G11 and G12 may be specified from the origin.

[0039] Further, when the acquisition unit 11 continuously acquires images, if the identification information is included in any of the images, the coordinate specifying unit 121 recognizes the position with the attached identification information as a predetermined position, and can recognize the predetermined position as the origin. That is, even if the image for which the control unit 12 controls to perform AR display does not include the identification information, if the identification information is included in any of the images acquired by the acquisition unit 11, the coordinate specifying unit 121 can specify the position of the target article from the origin by continuously analyzing the images.

[0040] Next, the coordinate conversion unit 122 converts the information regarding the position of the article specified by the coordinate specifying unit 121 into information for indicating the location of the article. Here, a case where the information for indicating the location of the article is the location number will be described as an example with reference to Table 1. Table 1 is a correspondence table between the xy coordinates and the location number.

[0041]

Table 1

[0042] Since the x - coordinate of the article G11 is 2 and the y - coordinate is 7, the coordinate conversion unit 122 converts it to the location number L13 according to Table 1. Thus, the coordinate conversion unit 122 can identify that the article G11 is located at the location number L13. Similarly, the coordinate conversion unit 122 can identify that the article G12 is located at the location number L12. Here, the coordinate conversion unit 122 converts to the location number based on the xy - coordinates of the articles G11 and G12, but it is not limited to this, and it may also be converted to the location number based on the xyz - coordinates of the articles G11 and G12.

[0043] Also, when the target article is located across the boundary of the area indicated by the location number, the coordinate conversion unit 122 may operate as follows. The coordinate conversion unit 122 calculates the exclusive area of the target article with respect to the area indicated by the location number, and converts it to the location number based on the exclusive area. For example, the coordinate conversion unit 122 converts to the location number for which the exclusive area of the target article with respect to the area indicated by the location number is the largest.

[0044] In this way, the coordinate specifying unit 121 specifies the position of the target article with the predetermined position of the image as the origin. The coordinate conversion unit 122 converts the information regarding the position of the target article specified by the coordinate specifying unit 121 into information indicating the location of the target article. The control unit 12 controls to display, as text characters, the information indicating the location of the target article specified by the coordinate conversion unit 122 on the image corresponding to the target article as described with reference to FIG. 2.

[0045] With such a configuration, even if the user does not grasp the information indicating the location of the target article, the user can easily grasp the information indicating the location of the target article. And the user does not need to spend time linking the information indicating the location of the target article and the information regarding the target article, and can efficiently manage the articles.

[0046] The correspondence table between the xy - coordinates and the location numbers shown in Table 1 is stored in advance in the storage unit of the management device 10 or in a storage unit communicable with the management device 10.

[0047] When the control unit 12 typically recognizes the identification information of the wall, floor, or ceiling as described above, it specifies the information indicating the location of the target article. As another example, the control unit 12 may use a learned model that has learned to specify the information indicating the location of the target article by using, as an input, an image including a wall, floor, or ceiling, to specify the information indicating the location of the target article. <Management method> Subsequently, the management method according to the present disclosure will be described. FIG. 7 is a flowchart showing the management method according to the present disclosure. The main bodies of each step are the acquisition unit 11 and the control unit 12 shown in FIG. 1. Since steps ST1 and ST2 in FIG. 7 are the same as those in FIG. 4, the description thereof will be omitted. Here, steps ST12 and ST13 will be described.

[0048] Subsequent to step ST1, the control unit 12 (coordinate specifying unit 121) specifies the position of the target article with a predetermined position of the image as the origin (step ST12). More specifically, when the coordinate specifying unit 121 recognizes the identification information of the wall, floor, or ceiling, it recognizes the position to which the identification information is attached as the predetermined position. Then, the coordinate specifying unit 121 recognizes with the predetermined position of the image as the origin. The coordinate specifying unit 121 specifies the position of the target article from the origin by performing image analysis.

[0049] Next, the coordinate conversion unit 122 converts the information regarding the position of the target article specified by the coordinate specifying unit 121 into the information indicating the location of the target article (step ST13). For example, the coordinate conversion unit 122 specifies the location number by using the correspondence table between the coordinates of the target article from the origin and the location number shown in Table 1.

[0050] As described above, in the management method according to the present disclosure, information for indicating the location of the target article is specified based on an image. Further, in the management method according to the present disclosure, the information for indicating the location of the target article is controlled to be displayed on the image corresponding to the target article as text characters. Therefore, even if the user does not grasp the information for indicating the location of the target article, the user can easily grasp the information for indicating the location of the target article. Thereby, the user does not need to spend time associating the information for indicating the location of the target article with the information regarding the target article, and can efficiently manage the articles.

[0051] <Selection of Target Article> Here, the control unit 12 may control to display, on the image, information for indicating the location of the selected target article corresponding to the selected target article based on the touch operation of the user. This will be specifically described with reference to FIGS. 8 to 10. FIG. 8 is a diagram showing an image including the target article acquired by the acquisition unit. FIG. 9 is a diagram showing an example of a selection screen of the target article. FIG. 10 is a diagram showing an example of a screen in which AR is displayed.

[0052] As shown in FIG. 8, the acquired image 300 includes articles G21 to G26. The articles G21 to G26 are respectively arranged on pallets P21 to P26. Here, it is assumed that the user wants to grasp the location numbers of the articles G21 and G26.

[0053] The user performs a touch operation on the articles G21 and G26 on the image 300 shown in FIG. 8 for selection input. Thereby, the control unit 12 controls to display the image 400 shown in FIG. 10 to the user. As shown in FIG. 10, in the image 400, the location numbers of the selected articles G21 and G26 are displayed corresponding to the articles G21 and G26.

[0054] In this way, based on the user's touch operation, the control unit 12 controls to display, on the image, information indicating the location of the selected target article corresponding to the selected target article. By adopting such a configuration, since the target article for which the location number is to be grasped is displayed to the user, the user can more easily grasp the location number.

[0055] Here, a configuration has been described in which the user performs a touch operation to select and input the articles G21 and G26 in the image 300 shown in FIG. 8, and the control unit 12 controls to display the image 400 shown in FIG. 9 to the user based on the user's touch operation. However, the present invention is not limited thereto, and the following configuration may be adopted.

[0056] The control unit 12 controls to display, as in the image 301 shown in FIG. 9, the sorting numbers 1 to 6 corresponding to the articles G21 to G26. The sorting numbers 1 to 6 are an example of information that can be touched by the user and is for sorting the target articles. The user performs a touch operation on any one or a plurality of the sorting numbers 1 to 6 displayed in the image 301. The control unit 12 recognizes the target article corresponding to the sorting number touched by the user as the selected target article according to the touch operation.

[0057] For example, when the user touches the sorting number 1, the control unit 12 recognizes that the article G21 with the sorting number 1 is the selected target article. Then, the control unit 12 controls to display the image 400 shown in FIG. 10 to the user. In this way, the control unit 12 may also control to display, on the image 300 shown in FIG. 8, information that can be touched by the user and is for sorting the target articles corresponding to the target articles. Note that the control unit 12 displays the sorting numbers according to the number of articles included in the image 300. In the example shown in FIG. 9, since there are 6 articles G21 to G26, the control unit 12 displays the sorting numbers 1 to 6.

[0058] Here, when an image contains a large number of target items, there is a risk that the user may accidentally select an unintended target item, that is, a target item for which it is not necessary to know the location number. Also, when the target items included in the image overlap, it is difficult for the user to select the intended target item, that is, the target item for which it is necessary to know the location number.

[0059] In the management device 10 according to the present disclosure, since control is performed to display the sorting numbers 1 to 6 corresponding to the articles G21 to G26, the user can perform a touch operation on the sorting numbers instead of the target articles. Therefore, even when the image contains a large number of target items or when the target items included in the image overlap, the user can easily select the intended target item, that is, the target item for which it is necessary to know the location number.

[0060] Of course, in the image 301 shown in FIG. 9, the user may be able to perform a touch operation not only on the sorting numbers but also on the articles. Also, the control unit 12 may control to display a message prompting the user to perform a touch operation. In the example shown in FIG. 9, the control unit 12 controls to display a message such as "Please select an article or a sorting number" on the image 301.

[0061] Further, when the user touches the palette, the control unit 12 may recognize the target item on the palette touched by the user as the selected target item. In the example shown in FIG. 9, in response to the user's touch operation on the palette P21, the control unit 12 recognizes that the selected target item is the article G21.

[0062] Note that the control unit 12 may also display the layout diagram with location numbers shown in the image 301 shown in FIG. 9. This will be specifically described with reference to FIG. 11. FIG. 11 is a diagram showing an example of a selection screen for target items. In FIG. 11, a layout diagram M1 with location numbers shown in the image 301 is displayed. For example, if the location number of the item G21 is already known to be L21, touch the L21 on the layout diagram M1. In response to this touch operation, the management device 10 sequentially displays the screens 111 and 112 shown in FIG. 3. That is, a user who already knows the location number can use the layout diagram M1 shown in FIG. 11 to perform the linking process between the information indicating the location of the target item and the information regarding the target item.

[0063] <Display control> Here, the control unit 12 may control the display of the arrangement of the information indicating the location of the target item so that it is easy for the user to view. Also, the control unit 12 may control the corresponding display between the information indicating the location of the target item and the target item. This will be described more specifically with reference to FIG. 12. FIG. 12 is a diagram showing an example of a screen with AR display. In FIG. 12, an image 401 is shown in which location numbers L31 to L41 are displayed corresponding to each target item.

[0064] As shown in FIG. 12, the control unit 12 causes the location numbers L31 to L41 to be displayed in the image 401 so as not to overlap with each target item. Also, the control unit 12 uses a balloon to display the correspondence between the location numbers L31 to L41 and each target item clearly. As a result, it becomes easy for the user to grasp which location number each target item has. Therefore, the user can efficiently manage the items without taking much time to link the information indicating the location of the target item and the information regarding the target item.

[0065] Note that the information indicating the location of the target article in the control unit 12 and the corresponding display of the target article are not limited to the display using the speech bubble shown in FIG. 12. The control unit 12 may perform display control, for example, to show the information indicating the location of the article using a leading line from the target article.

[0066] Also, the control unit 12 preferably displays the information indicating the location of the target article about 30 cm above the target article on the image so that it is easy for the user to visually recognize.

[0067] Here, as an example of the information indicating the location of the target article, the location number may be represented by a short character string, for example, L21, or a long character string, for example, L12-34-01, as shown in FIG. 10. In such a case, the control unit 12 may display, as the information indicating the location of the target article, a simply written text character, symbol, number, or a combination thereof instead of the location number.

[0068] A more specific description will be given with reference to FIG. 13 and Table 2. FIG. 13 is a diagram showing an example of the AR-displayed screen. Table 2 is a correspondence table between each location number and a symbol. In FIG. 13, it is assumed that the control unit 12 identifies the location numbers of the articles G41 to G43 by the same procedure as in FIGS. 7 to 9. That is, the control unit 12 identifies that the location number of the article G41 is L12-00-00. Similarly, the control unit 12 identifies that the location number of the article G42 is L12-00-01, and the location number of the article G43 is L12-00-02.

[0069]

Table 2

[0070] The control unit 12 identifies the symbol corresponding to each location number from Table 2. The control unit 12 identifies that the symbol of the article G41 is Δ from Table 2. Similarly, the control unit 12 identifies that the symbol of the article G42 is □ and the symbol of the article G43 is ☆ from Table 2.

[0071] Then, in the image 402 shown in FIG. 13, the control unit 12 causes the symbols (Δ, □, ☆ in FIG. 13) to be displayed so as to correspond to the respective articles G41 to G43. That is, in the image 402, the control unit 12 causes the symbols (Δ, □, ☆ in FIG. 11) to be displayed so as to correspond to the articles G41 to G43 instead of the location numbers.

[0072] When the user wants to associate the location number of the article G41 with the information regarding the article 41, the user touches and selects the symbol (Δ in FIG. 11) displayed in the image 402. Thereby, the control unit 12 recognizes from Table 2 that the location number L12-00-00 has been selected. The subsequent process of associating the location number L12-00-00 with the information regarding the article is the same as the screens 111 and 112 shown in FIG. 3, and thus the description thereof is omitted.

[0073] If the location numbers having long strings are displayed so as to correspond to the respective articles G41 to G43, the location numbers will be displayed overlapping each other on the respective articles G41 to G43. As a result, the user may erroneously perform the process of associating the information regarding the target article with a location number different from the location number that should be associated. In order to suppress such an erroneous operation of the association process, the control unit 12 controls to display symbols instead of the location numbers.

[0074] Note that the correspondence table between each location number and symbol shown in Table 2 is stored in advance in the storage unit of the management device or a storage unit communicable with the management device, similar to Table 1. Further, the control unit 12 may be configured to control to display a symbol instead of the location number using the correspondence table of symbols for each location number based on the number of characters of the identified location number. For example, when the number of characters of the identified location number is equal to or more than a predetermined number of characters, the control unit 12 controls to display a symbol instead of the location number using the correspondence table of symbols for each location number.

[0075] In other words, when the number of characters of the identified location number is equal to or more than a predetermined number of characters, the control unit 12 controls to display a symbol, and when the user touches the symbol, the management device 10 performs the linking process between the location number and the target article. Further, when the number of characters of the identified location number is less than a predetermined number of characters, the control unit 12 controls to display the location number, and when the user inputs the location number, the management device 10 performs the linking process between the location number and the target article. Thereby, an erroneous operation of the linking process can be suppressed.

[0076] In the example shown in FIG. 13, the control unit 12 controls to display a symbol instead of the location number. As another example, the control unit 12 may control to display a combination of simply written text characters instead of the location number. For example, in the three location numbers of L12-00-00, L12-00-01, and L12-00-02, L12-00 is common. In this case, the control unit 12 may omit L12-00 and display -01, -02, -03 corresponding to products G41 to G43. In this way, the control unit 12 may control to simply display the information indicating the location.

[0077] Thus, a user who knows that L12-00 is a location number included at the beginning can grasp the location numbers (L12-00-00, L12-00-01, L12-00-02) when -01, -02, and -03 are AR-displayed on the screen. That is, the management device 10 is highly convenient not only for users who do not know the location number but also for users who already know the location number.

[0078] <Embodiment 3> <Management System> Hereinafter, the configuration of the management system according to the present disclosure will be described with reference to the drawings. FIG. 14 is a block diagram illustrating the management system according to the present disclosure. As shown in FIG. 14, the management system 50 according to the present disclosure includes a management device 30 and a server 40. As shown in FIG. 14, the management system 50 is configured to be able to communicate with a control device 60. Note that the present disclosure is not limited to the example shown in FIG. 14, and the management system 50 may include the control device 60. Hereinafter, the management system 50 will be described on the assumption that it is configured to be able to communicate with the control device 60.

[0079] The management device 30 includes an acquisition unit 11 and a coordinate specifying unit 121. Since the acquisition unit 11 and the coordinate specifying unit 121 are the same as those in FIGS. 1 and 5, the description thereof will be omitted. The server 40 includes a coordinate conversion unit 122 and a generation unit 13. Since the coordinate conversion unit 122 is the same as that in FIG. 5, the description thereof will be omitted. Here, the generation unit 13 will be described.

[0080] The generation unit 13 executes generation processing of display information so that information indicating the location of an article can be displayed on an image in correspondence with the article as text characters. The management system 50 transmits the display information generated by the generation unit 13 to a display unit (not shown in FIG. 14), and the display unit displays the display information generated by the generation unit 13. The display unit displays, for example, an image 400 as described in FIG. 10. Note that the display unit is, for example, a monitor capable of communicating with the control device 60. However, the present disclosure is not limited thereto, and the display unit may be included in the management device 30.

[0081] The control device 60 controls the movement of the carrier. The carrier is, for example, a forklift, a transport robot, or a drone. The control device 60 receives information indicating the location of the article specified by the coordinate conversion unit 122 of the server 40. The control device 60 controls the movement of the carrier based on the information indicating the location of the article received from the server 40. Thereby, for example, the carrier can transport the target article to the storage location based on the information indicating the location of the target article.

[0082] In the example shown in FIG. 14, the management device 30 executes an acquisition process of acquiring an image including the article and a specification process of specifying the position of the article with a predetermined position of the image as the origin. Further, in the example shown in FIG. 14, the server 40 executes a conversion process and a generation process of converting information regarding the position of the article into information for indicating the location of the article. However, the present invention is not limited to this, and each functional block of the management system 50 may be distributed and provided in the management device 30 and the server 40, and each process may be executed. Of course, the configuration in which each functional block of the management system 50 is provided in the management device 30 alone or the configuration in which it is provided in the server 40 alone may be adopted.

[0083] <Management method> Subsequently, the management method according to the present disclosure will be described. FIG. 15 is a flowchart showing the management method according to the present disclosure. The subject of each step is any one of the management device 30, the server 40, and the control device 60. Here, the description will be made on the premise that the management device 30 includes a display unit.

[0084] First, the management device 30 acquires an image including the target article (step ST101). Step ST101 is the same as step ST1 shown in FIG. 4.

[0085] Next, the management device 30 specifies the position of the target article with a predetermined position of the image as the origin (step ST102). Since step ST102 is the same as step ST12 shown in FIG. 7, a detailed description thereof will be omitted.

[0086] Next, the management device 30 transmits to the server the position of the target article with a predetermined position of the image as the origin (step ST103). Then, the server 40 receives from the management device 30 the position of the target article with a predetermined position of the image as the origin (step ST201).

[0087] Next, the server 40 converts the information regarding the position of the target article specified by the coordinate specifying unit 121 into information for indicating the location of the target article (step ST202). Since step ST202 is the same as step ST13 shown in FIG. 7, a detailed description thereof will be omitted.

[0088] Next, the server 40 generates display information so that the information for indicating the location of the target article can be displayed on the image corresponding to the target article as text characters (step ST203). More specifically, as shown in FIG. 10, the display information is generated so that the location number is displayed corresponding to the target article.

[0089] Next, the server 40 transmits the display information to the management device 30 (step ST204).

[0090] The management device 30 receives the display information from the server (step ST104). Then, the management device 30 displays the display information (step ST105). As a result, for example, as shown in FIG. 10, since the location number is displayed corresponding to the target article on the image, the user can easily grasp the location number.

[0091] Then, in the management device 30, linking processing of the information for indicating the location of the target article (for example, the location number) and the information regarding the target article is executed (step ST106). As a result, the user does not need to take the trouble to link the information for indicating the location of the target article (for example, the location number) and the information regarding the target article, and can efficiently manage the articles. Further, the management device 30 transmits to the server 40 a signal indicating that the linking process of the location number and the information regarding the target article has been completed (step ST106).

[0092] The server 40 receives information (e.g., location number) indicating the location of the target article and a signal indicating that the linking process between the information regarding the target article has been completed (step ST205). Then, the server 40 transmits the information indicating the location of the target article to the control device 60 (step ST206).

[0093] The control device 60 receives information (e.g., location number) indicating the location of the target article from the server 40 (step ST301). Then, the control device 60 controls the movement of the carrier based on the information (e.g., location number) indicating the location of the target article received from the server 40 (step ST302).

[0094] In this way, after the linking between the information (e.g., location number) indicating the location of the target article and the information regarding the article is executed, the control device 60 controls the carrier to start moving. Thereby, for example, the carrier can convey the target article to the storage location based on the information (e.g., location number) indicating the location of the target article.

[0095] Note that in the management device 30, after the linking process is executed (step ST106), the management device 30 may be configured to transmit the position of the target article specified in step ST102 to the control device 60. Thereby, the control device 60 receives the position of the target article specified from the management device 30 (corresponding to step ST301). Then, the management device 30 controls the movement of the carrier based on the specified position of the target article (corresponding to step ST302). In this case, the processes of step ST205 and step ST206 in the server 40 are unnecessary.

[0096] Since the carrier stores the correspondence between the location number and the coordinates, when it receives a movement control signal based on the location number from the control device 60, it can move to the position of the target article. Further, even if the carrier does not store the correspondence between the location number and the coordinates, when it receives a movement control signal based on the position information from the management device 30 from the control device 60, it can move to the position of the target article.

[0097] Of course, when the management system 50 is composed of the management device 30 and the control device 60, the processes of steps ST201 to ST206 are executed in the management device 30. That is, the processes of steps ST201 to ST206 are not limited to being executed in the server 40 shown in FIG. 15, and may be executed in the management device 30. In this case, after the linking process is executed (step ST106), the management device 30 may transmit information (for example, location number) indicating the location of the target article or the position of the target article specified in step ST102 to the control device 60.

[0098] Similarly, when the management system 50 is composed of the server 40 and the control device 60, the processes of steps ST101 to ST106 are executed in the server 40. That is, the processes of ST101 to ST106 are not limited to being executed in the management device 30 shown in FIG. 15, and may be executed in the server 40.

[0099] <Configuration example> FIG. 16 is a block diagram showing a configuration example of the management device according to the present disclosure. FIG. 16 is a block diagram showing a configuration example of the above-described management devices 10 and 30 (hereinafter referred to as management device 10 etc.). Referring to FIG. 16, the management device 10 etc. includes a network interface 1201, a processor 1202, and a memory 1203. The network interface 1201 may be used to communicate with a network node. The network interface 1201 may include, for example, a network interface card (NIC) compliant with the IEEE 802.3 series. IEEE represents the Institute of Electrical and Electronics Engineers.

[0100] The processor 1202 reads and executes software (computer program) from the memory 1203 to perform the processing of the management device 10 etc. described using the flowchart in the above embodiment. The processor 1202 may be, for example, a microprocessor, an MPU, or a CPU. The processor 1202 may include a plurality of processors.

[0101] The memory 1203 is composed of a combination of a volatile memory and a non-volatile memory. The memory 1203 may include storage arranged separately from the processor 1202. In this case, the processor 1202 may access the memory 1203 via an I / O (Input / Output) interface (not shown).

[0102] In the example of FIG. 16, the memory 1203 is used to store a group of software modules. The processor 1202 can read and execute these groups of software modules from the memory 1203 to perform the processing of the management device 10 etc. described in the above embodiment.

[0103] As described with reference to FIG. 16, each of the processors included in the management device 10 and the like executes one or more programs including a set of instructions for causing a computer to execute the algorithms described with reference to the drawings.

[0104] In the above example, the program includes a set of instructions (or software code) for causing a computer to perform one or more functions described in the embodiments when loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0105] Although the present disclosure has been described with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. And each embodiment can be combined with other embodiments as appropriate.

[0106] Each drawing is merely an illustration for explaining one or more embodiments. Each drawing may be associated with not only one specific embodiment but also one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with the features or steps shown in one or more other drawings, for example, to create embodiments that are not explicitly illustrated or described. Not all of the features or steps shown in any one drawing for explaining exemplary embodiments are necessarily essential, and some features or steps may be omitted. The order of the steps described in any drawing may be changed as appropriate.

[0107] Some or all of the above embodiments may be described as follows, but are not limited thereto. (Appendix 1) An acquisition unit that acquires an image including the target article, A control unit that controls to display, as text characters, information indicating the location of the target article corresponding to the target article on the image, A Management device. (Appendix 2) The control unit includes a coordinate specifying unit and a coordinate conversion unit, The coordinate specifying unit specifies the position of the target article with a predetermined position of the image as the origin, The coordinate conversion unit converts information regarding the position of the target article specified by the coordinate specifying unit into information indicating the location of the target article, The management device according to Appendix 1. (Appendix 3) When the coordinate specifying unit recognizes the identification information of a wall or a floor or a ceiling, the coordinate specifying unit recognizes the position with the identification information attached as the predetermined position, The management device according to Appendix 2. (Appendix 4) The position of the target article is indicated using the distance and direction from the origin or the coordinates from the origin, The management device according to Appendix 2. (Appendix 5) The control unit controls to display, on the image, information indicating the location of the selected target article corresponding to the selected target article based on a touch operation by the user. The management device according to Appendix 1 or 2. (Appendix 6) The control unit controls to display, on the image, information for sorting the target article, which can be touched by the user, corresponding to the target article. When the user touches the information for sorting the target article, the target article is recognized as the selected target article. The management device according to Appendix 5. (Appendix 7) The control unit performs display control so that the information indicating the location of the target article does not overlap with the target article. The management device according to Appendix 1 or 2. (Appendix 8) An acquisition unit that executes an acquisition process for acquiring an image including a target article, A generation unit that executes a generation process for generating display information so that information indicating the location of the target article can be displayed as text characters corresponding to the target article on the image, A management system comprising: (Appendix 9) Further comprising a coordinate specifying unit and a coordinate conversion unit, The coordinate specifying unit executes a specifying process for specifying the position of the target article with a predetermined position of the image as the origin, The coordinate conversion unit executes a conversion process for converting information regarding the position of the target article into information indicating the location of the target article. The management system according to Appendix 8. (Appendix 10) The acquisition process and the specifying process are executed using a management device, The conversion process and the generation process are executed using a server. The management system according to Appendix 9. (Appendix 11) Further comprising a control device that controls the movement of a carrier, The server transmits the display information to the control device, The control device controls the movement of the carrier based on the information received from the server and indicating the location of the target article. The management system according to appended note 10. (Appended note 12) acquires an image including the target article, and controls to display, on the image corresponding to the target article, the information indicating the location of the target article as text characters. A management method executed by a computer. (Appended note 13) acquires an image including the target article, and controls to display, on the image corresponding to the target article, the information indicating the location of the target article as text characters. A program causing a computer to execute the process.

[0108] Some or all of the elements (for example, configurations and functions) described in appended notes 2 to 7 subordinate to appended note 1 may also be subordinate to appended notes 8, 12, and 13 in the same subordinate relationship as appended notes 2 to 7. Some or all of the elements described in any appended note may be applied to various hardware, software, recording means for recording software, systems, and methods.

Explanation of reference signs

[0109] 10, 30 Management device 11 Acquisition unit 12 Control unit 13 Generation unit 40 Server 50 Management system 60 Control device 100, 200, 300, 301, 400, 401, 402 Images 110, 111, 112 Screens 121 Coordinate specifying unit 122 Coordinate conversion unit​​ 1201 Network Interface 1202 Processor 1203 Memory

Claims

1. An acquisition unit that acquires an image including a target article, A control unit that controls to display, as text characters, information indicating the location of the target article on the image corresponding to the target article, A Management device.

2. The control unit includes a coordinate specifying unit and a coordinate conversion unit, The coordinate specifying unit specifies the position of the target article with a predetermined position of the image as the origin, The coordinate conversion unit converts information regarding the position of the target article specified by the coordinate specifying unit into information indicating the location of the target article, The management device according to Claim 1.

3. When the coordinate specifying unit recognizes identification information of a wall, floor, or ceiling, the coordinate specifying unit recognizes the position with the identification information attached as the predetermined position, The management device according to Claim 2.

4. The position of the target article is indicated using the distance and direction from the origin or the coordinates from the origin, The management device according to Claim 2.

5. Based on a touch operation of a user, the control unit controls to display, on the image corresponding to the selected target article, information indicating the location of the selected target article, The management device according to Claim 1 or 2.

6. The control unit controls to display, on the image corresponding to the target article, information that the user can touch-operate and that is for organizing the target article, When the user touch-ops the information for organizing the target article, the target article is recognized as the selected target article, The management device according to Claim 5.

7. The control unit performs display control so that the information indicating the location of the target article does not overlap with the target article, The management device according to Claim 1 or 2.

8. An acquisition unit that executes an acquisition process of an image including a target article, A generation unit that executes a generation process of display information so that information indicating the location of the target article can be displayed as text characters on the image corresponding to the target article, A Management system.

9. Acquire an image including a target article, Control to display, as text characters, information indicating the location of the target article on the image corresponding to the target article, A computer executes a Management method.

10. Acquire an image including a target article, Control to display, as text characters, information indicating the location of the target article on the image corresponding to the target article, A program that causes a computer to execute a process. Program.

Images