Identification device, identification method, and program

The device and method address the challenge of identifying unmarked equipment positions on a map by linking and estimating positions for unlinked identifiers, facilitating automatic equipment layout updates and informative heat maps.

JP7735513B1Active Publication Date: 2025-09-08RAKUTEN GROUP INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024192101
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2025-09-08
Estimated Expiration
2044-10-31

AI Technical Summary

Technical Problem

Existing systems struggle to accurately identify the positions of multiple pieces of identification information on a map image when not all equipment is labeled, making it difficult to determine the layout of equipment within an area.

Method used

A device and method that extracts identifiers conforming to predetermined rules from a map image, links them to their locations, estimates positions for unlinked identifiers based on linked ones, and generates a heat map representing associated information.

Benefits of technology

Accurately identifies and links unlinked identifiers to their positions, enabling automatic equipment layout updates and generating informative heat maps for equipment analysis without manual site checks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007735513000001_ABST
    Figure 0007735513000001_ABST
Patent Text Reader

Abstract

To provide a specifying device etc. capable of estimating the location of an identifier that conforms to a predetermined rule and is not depicted on a map image, and linking the identifier with the location. [Solution] An extraction unit 101 of an identification device 100 extracts, from a map image, identifiers that conform to a predetermined rule and the locations at which the identifiers are drawn. A linking unit 102 links the extracted identifiers to the extracted locations. An identification unit 103 identifies unlinked identifiers, which are identifiers that conform to the predetermined rule and have not yet been linked to a location. An estimation unit 104 estimates a location to be linked to an unlinked identifier based on a location linked to a linked identifier, which is an identifier whose location has been linked by the linking unit 102, and links the unlinked identifier to the estimated location. A registration unit 105 registers the linked identifiers and locations linked by the linking unit 102 and the unlinked identifiers and locations linked by the estimation unit 104.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an identification device, an identification method, and a program. [Background technology]

[0002] Conventionally, there is known a technique for identifying the location where an image was taken by analyzing identification information included in the image. For example, Patent Document 1 discloses a technique for identifying the location where an image was taken by analyzing character information included in the image, such as a postal code or address, or a code, such as a one-dimensional code or a two-dimensional code, in which data that can identify the location data is embedded. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-295198 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, there is a demand for an image containing multiple pieces of identification information, and for the position of each piece of identification information to be identified. For example, in an area such as a warehouse, each piece of equipment installed in the area is assigned an identification name according to a predetermined rule, and in order to grasp the layout of the equipment within the area, it is required to identify the position of the identification name on a map image showing the area. However, in some cases, the map image shows identification names for only some of the equipment, which makes it difficult to identify the position of the identification name assigned to the equipment from the map image.

[0005] The present invention solves the above-mentioned problems, and aims to provide an identification device, identification method, and program that can estimate the location of an identification name that conforms to predetermined rules and is not depicted on a map image, and link the identification name to a location. [Means for solving the problem]

[0006] A specific device according to a first aspect of the present invention comprises: an extracting unit that extracts, from the map image, an identifier that conforms to a predetermined rule and a position where the identifier is drawn; a linking unit that links the extracted identifier with the extracted location; an identification unit that identifies an unlinked identifier that is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation unit that estimates a location to be linked to the specified unlinked identifier based on a location linked to a linked identifier, which is an identifier to which the location is linked by the linking unit, and links the specified unlinked identifier to the estimated location; a registration unit that registers a linked identifier and a location linked by the linking unit and an unlinked identifier and a location linked by the estimation unit; The present invention is characterized by comprising:

[0007] In addition, in the specific device according to the above aspect, The facilities within the area shown on the map image are depicted surrounded by contour lines of a predetermined shape, the linking unit cancels the linking related to the identifier if the location extracted together with the identifier in the map image is not surrounded by the contour line of the predetermined form; The estimation unit stops the linking of the unlinked identifier name if the estimated position of the unlinked identifier name in the map image is not surrounded by the contour line of the predetermined form. It is characterized by:

[0008] In addition, in the specific device according to the above aspect, Identifiers that conform to the predetermined rules are ordered by the predetermined rules; The estimation unit selecting two linked identifiers that sandwich the unlinked identifier in the order; A position to be linked to the unlinked identifier is estimated based on two distances based on the order between the unlinked identifier and the two selected linked identifiers, and two positions linked to the two linked identifiers. It is characterized by:

[0009] In addition, in the specific device according to the above aspect, The estimation unit estimates a position obtained by dividing the two positions internally by the ratio of the two distances as a position to be linked to the unlinked identifier. It is characterized by:

[0010] In addition, in the specific device according to the above aspect, Identifying a color associated with the information based on the information associated with the identification name; Identifying a location registered in association with the identifier; a generating unit that generates a heat map representing the information by depicting the identified color at the identified position; The device further comprises:

[0011] In addition, in the specific device according to the above aspect, The map image is divided into a grid of cells, The generation unit renders the specified color in a cell that includes the specified position. It is characterized by:

[0012] In addition, in the specific device according to the above aspect, Identifying a color associated with the information based on the information associated with the identification name; Identifying a location registered in association with the identifier; a generating unit configured to generate a heat map representing the information by depicting the identified color at the identified position; The generation unit determining areas corresponding to the respective identifiers by dividing the area surrounded by the contour line of the predetermined form using the positions registered in association with the identifiers as mother points; The specified color is displayed in an area including the specified position. It is characterized by:

[0013] In addition, in the specific device according to the above aspect, The extraction unit extracts an identification name that conforms to the predetermined rule and a position where the identification name is drawn by machine-recognizing a character string displayed on the map image and a position where the character string is displayed within the map image. It is characterized by:

[0014] In addition, in the specific device according to the above aspect, The generation unit generating a blank map by filling in the map image with a predetermined background color the portion of the map image in which the identifier conforming to the predetermined rule is depicted; The identified colors are depicted in the generated blank map. It is characterized by:

[0015] In addition, in the specific device according to the above aspect, a set of distinguished names that conform to the predetermined rules is maintained in a database; The identifying unit identifies an identifier that is included in the set and is not the linked identifier as the unlinked identifier. It is characterized by:

[0016] In addition, in the specific device according to the above aspect, The registration unit registers, in the database, the linked identifier name and location linked by the linking unit and the unlinked identifier name and location linked by the estimation unit. It is characterized by:

[0017] In addition, in the specific device according to the above aspect, the extraction unit generates a set of identifiers that conform to the predetermined rule based on the predetermined rule and the identifiers depicted on the map image; The identification unit identifies, as the unlinked identifier name, an identifier name that is included in the generated set and is not the linked identifier name.

[0018] The identification method according to the second aspect of the present invention comprises: A specific method executed by a specific device, an extraction step of extracting, from the map image, an identifier that conforms to a predetermined rule and a position where the identifier is drawn; a linking step of linking the extracted identifier with the extracted location; a step of identifying an unlinked identifier that is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation step of estimating a location to be associated with the specified unlinked identifier based on a location associated with an associated identifier, which is an identifier with which the location is associated in the linking step, and linking the specified unlinked identifier with the estimated location; a registration step of registering the linked identifier and location linked in the linking step and the unlinked identifier and location linked in the estimation step; The present invention is characterized by comprising:

[0019] A program according to a third aspect of the present invention comprises: Computer, an extracting unit that extracts, from the map image, an identifier that conforms to a predetermined rule and a location where the identifier is drawn; a linking unit that links the extracted identifier with the extracted location; an identification unit that identifies an unlinked identifier, which is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation unit that estimates a location to be linked to the specified unlinked identifier based on a location linked to a linked identifier, which is an identifier to which the location has been linked by the linking unit, and links the specified unlinked identifier with the estimated location; a registration unit that registers a linked identifier and a location linked by the linking unit and an unlinked identifier and a location linked by the estimation unit; Function as.

[0020] The program may be recorded on a non-transitory recording medium. The non-transitory recording medium can be distributed or sold independently of the computer. Here, a non-transitory recording medium refers to a tangible recording medium. Examples of non-transitory recording media include compact discs, flexible disks, hard disks, magneto-optical disks, digital video disks, magnetic tapes, and semiconductor memories. A transitory recording medium refers to the transmission medium (propagation signal) itself. Examples of transitory recording media include electrical signals, optical signals, and electromagnetic waves. A temporary storage area is an area for temporarily storing data and programs, such as volatile memory such as RAM (Random Access Memory). [Effects of the Invention]

[0021] According to the present invention, it is possible to provide an identification device, an identification method, and a program that can estimate the location of an identification name that conforms to predetermined rules and is not depicted on a map image, and link the identification name to the location. [Brief explanation of the drawings]

[0022] [Figure 1] FIG. 2 is a diagram illustrating a relationship between a specific device and a database according to the embodiment. [Figure 2] FIG. 2 is a diagram illustrating a hardware configuration of a specific device according to an embodiment. [Figure 3]FIG. 2 is a diagram illustrating a functional configuration of a specific device according to an embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of a map image according to the embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of an identification name table according to the embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of a position information table according to the embodiment. [Figure 7] FIG. 10 is a diagram illustrating an example of an analysis information table according to the embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of a color information table according to the embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of a blank map according to an embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a heat map according to the embodiment. [Figure 11] FIG. 10 is a diagram illustrating a specific process executed by a specific device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0023] (1. Overall structure) As shown in FIG. 1, a identifying device 100 according to an embodiment of the present invention is communicably connected to a database 200 via a computer communication network 300 such as the Internet.

[0024] The identifying device 100 is a device that identifies the location of an identifier that matches a predetermined rule from a map image.

[0025] A map image is an image on which an identification name conforming to a predetermined rule is drawn. For example, a map image shows an area such as a warehouse, and equipment within the area shown on the map image is drawn surrounded by outlines of a predetermined shape. Equipment is, for example, a shelf, a desk, etc. placed in a warehouse, and the predetermined shape is, for example, a rectangle, a square, etc. Furthermore, an identification name conforming to a predetermined rule is information for identifying equipment. A predetermined rule is a rule for assigning an identification name to equipment, and is set arbitrarily, for example, by a warehouse manager, etc.

[0026] Although the facilities within the area shown on the map image are given pre-assigned identification names that conform to predetermined rules, the map image may only show the identification names of some of the facilities. In such cases, the identifying device 100 identifies the locations of the identification names that conform to the predetermined rules and are not shown on the map image. The reason why only some of the identification names are shown is that, considering the display space available on the map image, displaying all of the identification names would make it difficult for users to view the map image.

[0027] Database 200 is a database that manages a set of identifiers that conform to predetermined rules, information linking identifiers with locations, etc. Figure 1 essentially shows that a server device having database 200 is connected to computer communication network 300. For example, database 200 may be an SQL (Structured Query Language) database, or may be realized by a table prepared in memory, an associative array, etc.

[0028] (2. Hardware configuration of specific device) FIG. 2 is a block diagram showing the hardware configuration of the identifying device 100. As shown in FIG.

[0029] 2, the identifying device 100 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM 13, a recording medium 14, an output device 15, a communication device 16, and an input device 17. The components are connected to each other via a bus 18.

[0030] The CPU 11 controls the overall operation of the specific device 100, and is connected to each component to exchange control signals and data.

[0031] The ROM 12 stores operating programs and various data necessary for controlling the overall operation of the specific device 100 .

[0032] The RAM 13 is used to temporarily store data and programs, and stores programs and data read from the recording medium 14, as well as other data necessary for communication.

[0033] The recording medium 14 is composed of a hard disk, a flash memory, or the like, and records data to be processed by the specific device 100 .

[0034] The output device 15 includes a display device such as an LCD (Liquid Crystal Display) and an audio output device such as a speaker. The output device 15 outputs, for example, data output from the CPU 11 under the control of the CPU 11.

[0035] The communication device 16 includes a communication interface for connecting the specific device 100 to a computer communication network such as the Internet, and communicates with other information processing devices and the like via the communication device 16 .

[0036] The input device 17 includes input devices such as buttons, a keyboard, a touch panel, a microphone, etc. The input device 17 receives an operation input from the user of the specific device 100 and outputs a signal corresponding to the received operation input to the CPU 11.

[0037] (3. Functional Configuration of Specific Device of Embodiment) The functional configuration of the identifying device 100 will be described with reference to FIG.

[0038] The identifying device 100 functionally includes an extracting unit 101, a linking unit 102, an identifying unit 103, an estimating unit 104, a registering unit 105, and a generating unit 106. In this embodiment, the CPU 11 and the communication device 16 function as the extracting unit 101, the linking unit 102, the identifying unit 103, the estimating unit 104, the registering unit 105, and the generating unit 106.

[0039] The following describes the function of the identifying device 100, taking as an example a case where the position of an identifier that is not drawn in the map image 400 of FIG. 4 is identified.

[0040] Map image 400 in FIG. 4 is a plan view of floor A in a warehouse, showing the arrangement of multiple shelves installed on floor A. Map image 400 is created, for example, by a construction worker, manager, or the like at the warehouse site. In map image 400, shelves are depicted surrounded by a rectangular outline (the outline of the portion indicated by dotted line 4001), and multiple shelves such as shelves 401 to 412 are included in the rectangular outline. Identification names that conform to predetermined rules are assigned to the shelves installed on floor A in the warehouse. A collection of identification names that conform to the predetermined rules is stored in database 200 as an identification name table.

[0041] An example of an identification name table is shown in Figure 5. The identification name table in Figure 5 includes multiple identification names that conform to a predetermined rule. The predetermined rule in Figure 5 is that an identification name is composed of a letter that identifies the floor on which the shelf is located and a number that identifies the shelf, and that either an odd or even number is assigned to a row of shelves. For example, identification names "A101" to "A121" are identification names assigned to shelves in one row, and identification names "A102" to "A122" are identification names assigned to shelves in another row.

[0042] Furthermore, the order of identifiers that conform to the default rules is determined by the default rules. For example, in the identifiers in FIG. 5, shelves in a row are assigned either odd or even numbers in ascending order. For example, according to the default rules in FIG. 5, 11 identifiers, "A101" to "A121," are assigned to a row of shelves including shelves 401 to 406 in map image 400. Furthermore, according to the default rules in FIG. 5, 11 identifiers, "A102" to "A122," are assigned to a row of shelves including shelves 407 to 412 in map image 400. This indicates that the six shelves 401 to 406 and the six shelves 407 to 412 have regions that are subdivided vertically or horizontally, and that identifiers are assigned to the subdivided regions.

[0043] In the map image 400 of FIG. 4, identification names are drawn on some of the shelves among the multiple shelves. For example, when a shelf is newly installed or moved, a map image is created in which identification names are drawn on only some of the equipment. In the row including shelves 401 to 406 in the map image 400, only the identification names "A101" and "A121" are drawn, and the nine identification names "A103" to "A119" are not drawn. Similarly, in the row including shelves 407 to 412 in the map image 400, only the identification names "A102" and "A122" are drawn, and the nine identification names "A104" to "A120" are not drawn. The identifying device 100 identifies the locations of the identification names "A103" to "A119" and "A104" to "A120" that are not drawn in the map image 400. In the following, an example of specifying the identification names for the shelves 401 to 412 will be shown, but it is assumed that the same processing is performed for the other shelves included in the map image 400.

[0044] The extraction unit 101 extracts, from the map image, an identification name that conforms to a predetermined rule and the position where the identification name is drawn.

[0045] For example, the extraction unit 101 refers to the identification name table of Figure 5 managed in the database 200 and extracts, from the map image 400 of Figure 4, an identification name that complies with the predetermined rules and the position of the identification name in the map image 400.

[0046] Here, the extraction unit 101 extracts an identification name that conforms to the predetermined rules and the position at which the identification name is drawn by machine-recognizing the character string displayed on the map image and the position at which the character string is displayed within the map image.

[0047] For example, the extraction unit 101 performs OCR (Optical Character Recognition) processing on the map image 400 and extracts, from the character strings recognized by the OCR processing, character strings that match the character strings of the identification names included in the identification name table of FIG. 5 and the positions of the matching character strings. For example, since the character string of the identification name "A101" in the map image 400 matches the character string of the identification name included in the identification name table of FIG. 5, the extraction unit 101 extracts the identification name "A101" and the position [x11, y11] of the identification name "A101" in the map image 400. Here, the extraction unit 101 extracts the center position of the machine-recognized character string as the position where the identification name is drawn, and the extracted position is indicated by pixel-unit coordinates with the upper left corner of the map image 400 as the origin. On the other hand, since the character string of "Floor A" in the map image 400 does not match the character string of the identification name included in the identification name table of FIG. 5, the extraction unit 101 does not extract the character string of "Floor A" as an identification name.

[0048] The linking unit 102 links the extracted identifier with the extracted location.

[0049] For example, the linking unit 102 links the extracted identifier "A101" with the position [x11, y11] of the extracted identifier "A101." Information on the identifier and the position linked by the linking unit 102 is stored in, for example, the RAM 13.

[0050] Here, if the location extracted together with the identifier name in the map image is not surrounded by a contour line of a predetermined form, the linking unit 102 stops linking related to the identifier name.

[0051] For example, the identifier "A601" in the map image 400 in Fig. 4 conforms to the predetermined rule, but is not surrounded by the outline of a rectangle and is drawn in the corridor of floor A. In such a case, the linking unit 102 determines that the position [x61, y61] of the character string of the identifier "A601" in the map image 400 is not included in the outline of the rectangle, and does not link the identifier "A601" with the position [x61, y61].

[0052] The identification unit 103 identifies an unlinked identifier, which is an identifier that conforms to the predetermined rule and has not yet been linked to a location. Specifically, the identification unit 103 identifies, as an unlinked identifier, an identifier that is included in a set of identifiers that conform to the predetermined rule and is not a linked identifier, which is an identifier whose location has been linked by the linking unit 102.

[0053] An unlinked identifier is an identifier that conforms to the predetermined rules and is not linked to a location on the map image. For example, an unlinked identifier is an identifier that is included in the identifier table of FIG. 5 but is not linked to a location by the linking unit 102. A linked identifier is an identifier that conforms to the predetermined rules and is linked to a location on the map image. For example, a linked identifier is an identifier that is included in the identifier table of FIG. 5 and is linked to a location by the linking unit 102.

[0054] For example, the identification unit 103 refers to the identification name table in Fig. 5 and the information on the identification names and locations linked to their locations, and identifies the identification names "A103" to "A119" and "A104" to "A120" as unlinked identification names. Also, the identification unit 103 refers to the identification name table in Fig. 5 and the information on the identification names and locations linked to their locations, and identifies the identification names "A101", "A121", "A102", and "A122" as linked identification names.

[0055] The estimation unit 104 estimates a position to be linked to the identified unlinked identifier based on a position linked to a linked identifier, which is an identifier whose position has been linked by the linking unit 102, and links the identified unlinked identifier to the estimated position. Specifically, the estimation unit 104 selects two linked identifiers that sandwich the unlinked identifier in an order determined by a predetermined rule, and estimates a position to be linked to the unlinked identifier based on two distances based on the order between the unlinked identifier and the two selected linked identifiers, and two positions linked to the two linked identifiers.

[0056] 5, the estimation unit 104 selects two linked identifier names "A101" and "A121" that sandwich the unlinked identifier name "A103", and determines the distance of the unlinked identifier name "A103" from the linked identifier name "A101" to be "1", and the distance of the unlinked identifier name "A103" from the linked identifier name "A121" to be "9". Then, the estimation unit 104 estimates the position of the unlinked identifier name "A103" based on the distance "1" from the linked identifier name "A101" and the distance "9" from the linked identifier name "A121", as well as the coordinates [x11, y11] of the linked identifier name "A101" and the coordinates [x11, y12] of the linked identifier name "A121". Similarly, the estimation unit 104 calculates the distance from the linked identifier name "A101" and the distance from the linked identifier name "A121" for the unlinked identifier names "A105" to "A119", and estimates the positions of the unlinked identifier names "A105" to "A119" based on the calculated distances and the coordinates [x11, y11] of the linked identifier name "A101" and the coordinates [x11, y12] of the linked identifier name "A121".

[0057] More specifically, the estimation unit 104 estimates a position obtained by dividing the two positions internally by the ratio of the two distances as a position that should be linked to the unlinked identifier.

[0058] For example, based on the ratio of the two distances obtained for the unlinked identifier "A103" being "9:1", the estimation unit 104 estimates the position [x11, (y11 x 9 + y12 x 1) / 10] obtained by dividing the position [x11, y11] of the linked identifier "A101" and the position [x11, y12] of the linked identifier "A121" internally as the position that should be linked to the unlinked identifier "A103", and links the unlinked identifier "A103" to the estimated position [x11, (y11 x 9 + y12 x 1) / 10]. Similarly, the estimation unit 104 estimates the position obtained by dividing the position [x11, y11] of the linked identifier "A101" and the position [x11, y12] of the linked identifier "A121" internally based on the ratio of the two distances obtained for each of the unlinked identifier names "A105" to "A119", as the position to be linked to the unlinked identifier names "A105" to "A119", and links the unlinked identifier names "A105" to "A119" to the estimated position.

[0059] Here, if the position estimated for the unlinked identifier on the map image is not surrounded by a contour line of a predetermined form, the estimation unit 104 stops linking the unlinked identifier.

[0060] For example, in the map image 400 of Figure 4, if the coordinates of the estimated position are not surrounded by a rectangular outline and indicate a corridor on floor A, the estimation unit 104 determines that the estimated position is not included in the rectangular outline in the map image 400, and does not link the unlinked identifier name to the estimated position.

[0061] The registration unit 105 registers the linked identifier name and location linked by the linking unit 102 and the unlinked identifier name and location linked by the estimation unit 104. Specifically, the registration unit 105 registers the linked identifier name and location linked by the linking unit 102 and the unlinked identifier name and location linked by the estimation unit 104 in the database 200.

[0062] For example, the registration unit 105 registers the linked identifier name and location linked by the linking unit 102 and the unlinked identifier name and location linked by the estimation unit 104 in a location information table stored in the database 200.

[0063] An example of a location information table is shown in FIG. 6. The location information table in FIG. 6 includes an identifier conforming to a predetermined rule and a location associated with the identifier, in association with each other. For example, as shown in the record in the first row of the location information table in FIG. 6, the registration unit 105 associates and registers the associated identifier "A101" with the location [x11, y11]. Also, as shown in the record in the second row of the location information table in FIG. 6, the registration unit 105 associates and registers the unassociated identifier "A103" with the location [x11, (y11×9+y12×1) / 10]. Similarly, as shown in the records in the third to tenth rows of the location information table in FIG. 6, the registration unit 105 associates and registers the unassociated identifiers "A105" to "A119" with the locations.

[0064] Next, a case will be described in which the identifying device 100 uses the positions of the identified identifiers to generate a heat map that represents information associated with the identifiers.

[0065] The generation unit 106 generates a heat map representing the information by identifying the color associated with the information based on the information associated with the identification name, identifying the location registered in association with the identification name, and depicting the identified color at the identified location.

[0066] The information associated with the identifier is, for example, an analysis value obtained by analyzing the use of equipment in the area shown on the map image. The analysis value is, for example, the number of picks indicating the number of times an item stored on a shelf was picked up during a specified period, or the inventory turnover rate indicated by the number of shipped items relative to the number of items in stock during a specified period. The specified period is set, for example, by the warehouse manager or the user of the specified device 100. The analysis value associated with the identifier is registered in the analysis information table.

[0067] An example of an analysis information table is shown in Fig. 7. The analysis information table in Fig. 7 is stored in the database 200. The analysis information table contains an association between an identification name that complies with a predetermined rule and an analysis value. The record in the first row of the analysis information table indicates that an item was picked up "50 times" during a specified period from a shelf assigned the identification name "A101."

[0068] For example, when the generation unit 106 identifies the analysis value associated with the identification name "A101" "50 times," it refers to a color information table showing the correspondence between the analysis value and color and identifies the color to be depicted at the position registered in association with the identification name "A101."

[0069] FIG. 8 shows an example of a color information table. The color information table of FIG. 8 is stored in the database 200. The color information table contains analysis values ​​and colors associated with each other. The record in the first row of the color information table indicates that when the number of picks is "0," the color to be depicted in the heat map is "white." For example, the generation unit 106 refers to the color information table of FIG. 8 and identifies the color to be depicted at the position registered in association with the identification name "A101" as "red."

[0070] Next, before drawing the color, the generation unit 106 generates a blank map by filling in the part of the map image where the identifier that conforms to the predetermined rule is drawn with a predetermined background color. The generation unit 106 draws the specified color in the generated blank map.

[0071] The part where the identifier is drawn is the part where the letters of the identifier are drawn or the area surrounding the character string of the identifier. The predetermined background color is the background color of the map image.

[0072] For example, the generation unit 106 fills in the part of the map image 400 in FIG. 4 where the characters of the identification name that conform to the predetermined rules are drawn with the background color of the map image 400, thereby generating the blank map 500 in FIG.

[0073] Then, the generation unit 106 divides the area surrounded by a contour line of a predetermined form using the positions registered in association with the identification name as mother points, thereby determining areas that correspond to each identification name, and depicts the identified color in the area that includes the identified position.

[0074] The location registered in association with the identifier is the location in the location information table in FIG. 6, and the area surrounded by the contour line of the predetermined shape is a rectangular area including multiple shelves. For example, the generation unit 106 performs Voronoi division on the blank map 500 in FIG. 9 using the locations in the location information table in FIG. 6 as kernel points, and determines the area including each kernel point obtained by Voronoi division as the area associated with the identifier registered in association with the location used as the kernel point. Then, the generation unit 106 renders the color identified for the information associated with the identifier in the area including the location identified for the identifier.

[0075] An example of a heat map is shown in FIG. 10. Heat map 600 in FIG. 10 indicates the number of picks in a specified period using colors. In heat map 600, areas 601 to 611 are areas obtained using positions registered in association with identifiers "A101" to "A121" as mother points, and areas 612 to 622 are areas obtained using positions registered in association with identifiers "A102" to "A122" as mother points. For example, area 601 of identifier "A101" is depicted in "red."

[0076] (4. Specific Processing by the Specific Device of the Embodiment) The identification process executed by the identifying device 100 of this embodiment will be described with reference to Fig. 11. When the identifying device 100 receives input of a map image, for example, it starts the identification process shown in Fig. 11.

[0077] The extraction unit 101 extracts, from the map image, identifiers that conform to the predetermined rules and the positions at which the identifiers are drawn (step S101). Hereinafter, the number of identifiers extracted from the map image is represented as N.

[0078] For example, the extraction unit 101 refers to the identification name table of Figure 5 managed in the database 200 and extracts, from the map image 400 of Figure 4, an identification name that complies with the predetermined rules and the position of the identification name in the map image 400.

[0079] The linking unit 102 sets the variable i to 0 (step S102).

[0080] For example, the linking unit 102 sets the variable i of the identification name extracted from the map image 400 in FIG.

[0081] The linking unit 102 determines whether the location extracted together with the identifier name in the map image is surrounded by a contour line of a predetermined form (step S103). If the linking unit 102 determines that the location extracted together with the identifier name in the map image is surrounded by a contour line of a predetermined form (step S103; YES), the linking unit 102 links the extracted identifier name to the extracted location (step S104). Then, the linking unit 102 increments the variable i (step S105). On the other hand, if the linking unit 102 determines that the location extracted together with the identifier name in the map image is not surrounded by a contour line of a predetermined form (step S103; NO), the process proceeds to step S105.

[0082] For example, the linking unit 102 determines that the position [x11, y11] of the extracted identifier "A101" is surrounded by the outline of a rectangle (the outline of the portion indicated by dotted line 4001), and links the identifier "A101" to the position [x11, y11] of the identifier "A101". The linking unit 102 then increments the variable i. On the other hand, the linking unit 102 determines that the position [x61, y61] of the extracted identifier "A601" is not surrounded by the outline of a rectangle, and increments the variable i without linking the identifier "A601" to the position [x61, y61].

[0083] The linking unit 102 determines whether the variable i is equal to the number N of extracted identifier names (step S106). If the linking unit 102 determines that the variable i is equal to the number N (step S106; YES), the identifying unit 103 identifies unlinked identifier names, which are identifier names that conform to the predetermined rules and have not yet been linked to a location (step S107). Hereinafter, the number of identified unlinked identifier names will be represented as M. On the other hand, if the linking unit 102 determines that the variable i is not equal to the number N (step S106; NO), the process returns to step S103.

[0084] For example, if the linking unit 102 determines whether or not the positions of the extracted N identifier names are surrounded by a rectangular outline, the identifying unit 103 refers to the identifier table of Fig. 5 and the identifier names and position information whose positions are linked by the linking unit 102, and identifies identifier names "A103" to "A119", "A104" to "A120", etc. as unlinked identifier names. On the other hand, if the linking unit 102 does not determine whether or not the positions of the extracted N identifier names are surrounded by a rectangular outline, the process returns to step S103.

[0085] The estimation unit 104 estimates the location to be linked to the identified unlinked identifier based on the location linked to the linked identifier, which is an identifier whose location has been linked by the linking unit 102, and links the identified unlinked identifier to the estimated location (step S108).

[0086] For example, the estimation unit 104 estimates the position of the unlinked identifier name "A103" based on the distance "1" from the linked identifier name "A101" and the distance "9" from the linked identifier name "A121" in the order of the identifier names, and the coordinates [x11, y11] of the linked identifier name "A101" and the coordinates [x11, y12] of the linked identifier name "A121". Similarly, the estimation unit 104 estimates the position of each of the remaining M-1 identified unlinked identifier names.

[0087] The estimation unit 104 sets the variable j to 0 (step S109).

[0088] For example, the estimation unit 104 sets the variable j of the identified unlinked identifier to 0.

[0089] The estimation unit 104 determines whether the position estimated for the unlinked identifier in the map image is surrounded by a contour line of a predetermined shape (step S110). If the estimation unit 104 determines that the position estimated for the unlinked identifier in the map image is surrounded by a contour line of a predetermined shape (step S110; YES), the estimation unit 104 links the identified unlinked identifier with the estimated position (step S111). Then, the estimation unit 104 increments the variable j (step S112). On the other hand, if the estimation unit 104 determines that the position estimated for the unlinked identifier is not surrounded by a contour line of a predetermined shape (step S110; NO), the process proceeds to step S112.

[0090] For example, the estimation unit 104 determines that the position [x11, (y11×9+y12×1) / 10] of the identified unlinked identifier "A103" is surrounded by the outline of a rectangle, and links the identifier "A103" to the position [x11, (y11×9+y12×1) / 10] of the identifier "A103". Then, the estimation unit 104 increments the variable j. On the other hand, if the estimation unit 104 determines that the position of the identified unlinked identifier is not surrounded by the outline of a rectangle, it increments the variable j without linking the estimated position of the identified identifier.

[0091] The estimation unit 104 determines whether the variable j is equal to the number M of identified unlinked identifier names (step S113). If the estimation unit 104 determines that the variable j is equal to the number M (step S113; YES), the registration unit 105 registers the linked identifier name and location linked by the linking unit 102 and the unlinked identifier name and location linked by the estimation unit 104 (step S114). Then, the identification device 100 ends the identification process of Fig. 11. On the other hand, if the estimation unit 104 determines that the variable j is not equal to the number M (step S113; NO), the process returns to step S110.

[0092] For example, if the estimation unit 104 determines whether or not the positions of the identified M unlinked identifier names are surrounded by a rectangular outline, the registration unit 105 registers the linked identifier names and positions linked by the linking unit 102 and the unlinked identifier names and positions linked by the estimation unit 104 in a position information table stored in the database 200. Then, the identification device 100 ends the identification process of Fig. 11. On the other hand, if the estimation unit 104 does not determine whether or not the positions of the identified M unlinked identifier names are surrounded by a rectangular outline, the process returns to step S110.

[0093] According to this embodiment, it is possible to identify the positions of identifiers that conform to the default rules but are not depicted on the map image from identifiers that conform to the default rules depicted on the map image. As a result, even if the layout of equipment is changed due to, for example, the installation or relocation of equipment, it is possible to automatically identify the positions of identifiers that conform to the default rules on the map image, thereby eliminating the need for a person to go to the site to check.

[0094] Furthermore, according to this embodiment, even if an identifier conforms to the predetermined rules, if the location of the identifier is not surrounded by a predetermined outline of the facility, the identifier and the location are not linked and registered. As a result, even if an identifier is incorrectly drawn on the map image, it is not registered as an identifier indicating a facility within the area indicated by the map image, so the location of the identifier indicating the facility can be accurately identified.

[0095] Furthermore, according to this embodiment, it is possible to generate a heat map that uses colors to represent information associated with an identifier name by utilizing the position of the identifier name in a map image. This makes it possible to generate a heat map of various analytical values ​​related to equipment, for example, and visualize the analytical values ​​related to the equipment for each position in the map image. Furthermore, by dividing an area surrounded by a contour line of a predetermined form using positions registered in association with the identifier name as mother points, it is possible to automatically determine the area of ​​the equipment to which the identifier name is assigned.

[0096] Furthermore, according to this embodiment, a blank map can be generated by filling in the portion of the map image in which the identifiers that conform to the predetermined rules are drawn with a predetermined background color. This eliminates the need to prepare a separate blank map to generate a heat map, and also eliminates the need to align the map image with the identifiers drawn and the separately prepared blank map, making it easy to generate a heat map.

[0097] (5. Modifications) Although the embodiment of the present invention has been described above, various modifications and applications are possible in carrying out the present invention.

[0098] In the above embodiment, the extraction unit 101 extracts the center position of the machine-recognized character string as the position where the identifier is drawn, but this is not limited to this. The extraction unit 101 extracts a predetermined position of the machine-recognized character string as the position where the identifier is drawn. The predetermined position is set by the user of the identification device 100.

[0099] In the above embodiment, after the determination process of step S113 is completed, the registration unit 105 collectively registers the linked identifier name and location linked by the linking unit 102 and the unlinked identifier name and location linked by the estimation unit 104. However, this is not limiting. For example, after the determination process of step S106 is completed, the registration unit 105 may register the linked identifier name and location linked by the linking unit 102, and after the determination process of step S113 is completed, the registration unit 105 may register the unlinked identifier name and location linked by the estimation unit 104.

[0100] Furthermore, in the above embodiment, the estimation unit 104 estimates the location to be linked to the identified unlinked identifier based on the location linked to the linked identifier linked by the linking unit 102, but this is not limiting. For example, the estimation unit 104 may regard an unlinked identifier whose location was estimated before the unlinked identifier whose location is currently being estimated and to which the estimated location is linked as a linked identifier, and estimate the location of the unlinked identifier whose location is currently being estimated.

[0101] In the above embodiment, the estimation unit 104 estimates a position obtained by dividing two positions internally by the ratio of the two distances as a position to be linked to an unlinked identifier name, but this is not limited to this. For example, the estimation unit 104 may estimate the positions of the unlinked identifier names "A103" to "A119" and correct the positions of the linked identifier names "A101" and "A121" so that the identifier names "A101" to "A121" are evenly arranged on the shelves 401 to 406 in the map image 400 of Fig. 4.

[0102] In the above embodiment, a heat map is generated by drawing a specified color in an area surrounded by a contour line of a predetermined shape, which is divided using registered positions as mother points by linking the area to an identifier. However, this is not limited to this. For example, the map image may be divided into a grid of cells, and the generation unit 106 may generate a heat map by drawing a specified color in a cell that includes the specified position. For example, in the map image 400 of FIG. 4, cells of a size corresponding to the shelf are set, and the generation unit 106 draws "red" in the cell that includes the position [x11, y11] of the identifier "A101."

[0103] Furthermore, in the above embodiment, the set of identifiers conforming to the default rules is managed by the database 200, but this is not limited to this. The set of identifiers conforming to the default rules is not managed in the database 200, and for example, the identifier table of FIG. 5 does not need to be prepared in advance. In this case, the set of identifiers conforming to the default rules is generated based on the default rules and the identifiers depicted on the map image. For example, the extraction unit 101 generates the set of identifiers conforming to the default rules based on the default rules and the identifiers depicted on the map image. Furthermore, the identification unit 103 identifies, as unlinked identifiers, identifiers that are included in the generated set and are not linked identifiers.

[0104] For example, the extraction unit 101 regards as an identifier a character string composed of letters for identifying a floor and numbers for identifying a shelf, among the character strings recognized by the OCR processing on the map image 400 of Fig. 4, and arranges the identifiers drawn on the map image 400 as identifiers "A101", "A121", "A102", "A122", "A201", "A221", "A202", ... in accordance with an order determined by a predetermined rule that a row of shelves is assigned either odd or even numbers in ascending order. Next, the extraction unit 101 connects the positions on the map image of adjacent identifiers among the identifiers arranged in order with a line segment, and if the line segment is surrounded by a contour line of a predetermined shape, generates an identifier that is predicted to exist between the adjacent identifiers according to the predetermined rule. For example, the extraction unit 101 generates nine identifier names "A103" to "A119" between the identifier names A101" and "A121" according to a predetermined rule, since the line segment connecting the positions [x11, y11] and [x11, y12] of the adjacent identifier names "A101" and "A121" in the map image 400 is surrounded by the outline of a rectangle. Similarly, the extraction unit 101 generates identifier names that are predicted to exist between the other adjacent identifier names, such as "A102" and "A122", "A201" and "A221", according to a predetermined rule. Here, when the extracted identifier names are arranged, the positions [x11, y12] and [ The line segment connecting [x12, y11] is surrounded by the outline of a rectangle, but since this is an identifier that would be assigned to a shelf in a different row according to the predetermined rule, the extraction unit 101 does not generate an identifier between the identifiers "A121" and "A102." In this way, the extraction unit 101 generates the identifier table of FIG. 5. Then, the extraction unit 101 references the generated identifier table of FIG. 5 to extract, from the map image 400, identifiers that conform to the predetermined rule and the positions of the identifiers in the map image 400. Furthermore, the identification unit 103 references the generated identifier table of FIG. 5 and the identifiers and position information that are linked to positions, and identifies identifiers "A103" to "A119" and the like as unlinked identifiers.

[0105] Also, for example, suppose that an identifier "A131" is drawn at a position [x11, y13] outside the area surrounded by the rectangular outline so as to be adjacent to the character string "Floor A" in the x-axis direction in the map image 400. In this case, the extraction unit 101 arranges the identifiers extracted from the map image 400 in the order determined by the predetermined rule, as follows: "A101", "A121", "A131", "A102", "A122", ... Here, the line segment connecting the positions [x11, y12] and [x11, y13] of the adjacent identifiers "A121" and "A131" in the map image 400 is not surrounded by the rectangular outline, so the extraction unit 101 does not generate an identifier between the identifiers "A121" and "A131".

[0106] Furthermore, the extraction unit 101 may determine whether to generate an identifier that is predicted to exist between adjacent identifiers, based on the proportion of a line segment connecting the positions of the adjacent identifiers on the map image that is surrounded by a contour line of a predetermined shape. For example, if a line segment connecting the positions [x11, y12] and [x11, y13] of the adjacent identifiers "A121" and "A131" is surrounded by a rectangular contour line by a predetermined proportion (e.g., 80%) or more, the extraction unit 101 generates four identifiers "A123" to "A129" between the identifiers "A121" and "A131" according to a predetermined rule. With this configuration, it is possible to generate an identifier that is predicted to exist between adjacent identifiers, based on the proportion of a line segment connecting the positions [x11, y12] and [x11, y13] of the adjacent identifiers "A121" and "A131" that is surrounded by a rectangular contour line by a predetermined proportion (e.g., 80%) or more. If it is estimated that the majority of identifiers are included in the shelf area, an identifier predicted to exist between adjacent identifiers can be generated. Alternatively, if the line segment connecting the positions [x11, y12] and [x11, y13] of the adjacent identifiers "A121" and "A131" is not enclosed by the outline of the rectangle by a predetermined percentage (e.g., 80%) or more, the extraction unit 101 does not generate an identifier between the identifiers A121" and "A131". With this configuration, if it is estimated that the majority of identifiers predicted to exist between adjacent identifiers are included in the aisle area, it is possible to avoid generating an identifier predicted to exist between adjacent identifiers.

[0107] In addition, by applying an operating program that defines the operation of the specific device 100 according to the above embodiment to an existing personal computer or information terminal device, it is also possible to make the personal computer or information terminal device function as the specific device 100 according to the embodiment.

[0108] The present invention allows various embodiments and modifications without departing from the broad spirit and scope of the present invention. Furthermore, the above-described embodiments are intended to explain the present invention and do not limit the scope of the present invention. That is, the scope of the present invention is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of the invention equivalent thereto are considered to be within the scope of the present invention. [Industrial Applicability]

[0109] According to the present invention, it is possible to provide an identification device, an identification method, and a program that can estimate the location of an identification name that conforms to predetermined rules and is not depicted on a map image, and link the identification name to the location. [Explanation of symbols]

[0110] 11 CPU 12 ROM 13 RAM 14 Recording media 15 Output Devices 16. Communication Devices 17 Input Devices 18 Bus 100 Specific equipment 101 Extraction part 102 Stringing section 103 Specific part 104 Estimation part 105 Registration Department 106 Generation part 200 databases 300 Computer Communication Network 400 map images Shelves 401~412 500 Blank Map 600 Heatmaps 601~622 area

Claims

1. an extracting unit that extracts, from the map image, an identifier that conforms to a predetermined rule and a position where the identifier is drawn; a linking unit that links the extracted identifier with the extracted location; an identification unit that identifies an unlinked identifier that is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation unit that estimates a location to be linked to the specified unlinked identifier based on a location linked to a linked identifier, which is an identifier to which the location is linked by the linking unit, and links the specified unlinked identifier to the estimated location; a registration unit that registers a linked identifier and a location linked by the linking unit and an unlinked identifier and a location linked by the estimation unit; A specific device comprising:

2. The facilities within the area shown on the map image are depicted surrounded by contour lines of a predetermined shape, the linking unit cancels the linking related to the identifier if the location extracted together with the identifier in the map image is not surrounded by the contour line of the predetermined form; The estimation unit stops the linking of the unlinked identifier name if the estimated position of the unlinked identifier name in the map image is not surrounded by the contour line of the predetermined form. The identification device according to claim 1 .

3. Identifiers that conform to the predetermined rules are ordered by the predetermined rules; The estimation unit selecting two linked identifiers that sandwich the unlinked identifier in the order; A position to be linked to the unlinked identifier is estimated based on two distances based on the order between the unlinked identifier and the two selected linked identifiers, and two positions linked to the two linked identifiers. The identification device according to claim 1 .

4. The estimation unit estimates a position obtained by dividing the two positions internally by the ratio of the two distances as a position to be linked to the unlinked identifier. The identification device according to claim 3 .

5. Identifying a color associated with the information based on the information associated with the identification name; Identifying a location registered in association with the identifier; a generating unit that generates a heat map representing the information by depicting the identified color at the identified position; The identification device according to claim 1 , further comprising:

6. The map image is divided into a grid of cells, The generation unit renders the specified color in a cell that includes the specified position. The identification device according to claim 5 .

7. Identifying a color associated with the information based on the information associated with the identification name; Identifying a location registered in association with the identifier; a generating unit configured to generate a heat map representing the information by depicting the identified color at the identified position; The generation unit determining areas corresponding to the respective identifiers by dividing the area surrounded by the contour line of the predetermined form using the positions registered in association with the identifiers as mother points; The specified color is displayed in an area including the specified position. The identification device according to claim 2 .

8. The extraction unit extracts an identification name that conforms to the predetermined rule and a position where the identification name is drawn by machine-recognizing a character string displayed on the map image and a position where the character string is displayed within the map image. The identification device according to claim 1 .

9. The generation unit generating a blank map by filling in the map image with a predetermined background color the portion of the map image in which the identifier conforming to the predetermined rule is depicted; The identified colors are depicted in the generated blank map. The identification device according to any one of claims 5 to 7.

10. a set of distinguished names that conform to the predetermined rules is maintained in a database; The identifying unit identifies an identifier that is included in the set and is not the linked identifier as the unlinked identifier. The identification device according to claim 1 .

11. The registration unit registers, in the database, the linked identifier name and location linked by the linking unit and the unlinked identifier name and location linked by the estimation unit. The identification device according to claim 10 .

12. the extraction unit generates a set of identifiers that conform to the predetermined rule based on the predetermined rule and the identifiers depicted on the map image; The identification unit identifies, as the unlinked identifier name, an identifier name that is included in the generated set and is not the linked identifier name. The identification device according to claim 1 .

13. A specific method executed by a specific device, an extraction step of extracting, from the map image, an identifier that conforms to a predetermined rule and a position where the identifier is drawn; a linking step of linking the extracted identifier with the extracted location; a step of identifying an unlinked identifier that is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation step of estimating a location to be associated with the specified unlinked identifier based on a location associated with an associated identifier, which is an identifier with which the location is associated in the linking step, and linking the specified unlinked identifier with the estimated location; a registration step of registering the linked identifier and location linked in the linking step and the unlinked identifier and location linked in the estimation step; A method for identifying a target object, comprising:

14. Computer, an extracting unit that extracts, from the map image, an identifier that conforms to a predetermined rule and a location where the identifier is drawn; a linking unit that links the extracted identifier with the extracted location; an identification unit that identifies an unlinked identifier, which is an identifier that conforms to the predetermined rule and has not yet been linked to the location; an estimation unit that estimates a location to be linked to the specified unlinked identifier based on a location linked to a linked identifier, which is an identifier to which the location has been linked by the linking unit, and links the specified unlinked identifier with the estimated location; a registration unit that registers a linked identifier and a location linked by the linking unit and an unlinked identifier and a location linked by the estimation unit; A program that functions as a

Citation Information

Patent Citations

  • Positional relationship detecting apparatus and positional relationship detecting system

    JP2020102072A

  • Information processing device, information process system, and information processing method

    JP2024098386A

  • Shelf label management system, shelf label management method, and program

    JP7673841B2

  • Systems and methods for obtaining and using information from map images

    US20080059452A1

  • Method for Rapidly Determining Warehousing Map, Device, Storage Medium and Robot

    US20220088782A1