Management system, management method, and program
Patent Information
- Application Number
- JP2021186540
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2021-11-16
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2041-11-16
AI Technical Summary
Existing asset management systems fail to centrally manage assets both connected and unconnected to networks, requiring manual input of position information and lacking comprehensive coverage, especially in buildings.
A management system that utilizes sensors to detect objects, create floor maps, calculate self-position, identify markers, and associate asset information to centrally manage assets by linking positional and asset data in a database, enabling easy and comprehensive asset tracking and management.
Enables easy and centralized management of assets within buildings, allowing quick response to security incidents and efficient asset information retrieval, including network connections and high-importance assets.
Abstract
Description
Technical Field
[0001] The present disclosure relates to a management system, a management method, and a program.
Background Art
[0002] In recent years, there has been a demand for a technology that can easily manage assets such as control devices installed in a building and machines controlled by the control devices in a unified manner.
[0003] For example, Patent Document 1 discloses a management device that associates and stores machine information and position information of machine tools installed in a factory, presents a layout diagram of the machine tools in the factory based on the stored information, and outputs the machine information of the machine tool selected on the presented layout diagram.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, since the management device of Patent Document 1 acquires the machine information of the machine tools connected to the network and does not acquire the machine information of the machine tools not connected to the network, it is difficult to say that it can comprehensively manage the machine tools in the factory in a unified manner. In addition, when a new machine tool is installed or relocated, the user of the management device of Patent Document 1 needs to manually input the position information of the machine tool, which is laborious.
[0006] Therefore, the present disclosure provides a management system, a management method, and a program that can easily manage the assets installed in a building in a unified manner.
Means for Solving the Problems
[0007] To solve the above problems, a management system according to one aspect of the present disclosure is a management system for centrally managing a plurality of assets installed in a building, comprising: a sensor that detects objects around itself and acquires the positional relationship of the objects with respect to itself; a floor map creation unit that creates a floor map indicating a predetermined floor in the building based on the positional relationship acquired by the sensor; a self-position calculation unit that calculates the self-position of the sensor on the floor map created by the floor map creation unit; a marker identification unit that identifies markers present around the sensor; an asset information acquisition unit that acquires asset information relating to the asset to which the marker is attached based on the marker identified by the marker identification unit; an asset position calculation unit that calculates the position of the asset on the floor map based on the positional relationship, the self-position, and the relative position of the marker with respect to the sensor; a database in which the floor map, the asset information, and position information indicating the position of the asset are linked and registered; and an asset management map creation unit that creates an asset management map based on the database in which the position of the asset is reflected on the floor map and the reflected position of the asset is linked to the asset information.
[0008] Furthermore, a management method according to one aspect of the present disclosure is a management method for centrally managing a plurality of assets installed in a building, and includes: a position relationship acquisition step of detecting an object around a sensor and acquiring the positional relationship of the object with respect to the sensor; a floor map creation step of creating a floor map indicating a predetermined floor in the building based on the positional relationship acquired in the position relationship acquisition step; a self-position calculation step of calculating the self-position of the sensor on the floor map created in the floor map creation step; a marker identification step of identifying a marker present around the sensor; an asset information acquisition step of acquiring asset information relating to an asset to which the marker is attached based on the marker identified in the marker identification step; an asset position calculation step of calculating the position of the asset on the floor map based on the relative position of the marker with respect to the sensor; a registration step of registering the floor map, the asset information, and the position information indicating the position of the asset in a database; and an asset management map creation step of creating an asset management map based on the database, in which the position of the asset is reflected on the floor map and the reflected position of the asset is linked to the asset information.
[0009] Furthermore, a program relating to one aspect of this disclosure is a program for causing a computer to execute the management method described above. [Effects of the Invention]
[0010] According to this disclosure, a management system, management method, and program can be provided that enable easy and centralized management of assets installed within a building. [Brief explanation of the drawing]
[0011] [Figure 1] Figure 1 is a diagram illustrating the overview of the management system according to Embodiment 1. [Figure 2] Figure 2 is a block diagram showing an example of the functional configuration of the management system according to Embodiment 1. [Figure 3]FIG. 3 is a perspective view of the asset management site map creation device in Embodiment 1 as viewed from the upper oblique side. [Figure 4] FIG. 4 is a front view of the asset management site map creation device in Embodiment 1 as viewed from the front side. [Figure 5] FIG. 6 is a flowchart showing an example of the operation of the management system according to Embodiment 1. [Figure 6] FIG. 9 is a diagram showing an image presented on the presentation unit of the information terminal. [Figure 7] FIG. 12 is a diagram showing an example of a database. [Figure 8] FIG. 15 is a diagram showing an example of map information. [Figure 9] FIG. 18 is a diagram showing an example of a floor map. [Figure 10] FIG. 21 is a diagram showing an example of an asset management site map. [Figure 11] FIG. 24 is a diagram showing an example of area division in the asset management site map. [Figure 12] FIG. 27 is a diagram showing another example of area division in the asset management site map. [Figure 13] FIG. 30 is a diagram showing a display example of the asset management site map and management information. [Figure 14] FIG. 33 is a block diagram showing an example of the functional configuration of the management system according to Embodiment 2. [Figure 15] FIG. 36 is a front view of the asset management site map creation device in Embodiment 2 as viewed from the front side. [Figure 16] FIG. 39 is a block diagram showing an example of the functional configuration of the management system according to Embodiment 3. [Figure 17] FIG. 42 is a flowchart showing an example of the operation of the management system according to Embodiment 3. [Figure 18] FIG. 45 is a diagram showing an example of terminal position information. [Figure 19] FIG. 48 is a diagram showing a display example of inspection information.
MODE FOR CARRYING OUT THE INVENTION
[0012] (Findings leading to the present disclosure) In recent years, there has been a demand for a technology that can easily manage assets such as control devices installed in buildings and machines controlled by the control devices in a unified manner.
[0013] For example, in a building such as a factory or a building, there are many assets installed, such as industrial machines such as machine tools or robots and control devices for controlling the industrial machines, equipment devices such as elevators, entrance gates or air conditioners and control devices for controlling the equipment devices, and information processing devices such as personal computers. If the information of these assets is not managed in a unified manner, the facility manager or operator has to go to the location where the asset is installed to check the product name and model number of the asset in order to obtain detailed information about the asset installed in the building, and search based on the product name and model number on the Internet or the like to obtain detailed information about the asset.
[0014] In recent years, as a measure for cyber security, in order to grasp the state of assets that can be connected to a network, it is also important to check and manage the presence or absence of vulnerabilities and the connection relationships between assets. For example, when an asset is infected with a virus and urgent measures such as disconnecting the asset from the network are required, if it is not known where the asset is installed and which assets it is in a connection relationship with, appropriate responses may not be possible. Therefore, it is desirable to manage the asset information and location information in a unified manner not only for assets connected to devices outside the building through wide-area network communication such as the Internet, but also for assets in a connection relationship within the building.
[0015] For example, Patent Document 1 discloses a management device for industrial machines that manages the machine information of industrial machines including various types of machine tools or robots installed in a factory in a unified manner. This management device presents a factory layout diagram of the industrial machines being managed in a batch to the user, and when an icon of an industrial machine displayed on the factory layout diagram is selected by the user, outputs the machine information associated with the selected icon.
[0016] However, the management device described in Patent Document 1 acquires machine information for machine tools connected to the network, but does not acquire machine information for machine tools that are not connected to the network. Therefore, it cannot be said that it comprehensively manages all machine tools in the factory. In addition, the management device in Patent Document 1 requires users to manually input the location information of machine tools when new machine tools are installed or relocated, which is time-consuming.
[0017] Furthermore, as a means of understanding the status of assets, a control device having a status monitoring screen for monitoring the operating status of multiple injection molding machines installed in a factory has been disclosed (Patent Document 2: Japanese Patent Application Publication No. 2004-155053). In this control device, a factory area representing at least one factory is displayed on the status monitoring screen, and within the factory area, icons corresponding to injection molding machines are displayed based on the actual arrangement of injection molding machines within the factory. When a user selects an icon, operating information indicating the operating status of the injection molding machine corresponding to that icon is displayed.
[0018] However, while the control device described in Patent Document 2 can monitor the operating status of injection molding machines connected to a network, it cannot monitor the operating status of industrial machinery such as injection molding machines that are not connected to a network. Furthermore, although various industrial machines other than injection molding machines, control devices for those industrial machines, and personal computers for work are located within the factory, the control device described in Patent Document 2 can only manage information about injection molding machines.
[0019] Furthermore, as a means of automatically determining the location of assets connected to a network, a method for acquiring network terminal location information is disclosed that can automatically acquire location information of terminal devices connected to a network (Patent Document 3: Japanese Patent Application Publication No. 2007-318432). In this method, a table is prepared in advance that links the ports of a switching hub with the location information of the switching hub, access point, or terminal device connected to that port. Then, using SNMP (Simple Network Management Protocol), routing information including the ports and the MAC (Media Access Control) addresses of the terminal devices connected to those ports is read sequentially from the memory of the upstream switching hub toward the downstream switching hub. In this way, the current location of the terminal device is determined by sequentially tracking the terminal devices connected to each port and comparing them with the table.
[0020] However, the method described in Patent Document 3 can only acquire location information of terminal devices connected to an SNMP-compatible switching hub, and therefore cannot be applied to terminal devices that do not support SNMP.
[0021] Therefore, in light of the above problems, the inventors have conducted thorough research and have found a method to create a map of the space in which assets are located, acquire information about the assets located in that space, and store the location of the assets on the map in association with the asset information. This makes it possible to manage information and locations of assets located within a building in association with a map, regardless of whether or not there is a network connection.
[0022] Therefore, according to this disclosure, assets located within a building can be easily and centrally managed.
[0023] (Summary of this disclosure) An overview of one aspect of this disclosure is as follows:
[0024] A management system according to one aspect of this disclosure is a management system for centrally managing a plurality of assets installed in a building, comprising: a sensor that detects objects around itself and acquires the positional relationship of the objects with respect to itself; a floor map creation unit that creates a floor map indicating a predetermined floor in the building based on the positional relationship acquired by the sensor; a self-position calculation unit that calculates the self-position of the sensor on the floor map created by the floor map creation unit; a marker identification unit that identifies markers present around the sensor; an asset information acquisition unit that acquires asset information relating to the asset to which the marker is attached based on the marker identified by the marker identification unit; an asset position calculation unit that calculates the position of the asset on the floor map based on the positional relationship, the self-position, and the relative position of the marker with respect to the sensor; a database in which the floor map, the asset information, and position information indicating the position of the asset are linked and registered; and an asset management map creation unit that creates an asset management map based on the database in which the position of the asset is reflected on the floor map and the reflected position of the asset is linked to the asset information.
[0025] This allows the management system to link and manage various asset-related information on the floor map, enabling easy and centralized management of assets installed within the building. Therefore, according to the management system, users can easily check the location (also called the installation site) of an asset and related information on the floor map.
[0026] For example, in a management system according to one aspect of this disclosure, the asset information acquisition unit may further acquire information indicating whether or not the asset is an asset of high importance for management purposes.
[0027] This allows the management system to manage assets of high administrative importance. Therefore, according to the management system, users can easily identify which assets within the building are of high administrative importance.
[0028] For example, a management system according to one aspect of the present disclosure may further include a management information generation unit that generates management information relating to the management of the assets, and the management information generation unit may register the management information in the database, linking it to the asset management map.
[0029] This allows the management system to easily and centrally manage information related to asset management. Therefore, with the management system, users can check the location of assets on a map and retrieve the necessary information for asset management from the database, enabling quick responses regarding asset management.
[0030] For example, a management system according to one aspect of the present disclosure may further include a network connection determination unit that determines whether or not the asset is connected to a network, and the management information generation unit may acquire the determination result determined by the network connection determination unit, generate the management information based on the acquired determination result, and register the generated management information in the database linked to the asset management map.
[0031] This allows the management system to manage network-connected assets. Therefore, according to the management system, for example, when a security incident occurs, it is possible to identify the location of network-connected assets, enabling users to respond quickly to security incidents.
[0032] For example, a management system according to one aspect of the present disclosure may further include a connection relationship analysis unit that analyzes the connection relationship of the asset with other assets based on the determination result, and the management information generation unit may acquire the analysis results analyzed by the connection relationship analysis unit and generate the management information based on the acquired analysis results.
[0033] This allows the management system to manage whether network-connected assets have connectivity relationships with other assets. Therefore, according to the management system, for example, when a security incident occurs, it is possible to identify other assets that are connected to an asset based on their connectivity relationships, enabling users to respond quickly to security incidents.
[0034] For example, a management system according to one aspect of the present disclosure may further include an incident response unit that determines a response procedure for an incident that may occur in the asset based on the analysis results, and the management information generation unit may acquire the response procedure determined by the incident response unit and generate the management information based on the acquired response procedure.
[0035] This allows the management system to manage procedures for responding to incidents involving assets. Therefore, when a security incident occurs, the management system allows users to check the response procedures and take appropriate action, enabling a swift and appropriate response to security incidents.
[0036] For example, in a management system according to one aspect of the present disclosure, the management information generation unit may acquire area information for each of the multiple areas included in the asset management map, indicating whether or not the area is of high importance for management purposes, and generate the management information based on the acquired area information.
[0037] This allows the management system to manage areas of high administrative importance. Therefore, according to the management system, users can prioritize managing assets in areas of high administrative importance.
[0038] For example, a management system according to one aspect of the present disclosure further includes a reception unit for receiving user instructions, and when the reception unit receives a correction instruction to correct at least one of the asset location information and asset information, the management information generation unit may update the database by correcting at least one of the asset location information and asset information registered in the database in accordance with the correction instruction.
[0039] This allows the management system to update and manage the location and asset information of assets registered in the database. Therefore, according to the management system, if, for example, an asset is replaced, the user can take appropriate action in asset management based on the updated information.
[0040] For example, in a management system according to one aspect of this disclosure, when the management information generation unit receives a correction instruction from the reception unit to modify the management information, the unit may update the database by modifying the management information registered in the database in accordance with the correction instruction.
[0041] This allows the management system to update and manage the management information registered in the database. Therefore, according to the management system, users can manage their assets based on the updated management information, enabling them to take appropriate action in asset management.
[0042] For example, a management system according to one aspect of the present disclosure may further include a presentation unit for presenting information to a user, wherein the presentation unit may, upon receiving an instruction from the reception unit to present the asset management map, present the asset management map in accordance with the instruction.
[0043] This allows the management system to display an asset management map on the display unit. Therefore, according to the management system, users can easily confirm the location of assets by checking the asset management map displayed on the display unit, enabling them to take quick action in asset management.
[0044] For example, in a management system according to one aspect of the present disclosure, when the presentation unit receives a presentation instruction from the reception unit to present at least one of the asset information and management information of an asset selected on the asset management map, the presentation unit may present at least one of the asset information and management information in accordance with the presentation instruction.
[0045] This allows the management system to display registration information (more specifically, various information about assets registered in the database) related to the specified asset on the asset management map displayed on the display unit. Therefore, according to the management system, users can check information about assets at their desired time.
[0046] For example, in a management system according to one aspect of the present disclosure, when the display unit receives a display instruction from the reception unit to display the movement trajectory of the sensor's position on the asset management map, the display unit may display the movement trajectory on the asset management map in accordance with the display instruction.
[0047] This allows the management system to display the movement trajectory of the location sensors on an asset management map, enabling users to visually check, for example, the status of asset inspections.
[0048] Furthermore, a management method according to one aspect of the present disclosure is a management method for centrally managing a plurality of assets installed in a building, and includes: a position relationship acquisition step of detecting an object around a sensor and acquiring the positional relationship of the object with respect to the sensor; a floor map creation step of creating a floor map indicating a predetermined floor in the building based on the positional relationship acquired in the position relationship acquisition step; a self-position calculation step of calculating the self-position of the sensor on the floor map created in the floor map creation step; a marker identification step of identifying a marker present around the sensor; an asset information acquisition step of acquiring asset information relating to an asset to which the marker is attached based on the marker identified in the marker identification step; an asset position calculation step of calculating the position of the asset on the floor map based on the relative position of the marker with respect to the sensor; a registration step of registering the floor map, the asset information, and the position information indicating the position of the asset in a database; and an asset management map creation step of creating an asset management map based on the database, in which the position of the asset is reflected on the floor map and the reflected position of the asset is linked to the asset information.
[0049] This management method allows for the linking of various asset-related information to a floor map, enabling easy and centralized management of assets installed within a building. Therefore, according to this management method, users can easily check the location of assets and related information on the floor map.
[0050] Furthermore, a program relating to one aspect of this disclosure is a program that causes a computer to execute the above-described management method.
[0051] This allows a computer to achieve the same effect as the management method described above.
[0052] These comprehensive or specific embodiments may be implemented as systems, methods, apparatus, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs (Compact Disc Read Only memory), or as any combination of systems, methods, apparatus, integrated circuits, computer programs, and recording media.
[0053] The embodiments will be described in detail below with reference to the drawings. The numerical values, shapes, materials, components, arrangement and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit the scope of the claims. Furthermore, among the components in the following embodiments, those not described in the independent claim representing the highest-level concept will be described as optional components.
[0054] Furthermore, the figures are not necessarily strictly accurate. In each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.
[0055] Furthermore, in this disclosure, terms indicating relationships between elements such as parallel and perpendicular, terms indicating the shape of elements such as rectangles, and numerical values do not represent only strict meanings, but also include substantially equivalent ranges, such as differences of a few percent.
[0056] (Embodiment 1) First, Embodiment 1 will be described with reference to the drawings.
[0057] [Management System] [1. Overview] An overview of the management system according to Embodiment 1 will be described. Figure 1 is a diagram illustrating the overview of the management system according to the embodiment.
[0058] The management system 400 is a system that centrally manages multiple assets 1 within a building by storing asset information related to asset 1 installed within the building, location information indicating the installation location of asset 1 within the building, and linking these to a map of the floor where asset 1 is installed (in other words, a floor map) in a database.
[0059] Here, a building is a factory, office building, commercial facility, medical facility, educational facility, or public facility. Asset 1 is equipment and devices equipped with a so-called CPU (Central Processing Unit), such as a microcomputer or microcontroller. More specifically, Asset 1 is equipment and devices that may be subject to security threats such as malware infection or cyberattacks via a network such as the Internet or an intranet. Asset 1 includes, for example, industrial machinery such as machine tools or robots and control devices that control industrial machinery, equipment such as sensors, elevators, entrance gates or air conditioning systems and control devices that control equipment, and information processing devices such as personal computers.
[0060] Furthermore, asset information includes information about asset 1 itself and information about assets such as programs or data held by asset 1. For example, information about asset 1 itself may include identification information to identify asset 1, model number, serial number, product name, photograph of its appearance, size, material, manufacturer name, product URL information, and administrator. Information about assets such as programs or data held by asset 1 may include the program name, data name, and data type.
[0061] The management system 400 creates a floor map (a so-called floor map) and stores the location information and asset information of the assets 1 installed on that floor, linking them to the map. More specifically, the asset management map creation device 100 of the management system 400 identifies the marker 2 of the asset 1 while creating the floor map and acquires asset information based on the identified marker 2. The asset management map creation device 100 then calculates the position of the marker 2 relative to itself, and creates an asset management map by linking the calculated location information and asset information to the floor map, and stores the created asset management map in the database.
[0062] Furthermore, the management system 400, for example, if it identifies a marker 3 indicating that an asset 1 is of high importance for management purposes, manages the asset 1 to which the marker 3 is attached as a key asset. A key asset is an asset of high importance for management purposes, and may, for example, be an asset whose status should be checked preferentially. Specifically, for example, a key asset may be an asset to which inventory or work-in-progress should be prioritized. Also, for example, a key asset may be an asset to which the operation of asset 1 should be stopped preferentially. Specifically, for example, a key asset may be an asset that, if a problem such as a virus infection occurs in asset 1, could potentially cause relatively significant damage to other assets 1 connected to asset 1 (for example, via a network connection).
[0063] Furthermore, the management system 400, for example, if it identifies a marker 4 indicating an area of high administrative importance, manages the area to which the marker 4 is attached (the area enclosed by the dashed line in the figure) as an important area. An important area may be set regardless of whether or not there are important assets in that area. An important area is an area of high administrative importance, and for example, it may be an area where the status of asset 1 installed in that area is frequently checked, or it may be an area where, in the event of a problem, the status of the area and the status of asset 1 installed in that area are checked as a priority.
[0064] The management system 400 may create an asset management map by creating a floor map and linking the location and asset information of asset 1 to the floor map. Alternatively, the management system 400 may create an asset management map based on the database after linking the floor map, location information indicating the location of asset 1, and asset information. Furthermore, the management system 400 may update the asset management map based on the database, which has been updated with corrected asset information, etc. By presenting the asset management map to the user, the management system 400 allows the user to visually confirm the installation location of asset 1. In addition, by presenting the asset information of asset 1 selected on the asset management map, the management system 400 allows the user to easily grasp the information of asset 1.
[0065] Figure 1 shows an example in which the asset management map creation device 100 is mounted on a trolley 190, and the user pushes the trolley 190 to move across the floor, thereby creating an asset management map. However, the device is not limited to this example. For example, the asset management map creation device 100 may have wheels for movement, or it may have wheels and a motor to drive the wheels. Alternatively, the asset management map creation device 100 may be a robot that can move by operation such as a remote control.
[0066] The floor map may be created, for example, by an asset management map creation device 100 equipped with a LiDAR and position sensors such as an odometry device, or by an information terminal 200 equipped with a LiDAR.
[0067] [2. Structure] Next, the configuration of the management system 400 according to Embodiment 1 will be described. Figure 2 is a block diagram showing an example of the functional configuration of the management system 400 in Embodiment 1.
[0068] The management system 400 includes, for example, an asset management map creation device 100, an information terminal 200, and a management device 300. The asset management map creation device 100, the information terminal 200, and the management device 300 are communicated together via a network. The following describes each of these components.
[0069] [2-1. Asset Management Map Creation Device] First, the asset management map creation device 100 will be described. Figure 3 is a perspective view of the asset management map creation device 100 in Embodiment 1, viewed from diagonally above. Figure 4 is a front view of the asset management map creation device 100 in Embodiment 1, viewed from the front.
[0070] The asset management map creation device 100 is a device that creates a floor map of a predetermined floor within a building where asset 1 is installed, and creates an asset management map by linking the location information indicating the position of asset 1 with the asset information of asset 1 on the created floor map. More specifically, the asset management map creation device 100, while traveling on a predetermined floor by user operation, calculates the position of asset 1 on the floor map based on the floor map, its own position, and the relative position of marker 2, and creates a registered asset management map by linking the calculated position of asset 1 with the asset information.
[0071] For example, as shown in Figure 3, the asset management map creation device 100 may be mounted on a trolley 190 and driven on a predetermined floor by user operation. In this example, the user drives the asset management map creation device 100 by pushing the trolley 190. The trolley 190 may have, for example, a stand 192 for mounting an information terminal 200 attached to a handle 191, or it may have a display unit (not shown) for the asset management map creation device 100 installed on it. The display unit may be a so-called display panel.
[0072] The asset management map creation device 100 is not limited to the example shown in Figure 3. For example, the main body 101 of the asset management map creation device 100 may be equipped with a running section including wheels and a motor for rotating the wheels, and it may move on the floor by operation of a remote control or the like. Furthermore, for example, the asset management map creation device 100 may also be equipped with a handle on the main body 101, in which case the asset management map creation device 100 may be moved by operating the handle.
[0073] Next, the configuration of the asset management map creation device 100 will be described. As shown in Figure 2, the asset management map creation device 100 includes, for example, a position sensor 102, an imaging unit 104, a communication unit 110, a control unit 120, a storage unit 130, and a reception unit 140. Each of these components will be described below.
[0074] [Position sensor] The position sensor 102 detects objects around itself and acquires the positional relationship of objects relative to itself. For example, the position sensor 102 is located in the center of the top surface of the main body 101 and acquires the positional relationship, including distance and direction, between the asset management map creation device 100 and objects, including walls, that exist around the asset management map creation device 100. The position sensor 102 may be, for example, a LiDAR (Light Detection and Ranging) that emits light and detects positional relationships based on the light reflected back by obstacles, or a laser rangefinder. The position sensor 102 may have one or two scanning axes for light to perform two-dimensional or three-dimensional measurement of a predetermined area around the asset management map creation device 100.
[0075] In addition to the position sensor 102, the asset management map creation device 100 may also be equipped with other types of sensors. For example, the asset management map creation device 100 may further be equipped with a floor sensor, encoder, acceleration sensor, angular velocity sensor, contact sensor, ultrasonic sensor, distance measuring sensor, and the like.
[0076] [Imaging Department] The imaging unit 104 is an imaging device that images the area around the asset management map creation device 100. For example, the imaging unit 104 captures an image that includes markers around the asset management map creation device 100. This image may be a single image or a moving image. The imaging unit 104 may be located on the front of the main body 101 or rotatably located on the top surface. The imaging unit 104 may also consist of multiple cameras. The imaging unit 104 may be, for example, a stereo camera or an RGB-D camera. An RGB-D camera acquires distance image data (Depth) in addition to color image data (RGB). For example, as shown in Figure 4, if the imaging unit 104 is an RGB-D camera, the imaging unit 104 may include an RGB camera 104a, an infrared sensor 104b, and a projector 104c.
[0077] [g section] The communication unit 110 is a communication circuit for the asset management map creation device 100 to communicate with the information terminal 200 and the management device 300 via the network 5. For example, the communication unit 110 may transmit asset management maps to the information terminal 200 and the management device 300. The communication unit 110 may include a communication circuit for communication via a wide-area communication network and a communication circuit for communication via a local communication network. The communication unit 110 is, for example, a wireless communication circuit for wireless communication. The communication standard for communication performed by the communication unit 110 is not particularly limited.
[0078] [Control Unit] The control unit 120 performs various information processing to control the operation of the asset management map creation device 100. Specifically, the control unit 120 is implemented by a processor, a microcomputer, or a dedicated circuit. Alternatively, the control unit 120 may be implemented by a combination of two or more of the processor, microcomputer, or dedicated circuit. For example, the control unit 120 includes an acquisition unit 121, a self-position calculation unit 122, a floor map creation unit 123, a marker identification unit 124, a marker position calculation unit 125, an asset position calculation unit 126, an asset information acquisition unit 127, and an asset management map creation unit 128.
[0079] The acquisition unit 121 acquires, for example, the positional relationship of surrounding objects relative to the main body 101 of the asset management map creation device 100, which is acquired by the position sensor 102. The acquisition unit 121 also acquires image data (in other words, image information) captured by the imaging unit 104. Furthermore, if the asset management map creation device 100 is equipped with other types of sensors in addition to the position sensor 102, the acquisition unit 121 may acquire sensor information acquired by those other types of sensors.
[0080] The self-position calculation unit 122 uses the positional relationships acquired by the position sensor 102 and the floor map created by the floor map creation unit 123 to calculate the self-position of the asset management map creation device 100 on the floor map. For example, the self-position calculation unit 122 calculates its self-position using SLAM (Simultaneous Localization and Mapping) technology. When the asset management map creation device 100 uses SLAM technology, the self-position calculation unit 122 and the floor map creation unit 123 create a floor map while calculating the self-position, and sequentially update the self-position and the floor map.
[0081] The floor map creation unit 123 creates a floor map showing a predetermined floor. More specifically, the floor map creation unit 123 creates a floor map based on information (i.e., positional relationships) measured by the position sensor 102 regarding the position and distance of objects around it. Based on the positional relationships acquired by the position sensor 102, the floor map creation unit 123 may create a floor map of the surrounding environment (objects such as walls and furniture) of the asset management map creation device 100, for example, using SLAM technology. Specifically, the floor map is generated by SLAM using LiDAR as shown in International Publication No. 2020 / 026294 (Patent Document 4). SLAM uses a method called scan matching to match the current observation data (scan data) of the LiDAR with reference observation data (scan data) to estimate the most likely current position. Here, after estimating the current position of the main body 101 of the asset management map creation device 100 equipped with the position sensor 102, the floor map is generated using that observation data (i.e., observation data showing the most likely current position). The floor map generated by SLAM is an image file, such as in PNG (Portable Network Graphics) format.
[0082] The floor map creation unit 123 may create a floor map by adding information from other sensors, such as wheel odometry and gyro sensors, in addition to the sensing information from the position sensor 102 (e.g., LiDAR). The floor map creation unit 123 may also acquire the floor map from, for example, the information terminal 200 or the management device 300, or read the floor map stored in the storage unit 130.
[0083] The marker identification unit 124 identifies markers around the main body 101 of the asset management map creation device 100. For example, the marker identification unit 124 detects markers included in sensing data (e.g., sensing data for measuring positional relationships, image data, etc.) acquired by the position sensor 102 or the imaging unit 104. For example, the marker identification unit 124 may detect markers by analyzing images captured by the imaging unit 104 and identifying marker features such as contours, patterns, and colors. Alternatively, for example, the marker identification unit 124 may refer to marker information stored in the storage unit 130 and identify markers, or markers and marker types, based on marker information corresponding to the identified marker features. For example, as shown in Figure 1, the markers may be AR markers, and multiple types of markers may be used. For example, Marker 2 is an asset marker attached to Asset 1, Marker 3 is a critical asset marker attached to Asset 1 which is of high administrative importance, and Marker 4 is a critical area marker that indicates an area of high administrative importance.
[0084] The marker position calculation unit 125 calculates the relative position of the marker with respect to the main body 101 of the asset management map creation device 100. For example, the marker position calculation unit 125 calculates spatial information by performing a projection transformation based on the vertices of the contour of the marker identified by the marker identification unit 124. For example, based on the position and contour distortion of the marker in the image, which are determined according to the angle and distance from the imaging unit 104 (also called the camera), the marker is projected onto a predetermined rectangle, and a transformation matrix (view matrix) and field of view are calculated from the marker coordinate system, which has the marker as the origin and the plane on which the marker is located as the horizontal plane (XY plane), to the camera coordinate system. The origin of the marker coordinate system is defined, for example, as a predetermined vertex or centroid of the rectangular marker. Furthermore, the calculation of such a transformation matrix can be performed using existing methods or libraries. Regarding the field of view, for example, information on the lens provided by the imaging unit 104 being used may be stored in advance, and the field of view information may be acquired based on that information. Alternatively, instead of calculating a transformation matrix from the marker coordinate system to the camera coordinate system, a transformation matrix from the camera coordinate system to the marker coordinate system may be calculated.
[0085] Furthermore, for example, when the marker position calculation unit 125 identifies a marker 4 (for example, a marker indicating an important area) by the marker identification unit 124, it calculates the relative position of the marker 4 with respect to the main body 101 of the asset management map creation device 100. The marker position calculation unit 125 converts the calculated relative position of the marker 4 into its coordinate system using the position of the main body 101 of the asset management map creation device 100 on the floor map, and calculates the position of the marker 4 on the floor map. For example, if the position and orientation of the main body 101 of the asset management map creation device 100 at time t, generated by the floor map creation unit 123, are (xmt, ymt, θmt), the position of marker 4 before conversion is (xbt, ybt, θbt), and the position of marker 4 after conversion is (xit, yit, θit), then (xit, yit, θit) = (xmt, ymt, θmt) + (xbt, ybt, θbt).
[0086] The asset location calculation unit 126 calculates the position of the asset 1 to which the identified marker is attached on the floor map, based on its positional relationship with objects around it, its own position on the floor map, and its relative position to the marker. The "self" refers to the position sensor 102 and the imaging unit 104, but it may also refer to a device equipped with these sensors (in this case, the main body 101 of the asset management map creation device 100). The asset location calculation unit 126 links the calculated position information indicating the position of asset 1 on the floor map to the identification information of asset 1 and registers it in a database (not shown). Specifically, the position information refers to coordinate information on the floor map.
[0087] The asset information acquisition unit 127 acquires asset information about asset 1 to which a marker is attached, based on the marker identified by the marker identification unit 124. In addition, the asset information acquisition unit 127 acquires information indicating whether or not asset 1 is an asset of high management importance (a so-called important asset) (hereinafter also referred to as important asset information). For example, if the marker is an AR marker, the asset information acquisition unit 127 acquires important asset information in addition to the asset information of asset 1 by reading the information contained in marker 3 (a so-called important asset marker) identified by the marker identification unit 124. In other words, marker 3 contains asset information that includes information indicating whether or not asset 1 to which the marker is attached is an important asset. The asset information acquisition unit 127 registers the asset information, including the important asset information, in a database (not shown) linked to the location information of asset 1.
[0088] The asset management map creation unit 128 creates an asset management map based on a database (not shown), and more specifically, on a floor map, location information indicating the location of asset 1 on the floor map, and asset information for asset 1. The asset management map reflects the location of asset 1 on the floor map, and the reflected location of asset 1 is linked to the asset information. The asset management map creation unit 128 may also modify the asset management map based on user instructions received by the reception unit 140.
[0089] [Storage] The storage unit 130 is a storage device that stores control programs for controlling the operation of the control unit 120. For example, the storage unit 130 may store floor maps created by the floor map creation unit 123, positional relationships acquired by the position sensor 102, relative positions of markers calculated by the marker position calculation unit 125, a database in which position information indicating the location of the floor map and asset 1 is linked and registered, and asset management maps created by the asset management map creation unit 128. The storage unit 130 can be implemented, for example, by an HDD (Hard Disk Drive) or flash memory.
[0090] [Reception Department] The reception unit 140 is a user interface that receives user instructions. Here, the user is a user of the asset management map creation device 100 and can be a person or a robot. The reception unit 140 may be implemented by, for example, a touch panel, a display panel, hardware buttons, a camera, or a microphone. The display panel has an image display function and a function to receive manual input from the user, and accepts input operations to a keypad image displayed on a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The microphone accepts voice input from the user.
[0091] In this example, the reception unit 140 is shown as a component of the asset management map creation device 100, but the reception unit 140 may be integrated with at least one other component of the management system 400. For example, the reception unit 140 may be incorporated into the information terminal 200, into a remote controller (not shown), or into the management device 300.
[0092] [2-2. Information Terminals] Next, the information terminal 200 will be described. The information terminal 200 is, for example, a portable information terminal such as a smartphone or tablet used by the user, but it may also be a stationary information terminal such as a personal computer. Furthermore, the information terminal 200 may be a dedicated terminal for the management system 400. The information terminal 200 comprises a communication unit 210, a control unit 220, a storage unit 230, a reception unit 240, a display unit 250, and an imaging unit 260. Each of these components will be described below.
[0093] [g section] The communication unit 210 is a communication circuit for the information terminal 200 to communicate with the asset management map creation device 100 and the management device 300 via the network 5. The communication unit 210 may include a communication circuit for communication via a wide-area communication network and a communication circuit for communication via a local communication network. The communication unit 210 is, for example, a wireless communication circuit for wireless communication. The communication standard for communication performed by the communication unit 210 is not particularly limited.
[0094] [Control Unit] The control unit 220 controls the display of images to the reception unit 240 and performs identification processing of instructions input by the user (for example, voice recognition processing if the input is by voice). The control unit 220 may be implemented by a microcomputer or a processor.
[0095] [Storage] The memory unit 230 is a storage device that stores dedicated application programs and the like for execution by the control unit 220. The memory unit 230 is implemented, for example, by semiconductor memory.
[0096] [Reception Department] The reception unit 240 receives user instructions. More specifically, the reception unit 240 receives input operations performed by the user to transmit the user instructions to the asset management map creation device 100 and the management device 300. The reception unit 240 may be implemented by, for example, a touch panel, a display panel, hardware buttons, or a microphone. The touch panel may be, for example, a capacitive touch panel or a resistive touch panel. The display panel has an image display function and a function to receive manual input from the user, and receives input operations to a keypad image displayed on a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The microphone receives voice input from the user.
[0097] For example, the reception unit 240 receives instructions from the user to start creating an asset management map, instructions to modify or add information about asset 1 and areas linked to the asset management map, or instructions to start inspecting asset 1, and transmits the received instructions to the asset management map creation device 100 and the management device 300. Information about asset 1 includes, for example, location information indicating the location of asset 1 on the floor map, asset information, and inspection information. Asset information includes detailed information about asset 1 such as specifications, information about the user of asset 1, and information indicating whether or not it is an important asset. Information about areas includes, for example, location information indicating the location of an area on the floor map, size information indicating the size of the area, information indicating whether or not it is an important area, and inspection information. When the reception unit 240 receives information about asset 1 and area information entered by the user, it transmits the received information to the asset management map creation device 100 and the management device 300, and also stores it in the storage unit 230.
[0098] [Presentation part] The display unit 250 presents information to the user. Specifically, for example, when the reception unit 240 receives an instruction to display an asset management map, the display unit 250 presents the asset management map in accordance with the instruction. Also, for example, when the reception unit 240 receives an instruction to display at least one of the asset information and management information of an asset selected on the asset management map, the display unit 250 presents at least one of the asset information and management information in accordance with the instruction. Also, for example, when the reception unit 240 receives a display instruction to display the movement trajectory of the position sensor 102 on the asset management map, the display unit 250 displays the movement trajectory on the asset management map in accordance with the display instruction.
[0099] Furthermore, the display unit 250 may, in accordance with instructions received by the reception unit 240, display, for example, asset information, map information, location information, and management information registered in a database, or it may, in accordance with search instructions, display the results of searching for a predetermined asset 1.
[0100] Furthermore, the display unit 250 may, for example, display asset information linked to markers captured by the imaging unit 260.
[0101] The display unit 250 may also include a display device that displays the above information as an image based on the control of the control unit 220, and an audio output device that outputs audio information as sound. The display device is, for example, a liquid crystal (LC) panel or an organic EL (Electro Luminescence) panel. The audio output device is, for example, a speaker.
[0102] [Imaging Department] The imaging unit 260 is a so-called camera, and is implemented using an image sensor or the like. The imaging unit 260 may capture an image of the exterior of asset 1, or it may capture a marker 2 attached to asset 1. For example, when the imaging unit 260 captures a marker 2, asset information of asset 1 is displayed on the display unit 250.
[0103] [2-3. Management device] The management device 300 is a management device that acquires, for example, an asset management map, a floor map, location information of asset 1, and asset information of asset 1, and registers the acquired information in the database 331 in association with it, thereby managing multiple assets 1 collectively. Furthermore, the management device 300 may generate management information related to the management of asset 1 and register the management information in the database 331 in association with the asset management map. The management device 300 may be, for example, an edge server installed within the building or a cloud server.
[0104] The management device 300 includes, for example, a communication unit 310, a control unit 320, and a storage unit 330.
[0105] [g section] The communication unit 310 is a communication circuit for the management device 300 to communicate with the asset management map creation device 100 and the information terminal 200 via the network 5. For example, the communication unit 310 may transmit information registered in the database 331 to the asset management map creation device 100 and the information terminal 200. The communication unit 310 may include a communication circuit for communication via a wide-area communication network and a communication circuit for communication via a local communication network. The communication unit 310 is, for example, a wireless communication circuit for wireless communication. The communication standard for communication performed by the communication unit 110 is not particularly limited.
[0106] [Control Unit] The control unit 320 performs various information processing related to the management of asset 1 based on information transmitted from the asset management map creation device 100 and user instructions output from the information terminal 200. The control unit 320 may be implemented by, for example, a microcomputer or a processor.
[0107] The acquisition unit 321 acquires, for example, an asset management map, a floor map, location information regarding the location of asset 1 on the floor map, asset information of asset 1, and the movement trajectory of the location sensor 102 from the asset management map creation device 100. The acquisition unit 321 also acquires user instructions received by the reception unit 240 from the information terminal 200.
[0108] The management information generation unit 322 generates management information related to the management of asset 1, for example, and links the generated management information to an asset management map and registers it in the database 331. The management information is information related to the management of asset 1, and more specifically, it is information necessary to manage the cybersecurity risks of asset 1 and multiple assets 1 that are connected to asset 1.
[0109] For example, the management information generation unit 322 may obtain the determination result determined by the network connection determination unit 324 (described later) and generate management information based on the obtained determination result. When the management information generation unit 322 obtains the determination result from the network connection determination unit 324 as to whether or not asset 1 is connected to the network, it registers management information in the database 331 based on the address of asset 1 included in the determination result. At this time, along with the address of asset 1, information indicating whether or not asset 1 is connected to the network (also called information indicating whether or not it is connected to the network) may be registered in the database 331 as management information. Furthermore, if the address of asset 1 is already registered in the database 331, the management information generation unit 322 may compare the address of asset 1 included in the determination result with the address of asset 1 in the database 331 to check whether or not the addresses match. For example, if these addresses do not match, the management information generation unit 322 updates the address of asset 1 in the database 331 with the address of asset 1 included in the determination result.
[0110] Furthermore, for example, the management information generation unit 322 may acquire the analysis results analyzed by the connection relationship analysis unit 325 (described later) and generate management information based on the acquired analysis results. When the management information generation unit 322 acquires the analysis results regarding the connection relationship between asset 1 and other asset 1 from the connection relationship analysis unit 325, it may register the identification information of the network used, whether there are other networks that can be connected to besides that network, and the names and identification information of the systems to which asset 1 and other asset 1 belong as management information in the database 331, along with the identification information of other asset 1 that has a connection relationship with asset 1.
[0111] Furthermore, for example, the management information generation unit 322 acquires the response procedures for incidents determined by the incident response unit 326 (described later) and generates management information based on the acquired response procedures. When the management information generation unit 322 acquires the response procedures for incidents that may occur in asset 1 from the incident response unit 326, it may register the incidents that may occur in asset 1 and their response procedures as management information in the database 331.
[0112] Furthermore, for example, the management information generation unit 322 may acquire area information (hereinafter also referred to as important area information) indicating whether or not an area is an area of high management importance (also called an important area) for each of the multiple areas included in the asset management map, for example, based on user instructions or marker 4 (important area marker), and generate management information based on the acquired area information. For example, if the management information generation unit 322 acquires a setting instruction to set a predetermined area included in the asset management map as an important area, it may register, for example, "1" linked to the coordinate information of the area in the database 331 as information indicating that it is an important area. Also, for example, if the management information generation unit 322 acquires information indicating that marker 4 (so-called important area marker) has been identified by the marker identification unit 124 and location information indicating the location of marker 4 calculated by the marker location calculation unit 125, it may extract the asset management map and area containing the location of marker 4 from the database 331. Specifically, the management information generation unit 322 refers to the map information registered in the database 331 to identify the area (more precisely, the coordinate information of the area) that includes the calculated location of marker 4. Next, the management information generation unit 322 identifies the asset management map that includes the identified area and extracts its information. The management information generation unit 322 registers, for example, "1" in the database 331 as area information indicating that the area included in the identified asset management map is an important area, linking it to the coordinate information of that area.
[0113] The output unit 323 outputs the management information generated by the management information generation unit 322, as well as various information registered in the database 331, to the asset management map creation device 100 and the information terminal 200.
[0114] The network connection determination unit 324 determines whether or not asset 1 is connected to the network. For example, the network connection determination unit 324 may detect asset 1 that is connected to the network from among multiple assets 1 installed on a predetermined floor and output information identifying the detected asset 1 as a determination result. For example, the network connection determination unit 324 may use a common network protocol such as Ping (ICMP (Internet Control Message Protocol) Echo) to obtain the addresses of asset 1 that are connected to the network and output a list of the obtained addresses to the management information generation unit 322 as a determination result.
[0115] The connection relationship analysis unit 325 analyzes the connection relationship between asset 1 and other assets 1 based on the determination result by the network connection determination unit 324. For example, the connection relationship analysis unit 325 may acquire information on multiple assets 1 installed in a building, such as whether they are components of a single system, whether they are connected on an intranet, and whether they can access a predetermined network access point, and then analyze the connection relationship between asset 1 and other assets 1 based on the acquired information. This information may be acquired based on network segment information and system configuration information stored in the storage unit 330.
[0116] The Incident Response Unit 326 determines the response procedures for incidents that may occur to asset 1 based on the analysis results by the Connection Relationship Analysis Unit 325. For example, the Incident Response Unit 326 refers to table information stored in the Storage Unit 330 that links incident types and corresponding response procedures, estimates incidents that may occur to asset 1 according to the attributes of asset 1 in connection with other assets 1, and determines the response procedures for the estimated incidents. For example, if multiple incidents that may occur to asset 1 are estimated, the Incident Response Unit 326 determines the incidents and their response procedures in order of decreasing probability, and outputs the response procedures for incidents with a probability of a certain value or higher to the Management Information Generation Unit.
[0117] [Storage] The storage unit 330 is a storage device that stores dedicated application programs for execution by the database 331 and the control unit 320. The storage unit 330 also stores, for example, the database 331, network segment information within the building, system configuration information, and table information. The storage unit 330 can be implemented, for example, by an HDD (Hard Disk Drive), but can also be implemented by semiconductor memory.
[0118] Database 331 stores a floor map, location information indicating the location of asset 1 on the floor map, and asset information for asset 1, all linked together. Furthermore, database 331 may also store an asset management map, or management information related to the management of asset 1. Additionally, database 331 may store inspection information (also called inspection history) related to the inspection of asset 1, as well as historical information such as the movement trajectory of the location sensor 102 during the inspection of asset 1.
[0119] [3. Operation] Next, the operation of the management system 400 according to Embodiment 1 will be explained with reference to the drawings. Figure 5 is a flowchart showing an example of the operation of the management system 400 according to Embodiment 1.
[0120] First, when the reception unit 140 of the asset management map creation device 100 receives an instruction to start creating an asset management map (S01), the control unit 120 of the asset management map creation device 100 causes the multiple sensors provided by the asset management map creation device 100, including the position sensor 102 and the imaging unit 104, to start acquiring sensing data (S02). More specifically, the control unit 120 of the asset management map creation device 100 outputs a command to start acquiring sensing data to each of the multiple sensors, including the position sensor 102 and the imaging unit 104.
[0121] When the position sensor 102 receives a command to start acquiring sensing data, it detects objects around itself and acquires the positional relationship of the surrounding objects relative to itself (S03). Also, when the imaging unit 104 receives a command to start acquiring sensing data, it takes an image of its surroundings (not shown). The image may be a single image or a moving image. Note that "self" refers to the position sensor 102 and the imaging unit 104 respectively, but it may also refer to the main body 101 of the asset management map creation device 100 on which these sensors are mounted. For example, if the position sensor 102 and the imaging unit 104 are mounted in the center of the top of the main body 101, the position of those sensors may be considered the position of the main body 101.
[0122] Next, the acquisition unit 121 of the control unit 120 acquires the positional relationship obtained by the position sensor 102 (not shown) and outputs it to the floor map creation unit 123 (not shown).
[0123] Next, the floor map creation unit 123 creates a floor map indicating a predetermined floor based on the positional relationship of surrounding objects relative to itself, which was acquired by the position sensor 102 in step S03 (S04).
[0124] Next, the self-position calculation unit 122 calculates its own position, which is the position of the position sensor 102 on the floor map created by the floor map creation unit 123 in step S04 (S05). Although not shown in the figure, the self-position calculation unit 122 stores the calculated self-position of the position sensor 102 in the storage unit 130 with a timestamp.
[0125] The marker identification unit 124 determines whether or not to identify a marker in the image captured by the imaging unit 104 (S06). If the marker is not identified in the image (No in S06), the process returns to step S03. On the other hand, if the marker identification unit 124 identifies a marker in the image (Yes in S06), the asset information acquisition unit 127 acquires asset information related to asset 1 to which the marker is attached, based on the identified marker (S07).
[0126] For example, the marker is an AR marker, as shown in Figure 1. The user may activate the imaging unit 260 of the information terminal 200 to photograph the marker 2 attached to asset 1 and confirm the asset information contained in the marker 2. Figure 6 shows the image displayed on the display unit 250 of the information terminal 200. As shown in Figure 6(a), when the imaging unit 260 of the information terminal 200 photographs the marker 2, the display unit 250 displays an image of the marker 2. Next, as shown in Figure 6(b), the control unit 220 of the information terminal 200 acquires the asset information contained in the photographed marker 2 and causes the display unit 250 to display the acquired asset information. At this time, if the asset information includes an image of the appearance of asset 1, the display unit 250 displays an image of the appearance of asset 1, as shown in Figure 6(c). If the asset information does not include an image of the exterior of asset 1, the user may take an image of the exterior of asset 1 using the imaging unit 260 of the information terminal 200 and output the image information of the captured image to the asset management map creation device 100. The control unit 120 of the asset management map creation device 100 adds the image information of the exterior of asset 1 to the asset information of asset 1 stored in the storage unit 130 by the asset information acquisition unit 127 and stores it in the storage unit 130.
[0127] Next, the marker position calculation unit 125 calculates the relative position of the marker identified by the marker identification unit 124 with respect to itself (in this case, the imaging unit 104) (S08). Although not shown, the marker position calculation unit 125 stores the calculated relative position of the marker in the storage unit 130 with a timestamp.
[0128] Next, the asset location calculation unit 126 calculates the location of asset 1 on the floor map (also called a map) based on the positional relationship, its own position, and the relative position of the marker (S09).
[0129] Next, the control unit 120 links the location information indicating the location of asset 1 on the floor map calculated by the asset location calculation unit 126 with the asset information of asset 1 acquired by the asset information acquisition unit 127 and registers it in the database (not shown) in the storage unit 130 (S10). In other words, the database is registered with the floor map, asset information, and location information linked together.
[0130] The control unit 120 determines whether the acquisition of sensing data has finished (S11). If it determines that the acquisition of sensing data has not finished (No in S11), it returns to step S03. On the other hand, if the control unit 120 determines that the acquisition of sensing data has finished (Yes in S11), the asset management map creation unit 128 creates an asset management map based on the database, in which the location of asset 1 is reflected on the floor map and the reflected location of asset 1 is linked to the asset information (S12). Although not shown, the asset management map creation unit 128 registers the created asset management map in the database in the storage unit 130.
[0131] When an asset management map is created, the control unit 120 of the asset management map creation device 100 sends a notification to the information terminal 200 via the communication unit 110 that the asset management map has been completed (not shown). At this time, the asset management map creation device 100 may output the asset management map, the floor map linked and registered in the database, location information indicating the location of asset 1 on the floor map, and asset information for asset 1 to the management device 300. When the control unit 320 of the management device 300 obtains the asset management map and this information from the asset management map creation device 100 via the communication unit 310, it stores them in the database 331 in the storage unit 330 (not shown).
[0132] When the control unit 220 of the information terminal 200 receives the notification via the communication unit 210, it causes the display unit 250 to display the notification (not shown).
[0133] When the reception unit 240 of the information terminal 200 receives an instruction to display an asset management map, the control unit 220 outputs the instruction to the asset management map creation device 100 via the communication unit 210 (not shown).
[0134] When the control unit 120 of the asset management map creation device 100 receives an instruction to display the asset management map via the communication unit 110, it outputs the asset management map to the information terminal 200 via the communication unit 110 (not shown).
[0135] When the control unit 220 of the information terminal 200 acquires an asset management map via the communication unit 210, it causes the display unit 250 to display the asset management map (not shown).
[0136] Next, when the reception unit 240 of the information terminal 200 receives an instruction to generate management information for asset 1 (S13), the control unit 220 outputs the generation instruction to the management device 300 via the communication unit 210 (not shown).
[0137] When the acquisition unit 321 of the management device 300 receives an instruction to generate management information for asset 1 via the communication unit 310, it outputs the instruction to the management information generation unit 322 (not shown).
[0138] When the management information generation unit 322 receives the instruction, it generates management information for asset 1 and registers the generated management information in the database 331, linking it to the asset management map (S14). More specifically, as shown in Figures 7 and 8, the management information generation unit 322 links the management information to the asset management map by registering it in the database 331, linking it to the asset ID (Identifier). Figure 7 is a diagram showing an example of the database. Figure 8 is a diagram showing an example of map information.
[0139] Database 331 contains asset information, specifically information indicating whether asset 1 is an asset of high administrative importance (in other words, an important asset) (in other words, important asset information). For example, as shown in Figure 7, the important asset information is a flag indicating whether or not an asset is an important asset. For example, a flag value of "0" indicates that the asset is not an important asset, while a flag value of "1" indicates that the asset is an important asset.
[0140] The management information generation unit 322 registers a flag indicating whether asset 1 is connected to the network and the address of asset 1 in the database 331, for example, based on the determination result made by the network connection determination unit 324. For example, if the value of the flag is "0", it indicates that asset 1 is not connected to the network, and if the value of the flag is "1", it indicates that asset 1 is connected to the network. The address of asset 1 is, for example, an IP address.
[0141] Although not shown in Figures 7 and 8, the management information generation unit 322 may register information indicating the connection relationship between asset 1 and other asset 1, linked to the ID of asset 1, based on the analysis results analyzed by the connection relationship analysis unit 325. The information indicating the connection relationship may include, for example, the IDs of other asset 1 that form a system with asset 1, and the network ID to which it is connected.
[0142] Although not shown in the diagram, the management information generation unit 322 may register the incidents that may occur to asset 1, as determined by the incident response unit 326, and the procedures for responding to those incidents, linked to the ID of asset 1.
[0143] The management information generation unit 322 registers information indicating whether or not an area is an area of administrative importance (a so-called important area) for each of the multiple areas included in the asset management map, linking it to the area ID. For example, as shown in Figure 8, the information indicating whether or not an area is an important area may be a flag indicating whether or not it is an important area. For example, if the value of the flag is "0", it indicates that the area is not an important area, and if the value of the flag is "1", it indicates that the area is an important area. The management information generation unit 322 may also register area information (in other words, coordinate information on the floor map) calculated based on user input instructions or a marker 4 (see Figure 1) indicating an important area, linking it to a flag indicating whether or not it is an important area.
[0144] The map image is the image information of the floor map shown in Figure 9. Figure 9 is a diagram showing an example of a floor map. As shown in Figure 9, the floor map 20 is a map showing the placement locations of objects 11 placed on a predetermined floor 10. When asset information for asset 1 is linked and registered on this floor map, asset 1 and important asset 1a are reflected, as shown in Figure 10. Figure 10 is an example of an asset management map. The asset management map 30 displays the locations of asset 1 and important asset 1a on the map by reflecting the location of asset 1 on the floor map and registering asset information linked to the reflected location of asset 1.
[0145] The asset management map 30 is divided into multiple rectangular areas 40, as shown in Figures 11 and 12. Figure 11 shows an example of area division in the asset management map 30. Figure 12 shows another example of area division in the asset management map 30. Here, the management information generation unit 322 performs the area division, but the asset management map creation unit 128 may also perform the area division. The management information generation unit 322 may divide the asset management map into multiple rectangular areas 40 based on the map image of the floor map. For example, as shown by the dashed frame in Figure 11, the management information generation unit 322 may divide the asset management map into areas of a certain size (e.g., 10 meters x 10 meters), or it may divide the asset management map 30 into rectangular areas by setting an area that surrounds the outer perimeter of a predetermined space with a rectangle, as shown in Figure 12. In this case, the management information generation unit 322 may set important areas 41 based on user instructions or markers 4 (so-called important area markers).
[0146] Returning to Figure 5, although not shown in Figure 5, when the reception unit 240 of the information terminal 200 receives an instruction to terminate the generation of management information, the control unit 220 of the information terminal 200 outputs the instruction to the management device 300 via the communication unit 210. Then, when the control unit 320 of the management device 300 receives the instruction via the communication unit 310, it terminates the process of creating the asset management map and management information.
[0147] As a result, the management system 400 creates an asset management map 30 and links and registers various information about asset 1 to the asset management map 30, thereby enabling centralized management of multiple assets 1 installed within a building.
[0148] Figure 13 shows an example of the display of an asset management map and management information. For example, as shown in Figure 13, a user can display the asset management map 30 on the display unit 250 (e.g., monitor) of an information terminal 200 such as a personal computer or tablet, and confirm the locations of asset 1 and important asset 1a displayed on the asset management map 30. Then, by tapping the icons of asset 1 and important asset 1a displayed on the asset management map 30, the user can confirm various information (registered information 50) registered in the database 331 regarding asset 1 and important asset 1a.
[0149] Furthermore, areas 40 and important areas 41 may be displayed on the asset management map 30. Although not shown in the diagram, the display unit 250 may display a list of registration information 50 for assets 1 registered in the database 331 in a table format, or it may display a list of assets 1 installed in a specific area 40 (or important area 41) displayed on the asset management map 30 by tapping to select that area, or it may search for assets 1 by entering the name of the asset 1 (so-called asset name) into the search cell.
[0150] [4. Effects, etc.] As described above, the management system 400 according to Embodiment 1 is a management system for centrally managing multiple assets 1 installed in a building, and includes a position sensor 102 that detects objects 11 around itself and acquires the positional relationship of the objects 11 with respect to itself, a floor map creation unit 123 that creates a floor map showing a predetermined floor in the building based on the positional relationship acquired by the position sensor 102, a self-position calculation unit 122 that calculates the position of the position sensor 102 on the floor map 20 created by the floor map creation unit 123, and a marker identification unit 124 that identifies markers 2 present around the imaging unit 104. The system includes: an asset information acquisition unit 127 that acquires asset information relating to asset 1 to which marker 2 is attached based on marker 2 identified by the system; an asset location calculation unit 126 that calculates the position of asset 1 on the floor map 20 based on the positional relationship, its own position, and the relative position of the marker with respect to the imaging unit 104; a database (not shown in Figure 2) in which the floor map 20, asset information, and position information indicating the location of the assets are linked and registered; and an asset management map creation unit 128 that creates an asset management map 30 based on the database in which the location of the assets is reflected on the floor map 20 and the reflected asset locations are linked to the asset information.
[0151] As a result, the management system 400 can manage various information about asset 1 by linking it to the floor map 20, thus enabling easy and centralized management of asset 1 installed within the building. Therefore, with the management system 400, users can easily check the location of asset 1 and information about asset 1 on the floor map 20.
[0152] For example, in the management system 400, the asset information acquisition unit 127 may further acquire information indicating whether or not asset 1 is an asset of high importance for management purposes.
[0153] This allows the management system 400 to manage assets of high administrative importance. Therefore, according to the management system 400, users can easily identify which of the assets 1 installed within the building are of high administrative importance.
[0154] For example, the management system 400 may further include a management information generation unit 322 that generates management information related to the management of asset 1, and the management information generation unit 322 may link the management information to the asset management map 30 and register it in the database 331.
[0155] This allows the management system 400 to easily and centrally manage information related to the management of asset 1. Therefore, with the management system 400, users can check the location of asset 1 on the asset management map 30 and read and check the information necessary for managing asset 1 from the database 331, enabling quick responses regarding the management of asset 1.
[0156] For example, the management system 400 may further include a network connection determination unit 324 that determines whether or not asset 1 is connected to a network, and the management information generation unit 322 may acquire the determination result determined by the network connection determination unit 324, generate management information based on the acquired determination result, and register the generated management information in the database 331, linked to the asset management map 30.
[0157] This allows the management system 400 to manage the network-connected asset 1. Therefore, according to the management system 400, for example, when a security incident occurs, the location of the network-connected asset 1 can be identified, enabling the user to respond quickly to the security incident.
[0158] For example, the management system 400 may further include a connection relationship analysis unit 325 that analyzes the connection relationship between asset 1 and other assets 1 based on the determination result, and the management information generation unit 322 may acquire the analysis results analyzed by the connection relationship analysis unit 325 and generate management information based on the acquired analysis results.
[0159] This allows the management system 400 to manage whether an asset 1 connected to the network has a connection relationship with another asset 1. Therefore, according to the management system 400, for example, when a security incident occurs, it is possible to identify other assets 1 that are connected to asset 1 based on their connection relationships, enabling the user to respond quickly to the security incident.
[0160] For example, the management system 400 may further include an incident response unit 326 that determines response procedures for incidents that may occur to asset 1 based on the analysis results, and the management information generation unit 322 may acquire the response procedures determined by the incident response unit 326 and generate management information based on the acquired response procedures.
[0161] This allows the management system 400 to manage procedures for responding to incidents for asset 1. Therefore, according to the management system 400, when a security incident occurs, users can check the response procedures and take action, enabling a swift and appropriate response to the security incident.
[0162] For example, in the management system 400, the management information generation unit 322 may acquire area information for each of the multiple areas 40 included in the asset management map 30, indicating whether or not the area 40 is an area of high importance for management purposes, and generate management information based on the acquired area information.
[0163] This allows the management system 400 to manage areas of high administrative importance (so-called critical areas 41). Therefore, according to the management system 400, users can prioritize asset management starting with areas of high administrative importance.
[0164] For example, the management system 400 further includes a reception unit 240 that receives user instructions, and when the management information generation unit 322 receives a correction instruction from the reception unit 240 to correct at least one of the location information and asset information of asset 1, it may update the database 331 by correcting at least one of the location information and asset information of asset 1 registered in the database 331 in accordance with the correction instruction.
[0165] This allows the management system 400 to update and manage the location information and asset information of asset 1 registered in the database 331. Therefore, according to the management system 400, if, for example, asset 1 is replaced, the user can take appropriate action in managing asset 1 based on the updated information.
[0166] For example, in the management system 400, when the management information generation unit 322 receives a correction instruction from the reception unit 240 to modify the management information, it may update the database 331 by modifying the management information registered in the database 331 according to the correction instruction.
[0167] This allows the management system 400 to update and manage the management information registered in the database 331. Therefore, according to the management system 400, users can manage asset 1 based on the updated management information, enabling them to take appropriate action in managing asset 1.
[0168] For example, the management system 400 may further include a presentation unit 250 for presenting information to the user, and when the reception unit 240 receives an instruction to present the asset management map 30, the presentation unit 250 may present the asset management map 30 in accordance with the instruction.
[0169] This allows the management system 400 to display the asset management map 30 on the display unit 250. Therefore, with the management system 400, users can easily confirm the location of asset 1 by checking the asset management map 30 displayed on the display unit 250, enabling them to take quick action in managing asset 1.
[0170] For example, in the management system 400, when the receiving unit 240 receives a presentation instruction to present at least one of the asset information and management information of asset 1 selected on the asset management map 30, the presentation unit 250 may present the asset information and at least one of the management information in accordance with the presentation instruction.
[0171] As a result, the management system 400 can display registration information (more specifically, various information about asset 1 registered in the database 331) related to asset 1 specified on the asset management map 30 displayed on the display unit 250. Therefore, according to the management system 400, the user can check information about asset 1 at any time they wish.
[0172] Furthermore, the management method is a management method for centrally managing multiple assets 1 installed in a building, and includes a position relationship acquisition step of detecting objects 11 around a position sensor 102 and acquiring the positional relationship of the objects 11 with respect to the position sensor 102; a floor map creation step of creating a floor map 20 indicating a predetermined floor in the building based on the positional relationship acquired in the position relationship acquisition step; a self-position calculation step of calculating the self-position of the position sensor 102 on the floor map 20 created in the floor map creation step; a marker identification step of identifying markers 2 present around the imaging unit 104; and marker recognition The system includes: an asset information acquisition step that acquires asset information relating to asset 1 to which marker 2 is attached, based on marker 2 identified in a separate step; an asset location calculation step that calculates the position of asset 1 on the floor map 20 based on the relative position of the marker with respect to the imaging unit 104; a registration step that links the floor map 20, asset information, and position information indicating the location of the assets to a database and registers them; and an asset management map creation step that creates an asset management map 30 based on the database, in which the position of asset 1 is reflected on the floor map 20 and the reflected position of asset 1 is linked to the asset information.
[0173] This allows the management method to link various information about asset 1 to the floor map 20, enabling easy and centralized management of asset 1 installed within the building. Therefore, according to this management method, users can easily check the location of asset 1 and related information on the floor map.
[0174] (Embodiment 2) Next, the management system according to Embodiment 2 will be described. In Embodiment 1, the asset management map creation device 100 does not have a means of travel such as wheels on its main body 101, but in Embodiment 2, the asset management map creation device differs from Embodiment 1 in that the main body 101 has a means of travel. The following description will focus on the differences from Embodiment 1, and redundant content will be omitted or simplified.
[0175] [1. Structure] Figure 14 is a block diagram showing an example of the functional configuration of the management system according to Embodiment 2. Figure 15 is a front view of the asset management map creation device in Embodiment 2, viewed from the front. In Figure 14, the same components shown in Figure 2 are denoted by the same reference numerals.
[0176] As shown in Figure 14, the management system 400a according to Embodiment 2 includes, for example, an asset management map creation device 100a, an information terminal 200, and a management device 300.
[0177] The asset management map creation device 100a differs from the asset management map creation device 100 in Embodiment 1 in that it further includes an obstacle sensor 150, a driving unit 160, a driving plan creation unit 171, an obstacle position calculation unit 172, and a driving control unit 173. In Embodiment 2, the asset management map creation device 100a includes an imaging unit 105, but it may also include an imaging unit 104 as in Embodiment 1. The following describes each configuration.
[0178] [Imaging Department] The imaging unit 105 is an imaging device that images the area around the asset management map creation device 100a. For example, the imaging unit 105 captures an image that includes markers around the asset management map creation device 100a. This image may be a single image or a moving image. The imaging unit 105 is located on the front of the main body 101, but it may be rotatably located on the top surface. For example, the imaging unit 105 is an RGB camera. The imaging unit 105 may be composed of multiple cameras.
[0179] [Control Unit] The control unit 120a includes, in addition to the configuration of the control unit 120 of Embodiment 1, a driving plan creation unit 171, an obstacle position calculation unit 172, and a driving control unit 173.
[0180] The driving plan creation unit 171 creates a driving plan based on the floor map and its own position. When the asset management map creation device 100a is driving according to the driving plan, if an obstacle is detected by the obstacle sensor 150, the driving plan creation unit 171 may change the driving plan based on the location of the obstacle calculated by the obstacle location calculation unit 172.
[0181] The obstacle position calculation unit 172 acquires information about obstacles detected by the obstacle sensor 150 (for example, the distance and position of the obstacle), and calculates the position of the obstacle on the floor map based on the acquired information and the self-position calculation unit 122.
[0182] The driving control unit 173 controls the driving unit 160 so that the asset management map creation device 100a drives according to the driving plan. More specifically, the driving control unit 173 performs information processing to control the operation of the driving unit 160 based on the driving plan. For example, the driving control unit 173 derives control conditions for the driving unit 160 based on information such as the floor map and its own position in addition to the driving plan, and generates control signals to control the operation of the driving unit 160 based on the control conditions. The driving control unit 173 outputs the generated control signals to the driving unit 160. Details such as the derivation of the control conditions for the driving unit 160 are the same as those of conventional autonomous driving robots, so the explanation is omitted.
[0183] [Obstacle Sensor] The obstacle sensor 150 is a sensor that detects obstacles that hinder movement, such as surrounding walls and furniture, that are located in front of the main unit 101 (specifically, on the side in the direction of travel). For example, an ultrasonic sensor is used for the obstacle sensor 150. The obstacle sensor 150 has a transmitter 151 located in the center of the front side of the main unit 101, and receivers 152 located on both sides of the transmitter 151. The receivers 152 receive ultrasonic waves that are emitted from the transmitter 151 and reflected back by obstacles, thereby detecting the distance to the obstacle and the position of the obstacle.
[0184] The asset management map creation device 100a may also be equipped with sensors other than the obstacle sensor 150. For example, it may be equipped with floor sensors placed at multiple locations on the bottom surface of the main body 101 to detect whether or not a floor surface exists. It may also be equipped with encoders on the travel unit 160 to detect the rotation angle of each of the pair of wheels 161 that are rotated by the travel motor. Furthermore, it may be equipped with an acceleration sensor to detect the acceleration when the asset management map creation device 100a is traveling, and an angular velocity sensor to detect the angular velocity when the asset management map creation device 100a is turning. It may also be equipped with a contact sensor that detects the displacement of the bumper (not shown) to detect when an obstacle has been hit.
[0185] [Running section] The running unit 160 moves the asset management map creation device 100a based on instructions from the running control unit 173. The running unit 160 includes wheels 161 that run on the floor, a running motor (not shown) that applies torque to the wheels 161, and a housing (not shown) that houses the running motor. The asset management map creation device 100a may also be a two-wheeled type with casters (not shown) as auxiliary wheels. In this case, the running unit 160 can move the asset management map creation device 100a freely, such as forward, backward, left turn, and right turn, by independently controlling the rotation of each wheel 161 of the pair of running units.
[0186] [2. Operation] Next, the operation of the management system 400a according to Embodiment 2 will be described. In Embodiment 1, the asset management map creation device 100 was moved by the user pushing the trolley 190, but in Embodiment 2, the asset management map creation device 100a is an autonomous mobile robot that travels autonomously on a predetermined floor.
[0187] In Embodiment 2, the process is basically the same as the flowchart shown in Figure 5, but it differs from Embodiment 1 in that the obstacle sensor 150 detects obstacles that may hinder the movement of the asset management map creation device 100a, and the device moves while avoiding these obstacles. Here, the obstacles are objects that are difficult to detect by the position sensor 102, such as chair legs or objects lying on the floor.
[0188] When the asset management map creation device 100a receives an instruction to start creating an asset management map (S01), it outputs an instruction to start sensing to the position sensor 102, the imaging unit 105, and the obstacle sensor 150, and starts acquiring sensing data (S02). Then, while performing the processes in steps S03 to S10, if an obstacle is detected in the direction of travel (forward) of the asset management map creation device 100a based on the sensing data acquired by the obstacle sensor 150, the obstacle position calculation unit 172 calculates the relative position of the obstacle with respect to the obstacle sensor 150, and calculates the position of the obstacle on the floor map based on the floor map, its own position, and the relative position.
[0189] The driving plan creation unit 171 creates a driving plan that avoids obstacles based on the floor map, its own position, and the location of obstacles.
[0190] When the driving control unit 173 acquires a driving plan, it controls the driving unit 160 according to the acquired driving plan.
[0191] As described above, the asset management map creation device 100a can detect obstacles in the direction of travel (forward) of the main unit 101 and autonomously travel through a predetermined floor while avoiding the obstacles.
[0192] [3. Effects, etc.] As described above, the management system 400a according to Embodiment 2 allows the asset management map creation device 100a to move autonomously and, when it detects an obstacle, to move while avoiding the obstacle, thereby reducing the effort required of the user in creating asset management maps.
[0193] (Embodiment 3) Next, a management system according to Embodiment 3 will be described. In Embodiment 1, the asset management map creation device 100 created an asset management map based on sensing data acquired by a position sensor 102 and an imaging unit 104 mounted on the main body 101. In Embodiment 3, an asset management map may be created based on sensing data acquired by a position sensor and an imaging unit mounted on an information terminal. The following description will focus on the differences from Embodiment 1, and redundant content will be omitted or simplified.
[0194] [1. Structure] Figure 16 is a block diagram showing an example of the functional configuration of the management system according to Embodiment 3. In Figure 16, the same components shown in Figure 2 are denoted by the same reference numerals.
[0195] As shown in Figure 16, the management system 400b according to Embodiment 3 includes, for example, an asset management map creation device 100b, an information terminal 200a, and a management device 300. The following describes each of these components.
[0196] [1-1. Asset Management Map Creation Device] The asset management map creation device 100b differs from the asset management map creation device 100 in Embodiment 1 in that it further includes a terminal location calculation unit 129.
[0197] [Control Unit] The control unit 120b includes a terminal position calculation unit 129 in addition to the configuration of the control unit 120.
[0198] The terminal position calculation unit 129 acquires the positional relationship between the position sensor 270 of the information terminal 200a and surrounding objects, and based on the acquired positional relationship, creates a floor map of the surrounding environment of the information terminal 200a using, for example, SLAM technology, and calculates its own position (i.e., terminal position), which is the position of the information terminal 200a on the created floor map. Specifically, as described above, it creates a floor map using SLAM with LiDAR as shown in International Publication No. 2020 / 026294 (Patent Document 4), and at the same time calculates the position of the information terminal 200a in a time series, and stores the time and position as a pair (more specifically, with a timestamp attached to the calculated position) in the storage unit 130.
[0199] [1-2. Information Terminals] Information terminal 200a further differs from information terminal 200 in Embodiment 1 in that it is equipped with a position sensor 270.
[0200] The position sensor 270 detects objects in its surroundings and obtains the positional relationship of these objects relative to itself. The position sensor 270 is, for example, a LiDAR.
[0201] The control unit 220 outputs the positional relationship acquired by the position sensor 270 to the asset management map creation device 100b via the communication unit 210.
[0202] [2. Operation] Next, the operation of the management system 400b according to Embodiment 3 will be described with reference to the drawings. Figure 17 is a flowchart showing an example of the operation of the management system 400b according to Embodiment 3. Here, we will describe an example of operation when inspecting multiple assets 1 installed on a predetermined floor.
[0203] First, when the reception unit 240 of the information terminal 200a receives an instruction to start the inspection of asset 1 (S21), the control unit 220 of the information terminal 200a outputs the instruction to the asset management map creation device 100b via the communication unit 210 (not shown).
[0204] When the control unit 120b of the asset management map creation device 100b receives the instruction, it outputs a response signal to the information terminal 200a via the communication unit 110 (not shown) and acquires an asset management map of the designated floor (S22). At this time, the control unit 120b of the asset management map creation device 100b may acquire the asset management map by reading it from the storage unit 130, or it may output a request signal for an asset management map to the management device 300 and acquire an asset management map stored in the database 331 of the management device 300.
[0205] When the control unit 220 of the information terminal 200a receives a response signal from the asset management map creation device 100b, it outputs an instruction to the position sensor 270 and the imaging unit 260 to start acquiring sensing data (not shown), and starts acquiring sensing data (for example, positional relationships and image information) from the information terminal 200a (S23).
[0206] When the position sensor 270 receives an instruction from the control unit 220 to start acquiring sensing data, it detects objects around itself and acquires the positional relationship of the surrounding objects relative to itself (not shown). When the control unit 220 of the information terminal 200a acquires the positional relationship acquired by the position sensor 270, it outputs the positional relationship to the asset management map creation device 100b via the communication unit 210 (not shown). The imaging unit 260 also captures an image of its surroundings. This image may be a single image or a moving image. The control unit 220 outputs the image information acquired by the imaging unit 260 to the asset management map creation device 100b via the communication unit 210 at predetermined intervals (not shown).
[0207] The acquisition unit 121 of the asset management map creation device 100b acquires the positional relationship of surrounding objects with respect to the position sensor 270 via the communication unit 110 (S24), and outputs the acquired positional relationship to the terminal position calculation unit 129 (not shown).
[0208] The terminal location calculation unit 129 calculates the terminal location (more specifically, the current location of the information terminal 200a) based on the acquired location relationship (S25). The terminal location calculation unit 129 links the calculated terminal location information, which indicates the current location of the terminal, to the asset management map and registers it in the storage unit 130 (S26). Figure 18 is a diagram showing an example of terminal location information. As shown in Figure 18, the terminal location information is linked to the terminal ID, map ID, and coordinate information indicating the terminal location.
[0209] The marker identification unit 124 determines whether or not to identify a marker in the image captured by the imaging unit 260 (S27). If the marker is not identified in the image (No in S27), the process returns to step S24. On the other hand, if the marker identification unit 124 identifies a marker in the image (Yes in S27), the asset information acquisition unit 127 acquires asset information related to the asset 1 to which the marker is attached, based on the identified marker (S28).
[0210] Next, the marker position calculation unit 125 calculates the relative position of the marker identified by the marker identification unit 124 with respect to itself (in this case, the imaging unit 260) (S29). Although not shown, the marker position calculation unit 125 stores the calculated relative position of the marker in the storage unit 130 with a timestamp.
[0211] Next, the asset location calculation unit 126 calculates the location of asset 1 on the floor map (also called a map) based on the positional relationship obtained in step S24, the terminal location calculated in step S25, and the relative position of the marker calculated in step S29 (S30).
[0212] When the reception unit 240 of the information terminal 200a receives input of the status confirmation result for asset 1 (S31), the control unit 220 outputs the received confirmation result to the asset management map creation device 100b via the communication unit 210 (not shown). For example, the status confirmation result for asset 1 is the operating status of asset 1 and the results of confirming whether or not there are any physical or system defects. The confirmation result is output with a timestamp indicating the date and time of input.
[0213] When the control unit 120b of the asset management map creation device 100b obtains the status confirmation result of asset 1 output from the information terminal 200a (not shown), it links the location information indicating the location of asset 1 calculated in step S30, the status confirmation result of asset 1, and the asset management map and registers them in the database (not shown) in the storage unit 130 (S32).
[0214] The control unit 120b determines whether the acquisition of sensing data has finished (S33). If it determines that the acquisition of sensing data has not finished (No in S33), it returns to step S24. On the other hand, if the control unit 120b determines that the acquisition of sensing data has finished (Yes in S33), the control unit 120b sends an inquiry signal to the information terminal 200a via the communication unit 110 to ask whether or not to terminate the operation (not shown).
[0215] When the control unit 220 of the information terminal 200a receives an inquiry signal transmitted from the asset management map creation device 100b via the communication unit 210, it displays a confirmation notification such as "Do you want to terminate?" on the display unit 250 (not shown). Then, when the reception unit 240 receives the termination instruction, the control unit 220 outputs the termination instruction to the asset management map creation device 100b via the communication unit 210 (not shown).
[0216] When the control unit 120b of the asset management map creation device 100b receives a termination instruction via the communication unit 110, it outputs inspection information linked to the terminal's movement trajectory and the status confirmation results (also called inspection results) of asset 1 to the information terminal 200a and the management device 300 (not shown).
[0217] When the control unit 220 of the information terminal 200a acquires inspection information output from the asset management map creation device 100b via the communication unit 210, it causes the display unit 250 to display the inspection information (not shown).
[0218] When the acquisition unit 321 of the management device 300 acquires inspection information output from the asset management map creation device 100b, it stores the inspection information in the database 331 (not shown).
[0219] Once the data saving process is complete, the management system 400b will cease operation.
[0220] As described above, the management system 400b can centrally manage information on multiple assets 1 installed within a building by inspecting assets 1 registered in conjunction with the asset management map 30 and saving the inspection information to the asset management map 30.
[0221] Figure 19 shows an example of how inspection information is displayed. For example, as shown in Figure 19, when a user displays the asset management map 30 on the display unit 250 (e.g., monitor) of an information terminal 200a such as a personal computer or tablet, the movement trajectory of the user's information terminal 200a (thick dashed line in the figure) is displayed on the asset management map 30. The movement trajectory of the information terminal 200a may be displayed on the display unit 250 only after the user has completed all inspection work. This allows the user to easily understand the inspected assets and inspection routes by checking the movement trajectory displayed on the asset management map 30. In addition, the current terminal position and movement trajectory may be displayed on the display unit 250 during the inspection work. This allows the user to proceed with the inspection work while checking their current position.
[0222] As shown in Figure 19, when a user taps the icon of important asset 1a displayed on the asset management map 30, the registration information 50 for important asset 1a is displayed. For example, a user may register the results of an inspection, such as the operating status of important asset 1a and whether or not there are any physical or system defects, while performing inspection work. At this time, the user can edit the registration information 50 by tapping the edit button displayed on the screen and then tapping the icon of important asset 1a.
[0223] In this example, the movement trajectory of the user's information terminal 200a is reflected on the asset management map. However, if the user performs an inspection while moving the asset management map creation device 100 or 100a, the movement trajectory will be that of the asset management map creation device 100 or 100a.
[0224] [3. Effects, etc.] As described above, in the management system 400b according to Embodiment 3, when the display unit 250 receives a display instruction from the reception unit 240 to display the movement trajectory of the position sensor 270 on the asset management map 30, it may display the movement trajectory on the asset management map 30 in accordance with the display instruction.
[0225] As a result, the management system 400b displays the movement trajectory of the position sensor 270 on the asset management map 30, which helps users visually confirm, for example, the inspection status of asset 1.
[0226] (Other embodiments) Although embodiments have been described above, this disclosure is not limited to the embodiments described above.
[0227] For example, in Embodiment 1, the asset management map creation device 100 is equipped with a position sensor 102 and an imaging unit 104, but it does not need to be equipped with a position sensor 102 and an imaging unit 104. For example, the asset management map creation device 100 may be an information processing device equipped with components other than the position sensor 102 and the imaging unit 104. In this case, the sensor equipped with the position sensor 102 and the imaging unit 104 may be placed on a trolley 190 and moved along a predetermined floor while the data acquired by the sensor is output to the information processing device. Alternatively, for example, an information terminal 200a equipped with a position sensor 270 and an imaging unit 260 may be held by a user and moved along a predetermined floor while the data acquired by the position sensor 270 and the imaging unit 260 is output to the information processing device.
[0228] For example, in Embodiment 1, an example was described in which the asset management map generated by the asset management map creation device 100 is transmitted to the information terminal 200 and the management device 300 via the network 5, but the invention is not limited to this. For example, the asset management map creation device 100 may transmit the asset management map to the information terminal 200 via the network 5, and the asset management map acquired by the information terminal 200 may be transmitted to the management device 300 via the network 5. Note that the network 5 is a wide-area communication network such as the Internet, but it may also be a local communication network such as Wi-Fi (registered trademark).
[0229] Furthermore, for example, the information terminal 200 and the management device 300 may acquire the asset management map via a USB (Universal Serial Bus) memory or the like on which the asset management map generated by the asset management map creation device 100 is stored.
[0230] For example, in Embodiment 2, an example was described in which the asset management map creation device 100a and the management device 300 are separate components. However, the management device 300 may be implemented as a single device incorporated into the asset management map creation device 100a.
[0231] For example, in embodiments 1 to 3, the management system is implemented by multiple devices, but it may also be implemented as a single device. Furthermore, when the system is implemented by multiple devices, the components of the management system may be distributed among the multiple devices in any way. Also, for example, a server device capable of communicating with an information terminal may comprise multiple components of the management system.
[0232] Furthermore, for example, in the above embodiment, LiDAR was used to create the floor map, but a ranging camera such as a ToF (Time of Flight) camera may also be used.
[0233] For example, the method of communication between devices in the above embodiment is not particularly limited. Furthermore, a relay device (not shown) may be involved in the communication between devices.
[0234] Furthermore, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit. Also, the order of multiple processes may be changed, or multiple processes may be executed in parallel.
[0235] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.
[0236] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.
[0237] Furthermore, the general or specific embodiments of this disclosure may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. They may also be implemented in any combination of systems, apparatus, methods, integrated circuits, computer programs, and recording media.
[0238] For example, this disclosure may be implemented as a driving control method executed by a computer, such as a management system, or as a program to cause a computer to execute such a driving control method. Furthermore, this disclosure may be implemented as a program to cause a general-purpose computer to operate as the management system of the above embodiment. This disclosure may also be implemented as a computer-readable non-temporary recording medium on which these programs are recorded.
[0239] Furthermore, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of this disclosure. [Industrial applicability]
[0240] The management system described in this disclosure reflects the location of assets on a floor map, and the reflected asset locations are linked to various information such as asset information, making it widely usable for the simple and centralized management of multiple assets within a building. [Explanation of Symbols]
[0241] 1. Assets 1a Key Assets 2, 3, 4 Markers 5 Network 10 floors 11 Object 20 Floor Map 30 Asset Management Map 40 areas 41 Important Areas 50 Registration Information 100, 100a, 100b Asset management map creation device 101 Main Unit 102,270 Position Sensors 104, 105, 260 Imaging Unit 104a RGB camera 104b Infrared sensor 104c Projector 110 Communications Department 120, 120a, 120b, 220, 320 control unit 121 Acquisition Department 122 Self-position calculation unit 123 Floor Map Creation Department 124 Marker identification unit 125 Marker position calculation unit 126 Asset Location Calculation Unit 127 Asset Information Acquisition Department 128 Asset Management Map Creation Department 129 Terminal position calculation unit 130 Storage section 140 Reception Department 150 Obstacle Sensors 151 Transmitter 152 Receiving Unit 160 Running section 161 Wheels 171 Driving Plan Creation Department 172 Obstacle position calculation unit 173 Driving Control Unit 190 bogies 191 Handle 192 Stands 200, 200a Information Terminals 210 Communications Department 230 Storage section 240 Reception Department 250 Presentation section 300 Management device 310 Communications Department 321 Acquisition Department 322 Management information generation section 323 Output section 324 Network connection determination unit 325 Connection Relationship Analysis Unit 326 Incident Response Department 330 Storage section 331 Database 400, 400a, 400b Management System
Claims
1. A management system for centrally managing a plurality of assets installed in a building, A sensor that detects an object around the vehicle and acquires a positional relationship of the object with respect to the vehicle; a floor map creation unit that creates a floor map showing a predetermined floor in the building based on the positional relationship acquired by the sensor; a self-position calculation unit that calculates a self-position of the sensor on the floor map created by the floor map creation unit; A marker identification unit that identifies a marker present around the sensor; an asset information acquisition unit that acquires asset information regarding an asset to which the marker is attached based on the marker identified by the marker identification unit; an asset position calculation unit that calculates a position of the asset on the floor map based on the positional relationship, the self-position, and a relative position of the marker with respect to the sensor; a database in which the floor map, the asset information, and location information indicating the location of the asset are registered in association with each other; an asset management map creation unit that creates an asset management map on the floor map based on the database, the asset positions being reflected on the floor map and the asset information being linked to the reflected asset positions; a management information generating unit for generating management information relating to management of the assets; a network connection determination unit that determines whether the asset has a network connection function by using a network diagnostic tool; Equipped with The management information generating unit acquires a result of the determination made by the Internet connection determining unit, generating the management information based on the acquired determination result; The generated management information is linked to the asset management map and registered in the database. Management system.
2. The network diagnostic tool is a command line tool. The management system according to claim 1.
3. The command line tool is a Ping command. The management system according to claim 2.
4. The management information generating unit, generating the management information including a flag indicating whether the asset has the network connection function based on the obtained determination result; The management system according to claim 1.
5. The marker includes a key asset marker indicating that the asset to which the marker is attached is a key asset; the asset information acquisition unit acquires, when the marker identification unit identifies the important asset marker, information indicating that the asset is an asset of high management importance as the asset information; The asset having high management importance is at least one of an asset whose status should be checked with priority, an asset whose inventory or in-process work should be performed with priority, and an asset whose operation should be stopped with priority. The management system according to claim 1.
6. Further, a connection relationship analysis unit is provided that analyzes a connection relationship between the asset and other assets based on the determination result, the connection relationship analysis unit analyzes the connection relationship based on information on whether the asset and the other asset are components that configure one system, whether they are connected via an intranet, and whether a predetermined network access point is accessible, The management information generating unit acquiring an analysis result analyzed by the connection relationship analysis unit; generating the management information based on the acquired analysis result; The management system according to any one of claims 1 to 5.
7. Further, based on the analysis result, an incident that may occur in the asset according to an attribute of the asset in a connection relationship with the other assets is estimated; An incident response unit that determines a response procedure for the estimated incident, The management information generation unit acquires the response procedure determined by the incident response unit, generating the management information based on the acquired response procedure; The management system according to claim 6.
8. The asset management map is divided into a plurality of areas, The markers include an important area marker that indicates an area that is important in terms of management; The management information generating unit When the marker identification unit identifies the important area marker, it acquires area information indicating that an area including the important area marker among the plurality of areas is an area having high importance in terms of management; generating the management information based on the acquired area information; The management system according to claim 6 or 7.
9. Further, a reception unit for receiving an instruction from a user is provided, The management information generating unit when the reception unit receives a correction instruction to correct at least one of the location information of the asset and the asset information, the database is updated by correcting at least one of the location information of the asset and the asset information registered in the database in accordance with the correction instruction. The management system according to any one of claims 6 to 8.
10. The management information generating unit: when the reception unit receives a correction instruction to correct the management information, the management information registered in the database is corrected in accordance with the correction instruction, thereby updating the database. The management system according to claim 9.
11. Further comprising a presentation unit for presenting information to a user, when the instruction to present the asset management map is accepted by the acceptance unit, the presentation unit presents the asset management map in accordance with the presentation instruction. The management system according to claim 9 or 10.
12. when a presentation instruction to present at least one of the asset information and the management information of an asset selected on the asset management map is received by the reception unit, the presentation unit presents at least one of the asset information and the management information in accordance with the presentation instruction. The management system according to claim 11.
13. Further, a reception unit for receiving an instruction from a user; a presentation unit that presents information to a user, when the reception unit receives a display instruction to display a movement trajectory of the sensor position on the asset management map and a confirmation result of the asset status including a confirmation result of the operation state of the asset and the presence or absence of a physical or system malfunction, the presentation unit displays inspection information linked to the movement trajectory and the confirmation result on the asset management map in accordance with the display instruction. The management system according to claim 1 .
14. A management method for centrally managing a plurality of assets installed in a building, comprising: a positional relationship acquisition step of detecting an object around a sensor and acquiring a positional relationship of the object with respect to the sensor; a floor map creating step of creating a floor map showing a predetermined floor in the building based on the positional relationship acquired by the positional relationship acquiring step; a self-position calculation step of calculating a self-position of the sensor on the floor map created in the floor map creation step; a marker identification step of identifying a marker present around the sensor; and an asset information acquisition step of acquiring asset information relating to an asset to which the marker is attached based on the marker identified by the marker identification step. an asset position calculation step of calculating a position of the asset on the floor map based on a relative position of the marker with respect to the sensor; a registration step of linking the floor map, the asset information, and location information indicating the location of the asset in a database and registering them; an asset management map creating step of creating an asset management map on the floor map based on the database, the asset positions being reflected on the floor map and the asset information being linked to the reflected asset positions; a management information generating step of generating management information relating to management of the assets; a network connection determination step of determining whether the asset has a network connection function by using a network diagnostic tool; Including, In the management information generating step, a result of the determination made in the Internet connection determining step is acquired, generating the management information based on the acquired determination result; The generated management information is linked to the asset management map and registered in the database. Management method.
15. A program for causing a computer to execute the management method described in claim 14.
