Information management device and information extraction method
The information management device and method address the challenge of integrating detailed building information by storing and displaying BIM data within defined ranges, enhancing the usability and visualization of building situations using spherical images.
Patent Information
- Application Number
- JP2020185644
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-11-06
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2040-11-06
AI Technical Summary
Existing methods for managing building information using spherical images and BIM data face challenges in integrating detailed information about buildings and facilities, leading to difficulties in processing large data volumes and smooth viewing operations, especially for large-scale structures.
An information management device and method that stores object information related to a virtual building in a three-dimensional space, allowing for the extraction and display of relevant data within defined ranges, superimposing it on indoor images to facilitate easy identification and visualization.
Enables a simple and efficient method to grasp the building situation by integrating detailed information, reducing processing burdens and enhancing the usability of BIM data, while allowing for seamless integration of spherical images and BIM models.
Smart Images

Figure 0007591905000001 
Figure 0007591905000002 
Figure 0007591905000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information management device and an information extraction method. [Background technology]
[0002] Traditionally, 2D drawings have been mainly used as materials for managing the current status of buildings, plant facilities, etc. In recent years, however, attention has been focused on the use of images (spherical images, panoramic images, omnidirectional images, etc.) that capture the surrounding conditions of the shooting location, and the use of BIM (Building Information Modeling / Management) as a means of recording and managing the current status.
[0003] For example, a spherical image is an image that includes the top, bottom, left, and right situations in one image, and the range that can be included in one image is wider than that of a panoramic image or an omnidirectional image. By using a dedicated camera for spherical images, a wide range can be included in one image (panoramic image) as described above by performing the same operation as taking a general photo. If such a spherical image is simply projected onto a two-dimensional plane, the image will be spatially distorted. There is known an information viewing device (software or service) that converts a distorted spherical image into a two-dimensional image close to a natural image and enables the image to be viewed. There are known information viewing devices that can be used simply as an image viewing tool, and in addition, there are also known devices that add simple comments as memos to images and allow the comments to be viewed together with the images.
[0004] On the other hand, there are information management devices for forming BIM. The information management device manages information (models) related to buildings and makes the managed information available. For example, the information managed by the information management device includes modeled data of the shape of an object such as a building. The information management device reproduces and displays the shape of the object in a virtual three-dimensional space based on data such as the modeled shape of the object. Furthermore, the information management device manages attribute information related to the object by associating it with the data of the object. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2018-88065 A Summary of the Invention [Problem to be solved by the invention]
[0006] However, while viewing a spherical image allows a user to grasp the surrounding situation in the same way as viewing a photograph, it is not easy to associate detailed information about a building and facilities related to the building with such a spherical image. In contrast, BIM uses a virtual three-dimensional space to represent an object in three dimensions, and can store information related to that object in association with the object. Basically, without an information management device (or software) for BIM, BIM data cannot be used. In the case of large-scale structures, or when detailed information is described, the amount of data becomes large. Even if a computer with relatively high processing power is used as an information management device, it can be difficult to process the data smoothly when viewing a relatively large amount of data. Even if the advantages of using BIM data are known, it has sometimes been difficult to use it easily.
[0007] The present invention has been made in consideration of the above circumstances, and has an object to provide an information management device and an information extraction method that enable understanding of the situation inside a building in a simple manner. [Means for solving the problem]
[0008] One aspect of the present invention for solving the above problem is an information management device capable of storing information of objects related to a virtual building arranged in three-dimensional space in a memory area in association with a predetermined position within the virtual building, wherein the information management device determines an extraction target area between a first range defined within the virtual building to include a first point within the virtual building and a second range defined to include at least a portion of the first range, and is equipped with an extraction processing unit that extracts information of the first object associated with the extraction target area.
[0009] In the information management device of the above aspect, the extraction processing unit does not extract information of a second object associated with an outside-extraction-range area outside the second range. The extraction processing unit in the information management device of the above aspect extracts information of a third object associated within the first range, by distinguishing it from the first object based on information of the respective associated positions. In the information management device of the above aspect, the extraction processing unit extracts the first object to be a display object.
[0010] The information management device of one embodiment described above includes a display image information generation unit that generates an image in which information about the first object and information about the third object are superimposed on an indoor image related to a specified position within the virtual building based on a request, and displays the first object and the third object in a manner that allows them to be distinguished from each other based on position information respectively specified in the information about the first object and the information about the third object.
[0011] One aspect of the present invention for solving the above problem is an information extraction method by a computer that can associate information of an object related to a virtual building arranged in three-dimensional space with a predetermined position within the virtual building and store it in a memory area, the information extraction method including a step of determining an extraction target area between a first range defined within the virtual building to include a first point within the virtual building and a second range defined to include at least a portion of the first range, and extracting information of the first object associated with the extraction target area. Effect of the Invention
[0012] The present invention can provide an information management device and an information extraction method that enable understanding of the situation inside a building in a simple manner. [Brief description of the drawings]
[0013] [Figure 1] 1 is a configuration diagram of an information sharing support system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram for explaining an information sharing support system according to an embodiment. [Diagram 3] FIG. 13 is a diagram for explaining a coordinate system of a target range according to the embodiment. [Figure 4A] FIG. 2 is a diagram showing an image captured by equirectangular projection according to the embodiment. [Figure 4B] FIG. 1 is a diagram illustrating a spherical image according to an embodiment. [Diagram 5] FIG. 2 is a configuration diagram of a terminal device 200 according to an embodiment. [Figure 6] FIG. 4 is a hardware configuration diagram of an information management device 400 according to an embodiment. [Figure 7] FIG. 4 is a functional configuration diagram of an information management device 400 according to an embodiment. [Figure 8] 4 is a diagram showing an example of the contents of space management information 411 according to the embodiment. FIG. [Figure 9] FIG. 4 is a diagram showing an example of the contents of collected information 412 according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of the contents of provided information 413 according to the embodiment. [Figure 11] 13 is a flowchart showing a processing procedure for the information management device 400 according to the embodiment to share BIM data. [Figure 12] FIG. 10 is a diagram for explaining an example of a target range of the embodiment. [Figure 13] 13 is a diagram for explaining a display example of a composite image of the room shown in FIG. 12. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Fig. 1 is a configuration diagram of an information sharing support system according to an embodiment of the present invention. Fig. 2 is a diagram for explaining the information sharing support system according to the embodiment. Fig. 3 is a diagram for explaining a coordinate system of a target range in the embodiment.
[0015] [Information sharing support system] First, an overview of the information sharing support system 1 will be described. The information sharing support system 1 supports the sharing of information relating to a target range 10 in real space. For example, the target range 10 is determined in advance so that it includes a part or all of an existing building 2. The position of the target range 10 in real space is specified using an orthogonal coordinate system (X, Y, Z). Several observation points (not shown) are provided within the target range 10. For example, the position of observation point P is determined so as to share the situation around observation point P. In the following description, observation point P is simply referred to as observation point.
[0016] For example, the information sharing support system 1 includes an imaging device 100, a terminal device 200 (information viewing device), an information sharing support device 300, an information management device 400, and an equipment management device 500. The imaging device 100, the terminal device 200, the information sharing support device 300, the information management device 400, and the equipment management device 500 can be connected to a network NW.
[0017] The information sharing support system 1 supports sharing of the surrounding situation based on this observation point. The information shared by the information sharing support system 1 includes an image of the surrounding situation of the observation point. This is called the surrounding image of the observation point.
[0018] The surrounding image of the observation point is an image captured by the imaging device 100 at the observation point, or a set of multiple images captured at the observation point. The surrounding image of the observation point may be any of a celestial sphere image, a panoramic image, an omnidirectional image, and the like. The surrounding image of the observation point may be an image captured by the user U1 operating the imaging device 100, or may be an image captured by the imaging device 100 at a predetermined timing. The position of the observation point is the position where the image is captured using the imaging device 100 (the position of the imaging point).
[0019] The information sharing support system 1 makes available an image of the surroundings of an observation point, and supports sharing of the situation within a target range 10 among a plurality of users operating terminal devices 200 or the like.
[0020] The situation within the target range 10 is determined by the presence or absence of objects located within the target range 10 and the locations where these objects are located. For example, objects located within the target range 10 include objects that are located in relatively easily visible locations, such as equipment and fixtures provided in the above-mentioned building, and objects that are located in relatively difficult to see locations, such as pipes (e.g., pipes for water, gas, and electrical wiring) and wiring (e.g., wiring for power, control, communication, and ground buses).
[0021] The information sharing support device 300 supports the sharing of images of the surroundings of an observation point. For example, the information sharing support device 300 collects data of images captured by the imaging device 100 from the imaging device 100. The information sharing support device 300 provides the collected image data to the terminal device 200 or the information management device 400 in response to a request from each of the terminal device 200 and the information management device 400. The terminal device 200 or the information management device 400 displays the data on the respective display units.
[0022] The equipment management device 500 manages various types of equipment installed in a building. For example, the equipment management device 500 collects information from sensors arranged within the target area 10 or sensors installed in various types of equipment, and controls the various types of equipment based on this information. The various types of equipment may include air conditioning equipment, lighting equipment, and the like. The equipment management device 500 provides the collected sensor data, data indicating the operation status of the equipment, and the like to the terminal device 200 or the information management device 400 in response to a request from each of them. The terminal device 200 or the information management device 400 displays this information on the respective display units.
[0023] In this way, the user U2 can obtain desired information related to the target range 10 by operating the terminal device 200 or the information management device 400.
[0024] When performing processing related to sharing information within the target range 10 as described above, the information sharing support system 1 manages and makes shareable information such as the surrounding situation and the location where an event is occurring based on the observation point.
[0025] Each device related to the information sharing support system 1 will be described below in order.
[0026] [Imaging device] An example of the imaging device 100 will be described. For example, it is desirable that the surrounding image output by the imaging device 100 includes an image in all directions such as an image by equirectangular projection and a celestial sphere image. FIG. 4A is a diagram showing an image by equirectangular projection according to an embodiment. FIG. 4B is a diagram showing a celestial sphere image according to an embodiment. The equirectangular projection is a projection in which the surface of a sphere as shown in FIG. 3 described above is developed and projected onto a rectangle. The scale of each part is adjusted so that the latitude and longitude of the sphere intersect at right angles and at equal intervals within the rectangle. Conversely, when the imaging device 100 projects an image by equirectangular projection drawn on the side of a cylinder onto the surface of the sphere shown in FIG. 3, the image projected onto the surface of the sphere becomes a celestial sphere image when viewed from inside the sphere. The imaging device 100 may output either an image by equirectangular projection or a celestial sphere image.
[0027] Instead of the imaging device 100, a general camera using a wide-angle lens or a standard lens may be used. Images captured by such a method may be subjected to a synthesis process to combine them. A general method can be used to synthesize images captured by dividing the entire circumference into multiple images.
[0028] In the following description of the embodiment, it is assumed that the imaging device 100 outputs an indoor image based on a celestial sphere image as a surrounding image of the target. For example, the imaging device 100 transmits the surrounding image of the target to the information sharing support device 300.
[0029] [Terminal Device] 5 is a configuration diagram of a terminal device 200 according to an embodiment. The terminal device 200 includes, for example, a CPU 200A, a RAM (Random Access Memory) 200B, a non-volatile storage device 200C, a portable storage medium drive device 200D, an input / output device 200E, and a communication interface 200F. The terminal device 200 may include any type of processor instead of the CPU 200A, or may omit some of the components shown in FIG. 5. A typical example of the terminal device 200 is a portable terminal device such as a personal computer or a tablet device, but is not limited thereto.
[0030] The CPU 200A loads a program stored in the non-volatile storage device 200C or a program stored in a portable storage medium mounted in the portable storage medium drive device 200D into the RAM 200B and executes the program, which will be described below. The RAM 200B is used as a working area by the CPU 200A. The non-volatile storage device 200C is, for example, a HDD, a flash memory, or a ROM (Read Only Memory). A portable storage medium such as a DVD (Digital Versatile Disc), a CD (Compact Disc), or an SD card is mounted in the portable storage medium drive device 200D. The input / output device 200E includes, for example, a keyboard, a mouse, a touch panel, and a display device. The communication interface 200F is connected to the network NW and controls communication in the terminal device 200.
[0031] A functional configuration of the terminal device 200 according to the embodiment will be described with reference to Fig. 5. The terminal device 200 includes a reception processing unit 211, a data acquisition unit 212, and a display control unit 213. These functional units are realized, for example, by the CPU 200A executing a program. Furthermore, these functional units may be realized by hardware such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array), or may be realized by software and hardware working together.
[0032] The reception processing unit 211 receives a user operation detected by the input / output device 200E. For example, the reception processing unit 211 detects an operation of selecting a button or the like on an image V21 (FIG. 2) displayed by the input / output device 200E and receives the operation as a user operation. The reception processing unit 211 transmits a request for sharing information to each of the information sharing support device 300, the information management device 400, and the equipment management device 500 based on the detected user operation.
[0033] The data acquisition unit 212 acquires information transmitted from any of the information sharing support device 300, the information management device 400, and the facility management device 500. For example, the information acquired from the information sharing support device 300 includes an image of the surroundings of an observation point corresponding to a specific observation point. The information acquired from the information management device 400 includes BIM data corresponding to the specific observation point. The information acquired from the facility management device 500 includes information such as the operating status of the facility corresponding to the specific observation point.
[0034] The display control unit 213 generates an image to be displayed on a display unit (not shown) of the input / output device 200E based on information transmitted from any one of the information sharing support device 300, the information management device 400, and the equipment management device 500. For example, the display control unit 213 generates a viewing image based on acquired information corresponding to a specific observation point, and displays it on the display unit.
[0035] The terminal device 200 may realize all or part of the reception processing unit 211, the data acquisition unit 212, and the display control unit 213 by using a browser applied to a Web system.
[0036] [Information sharing support device] The information sharing support device 300 is a computer that manages image information relating to a building 2 included in a target area 10. For example, as shown in FIG.
[0037] The storage unit 310 stores an image (such as a spherical image) of the target point of the building 2 and information such as the date and time of its capture.
[0038] The control unit 320 stores the image acquired from the imaging device 100 in the storage unit 310. The control unit 320 provides the image acquired from the imaging device 100 and the image stored in the storage unit 310 to the terminal device 200 or an information management device 400 described later.
[0039] The control unit 320 associates the date and time when an image obtained from the imaging device 100 was captured with the image and stores the date and time when the image was captured in the storage unit 310. For example, the control unit 320 associates the date and time when the image was captured with the image and stores the date and time in the storage unit 310. The user may perform this association on-site when the image is captured, or may perform this association at the stage of sorting the images after the images are captured. Alternatively, the control unit 320 may use information on the capture date and time indicated by attribute information assigned to each image, based on the attribute information.
[0040] [Equipment management device] The equipment management device 500 is a computer that manages equipment placed within the target range 10. For example, as shown in Fig. 1, the equipment management device 500 includes a storage unit 510 and a control unit 520. The storage unit 510 stores information detected by various sensors relating to the equipment placed within the target range 10. The control unit 520 provides the information from the various sensors in response to a request from the terminal device 200 or an information management device 400 described later.
[0041] [Information management device] 6 to 11, an example of the information management device 400 will be described. The information management device 400 is a computer that manages information related to the building 2 included in the target area.
[0042] Fig. 6 is a hardware configuration diagram of an information management device 400 according to an embodiment. The information management device 400 includes, for example, a CPU 400A, a RAM 400B, a non-volatile storage device 400C, a portable storage medium drive device 400D, an input / output device 400E, and a communication interface 400F. The information management device 400 may include a processor of any type instead of the CPU 400A, or may omit some of the components shown in Fig. 6.
[0043] The CPU 400A performs various processes described below by expanding a program stored in the non-volatile storage device 400C or a program stored in a portable storage medium mounted in the portable storage medium drive device 400D into the RAM 400B and executing the program. The RAM 400B is used as a working area by the CPU 400A. The non-volatile storage device 400C is, for example, a HDD, a flash memory, a ROM, etc. Portable storage media such as DVDs, CDs, and SD cards are mounted in the portable storage medium drive device 400D. The input / output device 400E includes, for example, a keyboard, a mouse, a touch panel, and a display device. The communication interface 400F is connected to the network NW and controls communication in the information management device 400. The communication interface 400F may have a function as a Web server applied to a Web system, and may also have a function as a browser.
[0044] 7 is a functional configuration diagram of the information management device 400 according to the embodiment. The information management device 400 includes a storage unit 410 and a control unit 420.
[0045] The storage unit 410 is a storage area provided in the RAM 400B or the non-volatile storage device 400C. The storage unit 410 may be realized by an external storage device accessible from the information management device 400, such as a NAS device.
[0046] For example, the memory unit 410 stores information such as space management information 411, collected information 412, provided information 413, and BIM data 414.
[0047] With reference to Fig. 8, the space management information 411 according to the embodiment will be described. Fig. 8 is a diagram showing an example of the contents of the space management information 411 according to the embodiment. The space management information 411 includes information that specifies the range of space corresponding to each observation point. For example, a target range corresponding to each observation point is assigned. The space management information 411 includes information related to the target range. For example, the space management information 411 includes information such as an observation point ID, a floor ID, observation point position information, a first range, and a second range as information for each target range.
[0048] The observation point ID is identification information for identifying a target range assigned to an observation point. For example, the observation point ID may be identification information for identifying an observation point, or may be the coordinate value of the observation point, or a value generated based on the coordinate value.
[0049] The floor ID is identification information for identifying a floor including the target range. For example, when the area corresponds to a floor (floor) of a building, the area ID may indicate the floor number in the building, with the first floor being indicated as 1F and the second floor being indicated as 2F. Furthermore, the building may be divided into a plurality of areas according to a desired rule, such as the floor number in the building, zones on the same floor, tenants, rooms, etc. In this case, the floor ID may include information such as an identification number of each divided area.
[0050] The observation point position information is information indicating the position of the observation point determined for each target range, and is defined, for example, by position information in a three-dimensional orthogonal coordinate system.
[0051] The first range and the second range are information for identifying the target range. These are defined so that their positions are related to each other and include a specific observation point (the first point in the virtual building). Details of this will be described later.
[0052] Returning to FIG. 7, the description of the storage unit 410 will be continued. The collected information 412 includes various information collected as the surrounding conditions of the observation point. The provided information 413 includes information extracted from the information collected as the surrounding conditions of the observation point. A more specific description of the collected information 412 and the provided information 413 will be described later. The BIM data 414 is a collection of data that models buildings and facilities. The BIM data 414 includes data related to BIM such as buildings and facilities. For example, the BIM data 414 stores data on each part and each facility in a building as data for forming a BIM. There is no restriction on the data structure and type of data of the BIM data 414, and BIM data with a known data structure may be applied. For example, the BIM data stores information on a three-dimensional model of the building 2, attribute information on the above-mentioned facilities, and history information on maintenance and inspection of the building 2 and the associated facilities.
[0053] The control unit 420 includes a designated information acquisition unit 421, a surrounding image acquisition unit 422, an extraction processing unit 423, a provision information generation unit 424, a view image information generation unit 425, a display image information generation unit 426, and a BIM processing unit 427.
[0054] The specified information acquisition unit 421 acquires a detection result of a user's operation on the terminal device 200 from the terminal device 200. For example, the detection result of the user's operation includes information specifying a target range. The specified information acquisition unit 421 adds the information acquired from the terminal device 200 to the collected information 412 in the storage unit 410.
[0055] The surrounding image acquisition unit 422 acquires a surrounding image of the observation point in real space from the information sharing support device 300 and adds it to the collected information 412 in a similar manner.
[0056] Here, the collected information 412 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of the contents of the collected information 412 according to the embodiment. The collected information 412 includes information such as image information and BIM data collected for each target range.
[0057] For example, the collected information 412 includes information such as an observation point ID, target range information, a validity flag, a data type, a data identification ID (file name), a date and time (time), and a reference direction (θ0).
[0058] The observation point ID corresponds to the observation point ID in the space management information. This observation point ID uniquely identifies each of the target ranges set up within the building.
[0059] The target range information is identification information for uniquely identifying the range including the observation point ID. As information for identifying this range, either the first range or the second range is assigned to the BIM data.
[0060] The validity flag is information that indicates the validity of the collected information. For example, the validity flag is invalid when the collected information is in a situation where it cannot be used, and is valid when it is in a situation where it can be used. A situation where the collected information is in a situation where new information is collected and the information becomes outdated includes the like.
[0061] The data type is information indicating the type of data, such as image, BIM data (written as BIM), etc. For example, the file name extension may be used.
[0062] The data identification ID is identification information for identifying data to be treated as collected information, and may be, for example, a file name when the collected information is treated as a file.
[0063] The date and time is information indicating the date and time related to the collected information. For example, when the data type is an image, the date and time is given, and the date and time is the date and time when the image was taken, the date and time when the image information was stored, etc.
[0064] The reference direction (θ0) is applied when the type of information is image information. For example, when allocating an image to a target range, the surrounding image acquisition unit 422 adjusts the image direction by rotating the image around the vertical z-axis (FIG. 3) so that the image direction matches the direction in the three-dimensional virtual space. The reference direction (θ0) is a correction angle when adjustment is required, and the value is set to 0 when no correction is performed.
[0065] Some examples of data will be described. For example, image data referenced with an observation point ID of "1F1" and a data identification ID of "FP001" is managed as "invalid" data because the image data was taken on a relatively old date. In contrast, image data referenced with a data identification ID of "FP002" is managed as "valid" data because the image data was taken on a relatively new date. In this way, among images associated with a specific observation point ID, the image with the most recent image date is considered "valid." When a new image associated with a specific observation point ID is added, the most recent image is considered "valid," and the data (file) that was previously considered "valid" is changed to "invalid." In this way, by referencing data whose validity flag is "valid," the most recent image can be extracted.
[0066] Similarly, the BIM data referenced with the observation point ID "1F1" and the data identification ID "FP003" includes data of objects within the first range. In contrast, the BIM data referenced with the data identification ID "FP004" includes data of objects within the second range. The BIM data referenced with "FP004" is generated by the BIM processing unit 427 and added here.
[0067] Returning to FIG. 7, the extraction processing unit 423 will be described. The extraction processing unit 423 extracts information included in a range (first range, second range) determined based on a target range specified by the terminal device 200. In the above extraction, the extraction processing unit 423 refers to information stored in the collected information 412 based on identification information given to this information. The above-mentioned assigned identification information includes an observation point ID indicating the position of the information stored in the collected information 412. This extraction processing unit 423 determines a specific target range from among target ranges that can be specified by the terminal device 200, and extracts data for each target range based on this.
[0068] The provided information generating unit 424 generates provided information 413 corresponding to the observation point based on the range selected as the above-mentioned browsing image.
[0069] Here, the provided information 413 will be described with reference to Fig. 10. Fig. 10 is a diagram showing an example of the contents of the provided information 413 according to the embodiment. The provided information 413 includes information extracted from the collected information 412 described above. Each item of the provided information 413 corresponds to an item of the collected information 412 described above.
[0070] Furthermore, the items of the provided information 413 include information on the display range. The information on the display range includes information (flag) indicating that the information is to be selected as a viewing image of the target range. Information to which "YES" is assigned is information to be selected for display as a viewing image of the target range, and information to which "NO" is assigned is information not to be displayed as a viewing image of the target range.
[0071] The provided information 413 includes not only information extracted from the collected information 412 but also data generated based on the information extracted from the collected information 412 .
[0072] For example, BIM data having an observation point ID of "1F1" and assigned a data identification ID of "FP005" is generated as data to be used in place of BIM data assigned a data identification ID of "FP004". For example, BIM data with a data identification ID of "FP004" has "NO" assigned to the display range. This identifies it as information that should not be displayed as a viewing image of the target range. Instead, BIM data with a data identification ID of "FP005" has "YES" assigned to the display range. This identifies it as information that should be displayed as a viewing image of the target range. Information with an observation point ID different from "1F1" has "NO" assigned to the display range. This identifies it as information that should not be displayed as a viewing image of the target range.
[0073] Returning to Fig. 7, the description will be continued. The browse image information generating unit 425 generates information (browsed image information) for displaying a browse image whose range has been identified based on the above-mentioned surrounding image. An example of displaying the browse image will be described later.
[0074] The display image information generating unit 426 generates list image information that displays, in association with the observation point, the presence or absence of the provided information stored in the storage unit 410. An example of the display of the presence or absence of the provided information will be described later.
[0075] The BIM processing unit 427 manages the BIM data 414. For example, the BIM processing unit 427 adds, deletes, changes, etc., each piece of information in the BIM data 414 based on a user operation. The BIM processing unit 427 generates an image for displaying each piece of information in the BIM data 414 on a display unit in response to a user operation. This makes it possible to display information on buildings and facilities as information in a virtual space.
[0076] Such a BIM processing unit 427 makes the information management device 400 function as a BIM data management device. When the BIM processing unit 427 detects a request from the input / output processing unit, it extracts data of objects within a desired range in response to the request, and displays the extracted data of the objects on the display unit as a three-dimensional model. Furthermore, when the BIM processing unit 427 detects a request from an extraction processing unit described later, it extracts data of objects within a desired range in response to the request, and stores the extracted data in the provided information 413 in the storage unit.
[0077] Furthermore, the BIM processing unit 427 extracts information on buildings and facilities within a specific range. In this embodiment, this extraction function is used to extract information. For example, the BIM processing unit 427 extracts information on buildings and facilities within a range corresponding to the target range specified by the extraction processing unit 423, and adds the result to the collected information 412. This allows the BIM processing unit 427 to extract objects within an arbitrary box (room) of a desired size, for example, and draw them. Such a BIM processing unit 427 can extract objects (such as the above-mentioned devices) that are located inside the surface of the wall and display them on the display unit.
[0078] If an object is placed inside the surface of the wall, it may not be possible to display the object. Such objects include wiring in the floor, buried piping, and objects on the other side of the slab.
[0079] [Processing for sharing BIM data] Next, the process for sharing BIM data will be described.
[0080] 11 is a flowchart showing a procedure of a process for sharing BIM data according to the embodiment. For example, the information management device 400 performs the following process in response to an operation of the terminal device 200 of a user or the input / output device 400E.
[0081] The designated information acquisition unit 421 acquires the position of the observation point corresponding to the request from the terminal device 200 (step S12). For example, the terminal device 200 detects the button that has been operated among a plurality of icons (buttons) displayed in the image V22 (FIG. 2). As a result, the terminal device 200 identifies the position requested by the user. The identification result is shown in the image V41 (FIG. 2). A circle in the image V41 indicates the position requested by the user.
[0082] Next, the extraction processing unit 423 controls the BIM processing unit 427 to extract BIM data of the target range (first range and second range) corresponding to the observation point (step S13). In response to the above control, the BIM processing unit 427 extracts BIM data for each of the first range and second range related to the target range corresponding to the observation point, and adds it to the collected information 412. For example, image V43 (FIG. 2) is a display example of an image based on the BIM data of the first range.
[0083] Next, the provided information generator 424 extracts data within the extraction target range associated with the first range and the second range based on the information of the collected information 412 added by the BIM processor 427, and adds the data to the provided information 413 (step S14). Furthermore, the provided information generator 424 extracts the extraction target that exists within the extraction region between the first range and the second range (step S15), and adds the result to the provided information 413.
[0084] Next, surrounding image acquisition unit 422 acquires a surrounding image based on the position of the observation point (step S16) and adds it to collected information 412. For example, image V42 (FIG. 2) is a display example of a celestial sphere image of the first range.
[0085] Next, the provided information generating unit 424 extracts various data within the extraction target range based on the positions of the observation points (step S17) and adds it to the provided information 413. The data within the extraction target range includes, for example, the latest surrounding image from among the surrounding images acquired in step S16, information on the third object extracted in step S14, and information on the extraction target present in the extraction region between the first range and the second range extracted in step S15.
[0086] Next, the viewing image information generating unit 425 generates a composite image based on the various data extracted in step S17 (step S18). For example, image V44 (FIG. 2) is a display example of the above composite image. This composite image is transmitted to the terminal device 200 and can be viewed using the terminal device 200.
[0087] In order to generate a composite image based on various data, it is necessary to align the directions indicated by each piece of information. The browse image information generating unit 425 may align the directions using a method disclosed in JP 2018-88065 A or the like. The browse image information generating unit 425 is not limited to this method and may align the directions using other methods.
[0088] The information management device 400 changes the position of the observation point and performs the same process for each observation point. After performing the same process for all observation points, the information management device 400 ends the series of processes.
[0089] Through the above processing, the information sharing support system 1 enables the situation around the observation point to be shared.
[0090] Fig. 12 is a diagram for explaining an example of the target range of the embodiment, and Fig. 13 is a diagram for explaining a display example of information on the target range of the example in Fig. 12.
[0091] The cross-sectional view shown in Fig. 12 is a vertical cross-sectional view of a room provided on a specific floor of the building 2 and included in the target range of a specific observation point. Hatching indicating a cross section is omitted. The image shown in Fig. 13 is a display example of a composite image of the room shown in Fig. 12.
[0092] Reference numeral 611 in FIG. 12 indicates the boundary of the first range. Reference numeral 612 indicates the boundary of the second range. For example, the first range may be made to coincide with the target range 10. The first range may be defined as a box having a size equivalent to the size of a room. In this case, the second range may be defined as a box having a size slightly larger than the size of the room. In this case, the size of the first range may be determined based on the size of the room. The size of the second range may be determined to a size that includes the desired extraction target.
[0093] For example, the boundary 611 of the first range is defined to include the observation point P (the first point in the virtual building). For example, the observation point P is defined inside a room corresponding to the target range 10. In this case, the boundary 611 corresponds to the surfaces such as the floor, ceiling, and walls of the room. The boundary 611 may be located at the same position as the surfaces such as the floor, ceiling, and walls of the room. Distance AH1 is the ceiling height of this room. Distance AW1 is the width of this room. Explanation of the depth direction will be omitted here, but it is the same as the width direction.
[0094] As described above, the first range is defined in association with the room corresponding to the target range and its size. When the first range is defined as a rectangular parallelepiped, the range defined by the vertex (P11) close to the origin of the Cartesian coordinate system and the vertex (P12) far from the origin may be the first range.
[0095] The boundary 612 of the second range is defined so that the second range includes at least a part of the first range. In the example shown in FIG. 12, the second range is defined so that it includes the first range. In this case, the boundary 612 does not necessarily have to correspond to a surface of the building structure. The distance AH2 is the height of the second range. The distance AW2 is the width of the second range. As above, the explanation of the depth direction is omitted, but it is the same as the width direction.
[0096] The surfaces forming the boundary 611 form the floor, ceiling, and walls of this room. The lower surface of the structure forming the floor of this room is the ceiling surface 613S of the lower room of the floor. For example, the ceiling surface 613S of the lower room is located higher than the lower end (boundary 612) of the second range.
[0097] The upper surface of the structure forming the ceiling of this room is the floor surface 613F of the room on the upper floor of the layer. For example, the floor surface 613F of the room on the upper floor is lower than the upper end (boundary 612) of the second range.
[0098] An opening 614 leading to the adjacent room is provided in a first wall of this room, and a door 615 is provided at the opening 614 to close the opening 614. A second wall opposite the first wall has no opening, but has buried piping 631 inside the wall.
[0099] Similarly, buried piping 632 exists within the structure forming the floor of this room. Across the structure, pull box 633 is provided on ceiling surface 613S of the lower level, and exposed piping 634 extends from pull box 633. These are the outdoor facilities of this room.
[0100] When the second range is defined by a rectangular parallelepiped as in the first range as described above, the range defined by the vertex (P21) close to the origin of the Cartesian coordinate system and the vertex (P22) far from the origin may be defined as the second range. When defining the position and size of the second range, the buried pipe 631, buried pipe 632, pull box 633, exposed pipe 634, etc. are defined so as to be included in the second range. As a result, the buried pipe 631, buried pipe 632, pull box 633, exposed pipe 634, etc. are provided within the second range.
[0101] Moreover, buried pipes 631, buried pipes 632, pull boxes 633, exposed pipes 634, etc. are located in an extraction target area (object extraction range) between the first range and the second range. These are examples of the first object. In other words, the first object is classified as an object that does not appear when a photo is taken in a room. Since the presence and position of the first object cannot be confirmed by checking the surrounding image, for example, these are displayed as objects as shown in FIG. 13. Displaying as an object means that the position and shape of the first object are modeled and displayed. In this case, the shape may be displayed by a method such as showing it with a dashed line.
[0102] In contrast, the device 621 is arranged so as to be located within the first range. The device 621 is an example of a third object. In other words, the third object is classified as an object that appears when a photo is taken in a room. If the first object exists, it appears in the surrounding image. Therefore, the presence and position of the first object can be confirmed by checking the surrounding image. This may also be displayed as an object as shown in FIG. 13. Displaying as an object in this case means that the position and shape of the third object are already modeled as BIM data, so that the shape is displayed in the image so as to match the position where it is arranged. This allows it to be different from the notation of the first object described above.
[0103] From the image in which the object is superimposed and displayed in this manner, the user can identify whether the object corresponds to the first object or the third object.
[0104] In addition, there are cases where the first object and the third object are located straddling the boundary of the first range and the boundary of the second range, respectively. In this case, it is advisable to predefine the identification conditions for whether or not to extract the object, and execute the extraction process based on these. For example, when using the image to check the planned construction site, it is advisable to extract the object if it contains part of the object. This allows the situation in the vicinity of the construction site to be checked without missing anything.
[0105] The provided information 413 shown in FIG. 10 will now be described in more detail. The file identified by the data identification ID "FP003" includes information on a third object, such as device 621.
[0106] In contrast, a file identified by the data identification ID "FP004" contains information on a third object such as the device 621, and information on a first object such as the buried pipe 631, the buried pipe 632, the pull box 633, and the exposed pipe 634. The data in this file may be used as is to provide information, but in this embodiment, the first object is extracted from this as a display object, and this is compiled into a file identified by the data identification ID "FP005".
[0107] As a result, information on the third object is stored in a file identified by the data identification ID "FP003." Information on the first object is stored in a file identified by the data identification ID "FP005." In this way, it is possible to classify the objects into file units using the positions of the objects as a key.
[0108] In this way, the provided information 413 stores data defining the area to be extracted as being between a first range defined within the virtual building to include a first point within the virtual building, and a second range defined to include at least a portion of the first range.
[0109] (Extraction processing by extraction processing unit 423) The above-mentioned extraction process by extraction processing unit 423 will be summarized from another perspective. The extraction processing unit 423 refers to the provided information 413 in the storage unit 410 and extracts information on a first object associated within the extraction target area. The extraction processing unit 423 is configured not to extract information on a second object associated with an area outside the extraction range that is outside the second range. The extraction processing unit 423 extracts information on a third object associated within the first range. At that time, the extraction processing unit 423 extracts information on the first object and the third object separately based on position information associated with each object.
[0110] For example, the extraction processing unit 423 causes the BIM processing unit 427 to extract information on a third object associated within the first range based on information on the respective associated positions. Similarly, the BIM processing unit 427 extracts information on an object associated within the second range. At this time, information on a third object associated within the first range, which is inside the second range, is also extracted. The extraction processing unit 423 may compare information on the object associated within the second range with information on the third object, remove overlapping information from the objects, and extract this as information on the first object. The extraction processing unit 423 may add the extracted result to the provided information 413 of the storage unit 410.
[0111] Through the above process, the information management device 400 can distinguish between the first object and the third object and change the display of each object.
[0112] (Examples of usage) According to the above embodiment, by sharing the shooting position of the omnidirectional image, attribute information of the BIM model is plotted on an image based on the omnidirectional image, and detailed information for each object can be viewed without relying on BIM software that requires specialized knowledge for operation. In addition, it is possible to use the omnidirectional image, an image with a BIM model superimposed thereon, and an image displaying detailed information for each object based on the BIM data. These images may be used for walk-throughs, and any memos may be attached to the omnidirectional image, and cross-searches of the above memos may be performed. If sensor information attached to actual equipment is applied as the detailed information for each object, it is possible to display this information on a common screen, and the user can view the information on a common screen without switching the screen displayed on the terminal device 200.
[0113] There are blind spots that are not captured in an image captured using the imaging device 100. The information management device 400 makes it possible to display objects in the blind spots as objects superimposed on the image. An example of the above object is a device (such as the pull box 633) and its piping (such as the exposed piping 634) that are installed in the ceiling part of the lower floor beyond the floor slab. It is recommended to draw the outline of the device with a dashed line. Furthermore, it is recommended to draw the outline of piping buried in the wall (such as the buried piping 631, 632) and piping in the floorboard that is hidden by the interior decoration with a dashed line in the same manner as above.
[0114] On the other hand, there is an area that will appear in the image if the image is captured by the imaging device 100. The information management device 400 displays an object corresponding to the object in the area on the display unit by superimposing it on the image. An example of the object is, for example, a fixture or equipment installed in a room. It is preferable to draw a contour line showing its shape. By superimposing the object on this image, it is possible to display the degree of correspondence between the actual object and the object defined in the virtual space in an easy-to-compare manner. If attribute information is assigned to the object in this area as BIM data, it is preferable to display this in association with the object. This attribute information may include predefined text, drawings, etc., and may further include sensor data (detection values) that are detected by a sensor or the like at a predetermined cycle and updated based on the detected values, and processed data thereof. The data that is updated in this manner can be superimposed on the image of the terminal device 200 and displayed. Note that the method of superimposing and displaying is one example, and is not limited thereto. For example, a pop-up window that opens in response to an operation or detection of an abnormal value may be displayed on the display unit of terminal device 200, and the above information may be displayed therein, or may be displayed in a partial area of the display unit of terminal device 200.
[0115] According to the above embodiment, the following usage patterns are possible, thereby providing the following effects.
[0116] By using the information management device 400, information can be managed centrally. This makes it possible to prevent duplicate management of related information. Since the information superimposed on the spherical image is displayed on the composite image, it is possible to utilize the information in a higher dimension, rather than simply viewing the spherical image.
[0117] By using the information management device 400, it is easy to check the current situation. This can reduce work errors caused by misunderstandings.
[0118] By using the information management device 400, it becomes easier to access multiple types of information managed by the information management device 400, improving convenience.
[0119] The information management device 400 makes it possible to display information based on a BIM model by superimposing it on a spherical image. This makes it easier to compare the BIM model with reality (the spherical image). Furthermore, it makes it easier to correct any discrepancy between the BIM model and reality.
[0120] By sharing information, it becomes possible to complement each other's current information where there is a lack of information.
[0121] (First Modification) A first modified example will be described. In the above embodiment, a case has been described in which the information management device 400 generates an image to be displayed on the display unit of the terminal device 200, and the image is viewed using the terminal device 200. Instead, in this modified example, a case will be described in which the terminal device 200 generates an image to be displayed on the display unit.
[0122] The information management device 400 of this modification identifies information on the first object and information on the third object in the same manner as in the embodiment. The information management device 400 transmits the information to the terminal device 200. The terminal device 200 may acquire the information on the first object and information on the third object and the omnidirectional image, and generate a composite image based on the information on the first object and the omnidirectional image instead of the browsing image information generating unit 425. According to this, the present modified example also provides the same effects as the embodiment.
[0123] (Second Modification) A modified example of the embodiment will be described. In the embodiment, when identifying the target range, the range is identified using the feature points of the first range and the second range. However, instead of this, the first range and the second range may be identified using a first range identification number and a second range identification number respectively associated with the first range and the second range. In this case, the first range identification number is an identification number for identifying the first range. The second range identification number is an identification number for identifying the second range. If the ranges in the virtual space for the first range identification number and the second range identification number are specified in advance, the ranges in each virtual space can be identified based on this. According to this, the present modified example also provides the same effects as the embodiment.
[0124] In addition, a program for realizing the information sharing support system 1 may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing operations for identifying objects in the building 2, etc. In addition, the term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer system" also includes a WWW system equipped with a homepage providing environment (or display environment). The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also refers to storage devices that hold a program for a certain period of time, such as volatile memory (RAM) inside a computer system that becomes a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line.
[0125] The above program may also be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium, or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network or a communication line. The above program may also be one that realizes part of the above-mentioned functions. Furthermore, it may also be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.
[0126] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]
[0127] 1...facility selection system, 2...building, 100...imaging device, 200...terminal device, 300...information sharing support device, 400...information management device, 410...storage unit, 420...control unit, 421...designated information acquisition unit, 422...surrounding image acquisition unit, 423...extraction processing unit, 424...provided information generation unit, 425...viewed image information generation unit, 426...display image information generation unit, 427...BIM processing unit, 500...facility management device
Claims
1. An information management device capable of storing information of an object related to a virtual building arranged in a three-dimensional space and information of a building related to the virtual building in a storage area in association with a predetermined position within the virtual building, the information management device comprising: an extraction processing unit that defines a first range within the virtual building so as to include a first point within the virtual building, defines a second range so as to include at least a portion of the first range, determines an area between the first range and the second range as an extraction target area, and extracts information of a first object associated within the extraction target area and information of a third object associated within the first range; a display image information generating unit that generates an indoor image related to a predetermined position in the virtual building related to the position information of the first object or the position information of the third object based on an image captured in the building; a model information processing unit that associates information of at least the third object with a predetermined position within the virtual building and stores the information in the storage area; Equipped with A three-dimensional model based on the information of the third object is displayed superimposed on the indoor image. Information management device.
2. The extraction processing unit: not extracting information of a second object associated with an outside-extraction-range area outside the second range; The information management device according to claim 1 .
3. The model information processing unit: The information on a three-dimensional model of the object related to the information based on the information on the first object or the information on the third object is associated with a predetermined position within the virtual building and stored in the storage area. The information management device according to claim 1 .
4. The extraction processing unit: extracting information of the first object and the third object to be displayed; The information management device according to claim 1 .
5. 1. An information extraction method by a computer capable of storing information of an object related to a virtual building arranged in a three-dimensional space and information of a building related to the virtual building in a storage area in association with a predetermined position within the virtual building, comprising: A step of defining an extraction target area between a first range defined within the virtual building so as to include a first point within the virtual building and a second range defined so as to include at least a part of the first range, and extracting information of a first object associated within the extraction target area and information of a third object associated within the first range; generating an indoor image related to a predetermined position in the virtual building related to the position information of the first object or the position information of the third object based on an image taken in the building; storing information of at least the third object in the storage area in association with a predetermined position within the virtual building; An information extraction method comprising: and displaying a three-dimensional model based on information about the third object on the indoor image. An information extraction method comprising:
Citation Information
Patent Citations
Information processor equipped with interactive control function
JP1998011248A
Selection apparatus, selection method, and computer program
JP2010134792A
Architectural information integrated management system and program
JP2012068698A
Virtual indoor space display device
JP2014164003A
Information visualization system, information visualization method, and program
JP2018088065A
