Process display system, process display method, and process display program

Abstract

This invention relates to a process display system, a process display method, and a process display program. [Solution] The process display system 1 comprises a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting location and time. The display processing unit, based on the time information, video information, and process information corresponding to the process received from the user terminal, displays the video information related to the process corresponding to the time information within the 3D model space, corresponding to the shooting position, and transmits the result of the display processing.

Description

【Technical Field】 【0001】 The present invention relates to a process display system, a process display method, and a process display program. 【Background Art】 【0002】 Conventionally, the status of construction work has been confirmed and inspected by using images and videos taken at the construction site. 【0003】 Patent Document 1 discloses an inspection processing system that can efficiently perform inspection of a structure by superimposing and outputting a BIM image generated under predetermined conditions on a captured image. 【Prior Art Documents】 【Patent Documents】 【0004】 【Patent Document 1】 Japanese Patent Application Laid-Open No. 2019-27855 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0005】 By the way, at an actual construction site, the positions and angles at which images are taken vary depending on the work content and the like, and from which position and from what perspective the object to be photographed (structure) is photographed is a very important factor in status confirmation and inspection. However, in the technology of Patent Document 1, such a perspective is not considered, and it is impossible to grasp from what position and angle the structure is photographed. 【0006】 The present invention has been made in view of the above problems of the prior art, and an object thereof is to realize a process display system that can easily and effectively confirm the history and perform inspection at a construction site. 【Means for Solving the Problems】 【0007】 To solve the above problems, the present invention provides a process display system for displaying the process history at a construction site, The process display system comprises a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting position and time. The display processing unit, based on the input of time information corresponding to the process received from the user terminal, the video information, and the process information, processes the video information related to the process corresponding to the time information to be displayed in the space of the 3D model in correspondence with the shooting position, and transmits the result of the display processing. 【0008】 Furthermore, the present invention relates to a process display method executed by a process display system that displays the history of processes at a construction site, The process display system comprises a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit performs the step of acquiring video information captured at a predetermined shooting position and time, The display processing unit includes the steps of: inputting time information corresponding to the process history received from a user terminal; the video information; the process information; displaying the video information relating to the process corresponding to the time information in the space of a 3D model in correspondence with the shooting position; and transmitting the result of the display processing. 【0009】 Furthermore, the present invention is a process display program that displays the process history at a construction site, The computer is configured to function as a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting position and time. The display processing unit, based on the input of time information corresponding to the process history received from the user terminal, the video information, and the process information, displays the video information related to the process corresponding to the time information within the space of the 3D model in correspondence with the shooting position, and transmits the result of the display processing. 【0010】 This configuration allows for easy and effective verification of construction history and inspections at the construction site. 【0011】 In a preferred embodiment of the present invention, if there are multiple steps corresponding to the input of time information in the input of time information, the display processing unit displays the multiple steps and transmits the result of the display processing to the user terminal. The system displays video information corresponding to the process selected based on input from the user terminal. 【0012】 This configuration allows for easy and appropriate display of video information according to the user's needs. As a result, users can perform inspections and other tasks more quickly and accurately than before. 【0013】 In a preferred embodiment of the present invention, if the display processing unit has a plurality of steps corresponding to the input of time information, it displays a plurality of video information corresponding to the plurality of steps. 【0014】 This configuration allows for easy and appropriate display and processing of multiple video data sources. As a result, users can perform inspections and other tasks more quickly and accurately than before. 【0015】 In a preferred embodiment of the present invention, the shooting position has temporal positional information in which the shooting position changes over time. The display processing unit displays the video information within the space of the 3D model based on the temporal position information. 【0016】 By adopting such a configuration, even in a situation where the shooting position changes over time, appropriate display processing corresponding to the change can be performed. For example, when the person in charge at the site is shooting while patrolling the site, the video information can be displayed and processed at an appropriate position (coordinate position) corresponding to the passage of time within the space of the 3D model based on the position information. 【0017】 In a preferred form of the present invention, the display processing unit performs display processing of a plurality of pieces of the video information within the space of the 3D model based on the position information over time of each piece of the video information corresponding to a plurality of the steps. 【0018】 By adopting such a configuration, a plurality of pieces of video information can be appropriately displayed and processed within the 3D model space according to the passage of time. 【0019】 In a preferred form of the present invention, the display processing unit performs display processing of each piece of the video information corresponding to a plurality of the steps in a distinguishable manner. 【0020】 By adopting such a configuration, the user can view the display of video information that is easy to distinguish for each step and has high convenience. 【0021】 In a preferred form of the present invention, the process display system further includes a video position adjustment unit. The video information has a shooting direction indicating the direction in which the video was shot at the construction site. The video position adjustment unit determines an overlap between the shooting target model and the video information within the space of the 3D model based on the shooting direction, the shooting position, and the process information. When there is an overlap between the shooting target model and the video information, the display position of the video information is adjusted. 【0022】 This configuration allows the 3D model of the subject and the video information to be displayed side-by-side on the same screen, regardless of the direction from which the subject was filmed. For example, even if the subject is filmed from multiple locations at the same time, the positional relationship between the 3D model of the subject and the video information can be automatically adjusted. 【0023】 In a preferred embodiment of the present invention, the adjustment process changes the display position of the video information to a position that does not overlap with the model being filmed in the viewing direction from the user using the user terminal. 【0024】 This configuration allows for an optimal display that is easy for users to see. For example, if the 3D model displayed on the user's terminal can be changed to various angles, the model being photographed and the video information can be displayed appropriately according to the changed angle. [Effects of the Invention] 【0025】 According to the present invention, by corresponding time-related information and executing predetermined processes, a novel technology related to a process display system can be provided. [Brief explanation of the drawing] 【0026】 [Figure 1] A block diagram of the system configuration for one embodiment of the present invention is shown. [Figure 2] A schematic diagram of an example of the hardware configuration of an information processing device and terminal according to one embodiment of the present invention is shown. [Figure 3] A flowchart of the processing procedure in a process display system according to one embodiment of the present invention is shown. [Figure 4] An example of the information used in the process display system according to one embodiment of the present invention is shown. [Figure 5] An example of the display processing result on a user terminal according to one embodiment of the present invention is shown. [Figure 6]An example of the display processing result on a user terminal according to one embodiment of the present invention is shown. [Figure 7] An example of the display processing result on a user terminal according to one embodiment of the present invention is shown. [Figure 8] An example of the display processing result on a user terminal according to one embodiment of the present invention is shown. [Figure 9] An example of the display processing result on a user terminal according to one embodiment of the present invention is shown. [Modes for carrying out the invention] 【0027】 Further details will be provided below with reference to the attached drawings. The drawings show preferred embodiments. However, many different forms are possible and the invention is not limited to those described herein. 【0028】 For example, in this embodiment, the configuration and operation of the process display system will be described, but similar effects can be achieved by the execution method (steps), apparatus, computer program, etc. The program in this embodiment may be provided as a non-transient recording medium that can be read by a computer, or it may be provided so that it can be downloaded from an external server. 【0029】 Furthermore, in this embodiment, "part" may also include, for example, hardware resources implemented by circuits in a broad sense, and software information processing that can be specifically realized by these hardware resources. 【0030】 In this embodiment, "information" can be represented, for example, by the physical value of a signal representing voltage or current, the high or low value of a signal as a set of binary bits consisting of 0s or 1s, or by a quantum superposition (so-called qubit), and communication and calculations can be performed on a circuit in a broad sense. 【0031】 In a broad sense, a circuit is a circuit realized by appropriately combining circuits, circuits (including processors and memory). That is, it includes CPUs (Central Processing Units), GPUs (Graphics Processing Units), LSIs (Large Scale Integration), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), etc. 【0032】 <System Configuration> Figure 1 is a block diagram showing the system configuration according to one embodiment of the present invention. As shown in Figure 1, the process display system 1 includes an information processing device 10 and a database DB. The process display system 1 is configured to communicate with a plurality of user terminals 2 (reference numerals 2(a) to 2(c) in Figure 1) and imaging devices 3 (reference numerals 3(a) to 3(c)) via a network NW. 【0033】 The information processing device 10 operates as a server, the user terminal 2 is a terminal used by users such as general contractors and site supervisors at construction sites, and the shooting device 3 is a terminal used to capture video and moving images (and other images, etc.) at construction sites. 【0034】 In this embodiment, the network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, nor on the type or size of the network. 【0035】 Furthermore, a general-purpose server computer or personal computer can be used as the information processing device 10. It is also possible to implement the functional components described later on multiple computers to constitute the process display system 1. 【0036】 User terminal 2 is a terminal used by the general contractor or other personnel at the construction site. User terminal 2 can be a smartphone, tablet, personal computer, wearable device, etc. User terminal 2 stores a user-defined process display application program, which has the functionality to display the work history (e.g., 3D models or videos) for each stage of the construction process at the site. 【0037】 Furthermore, user terminal 2 can be configured without a process display application program. In this case, user terminal 2 can display and transmit information using a web browser or similar. 【0038】 The recording device 3 is a camera device or the like for recording the work history of the construction site as video or video. Recording device 3 can utilize any known camera device. Recording device 3 is configured to transmit information such as the shooting location, recording disclosure date and time, recording end date and time (shooting time), and video information to the process display system 1. Furthermore, smartphones, tablet devices, wearable devices, etc., can also be used as recording device 3. Recording device 3 can be any device that can capture video of the history of each process at the construction site and transmit the video information and shooting location information to the process display system 1. Multiple recording devices 3 are present at the construction site, each positioned in a predetermined location. 【0039】 <Hardware Configuration> Figure 2(a) shows an example of the hardware configuration of the information processing device 10. The information processing device 10 comprises a control unit 11, a storage unit 12, and a communication unit 13 as its hardware configuration. 【0040】 The control unit 11 includes one or more processors such as a CPU, and controls the entire operation of the information processing device 10 by executing the process display program, OS, and other applications according to the present invention. 【0041】 The storage unit 12 is an HDD, SSD, ROM, RAM, etc., and stores the process display program according to the present invention and data used by the control unit 11 when executing processing based on the program. The control unit 11 executes processing based on the process display program stored in the storage unit 12, thereby realizing the functional configuration described later. 【0042】 The communication unit 13 performs communication control with the network NW and provides inputs necessary for operating the information processing device 10, as well as outputs related to the operation results. 【0043】 Figure 2(b) shows an example of the hardware configuration of terminal 90 (user terminal 2 in Figure 1). Terminal 90 comprises a control unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95 as its hardware configuration. 【0044】 The control unit 91 of the terminal 90 includes one or more processors such as a CPU and controls the entire operation of the terminal 90. The storage unit 92 of the terminal 90 is an HDD, SSD, ROM, RAM, etc., and stores the aforementioned performance management application program and data used by the control unit 91 when executing processing based on the program. 【0045】 The communication unit 93 of terminal 90 controls communication with the network. The input unit 94 of terminal 90 is a touch panel, mouse, keyboard, etc., which inputs user operation requests to the control unit 91. The output unit 95 of terminal 90 is a display, etc., which displays the results of processing by the control unit 91. 【0046】 <Functional Configuration> As shown in Figure 2(a), the information processing device 10 comprises, as a functional configuration, a reception unit 101, an acquisition unit 102, a display processing unit 103, and a video position adjustment unit 104. These are the concrete realizations of information processing performed by software (stored in the storage unit 12) by hardware (control unit 11, etc.). 【0047】 The reception unit 101 receives and registers various information from user terminals 2 and administrators. The reception unit 101 receives user information from user terminals 2 and stores it in the storage unit 12. The reception unit 101 also receives 3D model information and site information from user terminals 2 and administrator terminals (not shown in the diagram) and stores them in the storage unit 12. The reception unit 101 can also receive input of time information corresponding to the process history from user terminals 2 and administrator terminals (for example, input of operations on the time axis bar described later). 【0048】 The acquisition unit 102 acquires various types of information. In this embodiment, the acquisition unit 102 acquires video information captured at a predetermined shooting location and time. For example, the acquisition unit 102 can also acquire information such as the shooting location and time of the video information from a server other than the shooting device 3. In this embodiment, the predetermined date and time (a predetermined period, the time captured, for example, 2 hours, 12 hours, etc.) between the recording start date and time and the recording end date and time in the video information, as well as the shooting start date and time, shooting end date and time, etc., are collectively referred to as shooting time. 【0049】 The display processing unit 103 processes and displays various information. In this embodiment, the display processing unit 103 processes and displays the video information related to the process corresponding to the time information in the 3D model space, corresponding to the shooting position, based on the input of time information corresponding to the process history (operation input such as a time axis bar), video information, and process information received from the user terminal, and transmits the result of the display processing. 【0050】 Furthermore, if the display processing unit 103 has a history of multiple processes corresponding to the input of time information, it displays the multiple processes, transmits the results of the display processing to the user terminal 2, and displays the video information corresponding to the process selected by the input from the user terminal 2. The display processing unit 103 can display multiple video information corresponding to multiple processes if there is a history of multiple processes corresponding to the input of time information. The display processing unit 103 can also display video information in the space of a 3D model based on temporal position information where the shooting position changes over time. 【0051】 Furthermore, the display processing unit 103 displays multiple video information within the 3D model space based on the temporal positional information of each video information corresponding to multiple processes. In addition, the display processing unit 103 can display each video information corresponding to multiple processes in an identifiable manner. 【0052】 The video position adjustment unit 104 adjusts the display position of the video information based on predetermined conditions. In this embodiment, the video position adjustment unit 104 determines the overlap between the video information and the target model (for example, a single model such as an elevated bridge) in the 3D model space, based on the shooting direction, shooting position, and process information indicating the direction in which the video was taken at the construction site. If there is an overlap between the target model and the video information, it adjusts the display position of the video information. 【0053】 Furthermore, the video position adjustment unit 104 changes the display position of the video information to a position that does not overlap with the model being filmed in the viewing direction from the user using the user terminal 2 (if the video information overlaps with the model being filmed when viewed from the direction the user is viewing, the display position of the video information is adjusted). 【0054】 <database DB> The database DB in Figure 1 stores user information, 3D model information, site information, process information, video information, and other information necessary for process display. Some or all of this information may be stored in the storage unit 12, or some of this information may be stored in another database. 【0055】 The process display system 1 and the processing content of each functional component will be explained below with reference to Figures 3 to 9. 【0056】 <Overview of the Process Display System> The process display system 1 according to this embodiment is a system for displaying video (history) of the implementation history of each process carried out at a construction site within the space of a 3D model corresponding to the construction site (process) based on predetermined conditions. Specifically, the system can display the video within the 3D model space at the same position (coordinates) as the shooting position where the video was taken at the construction site (or display it in a way that allows the shooting position to be identified within the 3D model space). By displaying it in this way, users can appropriately perform inspections and history management for each process. 【0057】 Furthermore, the process display system 1 can display images within the 3D model space while changing the shooting position over time, even when the shooting position changes over time. The processing flow in the process display system 1 will be explained in detail below. 【0058】 <Register various types of information> Figure 3 shows a flowchart of the processing procedure in a process display system according to one embodiment of the present invention. In S201, users such as the general contractor and site supervisor (and workers) at the construction site register various information. 【0059】 Specifically, users can register information such as user information, 3D model information corresponding to the construction site or process, site information of the construction site, and process information related to the process at the construction site via user terminal 2 or the like. In this embodiment, the term "user" includes not only the general contractor (the general contractor company and its personnel) but also site supervisors, workers, and other people who manage the process and work at the construction site. 【0060】 To use the process display system 1, users register user information, such as company information. As shown in Figure 4(a), user information is managed by a user ID and includes information such as the company name (e.g., XXX Corporation), contact information, company address, types of work that can be performed, and registration date. User information can also include the name of the person in charge of the actual construction site. 【0061】 In this embodiment, users whose user information is registered (prime contractors and their representatives) can use the services related to the process display system 1. However, registration of user information is not necessarily required, and the system may be configured so that users who have not registered user information can also use the services. 【0062】 As shown in Figure 4(b), 3D model information is managed by a model ID, including information such as the model's storage location. The 3D model information includes multiple types of models, and a model here refers to a 3D model used to construct a 3D space. For example, structures and parts such as elevated bridges and buildings are managed by a model ID (or structure IDs or part IDs not shown), and the 3D space of the construction site can be constructed as a 3D model space by combining each part and structure (according to the progress). Also, as shown in Figure 4(c), site information is managed by a site ID, including information such as the site name and address of the construction site. 【0063】 As shown in Figure 4(d), process information is managed by a process ID, which includes information such as the name of the work for each process (e.g., preparatory work, crane installation), the planned start and end dates and times for each process, the model ID, the site ID, and the current progress rate for each process. 3D model information is associated with the process information, and this process information is used to display the 3D model corresponding to the date and time in each process. In other words, it is predetermined which 3D model will be displayed at which location at which date and time (the 3D model and the process correspond on a time axis). In this specification, the predetermined date and time from the planned start date and time to the planned end date and time in a process is sometimes referred to as the working time. In this embodiment, it is also possible to construct a 3D model for a specific date and time using the progress rate and other information included in the process information. 【0064】 <Acquisition of video information> In S202, the acquisition unit 102 acquires video information captured by the camera 3. The video information includes information about the shooting location. Multiple camera 3s are placed at predetermined locations on the construction site and are used to capture the work content (work history, process history) at each stage of the process. For example, if work related to a bridge girder occurs during the construction process, the camera 3 will capture the bridge girder. 【0065】 As shown in Figure 4(e), video information is managed by a video ID, which includes information such as the name of the shooting device 3, such as fixed camera A, the video storage location, the recording start date and time, the recording end date and time (shooting time), the site ID, the shooting location, and the shooting direction. 【0066】 Furthermore, at the construction site, multiple camera devices 3 can photograph the bridge girder from different directions, and the acquisition unit 102 can acquire this multiple video information. This video information is stored in the storage unit 12 in association with the aforementioned process information and 3D model information. 【0067】 <Display processing of 3D models and process charts> In S203, the 3D model and the construction schedule for the construction site are displayed. The display processing unit 103 can display the schedule based on the schedule information. The display processing unit 103 displays the 3D model and the schedule side by side based on the 3D model information and the schedule information, and transmits the result of the display processing to the user terminal 2. 【0068】 For example, as shown in Figure 5, the display processing unit 103 displays the 3D model W10 and the schedule W20 for a specific construction site, arranged vertically. In this embodiment, the 3D model W10 is displayed on the top and the schedule W20 is displayed on the bottom, but the 3D model W10 and the schedule W20 may be displayed upside down or side by side. The 3D model W10 and the schedule W20 can be displayed in any positional relationship, not limited to up, down, left, or right, as long as they are visible to the user. Also, although the schedule W20 shown in Figure 5 only displays the date, it can also display the date and time, or the date and time can be selected by selecting a predetermined position in the date display (selection by a time axis bar, which will be described later). 【0069】 For example, in this embodiment, multiple 3D models W10 with different scales and display ranges of the construction site and their corresponding schedules W20 can be displayed side by side. By displaying multiple 3D models W10 with different scales and display ranges and their corresponding schedules W20 side by side, the user can grasp the overall image of the construction site while also understanding the details of the structures they wish to check. 【0070】 In Figure 5, the schedule W20 displays a time axis bar W40 for selecting a predetermined date and time (day or hour) in process W30 (a process showing the period from the planned start date and time to the planned end date and time in Figure 4(d)). The user can select process W30 for a predetermined date and time by moving this time axis bar W40 left or right. The user can move the time axis bar W40 by touching (inputting operations) on the screen of user terminal 2. 【0071】 In actual construction sites, multiple tasks may be carried out simultaneously within a specified period (specified date and time), resulting in multiple overlapping processes being displayed within the specified period in the schedule W20. In the schedule W20, since each process W30 has a different construction period, processes W30 with different lengths in the horizontal direction are displayed. In this specification, the day (date and time) to which the time axis bar W40 is located may also be referred to as time information. 【0072】 <Display processing of video information> In S204, the reception unit 101 receives time information corresponding to the process schedule W20. Specifically, by moving the time axis bar W40 in Figure 5 left or right (by inputting an operation from the user terminal 2), a date or time in process W30 that the time axis bar W40 is touching (or overlapping on the screen) is selected. At this time, the history of process W30 in the selected time information (the history of processes based on time information) is displayed as a 3D model W10. As mentioned above, multiple tasks may be carried out simultaneously, in which case the time axis bar W40 may touch multiple processes. 【0073】 In this embodiment, the process corresponding to a predetermined date and time is selected by the operation input of the time axis bar W40. However, the selection of the process corresponding to a predetermined date and time is not necessarily limited to the operation of the time axis bar W40. For example, the predetermined date and time can be entered as text, or selected from a calendar display, time display, etc. The process can also be selected by selecting and inputting. In this case, the display processing unit 103 can display a calendar display or time display based on the general time information and process information held by the information processing unit 10, and send the result of the display processing to the user terminal 2. 【0074】 Then, in S205, video information of process W30 at the selected date and time is displayed in the space of the 3D model W10. The reception unit 101 receives predetermined time information from the user terminal 2 based on the movement of the time axis bar W40. The display processing unit 103, based on the input of time information corresponding to the history of process W30 received from the user terminal 2, the shooting position of the video information, and the process information stored in the storage unit 12, processes the video information related to process W30 corresponding to the time information to be displayed in the space of the 3D model W10 in correspondence with the shooting position, and transmits the result of the display processing. 【0075】 As shown in Figure 6(a), based on the time information (and 3D model information, and video information associated with the 3D model) where the time axis bar W40a is located in the process chart W20, video information W50a related to process W30a corresponding to the time information is displayed in the space of the 3D model W10. In this embodiment, this video information W50a is displayed in the space of the 3D model W10 corresponding to the shooting position that the shooting device 3 was shooting at the actual construction site. 【0076】 For example, the shooting position of the process information in Figure 4 can be converted to the coordinate position (global coordinate system) of the 3D model information, and the video information W50 can be displayed at the coordinate position in the 3D model space corresponding to the converted shooting position. In Figure 6(a), the shooting position is shown as a circle, and the video information W50a is displayed above it. 【0077】 Then, as shown in Figure 6(b), when the position of the time axis bar W40a in the process chart W20 is moved to the left, that is, when the time axis bar W40a is moved from the position in Figure 6(a) toward past dates and a predetermined date and time is selected (time axis bar W40b in Figure 6(b)), the time axis bar W40b comes into contact with another process W30b, and video information W50b based on that process W30b is displayed. At this time, in Figure 6(b), the video information W50b of the predetermined date and time selected in the newly selected process W30b is displayed in the space of the 3D model W10 corresponding to the shooting position of the shooting device 3 used to shoot the process W30b (the 3D model W10 also displays the 3D model of the selected date and time). 【0078】 In this embodiment, by utilizing the shooting position and shooting time, it is possible to represent images taken at the same location and time as the actual construction site within the 3D model space. For example, considering a scene of elevated bridge construction, the user can understand from which direction the elevated bridge was photographed in the 3D model, and can also check the video information together with the elevated bridge model displayed in the 3D model space. This allows for more accurate inspections and appropriate history management than before. 【0079】 Furthermore, as shown in Figure 7, when the time axis bar W40 is in contact with two processes W30c and W30d, the video information W50c and W50d for processes W30c and W30d can be simultaneously displayed within the space of the 3D model W10. The display processing unit 103 can display multiple video information corresponding to multiple processes when there are multiple processes corresponding to the input of time information. The display processing unit 103 can also display each video information corresponding to multiple processes in an identifiable manner. For example, the color and shape of the frame portion of each video information can be set to be distinguishable. 【0080】 The user can view two videos simultaneously and appropriately grasp the progress of two processes. For example, when related tasks arise in two processes, the progress of processes W30c and W30d can be quickly grasped (by simultaneously viewing W50c and W50d), allowing for appropriate changes to the subsequent process plan. Figure 7 illustrates the case where two processes are involved, but there is no limit to the number of processes, and two or more processes can be displayed simultaneously in the space of the 3D model W10. 【0081】 For example, if the time axis bar W40 is in contact with multiple processes W30, the display processing unit 103 displays the multiple processes and transmits the results of the display processing to the user terminal. The display processing unit may also display video information corresponding to the process selected by input from the user terminal. In this case, the video related to the process desired by the user can be displayed appropriately. 【0082】 The aforementioned camera 3 is like a fixed-point camera and is fixed in a predetermined shooting position to photograph each process. However, in reality, a representative of the main contractor may also photograph each process while touring the construction site (for example, wearable device B in Figure 6(e)). 【0083】 In such a case, as shown in Figure 8 of this embodiment, if a person in charge is touring the construction site and taking photographs related to process W30e at a time when process W30e and the time axis bar W40 are in contact, the video information W50e can be displayed in the space of the 3D model W10 in accordance with the changing shooting position over time. Specifically, the video information in this embodiment has temporal position information in which the shooting position changes over time. The display processing unit 103 then processes the video information to display it in the space of the 3D model based on the temporal position information. 【0084】 Furthermore, as shown in Figure 9, the display processing unit 103 can also display multiple video information within the 3D model space based on the temporal positional information of each video information corresponding to multiple processes. With this type of display processing, users checking the process history can appropriately understand how the shooting position has changed, and by simultaneously checking multiple temporal positional changes and each video information, they can consider appropriate responses if any troubles or irregularities occur in the multiple processes that were being worked on simultaneously. 【0085】 <Adjusting the position of video information within a 3D model space> As described above, in this embodiment, time-related information and position-related information are shared in the 3D model information, process information, and video information, respectively, and by using this time-related and position-related information, video information can be displayed at a predetermined position in the space of the 3D model (the position where the shooting device 3 is actually installed, or a corresponding position). 【0086】 For example, in Figures 6-9, the shooting position is indicated by a circle, and video information is displayed above it. However, the position of this video information may sometimes obscure the object within the 3D model space. 【0087】 Therefore, in the process display system 1 according to this embodiment, the display position of the video information W50 within the space of the 3D model W10 can be appropriately adjusted. Specifically, the video position adjustment unit 104 determines the overlap between a predetermined target model (for example, a model such as an elevated bridge) and the video information W50 within the space of the 3D model based on the shooting direction information (direction information) contained in the video information, the shooting position of the shooting device 3, and the 3D model information. If the predetermined target model and the video information W50 overlap, the display position of the video information can be adjusted. The shooting direction is angle information from a predetermined reference, detailed directional information that shows east, west, north, south, etc. in more detail. 【0088】 For example, the video position adjustment unit 104 can adjust (change) the display position of the video information W50 from an upper position to a lower position or to the left or right position relative to the circle shown in Figures 5 to 7 when the target model and the video information W50 overlap. In this embodiment, by appropriately adjusting the display position of the video information by the video position adjustment unit 104, the target model of the 3D model and the video information can be displayed side by side on the same screen without compromising convenience. For example, if the 3D model displayed on the user terminal 2 can be changed to various angles in response to user input, the target model and video information can be displayed appropriately according to the changed angle. The adjustment process in the video position adjustment unit 104 can change the display position of the video information to a position that does not overlap with the target model in the viewing direction from the user using the user terminal. 【0089】 As described above, the process display system 1 according to the present invention can easily and appropriately display video information in the 3D model space according to the user's wishes by corresponding positional and time information in each piece of information such as 3D model information, process information, and video information and performing a predetermined display process. As a result, the convenience of inspection and process management at construction sites can be improved. 【0090】 Furthermore, although this embodiment describes a predetermined display process at a construction site (display of video information in a 3D model space), the same effects as the present invention can be obtained when the process display system 1 is used at locations other than construction sites. [Explanation of Symbols] 【0091】 1. Process Display System 2 User terminals 3. Imaging device 4 Elevators 10 Information Processing Devices 11 Control Unit 12 Storage section 13 Communications Department 90 terminals (user terminal 2) 91 Control Unit 92 Memory section 93 Communications Department 94 Input section 95 Output section 101 Reception Department 102 Acquisition Department 103 Display Processing Unit 104 Video position adjustment unit NW Network W10 3D Model W20 process chart W30 process W40 Time axis bar W50 Video Information

Claims

[Claim 1] A process display system that displays the history of the process at a construction site, The process display system comprises a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting position and time. The display processing unit, based on the input of time information corresponding to the process received from the user terminal, the video information, and the process information, processes the video information related to the process corresponding to the time information to be displayed in the space of the 3D model in correspondence with the shooting position, and transmits the result of the display processing. Process display system. [Claim 2] The display processing unit, when there are multiple steps corresponding to the input of time information, displays the multiple steps and transmits the result of the display processing to the user terminal. The system displays video information corresponding to the process selected by input from the user terminal. The process display system according to claim 1. [Claim 3] The display processing unit, when there are multiple steps corresponding to the input of time information, displays multiple video information corresponding to the multiple steps. The process display system according to claim 1. [Claim 4] The aforementioned shooting position has temporal position information in which the shooting position changes over time. The display processing unit displays the video information within the space of the 3D model based on the temporal position information. The process display system according to claim 1. [Claim 5] The display processing unit displays the multiple video information in the space of the 3D model based on the temporal positional information of each video information corresponding to the multiple processes. The process display system according to claim 4. [Claim 6] The display processing unit processes and displays each of the video information corresponding to the multiple steps in an identifiable manner. The process display system according to claim 3 or claim 5. [Claim 7] The process display system further includes a video position adjustment unit, The aforementioned video information has a shooting direction indicating the direction in which the video was taken at the construction site. The video position adjustment unit determines the overlap between the target model being filmed and the video information within the 3D model's space based on the filming direction, filming position, and process information. If the aforementioned model to be filmed and the aforementioned video information overlap, the display position of the video information is adjusted. The process display system according to claim 1. [Claim 8] The adjustment process involves changing the display position of the video information to a position that does not overlap with the model being filmed in the viewing direction from the user's perspective using the user terminal. The process display system according to claim 7. [Claim 9] A process display method executed by a process display system that displays the history of processes at a construction site, The process display system comprises a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting position and time. The display processing unit includes the steps of: inputting time information corresponding to a process received from a user terminal, the video information, and the process information, and then displaying the video information relating to the process corresponding to the time information in the space of a 3D model in correspondence with the shooting position, and transmitting the result of the display processing. Process display method. [Claim 10] A process display program that displays the history of the process at a construction site, The computer is configured to function as a storage unit, an acquisition unit, and a display processing unit. The memory unit stores 3D model information and process information associated with the 3D model information. The acquisition unit acquires video information captured at a predetermined shooting position and time. The display processing unit, based on the input of time information corresponding to the process received from the user terminal, the video information, and the process information, processes the video information relating to the process corresponding to the time information to be displayed in the space of the 3D model in correspondence with the shooting position, and transmits the result of the display processing. Process display program.

Images