On-site video management system

The on-site video management system efficiently monitors construction sites by generating time-lapse videos from still images, facilitating quick confirmation and detailed verification through high-speed preview and video playback, overcoming communication and power limitations.

JP2024169826APending Publication Date: 2024-12-06PICTOGRAM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023086596
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Conventional on-site video management systems require large-capacity communication environments, which are often unavailable at construction sites, and viewing still images is inefficient for checking the site situation.

Method used

An on-site video management system that includes a camera capturing still images, a management server generating time-lapse videos from these images, and a terminal for high-speed preview display and video playback, allowing efficient site monitoring via a network.

Benefits of technology

Enables efficient site monitoring by allowing quick confirmation through high-speed preview display and detailed verification over time using time-lapse videos, reducing communication and power requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169826000001_ABST
    Figure 2024169826000001_ABST
Patent Text Reader

Abstract

To provide an on-site image management system capable of efficiently checking the situation of the spot even when the spot is photographed as a still image.SOLUTION: An on-site video management system 1 includes a camera 30, a management server 10 that is connected to the camera 30 and includes a still image storage unit 153 for sequentially storing on-site still images received from the camera 30, a video creation unit 12 for creating an on-site video from the on-site still images, and a video storage unit 154 for storing the on-site video, and a terminal 20 that has a display 27, and includes an image storage unit 252 for storing the on-site still images and the on-site video downloaded from the management server 10, a preview display unit 231 for performing a preview display that sequentially switches and displays a plurality of on-site still images stored in the image storage unit 252 on the display 27 at high speed, and a video display unit 232 for reproducing and displaying the on-site video on the display 27.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a site image management system. [Background technology]

[0002] Conventionally, systems have been provided that use cameras installed at on-site, such as a construction site, to capture images of the site and enable the situation at the site to be confirmed from a remote location through video. For example, such systems are disclosed in Patent Documents 1 and 2 listed below. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-267149 A [Patent Document 2] JP 2000-282684 A Summary of the Invention [Problem to be solved by the invention]

[0004] Many conventional on-site video management systems are configured to capture on-site video or still images, store them in a management server, and allow users to view the videos stored in the management server from their terminals.

[0005] However, when shooting video of a construction site, large volumes of video data must be sent and received between the camera and the management server, so a high-capacity communications environment is also required at the site. However, construction sites often do not have a communications environment such as wired or wireless LAN in the first place, and using a mobile phone network results in high communications charges.

[0006] Furthermore, while the amount of communication traffic can be reduced by taking still images of the site, in order to check the situation at the site using still images, it is necessary to view a large number of still images, which is inefficient.

[0007] The present invention has been made in consideration of such problems, and aims to provide a site video management system that allows efficient confirmation of the site situation even when capturing still images of the site. [Means for solving the problem]

[0008] In order to solve the above problems, the on-site video management system of the present invention is characterized in that it comprises a camera that captures on-site still images, a management server connected to the camera via a network, the management server having a still image memory unit that sequentially stores on-site still images received from the camera, a video generation unit that generates on-site videos from a plurality of the on-site still images stored in the still image memory unit, and a video memory unit that stores the on-site videos, and a terminal with a display connected to the management server via the network, the terminal having an image memory unit that stores the on-site still images and the on-site videos downloaded from the management server, a preview display unit that performs a preview display that sequentially switches between and displays the multiple on-site still images stored in the image memory unit at high speed on the display, and a video display unit that plays and displays the on-site video stored in the image memory unit on the display. Effect of the Invention

[0009] According to the present invention, even when the site is photographed as a still image, the site situation can be checked efficiently by displaying a preview that allows for simple confirmation in a short time and a video of the site that allows for detailed confirmation over a long period of time. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram illustrating the configuration of a site video management system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram illustrating a configuration of a management server according to an embodiment of the present invention. [Diagram 3]FIG. 3 is a schematic diagram illustrating a configuration of a terminal according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart showing a process flow of on-site video management by a user according to an embodiment of the present invention. [Diagram 5] FIG. 5 is a diagram showing a thumbnail display screen displayed on a terminal according to an embodiment of the present invention. [Figure 6] FIG. 6 is a diagram showing a digest preview display screen displayed on a terminal according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a site video management system according to an embodiment of the present invention will be described in detail with reference to the drawings. In this embodiment, a system will be described that allows a user in a remote location to manage and check site videos (still images) taken by a camera 30 installed at a construction site where a detached house is to be built, using a terminal such as a smartphone or a personal computer.

[0012] 1, the site video management system 1 comprises a management server 10, a terminal 20 used by a user who wants to manage and check site video, and a camera 30 installed at the construction site. The management server 10, the terminal 20, and the camera 30 are connected via a network 5 such as the Internet, and are capable of communicating with each other.

[0013] As shown in FIG. 2, the management server 10 includes a calculation device 11 such as a CPU (Central Processing Unit) for performing various calculations, and a storage device 15 such as an HDD (Hard Disc Drive) for storing various information and a RAM (Random Access Memory) used as a work area for calculation processing.

[0014] The computing device 11 functionally includes a video generation unit 12 that creates a video from a still image. The storage device 15 includes a program storage unit 151 that stores various programs, a still image storage unit 153 that stores still images of the site sequentially received from the camera 30, and a video storage unit 154 that stores the video generated by the video generation unit 12.

[0015] In this embodiment, the camera 30 is fixedly installed at the construction site and is configured to take still images every minute, transmit them to the management server 10, and store the site still images in the still image memory unit 153.

[0016] When the video generator 12 receives an instruction to generate a video together with the extracted period from the terminal 20, the video generator 12 generates a site video from still images of the site captured during the extracted period. Here, the extracted period is a specific period in the past during which the user wants to check the site situation, and is a period input by the user to the terminal 20 via the input device 28 described later.

[0017] The video generator 12 generates on-site videos (10 fps) in which still images captured within the extraction period are switched in chronological order at high speed every 0.1 seconds, that is, so-called time-lapse videos, and stores the videos in the video storage unit 154. Therefore, the length of the on-site video (time-lapse) is determined by the number of still images within the extraction period, with each still image lasting 0.1 seconds, so that if there are 1,000 still images on which the video is generated, for example, a 100-second (1 minute 40 seconds) video is generated.

[0018] Since the still image capturing cycle of the camera 30 is one minute, a video consisting of 1,000 still images is a video capturing the on-site situation for 16 hours and 40 minutes. Therefore, if this on-site video is played back at normal speed, the user can check the on-site situation for 16 hours and 40 minutes by watching 100 seconds of video.

[0019] If the on-site video is too long, the file size will become large and it will be inconvenient for the user to handle, so in this embodiment, the video generator 12 is set so that the length of the on-site video to be generated is 10 minutes or less. Of course, the user can change the upper limit of the video time as appropriate, and can set the upper limit to a desired length, such as 5 minutes or 3 minutes.

[0020] If the number of on-site still images included in the extraction period exceeds 6,000, the length of the on-site video will exceed 10 minutes. In this way, when the length of the video exceeds the video upper limit time, the video generator 12 thins out on-site still images from the chronologically ordered on-site still images included in the extraction period at a predetermined cycle, thereby reducing the number of on-site still images that form the basis of the video to 6,000, and then generates the on-site video. This makes it possible to reduce the length of the generated on-site video to the video upper limit time of 10 minutes.

[0021] Of course, the frame rate of the on-site video generated by the video generation unit 12 can be changed as appropriate, and the on-site still images may be advanced frame by frame at a higher speed, or at a lower speed.

[0022] However, if the frame rate exceeds 15 fps, the video data volume will increase and the still images at the site will switch too quickly, making it difficult for the user to accurately confirm the situation at the site, so it is desirable for the frame rate of the on-site video to be 15 fps or less. Also, if the frame rate is slow, the still images at the site will switch more slowly, and it will take a long time for the user to confirm the situation at the site, so it is desirable for the frame rate of the on-site video to be 1 fps or more.

[0023] As shown in FIG. 3, the terminal 20 includes a calculation unit 21 that performs various calculations, a storage unit 25 that stores various information, a display 27, and an input device 28 through which the user inputs information.

[0024] The computing device 21 functionally comprises a thumbnail display unit 22 that displays on-site still images as thumbnails on the display 27, and a digest display unit 23 that displays an overview of the on-site situation on the display 27. The digest display unit 23 comprises a preview display unit 231 that switches between on-site still images at high speed and displays them frame by frame as a digest, and a video display unit 232 that plays and displays the on-site video generated by the management server 10.

[0025] The preview display unit 231 downloads on-site still images captured within the extraction period from the still image storage unit 153 of the management server 10, and sequentially switches and displays them at high speed on the display 27. In this embodiment, the switching cycle of the still images is 0.1 seconds, that is, the frame rate of the preview display is 10 fps.

[0026] The preview display time by the preview display unit 231 is set to an upper limit of 30 seconds, and if displaying all on-site still images taken within the extraction period in frame advance exceeds 30 seconds, i.e., if the number of on-site still images within the extraction period exceeds 300, the preview display unit 231 thins out the still images at a predetermined interval to display the preview for 30 seconds (300 images).

[0027] If the number of on-site still images within the extraction period specified by the user is 300 or less, the preview display unit 231 downloads all the target on-site still images from the management server 10 and displays a preview by high-speed switching display, and if the number of on-site still images within the extraction period exceeds 300, the preview display unit 231 downloads only the thinned-out 300 still images and displays a preview.

[0028] Of course, even if the number of on-site still images within the extraction period exceeds 300, all target on-site still images may be downloaded from the management server 10 to the terminal 20, and the preview display unit 231 may perform a thinning process to display a preview of 300 still images.

[0029] In addition, the upper limit of the preview display time can be changed as appropriate, and the frame rate during preview display can also be changed as appropriate. For the same reasons as for the frame rate of the on-site video described above, the frame rate during preview display is preferably 1 fps or more and 15 fps or less.

[0030] In this embodiment, the frame rate of the on-site video generated by the video generation unit 12 and the frame rate of the preview display unit 231 are both 10 fps, but by differentiating the frame rates of the two, it is also possible to change the speed at which the on-site situation is confirmed between the on-site video and the preview display.

[0031] The video display unit 232 instructs the management server 10 to generate on-site videos for a specified extraction period, and downloads the on-site videos generated in the management server 10 and stored in the video storage unit 154, and plays and displays them on the display 27.

[0032] The storage device 25 includes a program storage unit 251 for storing various programs, and an image storage unit 252 for storing still images and videos downloaded from the terminal 20. The display 27 is a touch panel, and in this embodiment, the display 27 also serves as the input device 28.

[0033] The camera 30 includes a mobile communication unit 31 and a battery 32. By including the mobile communication unit 31, the camera 30 can access the network 5 via a mobile phone network and communicate with the management server 10 even in a place where there is no wired LAN or wireless LAN.

[0034] Furthermore, by providing the battery 32, the camera 30 can capture images and communicate even in locations where there is no AC power source. In particular, in this embodiment, still images are captured, so power consumption during capture and communication is small compared to when video is handled, and the camera 30 can be operated for a long time even when battery-powered.

[0035] The configuration of the on-site video management system 1 has been explained above. The functions of the management server 10 described above are realized by the calculation device 11 executing various programs stored in the program storage unit 151, and the functions of the terminal 20 described above are realized by the calculation device 21 executing various programs stored in the program storage unit 251.

[0036] Next, the process flow when a user checks on-site video in the on-site video management system 1 will be described with reference to Fig. 4. On-site video can be managed and viewed by accessing a on-site video management website provided by the management server 10 from the terminal 20, or by starting a on-site video management application on the terminal 20 and accessing the management server 10. Here, the case of accessing the on-site video management website will be described.

[0037] In S10, a user who wishes to check on-site video operates terminal 20 to access the on-site video management website. After accessing the site, the user first specifies, from terminal 20, the period during which the user wishes to check on-site video, i.e., the extraction period, in the thumbnail display of on-site still images (S11).

[0038] The extraction period input to the terminal 20 is transmitted from the terminal 20 to the management server 10 in S12. The management server 10 that has received the extraction period extracts from the still image storage unit 153 on-site still images for displaying predetermined thumbnails that were taken during the extraction period (S13), and transmits the extracted still images to the terminal 20 in S14.

[0039] In the terminal 20 that has received the on-site still images extracted in S14, the thumbnail display unit 22 displays the received still images as thumbnails on the display 27 (S15), as shown in Fig. 5. As the "Day by Day", "Hour by Hour" and "Minute by Minute" buttons are displayed on the thumbnail display screen in Fig. 5, in this embodiment, it is possible to group the on-site still images within the extraction period into groups for each day, each hour and each minute, and display them as thumbnails.

[0040] When selecting "by day," one still image per day is displayed as a thumbnail, when selecting "by hour," one still image per hour, and when selecting "by minute," all still images are displayed as thumbnails. When selecting "by day" or "by hour," the middle still image in the group is displayed in chronological order as a representative. In Figure 5, the "by day" button is selected, and the on-site still images are grouped by day, with one still image per day displayed as a representative.

[0041] In addition, in the extraction and transmission of on-site still images in S13 and S14, only still images for a specified thumbnail display within the extraction period for which thumbnails are displayed in S15 are extracted and transmitted. Therefore, when the extraction period in S12 is transmitted, the above-mentioned grouping information is also transmitted together, and in the case of "daily unit", only one still image per day, in the case of "hourly unit", only one still image per hour, and in the case of minutely unit, all still images are extracted and transmitted.

[0042] In the thumbnail display of S15, the extraction period and grouping method of the still images to be displayed as thumbnails can be changed as appropriate, and if changed, S11 to S15 are repeated under the new conditions, and the thumbnail display screen is updated.

[0043] In addition, the thumbnail display screen displays buttons for "Bulk download" and "Create digest." If the user selects the "Bulk download" button, all still images within the extraction period can be downloaded from the management server 10 in one go.

[0044] The user can instruct a preview display by selecting the "Create Digest" button (S20). When a preview display is instructed, in S21, a request is made from the terminal 20 to the management server 10 to download still images for a specified preview display within the extraction period.

[0045] In S22, the management server 10 extracts on-site still images for preview display within the extraction period from the still image storage unit 153, and transmits the extracted still images to the terminal 20 (S23). As described above, the upper limit of the number of still images to be previewed is 300, so if the number of on-site still images within the extraction period exceeds 300, in S22, only the thinned 300 still images are extracted.

[0046] In terminal 20 that has received the still images for preview display, in S24, a digest preview is displayed by preview display unit 231 (see FIG. 6). Specifically, preview display unit 231 switches the received still images for preview display on display 27 in chronological order every 0.1 seconds, and displays them frame by frame.

[0047] 6, a "Create" button is displayed on the preview display screen, and if the user selects the "Create" button, the user can instruct the creation of a digest movie (S30). The preview display screen also displays the maximum movie time, which in this embodiment is set to "10 minutes 0 seconds" by default, but can be changed to any desired maximum time of 10 minutes or less.

[0048] When an instruction to generate a video is given in S30, the instruction to generate a video including an upper limit video time together with information on the extraction period is transmitted from terminal 20 to management server 10 (S31). In management server 10 that has received the instruction to generate a video, video generator 12 generates an on-site video from on-site still images within the extraction period (S32) and stores the video in video storage unit 154. The stored on-site video is transmitted from management server 10 to terminal 20 in S33.

[0049] In S34, in the terminal 20, the digest on-site video received by the video display unit 232 is played back and displayed on the display 27. This allows the user who owns the terminal 20 to check the digest of the on-site video as a video on the display 27 at hand.

[0050] The user can access the video storage unit 154 at any time and can check the desired past on-site video at the desired time by selecting the desired video from a list of digest videos generated in the past. In the above embodiment, the video is generated after the preview is displayed, but the video may be generated and downloaded directly after the thumbnail is displayed.

[0051] This embodiment has been described in detail above. According to this embodiment, by installing a camera 30 at a construction site, it is possible to check the progress of the site from a remote location without visiting the site.

[0052] At construction sites, work is divided into small tasks, and many contractors need to check the progress and enter the site at a time that suits their own work. Therefore, if each contractor could easily check the progress of work on site from a remote location, work efficiency could be greatly improved.

[0053] In addition, in this embodiment, a digest of the on-site situation can be checked using a preview display that can be easily checked in a short amount of time, and a video display of the on-site situation that can be checked in detail over a long period of time. By using either of these displays depending on the situation, the on-site situation can be checked efficiently.

[0054] In addition, both the preview display and on-site video display are time-lapse videos in which still images of the site taken every minute by the camera 30 installed at the site are displayed frame by frame at 10 fps, allowing a digest of the on-site situation to be confirmed, so the situation can be confirmed in a significantly shorter time than with videos.

[0055] Furthermore, according to this embodiment, the generation of moving images from still images, which is a high-load task, is performed by the management server 10, so that even a terminal 20 with low performance can view the on-site moving images generated from the on-site still images.

[0056] Also, while a digest preview display can only be played on a dedicated website or app, which limits the playback environment, a video can be downloaded and played on a general-purpose video playback app, making it easy to use. For example, you can send a video of the site to the client as a memento.

[0057] Furthermore, in this embodiment, the camera 30 is equipped with a mobile communication unit 31, and the images captured on-site are still images with small storage capacity, so that even at a construction site where a communication environment such as a LAN is not in place, the camera 30 can be installed and on-site footage can be transmitted.

[0058] In addition, the images captured at the site are not moving images but still images that require a small storage capacity, and the still images stored in the still image storage unit 153 are also stored at one-minute intervals, so the power consumption during capture and transmission is small. Therefore, the camera 30 can be practically driven by the battery 32, and on-site video management can be realized even at sites where no AC power source is installed.

[0059] Here, the camera's shooting interval can be changed as needed, and may be every 30 seconds or every 5 minutes. If the shooting interval is made longer, the number of shots taken per hour will be reduced, and the amount of communication data can be reduced, but the interval at which the site conditions can be confirmed will be longer. On the other hand, if the shooting interval is made shorter, the interval at which the site conditions can be confirmed will be shorter, but the number of shots taken per hour will increase, and the communication data volume will also increase.

[0060] The frequency at which on-site conditions are checked varies depending on the site and the user. For example, if the camera's shooting interval is long, such as 30 minutes, the interval at which on-site conditions can be checked will also be every 30 minutes, which may make it impossible to check people entering or leaving the site during the 30 minutes between taking still images.

[0061] On the other hand, if the camera's shooting interval is as short as 1 second, the frequency and data volume of communication between the camera and the management server will increase, which will increase the load on the communication environment and power consumption. Therefore, it is desirable for the shooting interval of the on-site still images of the camera 15 to be between 10 seconds and 20 minutes.

[0062] As described above, the present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the present invention. For example, the functions of the management server may be distributed among multiple management servers, including an external management server.

[0063] In addition, the extraction period may be specified by specifying the day of the week, etc. In addition, since construction workers enter and leave the construction site during the daytime, if there is no need to check the situation at night, the extraction period may be specified so as to be limited to the time period from sunrise to sunset. [Explanation of symbols]

[0064] 1 On-site video management system 5. Network 10 Management Server 11 Arithmetic unit 12 Video Generation Unit 15 Storage device 151 Program Storage Unit 153 Still image storage section 154 Video storage section 20 Terminals 21 Arithmetic unit 22 Thumbnail display area 23 Digest display section 231 Preview display area 232 Video display section 25 Storage device 251 Program Storage Unit 252 Image storage unit 27 Display 28 Input Devices 30 Camera 31 Mobile Communications Department 32 Battery

Claims

1. In the on-site video management system that manages on-site video, A camera for taking still images of the scene; A management server connected to the camera via a network, a still image storage unit that sequentially stores still images of the scene received from the camera; a video generation unit that generates a site video from the plurality of site still images stored in the still image storage unit; A video storage unit that stores the on-site video; a management server having a terminal having a display, connected to the management server via the network, an image storage unit that stores the on-site still images and the on-site video images downloaded from the management server; a preview display unit that performs a preview display by sequentially switching the plurality of on-site still images stored in the image storage unit at high speed on the display; a video display unit that reproduces and displays the on-site video stored in the image storage unit on the display; A terminal having A site image management system comprising:

2. The terminal includes an input unit for inputting an extraction period, which is a period during which a user wants to check the site situation, The on-site video management system of claim 1, characterized in that the video generation unit generates the on-site video by quickly switching between the on-site still images taken during the extraction period received from the terminal in chronological order, and if the length of the on-site video exceeds a predetermined video upper limit time, adjusts the length of the generated on-site video to fall within the video upper limit time by thinning out the on-site video at predetermined intervals.

3. 2. The on-site video management system according to claim 1, wherein the still image storage unit sequentially stores the on-site still images captured by the camera at intervals of 10 seconds to 20 minutes.

4. 4. The on-site video management system according to claim 1, wherein the video generation unit generates the on-site video at a frame rate of 1 fps or more and 15 fps or less.

5. 5. The site image management system according to claim 4, wherein the preview display unit displays the preview at a frame rate of 1 fps or more and 15 fps or less.

Citation Information

Patent Citations

  • Progress control system for construction site

    JP2000282684A

  • Remote monitoring system of construction site

    JP2007267149A