Information processing device, information processing method, information processing program, information processing terminal, and information processing system
The information processing system addresses the challenge of uneven work sites by prioritizing camera image display based on project progress and user preferences, facilitating efficient site management through improved navigation and image association.
Patent Information
- Application Number
- JP2023084379
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional patrol robots struggle to effectively navigate uneven work sites due to steps and materials, making it impractical for them to roam and conduct thorough site checks.
An information processing system that receives and prioritizes images from multiple cameras at work sites, determining the order of display based on project progress and user preferences, and associates camera positions with site drawings to facilitate efficient site management.
Enables effective site checking by prioritizing image display based on work processes, reducing the effort required to locate specific camera images and ensuring consistent focus on critical areas, thereby enhancing site management efficiency.
Smart Images

Figure 2024168006000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, an information processing method, an information processing program, an information processing terminal, and an information processing system. [Background technology]
[0002] At work sites, various checks must be made daily, such as whether construction and other work is proceeding as planned, whether there are any mistakes such as mix-ups in the materials being used, and whether construction and other work is being carried out properly. This means that the person in charge must travel to many work sites to check, which places a heavy burden on the work, including travel and schedule management.
[0003] For this reason, a site management support system has been proposed as conventional technology in which a patrol robot capable of moving autonomously around a work site patrols the work site, detects objects to be checked that are included in images it takes, determines the progress status of each management item in the work process that is associated with these objects to be checked, and displays the progress status on a display unit. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2022-030717 Summary of the Invention [Problem to be solved by the invention]
[0005] However, work sites are not flat due to steps, materials, etc., so it is not practical to have a patrol robot roaming around.
[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an information processing device, an information processing method, an information processing program, an information processing terminal, and an information processing system that can effectively check the site. [Means for solving the problem]
[0007] In order to solve the above problems, the information processing device of the present invention includes a receiving unit that receives video or images transmitted from multiple cameras that capture one or more work sites, and a priority determination unit that determines the priority of displaying the video or images based on a predetermined priority order. Effect of the Invention
[0008] According to the present invention, it is possible to provide an information processing device, an information processing method, an information processing program, an information processing terminal, and an information processing system that are capable of effectively checking the site. [Brief description of the drawings]
[0009] [Figure 1] 1 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of a server according to an embodiment. [Diagram 3] FIG. 4 is a diagram illustrating an example of data stored in a storage device of a server according to the embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of functions of a server according to an embodiment. [Diagram 5] FIG. 2 is a block diagram showing an example of the configuration of a user terminal according to an embodiment and an example of its functions. [Figure 6] FIG. 11 is a diagram illustrating an example of a screen displayed on a user terminal according to the embodiment. [Figure 7] FIG. 11 is a diagram illustrating an example of a screen displayed on a user terminal according to the embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of a screen displayed on a user terminal according to the embodiment. [Figure 9] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 10] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] [Embodiment] 1 is a schematic configuration diagram of an information processing system 1 according to an embodiment. The information processing system 1 includes a server 2 (information processing device), and one or more user terminals 3 (information processing terminals) and imaging devices 5 (hereinafter also referred to as cameras 5) connected to the server 2 via a network 4. Note that the number of servers 2, user terminals 3, and cameras 5 included in the information processing system 1 is arbitrary.
[0011] (Camera 5) For example, one or more cameras 5 are placed at positions capable of capturing an image of the work site, and transmit video or images (hereinafter also referred to as video or the like). Note that the cameras 5 do not necessarily have to be placed within the premises of the work site, as long as they are capable of capturing an image of the work site. The number of cameras 5 placed at one work site is arbitrary. The cameras 5 are capable of panning, tilting and zooming, and in this embodiment, the camera 5 is configured to be capable of being specified from the user terminal 3 to perform panning, tilting and zooming. The camera 5 also has a function of measuring and outputting its current position using GNSS (Satellite positioning, navigation and timing system).
[0012] (Server 2) Fig. 2 is a configuration diagram of the server 2. Fig. 2 shows the main hardware configuration of the server 2, in which the server 2 has a configuration in which a communication IF 200A, a storage device 200B, and a CPU 200C are connected via a bus. Although not shown in Fig. 2, the server 2 may also include an input device (e.g., a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.).
[0013] The communication IF 200A is an interface for communicating with other devices (for example, the user terminal 3 and the camera 5).
[0014] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). Various types of information and information processing programs are stored in the storage device 200B. As various types of information, for example, data such as that shown in FIG. 3 is stored in the storage device 200B.
[0015] 3(a) shows data in which the ID of camera 5 (name of camera 5), the image capturing location, location information (current location of camera 5 acquired by acquisition unit 207 described below), the ID of a user (user ID) who can view the video or images captured by camera 5 and operate camera 5, and the ID of a case (case ID) described below are associated with each other. Note that the data associated with the ID of camera 5 is not limited to the data shown in FIG. 3(a), and other data may also be associated with the ID of camera 5.
[0016] Fig. 3(b) shows data in which a user ID is associated with a user name (e.g., a company name or an individual name), an address, a contact address (e.g., a main phone number, an email address, etc.), and an authentication password (PW). Note that the data associated with a user ID is not limited to the data shown in Fig. 3(b), and other data may also be associated with the user ID.
[0017] Fig. 3(c) shows data associating a case ID, a case name (case name at the work site), a case address (address of the work site), a user ID, a person in charge, an ID of one or more work processes included in the case (work process ID), and data of a drawing used in the case (drawing data). Note that the data associated with the case ID is not limited to the data shown in Fig. 3(c), and other data may also be associated with the case ID. Furthermore, the file format of the drawing data is not particularly limited and may be any.
[0018] Fig. 3(d) shows data associating a work process ID with work instructions (e.g., "check foundation," "check dimensions," "install kitchen," etc.), work content (details of work instructions and actual work content), name of person in charge of work, and work status (e.g., "completed," "not yet," "in progress," etc.). Note that data associated with work process IDs is not limited to the data shown in Fig. 3(d), and other data may also be associated with work process IDs.
[0019] Some or all of the various information stored in the storage device 200B may be stored in an external storage device such as a Universal Serial Bus (USB) memory or an external HDD, or in a storage device of another information processing device connected via the network 4. In this case, the server 2 refers to or acquires the various information stored in the external storage device or the storage device of the other information processing device.
[0020] The CPU 200C controls the server 2, and includes a ROM and a RAM (not shown).
[0021] (Server 2 function) Fig. 4 is a functional block diagram of server 2. As shown in Fig. 4, server 2 includes functions such as receiving unit 201, transmitting unit 202, storage device control unit 203, priority order determination unit 204, association unit 205 (first association unit, second association unit), extracting unit 206, acquiring unit 207, and estimating unit 208. The functions shown in Fig. 4 are realized by CPU 200C executing an information processing program stored in storage device 200B. The above functions of server 2 may be distributed among multiple servers.
[0022] The receiving unit 201 receives information transmitted from the camera 5 and the user terminal 3 via the network 4 .
[0023] The transmitting unit 202 transmits information to the user terminal 3 via the network 4 .
[0024] The storage device control unit 203 controls the storage device 200B. For example, the storage device control unit 203 writes and reads information to and from the storage device 200B.
[0025] The priority determination unit 204 determines a priority for displaying images, etc., based on a predetermined priority, for example, a work process at a work site. Here, the priority is a priority when displaying images, etc., from the camera 5 on the user terminal 3. The priority determination unit 204 determines a priority for displaying images, etc., based on, for example, the progress (status) of the work instructions of the case associated with the camera 5 (for example, prioritizes images with a status of "not yet". Also, if a deadline is set, prioritizes images with a deadline approaching, etc.). Note that since it is possible that the work processes to be focused on differ for each user, the user may specify the work process for which the user wants to display images, etc. with priority. In this case, the priority determination unit 204 determines a priority for displaying images, etc., based on the work process specified by the user.
[0026] The correspondence unit 205 (first correspondence unit) corresponds images etc. to information about the work site (e.g., work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.) based on information that corresponds the case ID (work site) and the camera ID of camera 5 described in Figure 3 (a). As shown in Figures 3 (a) and 3 (c), the correspondence unit 205 corresponds the work site information associated with the case ID (e.g., work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.) with images etc. by corresponding the camera ID of camera 5 with the case ID. Furthermore, the association unit 205 (second association unit) associates the installation position of the camera 5 with the drawing data of the work site based on information on the image capturing location of the camera 5 at the work site. The association unit 205 recognizes characters written in the drawing data of the case ID associated with the camera 5, for example, by OCR (Optical Character Recognition) or the like (recognition may be performed by a method other than OCR). Next, the association unit 205 associates the installation position of the camera 5 with the drawing data having the closest similarity to the character string of the image capturing location associated with the camera 5 among the recognized character strings, and stores the same in the storage device control unit 203. Note that a known method may be used to calculate the similarity of the character strings. Also, a learning model that has learned the names of the parts of the architectural drawings and the like may be used. Also, the character recognition and the learning model may be used in combination. Note that it is preferable to configure the associated installation position of the camera 5 so that the user can correct it.
[0027] The extraction unit 206 extracts a predetermined portion from the video etc. transmitted from the camera 5 based on the work process at the work site. For example, the work process and the confirmation items required for the work process (for example, dimension confirmation of a predetermined place, building materials, etc.) may be associated and stored in the storage device 200B, and the extraction unit 206 may extract the portion required for the confirmation item associated with the work process from the video etc. It is preferable to enlarge or highlight the extracted portion (for example, surround it with a red line, etc.). It is preferable that the extraction unit 206 extracts the portion required for the confirmation item from the video etc. using a first learning model. The first learning model is, for example, a first learning model that has learned the portion required for the confirmation item from teacher data. Here, the teacher data is information that includes the video etc. and the portion of the video etc. that is required for the confirmation item. It is preferable that the first learning model is prepared for each work process, in other words, for each confirmation item. The extraction unit 206 may, for example, select a first learning model corresponding to the work process, input the video etc. transmitted from the camera 5 to this selected first learning model, and extract the parts necessary for the confirmation items from the video etc. The extraction unit 206 may also extract a predetermined portion from the video etc. based on a predetermined motion of a worker working at a work site. In this case, for example, a second learning model that learns the motion of the worker and the work process is prepared, and the extraction unit 206 inputs the video etc. transmitted from the camera 5 to this second learning model and recognizes the work process corresponding to the predetermined motion of the worker. Next, the extraction unit 206 may select a first learning model corresponding to the recognized work process, input the video etc. transmitted from the camera 5 to this selected first learning model, and extract a portion necessary for the confirmation item from the video etc.
[0028] The acquisition unit 207 acquires information (position information) of the current position measured by the camera 5. The position information of the camera 5 acquired by the acquisition unit 207 is stored in the storage device 200B by the storage device control unit 203. Note that instead of the acquisition unit 207 acquiring the position information of the camera 5, the position information of the camera 5 input by the user may be stored in association with the camera 5 as shown in FIG. 3(a).
[0029] The estimation unit 208 estimates at which work site each camera 5 is installed, based on the position information of the camera 5 stored in the storage device 200B and the position information of the work site. For example, the estimation unit 208 estimates that the work site having the position information closest to the position information of a certain camera 5 is the work site where the camera 5 is installed. Note that, if the position of the closest work site and the camera 5 are separated by a predetermined distance (for example, 10 m) or more, the estimation unit 208 may determine that there is no work site where the camera 5 is installed.
[0030] (User terminal 3) Fig. 5 is a configuration diagram of the user terminal 3. Fig. 5(a) shows the main hardware configuration of the user terminal 3, and the user terminal 3 has a configuration in which a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, and a CPU 300E are connected via a bus.
[0031] The communication IF 300A is an interface for communicating with other devices (eg, the server 2).
[0032] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 300B stores a terminal identifier, an information processing program, and the like. The terminal identifier is an identifier for identifying the user terminal 3. By assigning the terminal identifier to information transmitted from the user terminal 3, the server 2 can determine which user terminal 3 transmitted the received information. Note that the terminal identifier may be an Internet Protocol (IP) address, a Media Access Control (MAC) address, or the like, or may be assigned to the user terminal 3 by the server 2.
[0033] The input device 300C is, for example, an input device such as a keyboard or a touch panel. However, as long as it is capable of inputting, it may be a device or equipment other than a keyboard or a touch panel. It may also be a voice input device.
[0034] The display device 300D is, for example, a liquid crystal display, a plasma display, an organic EL display, or the like, but may be any other device or equipment (for example, a CRT: Cathode Ray Tube) as long as it is capable of displaying.
[0035] The CPU 300E controls the user terminal 3, and includes a ROM and a RAM (not shown).
[0036] Fig. 5(b) is a functional block diagram of the user terminal 3. As shown in Fig. 5(b), the user terminal 3 has functions such as a receiving unit 301, a transmitting unit 302, a storage device control unit 303, an input accepting unit 304, and a display device control unit 305 (display control unit). Note that the functions shown in Fig. 5(b) are realized by the CPU 300E executing an information processing program stored in the storage device 300B.
[0037] The receiving unit 301 receives, for example, information transmitted from the server 2. The receiving unit 301 receives, for example, images of one or more work sites captured by the camera 5 and the priority order of the images. The receiving unit 301 also receives, for example, information associating the images with information about the work site. The receiving unit 301 also receives, for example, information associating the installation position of the camera 5 with drawing data of the work site.
[0038] The transmitting unit 302 transmits, for example, information corresponding to the input operation accepted by the input accepting unit 304 to the server 2.
[0039] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 303 controls the storage device 300B to write and read information.
[0040] The input receiving unit 304 receives an input operation from the input device 300C.
[0041] The display device control unit 305 controls the display device 300D and displays the information received by the receiving unit 301 on the display device 300D. For example, the display device control unit 305 displays the images on the display device 300D based on the priority order (in this embodiment, the higher the priority order is displayed first, but other display methods, for example, the higher the priority order is displayed larger, may be used). In addition, the display device control unit 305 displays the information of the work site associated with the camera 5 that captured the images on the display device 300D (for example, work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.) based on the information that associates the images with the information of the work site. In addition, the display device control unit 305 displays the information indicating the position of the camera 5 on the drawing data, for example, based on the information that associates the installation position of the camera 5 with the drawing data of the work site.
[0042] (display screen) Figures 6 to 8 are examples of screens displayed on the user terminal 3. Below, an example of a screen displayed on the user terminal 3 will be described with reference to Figures 6 to 8. Note that the same components as those described with reference to Figures 1 to 5 are denoted by the same reference numerals, and duplicated description will be omitted.
[0043] FIG. 6 is a diagram showing an example of a screen for linking the camera 5. As shown in FIG. 6, the display device 300D of the user terminal 3 displays the camera ID 1001 of the camera 5 that can be linked. The user can link the camera 5 that the user wants to link from the camera ID displayed on the display device 300D of the user terminal 3. The user can link the camera 5 by operating the input device 300C of the user terminal 3 and sliding the slider 1002 arranged to the left of the camera ID to the right. Also, the user can cancel the linking of the camera 5 by sliding the slider 1002 to the left. When the camera 5 is linked, the user can view the video captured by the camera 5 on the user terminal 3. Also, the user can operate the pan, tilt, and zoom operations of the linked camera 5. Also, the user can display information on the linked case (work site) on the display device 300D when displaying the video of the camera 5 by linking the linked camera 5 with the case ID.
[0044] FIG. 7 is a diagram showing an example of a screen displaying the video of the linked camera 5. As shown in FIG. 7, the video 1011 of the linked camera 5 is displayed on the display device 300D of the user terminal 3 based on the priority order (in the example shown in FIG. 7, the video has the highest priority in the upper left, and the video with the next highest priority is displayed on the right side in order). In addition, under the video 1011 of the camera 5, a description 1012 of the camera 5 (for example, the camera ID (the name of the camera 5), the image capture location, and information on the work site) is displayed. The video of the linked camera 5 can be displayed for each case. By selecting the video displayed on the display device 300D, the selected video can be enlarged and displayed. As described above, the user can operate the input device 300C of the user terminal 3 to operate the pan, tilt, and zoom operations of the camera 5.
[0045] Fig. 8 is a diagram showing an example of a screen in which the installation positions of the cameras 5 are associated with the drawing data. When the user specifies a case and instructs to display the installation positions of the cameras 5, the installation positions of the cameras 5 are displayed in the drawing data as shown in Fig. 8. Also, the camera IDs of the cameras 5 (camera IDs 100001 and 100002 in the example shown in Fig. 8) are displayed.
[0046] (Information Processing) Figures 9 and 10 are flowcharts showing an example of information processing of the information processing system 1. Below, the information processing of the information processing system 1 will be described with reference to Figures 9 and 10. Note that the same components as those described with reference to Figures 1 to 8 are given the same reference numerals and duplicated descriptions will be omitted. Note that in the following description, it is assumed that the user has already logged in to the information processing system 1 with a user ID and PW.
[0047] (Coordination processing) 9 is a flowchart showing an example of the cooperative processing of the information processing system 1. Hereinafter, an example of the cooperative processing of the information processing system 1 will be described with reference to FIG.
[0048] (Step S101) The user operates the input device 300C of the user terminal 3 to instruct the presentation of the camera 5 that can be linked. When the receiving unit 201 of the server 2 receives the instruction to present the camera 5 that can be linked, the transmitting unit 202 of the server 2 transmits information of the camera 5 that can be linked by the user (e.g., camera ID (name of the camera 5), etc.) to the user terminal 3. The transmitting unit 202 transmits information of the camera 5 that the user has management authority as the camera 5 that can be linked to the user terminal 3, such as the camera ID (name of the camera 5), etc. Information that associates the user with the information of the camera 5 that the user has management authority may be stored in the storage device 200B of the server 2, or may be stored in an external storage device or a storage device of another information processing device connected via the network 4. When the receiving unit 301 of the user terminal 3 receives the information of the camera 5 that can be linked from the server 2, the display device control unit 305 causes the display device 300D to display the information of the camera 5 that can be linked.
[0049] (Step S102) The user operates the input device 300C of the user terminal 3 to select and link the camera 5 that is to be linked. Specifically, the user operates the slider 1002 illustrated in FIG.
[0050] (Step S103) The user operates the input device 300C of the user terminal 3 to link (associate) a case with the linked camera 5. Specifically, a case ID is associated with the camera 5 as illustrated in FIG.
[0051] It should be noted that the coordination process of step S102 and the coordination process of step S103 are independent processes, and it is not necessary to perform the coordination process of step S103 immediately after the coordination process of step S102. The coordination process of step S102 may be performed first, and then the coordination process of step S103 may be performed after a period of time (for example, at a later date).
[0052] (Display processing) 10 is a flowchart showing an example of the display processing of the information processing system 1. Hereinafter, an example of the display processing of the information processing system 1 will be described with reference to FIG.
[0053] (Step S201) The user operates the input device 300C of the user terminal 3 to instruct the display of images, etc. from the linked camera 5. When the receiving unit 201 of the server 2 receives the instruction to display images, etc. from the linked camera 5, the priority order determining unit 204 of the server 2 determines the priority order for displaying images, etc. from the camera 5. Note that the method by which the priority order determining unit 204 determines the display priority order has already been explained, so a description thereof will be omitted.
[0054] (Step S202) The matching unit 205 of the server 2 matches the images etc. with information about the work site (e.g., work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.) based on information matching the case ID (work site) and the camera ID of the camera 5 described in Figure 3 (a).
[0055] (Step S203) The transmitting unit 202 of the server 2 transmits the image of the camera 5, the priority order, and the associated work site information to the user terminal 3. When the receiving unit 301 of the user terminal 3 receives the image of the camera 5, the priority order, and the associated work site information transmitted from the server 2, the display device control unit 305 causes the display device 300D to display the image of the camera 5 and the associated work site information based on the priority order. Note that the image of the camera 5 and the associated work site information are displayed on the display device 300D in a manner that allows the user to recognize that they are related to each other (for example, they are displayed as a description 1012 of the camera 5 illustrated in FIG. 7).
[0056] (Other information processing) As described above with reference to FIG. 4, the server 2 also performs the following processes.
[0057] (Matching with drawing data) The association unit 205 of the server 2 recognizes characters written in the drawing data of the case ID associated with the camera 5 by OCR (Optical Character Recognition) or the like, associates the installation position of the camera 5 with the drawing data having the closest similarity to the character string of the image capturing location associated with the camera 5 among the recognized character strings, and stores the association in the storage device control unit 203. Note that a learning model that has learned architectural drawings, etc., as described above, may be used.
[0058] (Extraction processing of images, etc.) The extraction unit 206 of the server 2 refers to the storage device 200B in which the work process recognized from the actions of the worker and the confirmation items required for the work process (for example, checking the dimensions of a specified location) are stored in association with each other, and extracts from the video, etc., the part required for the confirmation items associated with the work process. As described above, the extraction unit 206 may extract from the video, etc., the part required for the confirmation items by utilizing a learning model.
[0059] (Estimation process) The estimation unit 208 of the server 2 estimates at which work site the camera 5 is installed, based on the position information of the camera 5 and the position information of the work site stored in the storage device 200B. The estimation result of the estimation unit 208 is transmitted to the user terminal 3 and displayed on the display device 300D. This is expected to make it easier for the user to associate the camera 5 with the case (work site).
[0060] As described above, the server 2 includes a receiving unit 201 that receives images, etc. transmitted from a plurality of cameras 5 that capture one or more work sites, and a priority order determining unit 204 that determines the priority order of displaying images, etc. based on a predetermined priority order. Therefore, the images, etc. of the cameras 5 can be displayed on the display device 300D of the user terminal 3 based on a predetermined priority order, and the work site can be effectively checked. For example, in the case of a large-scale project or user in which several tens to a hundred cameras 5 are installed, it takes time to find images, etc. of a specific camera 5. In addition, even when images, etc. of all the linked cameras 5 are to be periodically monitored, there is a problem that which images, etc. of a work process should be focused on depends on the person who monitors. However, as in this embodiment, by determining the priority order of displaying images, etc. of the cameras 5, the effort of finding images, etc. of a specific camera 5 can be reduced. In addition, it is possible to prevent the decision of which images, etc. of the camera 5 to focus on and monitor from depending on the person who monitors. For example, images, etc. of the cameras 5 in the middle of execution can be displayed preferentially over images, etc. of the cameras 5 whose status of the project or process is completed, or any work process can be displayed preferentially according to the user's settings, which is highly convenient.
[0061] Furthermore, the priority order determination unit 204 of the server 2 determines a predetermined priority order based on the work process at the work site. Therefore, the video of the camera 5 or the like can be displayed on the display device 300D of the user terminal 3 based on the work process at the work site, and the site can be checked effectively.
[0062] The server 2 also includes an association unit 205 that associates images and the like with information about the work site (e.g., work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.) based on information associating the work site with the camera. Therefore, when images and the like from the camera 5 are displayed on the display device 300D of the user terminal 3, the images can be displayed in association with information about the work site, allowing the site to be checked effectively.
[0063] The server 2 also includes an association unit 205 that associates the installation position of the camera 5 with the drawing data of the work site based on information on the location captured by the camera 5 at the work site. This allows the installation position of the camera 5 to be confirmed on the drawing, which is highly convenient.
[0064] The server 2 also includes an extraction unit 206 that extracts a predetermined portion from the video or the like transmitted from the camera 5 based on the work process at the work site. This makes it easy to recognize the portion to be checked, and is highly convenient.
[0065] Furthermore, the extraction unit 206 of the server 2 extracts a predetermined portion from the video etc. based on a predetermined action of the worker at the work site. This provides excellent convenience since the work process can be recognized based on the predetermined action of the worker and a predetermined portion can be extracted from the video etc. transmitted from the camera 5 based on the recognized work process.
[0066] The information on the work site includes, for example, at least one of the following information: work instructions, work content, person in charge, case name (work site), image capture location, and work process. This information on the work site is displayed on the display device 300D of the user terminal 3 in association with the image of the camera 5, etc. Therefore, the work instructions, work content, and person in charge in association with the image of the camera 5, etc. can be easily understood, which is highly convenient.
[0067] The server 2 also includes an acquisition unit 207 that acquires position information of the multiple cameras 5, and an estimation unit 208 that estimates at which work site each of the multiple cameras 5 is installed based on the position information of the multiple cameras 5 and the position information of the work site. This is expected to facilitate the user to associate the camera 5 with the project (work site), which is highly convenient.
[0068] The user terminal 3 also includes a receiving unit 301 that receives images of one or more work sites captured by the multiple cameras 5 and the priority of the images, and a display device control unit 305 that displays the images on a display device based on the priority. This makes it possible to display the images from the cameras 5 based on a predetermined priority, allowing the site to be checked effectively.
[0069] In addition, the predetermined priority order is determined based on the work process at the work site. Therefore, the images from the camera 5 and the like can be displayed based on the work process at the work site, and the site can be checked effectively.
[0070] Furthermore, the receiving unit 301 of the user terminal 3 receives information on the work site (for example, work instructions, work content, person in charge, case name (work site), image capture location, work process, etc.), and the display device control unit 305 causes the video etc. to be displayed on the display device in association with the information on the work site. This makes it possible to display the video etc. from the camera 5 in association with the information on the work site, allowing the site to be checked effectively.
[0071] The information on the work site includes at least one of information such as work instructions, work content, person in charge, case name (work site), image capture location, work process, etc. Therefore, it is easy to grasp the work instructions, work content, person in charge, case name (work site), image capture location, work process, etc. associated with the image of the camera 5, and it is highly convenient.
[0072] [Other embodiments] In the above embodiment, the server 2 includes the priority determination unit 204, the association unit 205, the extraction unit 206, the acquisition unit 207, and the estimation unit 208, but the user terminal 3 may have at least one or more functions of the priority determination unit 204, the association unit 205, the extraction unit 206, the acquisition unit 207, and the estimation unit 208. In this case, a part or all of the various information stored in the storage device 200B may be stored in the storage device 300B of the user terminal 3, in addition to an external storage device such as a USB (Universal Serial Bus) memory or an external HDD, or in a storage device of another information processing device connected via the network 4. The effect of the user terminal 3 having at least one or more functions of the priority order determination unit 204, the association unit 205, the extraction unit 206, the acquisition unit 207, and the estimation unit 208 is the same as that of the server 2 having these functions.
[0073] Furthermore, the current position of the camera 5 and the position of the case may be displayed on a map on the display device 300D of the user terminal 3 based on the information on the current position (position information) measured by the camera 5 and the address of the case. This is highly convenient because the relationship between the camera position and the case position can be seen on the map. For example, it is easy to confirm which camera 5 is capturing an image of which case (work site).
[0074] In addition, the above embodiment is merely one example of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited by this. In other words, the present invention can be implemented in various forms without departing from the gist or main features of the present invention. For example, the embodiment may be variously added, variously omitted, variously replaced, or variously modified without departing from the gist of the invention. [Explanation of symbols]
[0075] 1: Information processing system 2: Server (information processing device) 3: User terminal (information processing terminal) 4: Network 5: Imaging device (camera) 200A: Communication IF 200B: Storage device 200C: CPU 201: Receiving unit 202: Transmission unit 203: Storage device control unit 204: Priority determination unit 205: Correspondence section 206:Extraction part 207: Acquisition Department 208: Estimation section 300A: Communication IF 300B: Storage device 300C: Input device 300D:Display device 300E: CPU 301: Receiving unit 302: Transmission department 303: Storage device control unit 304: Input reception section 305: Display device control unit
Claims
1. A receiving unit that receives videos or images transmitted from a plurality of cameras that capture one or more work sites; a priority order determination unit that determines a priority order for displaying the video or image based on a predetermined priority order; An information processing device comprising:
2. The priority order determination unit determining the predetermined priority order based on a work process at the work site; 2. The information processing apparatus according to claim 1,
3. a first association unit that associates the video or the image with information of the work site based on information associating the work site with the camera; 2. The information processing apparatus according to claim 1,
4. a second association unit that associates an installation position of the camera with drawing data of the work site based on information on an image capturing location of the camera at the work site; The information processing apparatus according to claim 1 , further comprising:
5. an extraction unit that extracts a predetermined portion from the video or image transmitted from the camera based on a work process at the work site; The information processing apparatus according to claim 1 , further comprising:
6. The extraction unit is Extracting a predetermined portion from the video or the image based on a predetermined action of a worker at the work site; 6. The information processing apparatus according to claim 5,
7. The work site information includes: At least one of the following information is included: work instructions, work content, person in charge, project name, image capture location, and work process.
4. The information processing apparatus according to claim 3.
8. An acquisition unit that acquires position information of the plurality of cameras; an estimation unit that estimates in which work site each of the plurality of cameras is installed based on position information of the plurality of cameras and position information of the work site; The information processing apparatus according to claim 1 , further comprising:
9. A receiving unit receives video or images transmitted from a plurality of cameras capturing images of one or more work sites; a step of a priority order determination unit determining a priority order for displaying the video or the image based on a predetermined priority order; 13. An information processing method comprising:
10. Computer, A receiving unit that receives videos or images transmitted from a plurality of cameras that capture one or more work sites; a priority order determination unit that determines a priority order for displaying the video or image based on a predetermined priority order; An information processing program characterized by causing the program to function as follows.
11. A receiving unit that receives one or more videos or images of a work site captured by a plurality of cameras and a display priority of the videos or images; a display control unit that causes a display device to display the video or the image based on the priority order; An information processing terminal comprising:
12. The predetermined priority order is determined based on a work process at the work site.
12. The information processing terminal according to claim 11.
13. The receiving unit is receiving information about the work site; The display control unit is Displaying the video or image on the display device in association with information on the work site.
12. The information processing terminal according to claim 11.
14. The receiving unit is receiving drawing data of the work site and information on the installation position of the camera; The display control unit is displaying information indicating the position of the camera on the display device in a state where the information is superimposed on the drawing data; 12. The information processing terminal according to claim 11.
15. The work site information includes: At least one of the following information is included: work instructions, work content, person in charge, project name, image capture location, and work process.
14. The information processing terminal according to claim 13.
16. an extraction unit that extracts a predetermined portion from the video or the image based on a work process at the work site; 12. The information processing terminal according to claim 11, further comprising:
17. The extraction unit is Extracting a predetermined portion from the video or the image based on a predetermined action of a worker; 17. The information processing terminal according to claim 16,
18. An acquisition unit that acquires position information of the plurality of cameras; an estimation unit that estimates in which work site each of the plurality of cameras is installed based on position information of the plurality of cameras and position information of the work site; 12. The information processing terminal according to claim 11, further comprising:
19. A receiving unit receives one or more videos or images of a work site captured by a plurality of cameras and a priority order for displaying the videos or images; and a step of causing a display control unit to display the video or the image on a display device based on the priority order.
23. An information processing method comprising:
20. Computer, A receiving unit that receives one or more videos or images of a work site captured by a plurality of cameras and a priority order for displaying the videos or images; a display control unit that causes a display device to display the video or the image based on the priority order; An information processing program characterized by causing the program to function as follows.
21. an information processing device including a receiving unit that receives video or images transmitted from a plurality of cameras that capture one or more work sites, a priority order determining unit that determines a priority order for displaying the video or images based on a predetermined priority order, and a transmitting unit that transmits the video or images and the priority order; an information processing terminal including: a receiving unit that receives the video or the image transmitted from the information processing device and a priority order for displaying the video or the image; and a display control unit that displays the video or the image on a display device based on the priority order; An information processing system comprising:
22. An information processing method in a system including an information processing device that transmits a video or an image captured by a camera, and an information processing terminal that displays the video or the image, A step in which a receiving unit of the information processing device receives videos or images transmitted from a plurality of cameras that capture one or more work sites; a step of a priority order determination unit of the information processing device determining a priority order for displaying the video or the image based on a predetermined priority order; a transmitting unit of the information processing device transmitting the video or the image and the priority order; a receiving unit of the information processing terminal receiving the video or the image transmitted from the information processing device and a display priority of the video or the image; a step of causing a display control unit of the information processing terminal to display the video or the image on a display device based on the priority order; 13. An information processing method comprising:
Citation Information
Patent Citations
Construction site management support system and construction site management support method
JP2022030717A
