Display device

Abstract

This display device 400, which displays, on a screen, at least a portion of images captured by a plurality of imaging devices installed in fields, has: an acquisition unit 421 which acquires work situation information which indicates a work situation in a field; a determination unit 422 which determines, on the basis of the work situation information acquired by the acquisition unit 421, priority at the time of displaying an image; and a display unit 423 which displays, on the screen, an image selected on the basis of the priority determined by the determination unit 422.

Description

display device

[0001] The present invention relates to a display device, a display method, and a recording medium.

[0002] BACKGROUND ART Techniques used to display the status of work at a construction site or the like are known.

[0003] For example, Patent Document 1 discloses a device that displays the status of multiple work sites. Patent Document 1 also discloses that the work status is determined and a display according to the determination result is performed for each work site.

[0004] JP 2022-98327 A

[0005] When video images are acquired from multiple sites or multiple locations at a single site, it may not be possible to display all of the video images at once. The technology described in Patent Document 1 does not anticipate such cases. Therefore, even if the technology described in Patent Document 1 is used, it is not possible to accurately display such cases. Thus, there has been a problem in that it may be difficult to accurately display video images acquired from multiple sites.

[0006] Therefore, an object of the present invention is to provide a display device, a display method, and a program that can solve the above-mentioned problems.

[0007] In order to achieve this object, a display device that is one form of the present disclosure is a display device that displays on a screen at least some of the images captured by multiple imaging devices installed at a site, and is configured to have: an acquisition unit that acquires work status information that is information indicating the work status at the site; a determination unit that determines a priority for displaying the images based on the work status information acquired by the acquisition unit; and a display unit that displays on a screen the images selected based on the priority determined by the determination unit.

[0008] In addition, a display method that is another embodiment of the present disclosure is configured such that an information processing device that displays on a screen at least some of the images captured by multiple imaging devices installed at a site acquires work status information that is information indicating the work status at the site, determines a priority for displaying the images based on the acquired work status information, and displays on the screen the images selected based on the determined priority.

[0009] Another aspect of the present disclosure is a computer-readable recording medium having recorded thereon a program for causing an information processing device that displays on a screen at least some of the images captured by a plurality of imaging devices installed at the site to acquire work status information that indicates the work status at the site, determine a priority for displaying the images based on the acquired work status information, and display on the screen the images selected based on the determined priority.

[0010] According to the above-mentioned configurations, the above-mentioned problems can be solved.

[0011] 1 is a diagram illustrating a configuration example of a display system according to a first embodiment of the present disclosure; FIG. 2 is a block diagram illustrating a configuration example of a display device; FIG. 3 is a diagram illustrating an example of attention index information; FIG. 4 is a diagram illustrating an example of camera information; FIG. 5 is a diagram illustrating an example of processing performed by a work situation recognition unit; FIG. 6 is a diagram illustrating an example of processing when determining priority; FIG. 7 is a diagram illustrating an example of display by a display unit; FIG. 8 is a diagram illustrating an example of display switching; FIG. 9 is a diagram illustrating an example of display switching; and FIG. 10 is a flowchart illustrating an operation example of a display device; FIG. 11 is a diagram illustrating a hardware configuration example of a display device according to a second embodiment of the present disclosure; and FIG. 12 is a block diagram illustrating a configuration example of a display device.

[0012] [First Embodiment] A first embodiment of the present invention will be described with reference to Figs. 1 to 11. Fig. 1 is a diagram showing an example of the configuration of a display system 100. Fig. 2 is a block diagram showing an example of the configuration of a display device 300. Fig. 3 is a diagram showing an example of attention index information 341. Fig. 4 is a diagram showing an example of camera information 342. Fig. 5 is a diagram for explaining an example of processing performed by a work situation recognition unit 353. Fig. 6 is a diagram for explaining an example of processing when determining priority. Figs. 7 and 8 are diagrams showing an example of display by a display unit 355. Figs. 9 and 10 are diagrams showing an example of display switching. Fig. 11 is a flowchart showing an example of operation of the display device 300.

[0013] In a first embodiment of the present disclosure, a display system 100 is described that displays on a screen an image captured at a site where a predetermined task is being performed, such as a construction site or any other work site. For example, in the present disclosure, the display system 100 acquires images from a plurality of image capture devices 200. Then, the display system 100 displays on a screen the images acquired from at least some of the image capture devices 200.

[0014] Furthermore, when performing the above display, the display system 100 can select an image to display based on predetermined conditions and display the selected image. For example, the display system 100 acquires work status information, which is information indicating the work status at the site, by using a predetermined means described below. Furthermore, the display system 100 determines a priority for displaying the image based on the acquired work status information. Then, the display system 100 can select an image to display based on the determined priority.

[0015] The work status may include information such as the content of the work actually being performed and the work environment, as well as a work schedule and a comparison result between the work currently being performed and the work schedule. Furthermore, work status information may include information that allows understanding of the work status at the site, such as the work content, the number and attributes of workers, the work environment, the work schedule, and the comparison result. For example, the work status information may include at least a portion of the actual work status, such as information indicating the content of the work being performed at the site, information indicating the number of workers currently working, information indicating the presence or absence of unsafe behavior such as throwing materials or excessive approach to heavy machinery, information indicating the weather at the site, and information indicating the progress of the work, such as the completion or start of the work. Furthermore, the work status information may include information indicating the content and process of the work to be performed, information indicating the number of workers scheduled to participate, the work schedule, such as the reliability of contractors based on order history and past performance, and related information that can be obtained in advance. Furthermore, the work status information may include information corresponding to the comparison result between the actual work status and the work schedule, such as the comparison result between the number of workers currently working and the number of workers scheduled to participate. As an example, the display system 100 can acquire work status information by inputting image data included in a video into a pre-trained model, etc. The display system 100 can also acquire work status information by referring to pre-stored work plan information 343, etc. The display system 100 may acquire work status information using a method other than those exemplified above.

[0016] Fig. 1 shows an example of the overall configuration of a display system 100. Referring to Fig. 1, the display system 100 has a plurality of imaging devices 200 (imaging device 200-1, imaging device 200-2, imaging device 200-3, .... Hereinafter, when no particular distinction is made, they will be referred to as imaging devices 200) and a display device 300. As illustrated in Fig. 1, the imaging devices 200 and the display device 300 are connected so as to be able to communicate with each other via a network or the like.

[0017] The imaging device 200 is installed at a predetermined location at a site such as a construction site, and captures video showing the work situation. The imaging device 200 may be a general device such as a surveillance camera. For example, at least some of the multiple imaging devices 200 included in the display system 100 may be installed at different sites. At least some of the multiple imaging devices 200 included in the display system 100 may be installed at different locations on the same site.

[0018] Furthermore, the imaging device 200 transmits the acquired video to the display device 300. For example, the imaging device 200 may transmit the acquired video together with identification information of the imaging device 200 itself to the display device 300 so that the imaging device 200 that acquired the video can be identified on the display device 300 side.

[0019] The display device 300 is an information processing device that displays on a screen the images acquired from the imaging devices 200. The display device 300 may be installed on-site, or may be installed outside the site, such as in a monitoring center that centrally monitors work at multiple sites. For example, the display device 300 can be configured to acquire images from multiple imaging devices 200 and display some of the acquired images selected based on predetermined conditions.

[0020] Fig. 2 shows an example of the configuration of the display device 300. Referring to Fig. 2, the display device 300 has, as main components, for example, an operation input unit 310, a screen display unit 320, a communication I / F unit 330, a storage unit 340, and an arithmetic processing unit 350.

[0021] 2 illustrates an example in which the functions of the display device 300 are realized using one information processing device. However, at least some of the functions of the display device 300 may be realized using multiple information processing devices, for example, on the cloud. Furthermore, the display device 300 may not include some of the components illustrated above, such as not having the operation input unit 310 or the screen display unit 320, or may have a configuration other than those illustrated above.

[0022] The operation input unit 310 is made up of operation input devices such as a keyboard, a mouse, etc. The operation input unit 310 detects operations of the operator operating the display device 300 and outputs the operations to the arithmetic processing unit 350.

[0023] The screen display unit 320 is composed of a screen display device such as a liquid crystal display, an organic electroluminescence (EL) display, etc. The screen display unit 320 can display various information stored in the storage unit 340 on the screen in response to instructions from the arithmetic processing unit 350.

[0024] The communication I / F unit 330 includes a data communication circuit, etc. The communication I / F unit 330 performs data communication with an external device such as the image capture device 200 connected via a communication line.

[0025] The storage unit 340 is a storage device such as a hard disk or memory. The storage unit 340 stores processing information and programs 345 required for various processes in the arithmetic processing unit 350. The programs 345 are read into the arithmetic processing unit 350 and executed to realize various processing units. The programs 345 are read in advance from an external device or recording medium via a data input / output function such as the communication I / F unit 330, and are stored in the storage unit 340. Main information stored in the storage unit 340 includes, for example, attention index information 341, camera information 342, work plan information 343, and video information 344.

[0026] The attention index information 341 indicates an attention index, which is a value indicating which point of interest in the work status information should be displayed with priority, for each point of interest in the work status information. The attention index information 341 is acquired in advance by any method, such as inputting using the operation input unit 310 or acquiring from an external device via the communication I / F unit 330, and is stored in the storage unit 340.

[0027] FIG. 3 shows an example of attention index information 341. Referring to FIG. 3, the attention index information 341 associates points of interest with attention indices. Here, the points of interest indicate points to be focused on in work status information. For example, the points of interest include at least some of points to be focused on in the actual work status that can be determined based on video, such as the content of the work and whether or not there is unsafe behavior, points to be focused on in information indicating the work schedule, and points to be focused on in the results of comparing the actual work status with the schedule. Furthermore, the attention index is a value indicating which information should be displayed with priority. In the case of the present disclosure, a larger value of the attention index indicates which information should be displayed with priority.

[0028] As an example, referring to FIG. 3 , the attention index information 341 associates the focus point "(a) dangerous work in progress" with an attention index of "20." Here, dangerous work may be any predetermined work, such as heavy machinery work or work at height. Also referring to FIG. 3 , the attention index information 341 associates the focus point "(b) specific work in progress" with an attention index of "8." At construction sites and other such sites, safety for specific work may be required over a predetermined period, such as "ensure greater safety with work of ~ in ~ months." The focus point "(b) specific work in progress" illustrated above may correspond to any work, such as work that requires particular safety over a predetermined period, as described above. Also referring to FIG. 3 , the attention index information 341 associates the focus point "(c) work different from the work plan in progress" with an attention index of "15." Furthermore, referring to FIG. 3, in the attention index information 341, the focus point "(A) Dangerous work is scheduled to be carried out" is associated with an attention index of "10."

[0029] The attention index information 341 is not limited to the example shown in FIG. 3 . For example, the attention index information 341 may include points of interest other than those shown in FIG. 3 , and the value of the attention index may also be other than those shown in FIG. 3 . The points of interest and the attention index may be common to each site, or may be different for each site. In other words, the points of interest and the attention index may be set differently for each site. For example, the attention index information 341 may include information associating the points of interest and the attention index for each site.

[0030] Furthermore, in the present disclosure, the specific method of determining the attention index is not particularly limited. For example, the attention index may be set manually or may be determined by machine learning. As an example, the attention index may be determined by performing machine learning using videos to be displayed and videos that do not need to be displayed as training videos. For example, the attention index may be determined by learning weight values ​​corresponding to each attention index using each training video so that the total attention index corresponding to the videos to be displayed is large and the total attention index corresponding to the videos that do not need to be displayed is small.

[0031] The camera information 342 includes information indicating the location where the imaging device 200, such as a surveillance camera, is installed. For example, the camera information 342 may include information indicating the site where the imaging device 200 is installed, as information indicating the location where the imaging device 200 is installed. The camera information 342 is acquired in advance by any method, such as inputting the information using the operation input unit 310 or acquiring the information from an external device via the communication I / F unit 330, and is stored in the storage unit 340.

[0032] Fig. 4 shows an example of the camera information 342. Referring to Fig. 4, the camera information 342 associates identification information with installation location information. Here, the identification information is information for identifying the image capture device 200. The identification information may be any information uniquely assigned to each image capture device 200. The installation location information also includes site identification information for identifying the site where the associated image capture device 200 is installed. The installation location information may also include more detailed information, such as a specific location within the site.

[0033] The work plan information 343 includes work plan data indicating a plan for work to be performed at a site, such as the work content to be performed and the workers who will perform the work. The work plan information 343 may include work plan data for each site. For example, the work plan data may include at least some of information indicating the work content and work process to be performed, information indicating the number of workers scheduled to participate, and the reliability of contractors based on their order history and past performance. The work plan data may also include data related to work schedules and work plans other than those exemplified above. For example, the work plan information 343 is updated in response to the work plan acquisition unit 351 (described later) acquiring work plan data.

[0034] Video information 344 includes video captured by each imaging device 200 included in display system 100. For example, video information 344 stores video for each imaging device 200. For example, video information 344 is updated in response to video capture unit 352 capturing video from an imaging device 200.

[0035] The arithmetic processing unit 350 has an arithmetic device such as a CPU (Central Processing Unit) and its peripheral circuits. The arithmetic processing unit 350 reads and executes a program 345 from the storage unit 340, thereby realizing various processing functions by causing the above hardware and the program 345 to work together. Major processing units realized by the arithmetic processing unit 350 include, for example, a work plan acquisition unit 351, an image acquisition unit 352, a work situation recognition unit 353, a priority determination unit 354, a display unit 355, and a switching instruction unit 356.

[0036] In addition, instead of the above-mentioned CPU, the arithmetic processing unit 350 may have a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an MPU (Micro Processing Unit), an FPU (Floating point number Processing Unit), a PPU (Physics Processing Unit), a TPU (Tensor Processing Unit), a quantum processor, a microcontroller, or a combination of these.

[0037] The work plan acquisition unit 351 acquires work plan data indicating the work content to be performed and information about the workers who will perform the work. For example, the work plan acquisition unit 351 acquires work plan data corresponding to each site in response to an operation received via the operation input unit 310 or by acquiring the data from an external device via the communication I / F unit 330. The work plan acquisition unit 351 also stores the acquired work plan data in the storage unit 340 as work plan information 343.

[0038] The video acquisition unit 352 acquires video from the imaging device 200. For example, the video acquisition unit 352 acquires video from the imaging device 200 via the communication I / F unit 330. The video acquisition unit 352 also stores the acquired video in the storage unit 340 as video information 344.

[0039] The work situation recognition unit 353 acquires work situation information indicating the work situation at the work site. The work situation recognition unit 353 may acquire work situation information for each video or each imaging device 200 that acquires video, for which it is possible to select whether or not to display the video. For example, the work situation recognition unit 353 can acquire work situation information by performing work situation recognition processing on the video. The work situation recognition unit 353 can also acquire work situation information by referencing the work plan information 343. The work situation recognition unit 353 can also acquire new work situation information that differs from the above-described information by comparing the results of the work situation recognition processing with the results of referencing the work plan information 343. For example, the work situation recognition unit 353 may acquire work situation information by using at least some of the methods exemplified above.

[0040] For example, the work situation recognition unit 353 acquires work situation information by performing work situation recognition processing based on video. As an example, the work situation recognition unit 353 can acquire work situation information by inputting image data included in video into a pre-trained model or the like. Note that the work situation recognition unit 353 may acquire work situation information from video using any means other than those exemplified above. For example, as a result of the work situation recognition processing based on video, the work situation recognition unit 353 can acquire work situation information including at least a part of the actual work situation, such as information indicating the content of the work being performed at the work site, information indicating the number of workers, information indicating the presence or absence of unsafe behavior such as throwing materials or excessive approach to heavy machinery, information indicating the weather at the work site, and information indicating the progress of the work.

[0041] Specifically, for example, the work situation recognition unit 353 detects people, objects, etc. based on image data included in the video by using an arbitrary trained detector, etc. Furthermore, the work situation recognition unit 353 detects people, objects, etc. and extracts feature information indicating the characteristics of the people and objects. For example, the work situation recognition unit 353 extracts, as feature information, at least some of the following: rectangle information indicating a rectangle surrounding the detected person or object; posture information indicating the person's skeleton and posture; shape information indicating the object's edges; and environmental information indicating the weather and other surrounding environment around the detected person or object. Note that the work situation recognition unit 353 may extract the feature information by using one or more trained feature extractors, etc. Furthermore, the work situation recognition unit 353 may be configured to acquire feature information based on multiple image data included in the video by using an arbitrary tracking function. In this case, the work situation recognition unit 353 may extract, as feature information, behavioral information indicating a person's behavior according to, for example, time-series rectangle information or posture information.

[0042] 5 shows an example of extraction by the work situation recognition unit 353. For example, referring to FIG. 5, the work situation recognition unit 353 extracts rectangle information r1 and rectangle information r2 as a result of the extraction process. In addition, the work situation recognition unit 353 can extract posture information p1 and posture information p2 as a result of the extraction process, and can also extract environmental information s1 indicating a building and environmental information s2 indicating the ground, etc.

[0043] The work situation recognition unit 353 also aggregates and integrates the extracted feature information for each detected person or object. As a result, the work situation recognition unit 353 generates integrated information for each detected person or object. Then, the work situation recognition unit 353 can acquire work situation information indicating the content of the work being performed by the person, etc., based on the generated integrated information. The work situation recognition unit 353 may perform the integration using any means, such as inputting feature information into a trained neural network having a conversion layer and an integration layer, and then acquiring integrated information that is output from an output layer. The work situation recognition unit 353 may also acquire the work situation information using any means, such as inputting the integrated information into a trained task recognizer, and then recognizing the content of the task, etc.

[0044] For example, the work situation recognition unit 353 can acquire work situation information based on video by executing the work situation recognition process described above. The work situation recognition unit 353 may acquire work situation information based on video using a method other than the example described above.

[0045] Furthermore, the work status recognition unit 353 can acquire work status information by referring to the work plan information 343. For example, the work status recognition unit 353 identifies a site corresponding to the video or the imaging device 200 that acquired the video by referring to the camera information 342. Thereafter, the work status recognition unit 353 can acquire work plan data corresponding to the identified site as work status information by referring to the work plan information 343.

[0046] Furthermore, the work status recognition unit 353 may acquire work status information by comparing the result of acquiring work status information based on video with the result of referring to the work plan information 343. For example, by performing the above comparison, the work status recognition unit 353 can acquire work status information indicating whether or not work different from the work plan is being performed, whether or not a different number of workers than the work plan has been detected, and the like.

[0047] The priority determination unit 354 determines the priority for displaying the video based on the work status information corresponding to each video or each imaging device 200 acquired by the work status recognition unit 353. For example, the priority determination unit 354 identifies an attention index corresponding to a point of interest included in each piece of work status information by referring to the attention index information 341. The priority determination unit 354 then determines the priority based on the identified result. For example, the priority determination unit 354 can determine the priority by calculating the total value of the attention index for each video.

[0048] FIG. 6 shows an example of processing by the priority determination unit 354. Referring to FIG. 6, for example, the priority determination unit 354 checks whether each piece of work status information acquired by the work status recognition unit 353 includes a point of interest included in the attention index information 341. The priority determination unit 354 also identifies attention indices associated with the points of interest included in the work status information and sums the identified values ​​for each video (image capture device 200). For example, in the example shown in FIG. 6, the work status information corresponding to the video acquired by the image capture device 200-1 includes the points of interest "(a) dangerous work currently being performed" and "(A) dangerous work scheduled to be performed." Therefore, the priority determination unit 354 calculates 20 + 10 = 30 as the total value of the points of interest corresponding to the video acquired by the image capture device 200-1. In the example shown in FIG. 6, the work status information corresponding to the video acquired by the image capture device 200-2 includes the point of interest "(b) specific work currently being performed." Therefore, the priority determination unit 354 calculates the total value of the points of interest corresponding to the video captured by the image capture device 200-2 as 8. In this way, the priority determination unit 354 calculates a value corresponding to the points of interest included in the work status information for each video or each image capture device 200 that captures video.

[0049] For example, the priority determination unit 354 determines the calculated total value as a value indicating the priority. Here, the determined priority is a value in which the higher the value, the higher the priority. For example, in the example shown in FIG. 6, the total value corresponding to the video acquired by the imaging device 200-1 is greater than the total value corresponding to the video acquired by the imaging device 200-2. Therefore, the priority when displaying the video acquired by the imaging device 200-1 is higher than the priority when displaying the video acquired by the imaging device 200-2. As a result, the display unit 355, which will be described later, displays the video acquired by the imaging device 200-1 with higher priority than the video acquired by the imaging device 200-2.

[0050] The display unit 355 displays the images based on the priorities determined by the priority determination unit 354. For example, the display unit 355 displays the images on the screen display unit 320 in order from the image determined to have the highest priority based on the priorities.

[0051] 7 shows an example of display by the display unit 355. For example, in the example shown in FIG. 7, the display unit 355 displays images in four areas, namely, area 321, area 322, area 323, and area 324, on the screen display unit 320. As an example, the display unit 355 can display the top four images in order from the highest priority image in area 321, area 322, area 323, and area 324. Note that the number of areas that the display unit 355 can display is not limited to four and may be set arbitrarily. The display unit 355 may select images according to the number of areas that can be displayed and display the selected images.

[0052] As illustrated in FIG. 7 , when displaying a video, the display unit 355 can display at least one of main cause information, process information, and the like together with the video. Here, the main cause information is information indicating the focus used in determining the priority. For example, the main cause information may indicate the focus associated with the highest attention index among the attention indices used in determining the priority. The process information is information indicating a work process that can be determined based on the work content included in the work status information. For example, a table correlating one or more work contents with the work process is stored in the storage unit 340 or the like. The display unit 355 may identify a work process by checking the table and display the identified work process as the process information. The display unit 355 may also display the work content included in the work status information as the process information. For example, in the example illustrated in FIG. 7 , a main cause information area 3211 displaying main cause information and a process information area 3212 displaying process information are displayed in the area 321, and a main cause information area 3221 and a process information area 3222 are displayed in the area 322. Similarly, a main cause information area 3231 and a process information area 3232 are displayed in area 323, and a main cause information area 3241 and a process information area 3242 are displayed in area 324. As illustrated in Fig. 7, the positions of the main cause information area and the process information area are not fixed, but may be freely movable.

[0053] Furthermore, display unit 355 can switch the video displayed in each area based on an instruction from switching instruction unit 356, which will be described later. The switching of the video displayed by display unit 355 may also be performed according to the priority determined by priority determination unit 354. For example, based on an instruction from switching instruction unit 356, display unit 355 can switch the video currently displayed in the area to an undisplayed video that has the next highest priority after the displayed video.

[0054] The display unit 355 may be configured to display each site by referring to the camera information 342. For example, the display unit 355 may display the top four images, in order from highest priority, of images captured at the site corresponding to the image with the highest priority in areas 321, 322, 323, and 324. For example, in the example shown in FIG. 8 , the image with the highest priority is an image captured at site A. Therefore, the display unit 355 displays the top four images, in order from highest priority, of images captured at site A in areas 321, 322, 323, and 324. In this way, the display unit 355 may be configured to display images for each site.

[0055] The display unit 355 may also be configured to allow selection of whether or not to display the above-described site-specific image. Whether or not to display the site-specific image may be selectable based on an operation via the operation input unit 310, or may be selectable based on the above-described main cause information and work status information. For example, the display unit 355 may determine to display the site-specific image when it is determined that a wide range of view is desired based on the main cause information and work status information corresponding to the highest priority image. Whether or not a wide range of view is desired may be determined based on information included in the work status information, such as whether the work content, work schedule, etc., satisfy predetermined conditions.

[0056] Furthermore, when switching the video to be displayed in each area based on an instruction from switching instruction unit 356, display unit 355 may select a video to be displayed based on priority from among all the videos included in video information 344, or may select a video to be displayed from among the videos included in video information 344 that satisfy a predetermined condition. For example, display unit 355 may be configured to select a video to be displayed from among the videos whose total value of the attention index calculated by priority determination unit 354 is equal to or greater than a predetermined value.

[0057] The switching instruction unit 356 instructs the display unit 355 to switch the video displayed.

[0058] For example, the switching instruction unit 356 acquires a switching instruction in response to receiving an operation via the operation input unit 310 or acquiring the switching instruction from an external device via the communication I / F unit 330. Then, the switching instruction unit 356 instructs the display unit 355 to switch the video to be displayed in response to the acquired switching instruction. Note that the switching instruction may include information indicating the area (or video) to be switched. The switching instruction may also include information specifying the priority, order of priority, location, etc. of the video to be switched.

[0059] 9 , for example, the switching instruction unit 356 acquires a switching instruction targeting the video currently being displayed in the area 323. The switching instruction unit 356 then instructs the display unit 355 to switch the video currently being displayed in the area 323. In response to this, the display unit 355 switches the video currently being displayed in the area 323 to an undisplayed video that has the next highest priority after the video that has already been displayed.

[0060] Furthermore, the switching instruction unit 356 can instruct the display unit 355 to switch the video to be displayed according to a predetermined condition, such as a predetermined interval. In this case, the switching instruction unit 356 may instruct the display unit 355 to switch the video currently displayed in all areas, or may instruct the display unit 355 to switch the video currently displayed in some areas. For example, FIG. 10 shows an example in which the switching instruction unit 356 instructs the display unit 355 to switch at a predetermined interval. The predetermined interval may be determined by any method. Note that the switching instruction unit 356 may be configured to instruct the display unit 355 to switch periodically regardless of the condition, or may be configured to instruct the display unit 355 to switch when the undisplayed video includes video that satisfies any condition, such as when the total value of the attention index is equal to or greater than a predetermined value.

[0061] The above is an example of the configuration of the display device 300. Next, an example of the operation of the display device 300 will be described with reference to FIG.

[0062] Fig. 11 is a flowchart showing an example of the operation of the display device 600. Referring to Fig. 11, the video acquisition unit 352 acquires a video from the imaging device 200 (step S101).

[0063] The work situation recognition unit 353 acquires work situation information indicating the work situation at the site (step S102). For example, the work situation recognition unit 353 may acquire work situation information for each video or each imaging device 200 that acquires video, for which the presence or absence of display and the display order are to be selected. For example, the work situation recognition unit 353 can acquire the work situation information by performing work situation recognition processing on the video. The work situation recognition unit 353 may acquire the work situation information by referring to the work plan information 343 or by comparing the result of the work situation recognition processing with the result of referring to the work plan information 343.

[0064] The priority determination unit 354 determines the priority for displaying the video based on the work status information corresponding to each video or each imaging device 200 acquired by the work status recognition unit 353 (step S103). For example, the priority determination unit 354 identifies an attention index corresponding to a point of interest included in each piece of work status information by referring to the attention index information 341. The priority determination unit 354 then determines the priority based on the identified result. For example, the priority determination unit 354 can determine the priority by calculating the total value of the attention index for each video.

[0065] Display unit 355 displays the images based on the priorities determined by priority determination unit 354 (step S104). For example, display unit 355 displays the images on screen display unit 320 in order of priority, starting with the image determined to have the highest priority based on the priorities. Note that display unit 355 may be configured to switch the images displayed in each area based on an instruction from switching instruction unit 356.

[0066] As described above, the display device 300 has the work status recognition unit 353, the priority determination unit 354, and the display unit 355. With this configuration, the priority determination unit 354 can determine the priority for displaying the video based on the work status information acquired by the work status recognition unit 353. Furthermore, the display unit 355 can display the video based on the priority determined by the priority determination unit 354. As a result, even when videos are acquired from multiple work sites, the video can be displayed accurately.

[0067] Furthermore, the work situation recognition unit 353 can acquire work situation information by performing work situation recognition processing on the video and by referring to the work plan information 343. In this way, by acquiring work situation information based on the results of the work situation recognition processing and the work plan data, the work situation can be grasped more accurately. As a result, it is possible to more accurately determine priorities and perform more accurate display.

[0068] Second Embodiment Next, a second embodiment of the present disclosure will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a diagram showing an example of the hardware configuration of a display device 400. Fig. 13 is a block diagram showing an example of the configuration of the display device 400.

[0069] In a second embodiment of the present disclosure, a display device 400 that displays on a screen at least some of the images captured by a plurality of imaging devices installed at a site will be described. Fig. 12 shows an example of the hardware configuration of the display device 400. Referring to Fig. 12, the display device 400 has the following hardware configuration, for example: a CPU (Central Processing Unit) 401 (arithmetic unit); a ROM (Read Only Memory) 402 (storage device); a RAM (Random Access Memory) 403 (storage device); a group of programs 404 loaded into the RAM 403; a storage device 405 that stores the group of programs 404; a drive device 406 that reads and writes data from and to a storage medium 410 external to the information processing device; a communication interface 407 that connects to a communication network 411 external to the information processing device; an input / output interface 408 that inputs and outputs data; and a bus 409 that connects the various components.

[0070] 13 . The program group 404 is stored in advance in the storage device 405 or the ROM 402, for example, and is loaded into the RAM 403 or the like and executed by the CPU 401 as needed. The program group 404 may be supplied to the CPU 401 via the communication network 411, or may be stored in advance in the recording medium 410, and the drive device 406 may read out the program and supply it to the CPU 401.

[0071] 12 shows an example of the hardware configuration of the display device 400. The hardware configuration of the display device 400 is not limited to the above-described case. For example, the display device 400 may be configured with only a part of the above-described configuration, such as not including the drive device 406. Furthermore, the CPU 401 may be a GPU, etc., as exemplified in the first embodiment.

[0072] The acquisition unit 421 acquires work status information, which is information indicating the work status at the site.

[0073] The determination unit 422 determines the priority for displaying the video based on the work status information acquired by the acquisition unit 421 .

[0074] The display unit 423 displays the video selected based on the priority determined by the determination unit 422 on the screen.

[0075] As described above, the display device 400 includes the determination unit 422 and the display unit 423. With this configuration, the determination unit 422 can determine the priority for displaying the video based on the work status information acquired by the acquisition unit 421. As a result, the display unit 423 can display the video selected based on the priority determined by the determination unit 422 on the screen. This allows for accurate display even when video is acquired from multiple work sites.

[0076] The display device 400 described above can be realized by incorporating a predetermined program into an information processing device such as the display device 400. Specifically, a program according to another aspect of the present invention is a program for causing an information processing device such as the display device 400 to acquire work status information that indicates the work status at a work site, determine a priority for displaying an image based on the acquired work status information, and display an image selected based on the determined priority on the screen.

[0077] Furthermore, the display method executed by an information processing device such as the above-mentioned display device 400 is a method in which work status information, which is information indicating the work status at the site, is acquired, a priority for displaying the image is determined based on the acquired work status information, and the image selected based on the determined priority is displayed on the screen.

[0078] Even if the invention is a program having the above-described configuration, or a recording medium readable by a computer having the program recorded thereon, or a display method, it can achieve the above-described objective of the present disclosure by achieving the same functions and effects as the above-described display device 400.

[0079] <Supplementary Notes> Part or all of the above-described embodiments can be described as follows: The display device and the like according to the present invention will be outlined below. However, the present invention is not limited to the following configuration.

[0080] (Supplementary Note 1) A display device that displays on a screen at least some of images captured by a plurality of imaging devices installed at a work site, the display device having: an acquisition unit that acquires work status information that is information indicating a work status at the work site; a determination unit that determines a priority for displaying images based on the work status information acquired by the acquisition unit; and a display unit that displays on a screen an image selected based on the priority determined by the determination unit. (Supplementary Note 2) The display device according to Supplementary Note 1, wherein the determination unit determines the priority by calculating the priority according to a focus point included in the work status information. (Supplementary Note 3) The display device according to Supplementary Note 2, wherein the determination unit calculates the priority by calculating a total value of the attention index associated with the focus point included in the work status information based on attention index information that associates the attention index, which is a value indicating that the focus should be displayed with priority. (Supplementary Note 4) The display device according to Supplementary Note 3, wherein the attention index is set for each work site. (Supplementary Note 5) The display device according to Supplementary Note 3 or Supplementary Note 4, further comprising an instruction unit that instructs the display unit to switch the video to be displayed, and the display unit selects a video to be displayed from among the videos whose total value of the attention index satisfies a predetermined condition in response to an instruction from the instruction unit. (Supplementary Note 6) The display device according to any one of Supplementary Note 2 to Supplementary Note 5, wherein the display unit displays main cause information indicating the focus used in determining priority together with the video. (Supplementary Note 7) The display device according to any one of Supplementary Note 1 to Supplementary Note 6, wherein the acquisition unit acquires the work status information based on the video. (Supplementary Note 8) The display device according to Supplementary Note 7, wherein the acquisition unit acquires the work status information indicating at least a part of the work content, the number of workers, and the work environment based on the video. (Supplementary Note 9) The display device according to any one of Supplementary Note 1 to Supplementary Note 8, wherein the acquisition unit acquires the work status information indicating at least a part of the work content, the number of workers, and the work environment by referring to work plan data indicating a plan for work to be performed at a site.(Supplementary Note 10) The display device according to Supplementary Note 9, wherein the acquisition unit acquires the work status information indicating at least some of information indicating the content of work to be performed, information indicating the number of workers scheduled to participate, and reliability of a contractor based on order history or past performance, by referring to the work plan data. (Supplementary Note 11) The display device according to any one of Supplementary Notes 1 to 10, wherein the acquisition unit acquires new work status information by comparing the work status information acquired based on video with the work status information acquired by referring to work plan data indicating a plan for work to be performed at a site. (Supplementary Note 12) The display device according to any one of Supplementary Notes 1 to 11, wherein the display unit displays on the screen an image selected based on priority from among multiple images captured of the same site. (Supplementary Note 13) The display device according to Supplementary Note 12, wherein the display unit selects an image to display from images captured of a site corresponding to an image with the highest priority among the images to be displayed. (Supplementary Note 14) The display device according to Supplementary Note 12 or Supplementary Note 13, wherein the display unit determines whether to select an image to be displayed from a plurality of images captured of the same work site, based on information included in the work status information. (Supplementary Note 15) A display method, wherein an information processing device that displays at least some of the images captured by a plurality of imaging devices installed at a work site on a screen, acquires work status information that is information indicative of the work status at the work site, determines a priority for displaying the images based on the acquired work status information, and displays the image selected based on the determined priority on the screen. (Supplementary Note 16) A computer-readable recording medium having recorded thereon a program for causing an information processing device that displays at least some of the images captured by a plurality of imaging devices installed at a work site on a screen to acquire work status information that is information indicative of the work status at the work site, determines a priority for displaying the images based on the acquired work status information, and displays the image selected based on the determined priority on the screen.

[0081] The programs described in the above embodiments and appendices may be stored in a storage device or a computer-readable recording medium, such as a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0082] Although the present invention has been described above with reference to the above-mentioned embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0083] 100 display system 200 imaging device 300 display device 310 operation input section 320 screen display section 321 area 3211 main cause information area 3212 process information area 322 area 3221 main cause information area 3222 process information area 323 area 3231 main cause information area 3232 process information area 324 area 3241 Main factor information area 3242 Process information area 330 Communication I / F section 340 Storage section 341 Attention index information 342 Camera information 343 Work plan information 344 Video information 345 Program 350 Arithmetic processing section 351 Work plan acquisition section 352 Video acquisition section 353 Work situation recognition section 354 Priority determination section 355 Display section 356 Switching instruction section 400 Display device 401 CPU 402 ROM 403 RAM 404 Program group 405 Storage device 406 Drive device 407 Communication interface 408 Input / output interface 409 Bus 410 Recording medium 411 Communication network 421 Acquisition unit 422 Decision unit 423 Display unit

Claims

1. A display device that displays on a screen at least some of the images captured by a plurality of imaging devices installed at a site, an acquisition unit that acquires work status information that indicates a work status at a work site; a determination unit that determines a priority for displaying an image based on the work status information acquired by the acquisition unit; a display unit that displays on a screen the video selected based on the priority determined by the determination unit; have Display device.

2. The display device according to claim 1 , The determination unit determines the priority by calculating the priority according to a focus point included in the work status information. Display device.

3. The display device according to claim 2, The determination unit calculates the priority by calculating a total value of the attention index associated with the point of interest included in the work status information based on attention index information that associates the point of interest with an attention index, the attention index being a value indicating that the point of interest should be displayed with priority. Display device.

4. The display device according to claim 3, The attention index is set for each site. Display device.

5. The display device according to claim 3, an instruction unit that instructs switching of the image displayed by the display unit; The display unit selects an image to be displayed from among the images whose total value of the attention index satisfies a predetermined condition in response to an instruction from the instruction unit. Display device.

6. The display device according to claim 2, The display unit displays main cause information indicating the focus points used in determining the priority together with the image. Display device.

7. The display device according to claim 1 , The acquisition unit acquires the work status information based on a video. Display device.

8. The display device according to claim 7, The acquisition unit acquires the work status information indicating at least a part of the work content, the number of workers, and the work environment based on the video. Display device.

9. An information processing device that displays on a screen at least some of the images captured by a plurality of imaging devices installed at a site, Acquire work status information that indicates the work status at the site; determining a priority for displaying the video based on the acquired work status information; Display the selected video on the screen based on the determined priority Display method.

10. An information processing device that displays on a screen at least some of the images captured by a plurality of imaging devices installed at a site, Acquire work status information that indicates the work status at the site; determining a priority for displaying the video based on the acquired work status information; Display the selected video on the screen based on the determined priority A program to realize the processing.