Display system, information terminal, and display method

Abstract

To allow a manager to recognize an area requiring safety measures in a construction site.SOLUTION: A display system comprises: a storage unit that stores safety information indicating a specific area requiring safety measures in a construction site and response information indicating the presence or absence of execution of the safety measures; a display data generation unit that generates display data including a map of the construction site, safety information, and response information; and a display control unit that displays the display data on a display.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present disclosure relates to a display system, an information terminal, and a display method. [Background technology]

[0002] A work machine works at a construction site. There may be other work machines or workers working near the work machine, or there may be obstacles near the work machine. If there is a possibility of contact between the work machine and an object near the work machine, the safety of the construction site may be reduced. Patent Document 1 discloses a perimeter monitoring system that detects objects near the work machine. Information about the presence or absence of objects near the work machine is output to a perimeter monitoring monitor located in the cab of the work machine. Furthermore, when an object is detected near the work machine, the operation of the work machine is restricted. By outputting the information about the presence or absence of an object to the perimeter monitoring monitor and restricting the operation of the work machine, a reduction in safety at the construction site is prevented. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-068948 Summary of the Invention [Problem to be solved by the invention]

[0004] The perimeter monitoring system provides information on the presence or absence of objects to the operator in the cab of the work machine. By identifying areas requiring safety measures at a construction site, for example, the site manager can take safety measures, thereby maintaining safety at the construction site.

[0005] The present disclosure aims to make people aware of areas at construction sites where safety measures are required. [Means for solving the problem]

[0006] According to the present disclosure, there is provided a display system comprising: a memory unit that stores safety information indicating specific areas at a construction site where safety measures are required and corresponding information indicating whether or not the safety measures are being implemented; a display data generation unit that generates display data including a map of the construction site, the safety information, and the corresponding information; and a display control unit that displays the display data on a display device. [Effects of the Invention]

[0007] According to the present disclosure, areas requiring safety measures at a construction site are recognized. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram schematically illustrating a display system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing a display system according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating a method for generating safety information according to the embodiment. [Figure 4] FIG. 4 is a diagram showing a login screen according to the embodiment. [Figure 5] FIG. 5 is a diagram showing a site selection screen according to the embodiment. [Figure 6] FIG. 6 is a diagram showing a site map screen according to the embodiment. [Figure 7] FIG. 7 is a diagram showing a site map screen including a heat map image according to the embodiment. [Figure 8] FIG. 8 is a diagram showing a site map screen including safety information and response information according to the embodiment. [Figure 9] FIG. 9 is a diagram showing a manual symbol registration screen according to the embodiment. [Figure 10] FIG. 10 is a diagram showing a manual symbol registration screen according to the embodiment. [Figure 11] FIG. 11 is a diagram showing the site map screen when a symbol according to the embodiment is selected. [Figure 12]FIG. 12 is a diagram showing a details confirmation screen according to the embodiment. [Figure 13] FIG. 13 is a diagram showing a detailed editing screen according to the embodiment. [Figure 14] FIG. 14 is a diagram showing a first dangerous area list screen according to the embodiment. [Figure 15] FIG. 15 is a diagram showing an alert graph screen according to the embodiment. [Figure 16] FIG. 16 is a diagram showing a local map screen including the number of overlapping symbols according to the embodiment. [Figure 17] FIG. 17 is a diagram showing a site map screen including narrowed-down symbols according to the embodiment. [Figure 18] FIG. 18 is a diagram showing a site map screen including narrowed-down symbols according to the embodiment. [Figure 19] FIG. 19 is a diagram showing a site map screen including a live camera button according to the embodiment. [Figure 20] FIG. 20 is a diagram showing a live camera video screen according to the embodiment. [Figure 21] FIG. 21 is a diagram showing a refined search screen according to the embodiment. [Figure 22] FIG. 22 is a diagram showing the site map screen after the refined search processing according to the embodiment. [Figure 23] FIG. 23 is a block diagram illustrating a computer system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings, but the present disclosure is not limited to the embodiments. The components of the embodiments described below can be combined as appropriate. In addition, some components may not be used.

[0010] [Display System] 1 is a diagram schematically illustrating a display system 1 according to an embodiment. The display system 1 includes a server 2 and an information terminal 3. The display system 1 provides a user of the display system 1 with safety information indicating specific areas requiring safety measures at a construction site and corresponding information indicating whether or not the safety measures have been implemented.

[0011] The server 2 is located outside the construction site. The server 2 is capable of communicating with the information terminal 3. The information terminal 3 is carried by a user of the display system 1. The information terminal 3 includes a mobile terminal. An example of the information terminal 3 is a tablet terminal. The information terminal 3 may be a smartphone. The information terminal 3 may be a personal computer.

[0012] The server 2 can communicate with a plurality of information terminals 3. A plurality of users can use the display system 1. Each of the plurality of users (information terminals 3) has an account registered. The users who have registered accounts can use the display system 1.

[0013] The user of the display system 1 includes a manager of the construction site. The manager of the construction site includes a supervisor of the construction site. Note that the manager of the construction site does not have to be a supervisor. The manager of the construction site may manage multiple construction sites. The user of the display system 1 may be present at the construction site or may be present at a location separate from the construction site.

[0014] A work machine 4 operates at a construction site. The server 2 is capable of communicating with the work machine 4. The server 2 is capable of communicating with a plurality of work machines 4. In this embodiment, the work machine 4 is a shovel.

[0015] 2 is a block diagram showing a display system 1 according to an embodiment. As shown in FIG. 2, the work machine 4 has an on-board controller 41, a position sensor 42 connected to the on-board controller 41, and a camera 43 connected to the on-board controller 41.

[0016] The vehicle controller 41 includes a computer system. The vehicle controller 41 communicates with the server 2 via a communication system 100. The communication system 100 includes at least one of a mobile phone line, a communication satellite line, an Internet line, and a local area network.

[0017] The position sensor 42 detects the position of the work machine 4. The position sensor 42 detects the position of the work machine 4 using a global navigation satellite system (GNSS). The global navigation satellite system includes a global positioning system (GPS). The position sensor 42 includes a GNSS receiver, and detects the absolute position (coordinates) of the work machine 4. The detection data of the position sensor 42 is input to the on-board controller 41. The detection data of the position sensor 42 is position data of the work machine 4. The on-board controller 41 transmits the position data of the work machine 4 to the server 2 via the communication system 100.

[0018] The camera 43 detects objects in the vicinity of the work machine 4. The camera 43 is an example of an external sensor that detects objects in the vicinity of the work machine 4. The camera 43 captures images of objects in the vicinity of the work machine 4 and acquires image data of the objects. The image data of the objects captured by the camera 43 is detection data of the external sensor.

[0019] Image data of an object captured by the camera 43 is input to the on-board controller 41. The on-board controller 41 processes the image data of the object using, for example, artificial intelligence (AI) technology. The on-board controller 41 performs AI processing on the image data. A learning model is pre-stored in the on-board controller 41, which takes image data as input and outputs the type of object and the distance between the work machine 4 and the object. Examples of object types include other work machines working around the work machine 4, workers working around the work machine 4, and obstacles present at the construction site. The on-board controller 41 can recognize the type of object and the distance between the work machine 4 and the object by performing AI processing that inputs the image data captured by the camera 43 into the learning model. Note that the external sensor may include a stereo camera that can measure distance. In this case, the distance between the work machine 4 and the object may be recognized using detection data from the stereo camera. The on-board controller 41 transmits object data indicating the type of object around the work machine 4 and the distance between the work machine 4 and the object to the server 2 via the communication system 100.

[0020] The information terminal 3 has a terminal controller 31 , an input device 32 connected to the terminal controller 31 , and a display device 33 connected to the terminal controller 31 .

[0021] The terminal controller 31 includes a computer system and communicates with the server 2 via the communication system 100.

[0022] The input device 32 generates input data when operated by a user. An example of the input device 32 is a touch panel. The input device 32 may be a computer keyboard, a mouse, or a voice input device. The input data generated by the input device 32 is input to the terminal controller 31.

[0023] The display device 33 displays the display data and provides it to the user. Examples of the display device 33 include a flat panel display such as a liquid crystal display or an organic EL display. The terminal controller 31 causes the display device 33 to display the display data.

[0024] The server 2 includes a computer system, and includes a safety information generating unit 21, a correspondence information generating unit 22, a display data generating unit 23, and a storage unit 24.

[0025] The safety information generating unit 21 generates safety information indicating specific areas at a construction site where safety measures are required. The safety information generating unit 21 generates the safety information based on the detection data of the position sensor 42 and the image data of the camera 43.

[0026] FIG. 3 is a diagram illustrating a method for generating safety information according to an embodiment. As shown in FIG. 3, the work machine 4 is a shovel. The work machine 4 has a running body 4A with tracks, a revolving body 4B supported on the running body 4A, and a work implement 4C supported on the revolving body 4B. The work implement 4C has a boom connected to the revolving body 4B, an arm connected to the boom, and a bucket connected to the arm. A position sensor 42 is provided on the revolving body 4B. The position sensor 42 detects the position of the revolving body 4B. A plurality of cameras 43 are provided on the revolving body 4B.

[0027] In the embodiment, the specific area requiring safety measures includes the position of the work machine 4 when an object is detected by the camera 43. The detection data of the position sensor 42 and the image data captured by the camera 43 are input to the on-board controller 41. The on-board controller 41 can recognize the position of the object and the distance between the work machine 4 and the object by performing AI processing on the image data captured by the camera 43. In the example shown in FIG. 3, a worker WM and a cliff CL are present in the vicinity of the work machine 4. The on-board controller 41 can recognize that the object is the worker WM and the distance between the work machine 4 and the worker WM. The on-board controller 41 can recognize that the object is a cliff CL and the distance between the work machine 4 and the cliff CL. The on-board controller 41 transmits the detection data of the position sensor 42 when the object is detected by the camera 43, and object data indicating the type of object and the distance between the work machine 4 and the object, to the server 2 via the communication system 100. The safety information generation unit 21 determines that the position of the work machine 4 when the object is detected by the camera 43 is a specific area.

[0028] The specific area requiring safety measures is an area where a dangerous situation is predicted to occur or an area where a dangerous situation has occurred. In the embodiment, the safety information generation unit 21 determines the degree of danger of the specific area. That is, the safety information generation unit 21 classifies the degree of danger of the specific area into a plurality of levels.

[0029] The safety information generation unit 21 may determine the level of danger of a specific area based on the number of times an object is detected. The safety information may include the level of danger of a specific area determined by the safety information generation unit 21. For example, when the work machine 4 is working in a narrow section of the construction site, there is a possibility that the worker WM will pass near the work machine 4 many times. When the work machine 4 is working in a narrow section of the construction site, there is a possibility that the camera 43 will detect the worker WM many times. Furthermore, depending on the work content, there is a possibility that another work machine will be working near the work machine 4. When another work machine is working near the work machine 4, there is a possibility that the camera 43 will detect the other work machine many times. Furthermore, when the work machine 4 is working near a cliff CL, there is a possibility that the camera 43 will detect the cliff CL many times.

[0030] The safety information generation unit 21 may determine the location of the work machine 4 when the number of times an object is detected is less than the number threshold to be a specific area of a first danger level. The safety information generation unit 21 may determine the location of the work machine 4 when the number of times an object is detected is equal to or greater than the number threshold to be a specific area of a second danger level. The number threshold is a predetermined value.

[0031] The safety information generation unit 21 may determine the level of danger of a specific area based on the distance between the work machine 4 and an object. The safety information may include the level of danger of the specific area determined by the safety information generation unit 21. As described above, the on-board controller 41 can recognize the distance between the work machine 4 and an object through AI processing. When the work machine 4 is working in a narrow section of a construction site, there is a possibility that the worker WM will get too close to the work machine 4. There is also a possibility that another work machine will get too close to the work machine 4, or that the work machine 4 will get too close to a cliff CL.

[0032] The safety information generation unit 21 may determine the position of the work machine 4 when the distance between the work machine 4 and the object is equal to or greater than the distance threshold as a specific area of a first level of danger. The safety information generation unit 21 may determine the position of the work machine 4 when the distance between the work machine 4 and the object is less than the distance threshold as a specific area of a second level of danger. The distance threshold is a predetermined value.

[0033] A specific area with a first risk level may be considered to be an area where a dangerous situation is predicted to occur. A specific area with a second risk level may be considered to be an area where a dangerous situation has occurred. In the following description, a specific area with a first risk level will be referred to as a first dangerous area, and a specific area with a second risk level will be referred to as a second dangerous area.

[0034] The safety information generating unit 21 may generate the safety information based on input data indicating a specific area from the input device 32. For example, a location where a cliff or soft ground exists may be input as the specific area.

[0035] The response information generation unit 22 generates response information that indicates whether or not safety measures have been implemented. The response information indicates whether or not safety measures have actually been implemented in specific areas that require safety measures. Examples of safety measures include installing safety equipment such as safety fences or road cones (color cones (registered trademark)) around the specific area, verbally warning the worker WM or the operator of the work machine 4 to work safely, and reviewing the work procedures of the work machine 4 or worker WM.

[0036] The response information generating unit 22 may generate response information based on input data from the input device 32 indicating whether or not a safety measure has been implemented. For example, the installation of safety equipment, the issuance of a warning, and the review of work procedures may be input to the display system 1 as the implementation of a safety measure.

[0037] The safety information generated by the safety information generating unit 21 and the correspondence information generated by the correspondence information generating unit 22 are stored in the storage unit 24.

[0038] The display data generation unit 23 generates display data to be displayed on the display device 33 of the information terminal 3. In the embodiment, the display data includes a map of the construction site, safety information, and response information stored in the storage unit 24. The display data generated by the display data generation unit 23 is transmitted to the terminal controller 31 of the information terminal 3. The terminal controller 31 displays the display data generated by the display data generation unit 23 on the display device 33. In the embodiment, the terminal controller 31 functions as a display control unit that displays the display data on the display device 33.

[0039] [Display method] Next, a display method according to an embodiment will be described. Each of Fig. 4 to Fig. 22 is a diagram showing a display screen of the display device 33 according to an embodiment. The display data generation unit 23 generates display data to be displayed on the display device 33. The terminal controller 31 causes the display device 33 to display the display data.

[0040] FIG. 4 is a diagram showing a login screen according to an embodiment. A user of the display system 1 has an account registered. When the user logs in to the display system 1, a login screen is displayed on the display device 33. As shown in FIG. 4, the login screen includes a user ID input section 5A and a password input section 5B. After the user ID is input into the input section 5A and the password is input into the input section 5B, the login is completed by pressing the login button 5C.

[0041] FIG. 5 is a diagram showing a site selection screen according to the embodiment. When the login button 5C is pressed and login is completed, the display screen of the display device 33 transitions from the login screen shown in FIG. 4 to a site selection screen shown in FIG. 5. As shown in FIG. 5, the site selection screen includes a list 6A of construction sites managed by the user. In the example shown in FIG. 5, the list 6A is displayed on the left side of the site selection screen. In the example shown in FIG. 5, a first site and a second site are displayed in the list 6A. The user selects a construction site for which safety information is to be confirmed from the multiple sites displayed in the list 6A. A construction site is selected by pressing one of the multiple sites displayed in the list 6A. FIG. 5 shows an example in which the second site is selected. The site name 6B of the selected construction site is displayed at the top of the site selection screen. A map 6C and detailed information 6D of the selected construction site are displayed in the center of the site selection screen. After a construction site is selected, the selected construction site is confirmed by pressing the site selection button 6E.

[0042] Fig. 6 is a diagram showing a site map screen according to the embodiment. When the site selection button 6E is pressed to confirm the construction site for which safety information is to be confirmed, the display screen of the display device 33 transitions from the site selection screen shown in Fig. 5 to the site map screen shown in Fig. 6. The site map screen includes a map of the selected construction site (second site). The map may be an aerial photograph or a map showing the construction site from above.

[0043] A list of selection buttons 7 for selecting the display content of the display screen is displayed on the left side of the work site map screen. The selection buttons displayed in the list 7 include a map selection button 7A, a first danger area selection button 7B, a second danger area selection button 7C, a work machine selection button 7D, a worker selection button 7E, a work site equipment selection button 7F, and a camera selection button 7G.

[0044] A list of selection buttons 8 for selecting the display content of the display screen is also displayed at the bottom of the work site map screen. The selection buttons displayed in the list 8 include a map selection button 8A, a first danger area selection button 8B, a second danger area selection button 8C, a work machine selection button 8D, a worker selection button 8E, and a site equipment selection button 8F.

[0045] As shown in FIG. 6, when the map selection button 7A is pressed, a site map screen including a map of the construction site is displayed.

[0046] On the site map screen, a narrowing down button 9 is displayed to the right of the list 8, which is pressed to narrow down the content displayed on the display screen. A registration button 10 is displayed in the lower right corner of the site map screen, which is pressed to register a symbol. A heat map display selection button 11 is displayed in the upper right corner of the site map screen, which allows the user to select whether or not to display a heat map image. A map scale change button 12 is displayed on the right side of the site map screen.

[0047] The display data generation unit 23 generates display data including a map of the construction site and safety information. The display data generation unit 23 displays a safety information symbol 51 in a specific area of the construction site. The display data generation unit 23 generates the display data so that the symbol 51 is superimposed on the specific area of the construction site map.

[0048] FIG. 7 is a diagram showing a site map screen including a heat map image 13 according to an embodiment. When the need to display a heat map image is selected using the heat map display selection button 11, the heat map image 13 is superimposed on the construction site map as shown in FIG. 7. The heat map image 13 shows the relationship between each of the multiple areas on the construction site map and the level of risk. The heat map image 13 includes an element image 13A indicating that the number of times an object has been detected is equal to or greater than a first threshold, and an element image 13B indicating that the number of times an object has been detected is equal to or greater than a second threshold. The second threshold is greater than the first threshold. Each of the element images 13A and 13B is square. The element image 13A is displayed in yellow, for example. The element image 13B is displayed in red, for example. The display data generation unit 23 generates display data so that the heat map image 13 is superimposed on the construction site map.

[0049] The heat map image 13 described above is an example. The object detected to display the heat map image 13 may be a specific object. For example, the specific object may be another work machine working near the work machine 4, a worker working near the work machine 4, or an obstacle present at the construction site. Furthermore, element image 13A may be an image indicating that the distance between the work machine 4 and the object is less than a first distance. Element image 13B may be an image indicating that the distance between the work machine 4 and the object is less than a second distance. In this case, the second distance is smaller than the first distance. Furthermore, the shading of the heat map is not limited to two types, red and yellow. The heat map may be displayed in one color or three or more colors using one or three or more thresholds.

[0050] FIG. 8 is a diagram showing a site map screen including safety information and response information according to the embodiment. The display data generation unit 23 can generate display data including a map of the construction site, safety information, and response information. As shown in FIG. 8, the display data generation unit 23 can generate display data such that symbols 51 and 52 of the safety information are superimposed on the map of the construction site. The display data generation unit 23 can generate display data such that symbols 61 and 62 of the response information are superimposed on the map of the construction site. Each of the symbols 51 and 52 includes an icon. The design of the symbol 51 is different from the design of the symbol 52. Each of the symbols 61 and 62 includes an icon. The design of the symbol 61 is different from the design of the symbol 62.

[0051] As described above, the safety information generation unit 21 may determine the level of danger of a specific area based on the distance between the work machine 4 and an object. The first danger area is a specific area where the distance between the work machine 4 and the object is equal to or greater than the distance threshold. The second danger area is a specific area where the distance between the work machine 4 and the object is less than the distance threshold. The safety information includes first safety information indicating the first danger area and second safety information indicating the second danger area. Symbol 51 is a symbol indicating the first safety information. Symbol 52 is a symbol indicating the second safety information. The display data generation unit 23 superimposes and displays the symbol 51 on the first danger area. The display data generation unit 23 superimposes and displays the symbol 52 on the second danger area.

[0052] The response information indicates whether or not safety measures have been implemented. The response information indicates whether or not safety measures have actually been implemented in specific areas requiring safety measures. The response information may indicate whether or not safety devices such as safety fences or road cones (color cones (registered trademark)) have been installed around the specific area, whether or not the worker WM or the operator of the work machine 4 has been verbally warned to work safely, or whether or not the work procedures of the work machine 4 or the worker WM have been reviewed. The display data generation unit 23 displays a symbol 61 in specific areas where safety measures have not been implemented. The display data generation unit 23 displays a symbol 62 in specific areas where safety measures have been implemented. The symbol 61 is a symbol indicating that safety measures have not been implemented. The symbol 62 is a symbol indicating that safety measures have been implemented. As shown in FIG. 8 , the symbol 61 is displayed at least partially around the symbol 51 indicating a first danger area where safety measures have not been implemented. The symbol 61 is displayed at least partially around the symbol 52 indicating a second danger area where safety measures have not been implemented. A symbol 62 is displayed at least partially around the symbol 51 indicating the first danger area for which safety measures have been implemented. A symbol 62 is displayed at least partially around the symbol 52 indicating the second danger area for which safety measures have been implemented.

[0053] The display data generation unit 23 can also display, on the site map screen, a symbol 53 indicating the position of a work machine 4 working at the construction site, a symbol 54 indicating the position of a worker WM working at the construction site, and a symbol 55 indicating the position of field equipment other than the work machine 4. The position data of the work machine 4 is detected by the position sensor 42 and transmitted to the server 2. If the worker WM carries a portable device having a position sensor, the position data of the worker WM is detected by the portable device and transmitted to the server 2. Examples of the portable device include a smartphone or a wearable device. If a position sensor is attached to the field equipment, the position data of the field equipment is detected by the position sensor attached to the field equipment and transmitted to the server 2. The display data generation unit 23 can display the symbol 53 based on the position data of the work machine 4 transmitted from the position sensor 42 of the work machine 4. The display data generation unit 23 can display the symbol 54 based on the position data of the worker WM transmitted from the portable device. The display data generation unit 23 can display the symbol 55 based on the position data of the field equipment transmitted from the position sensor of the field equipment.

[0054] 9 is a diagram showing a manual registration screen for the symbol 51 or the symbol 52 according to the embodiment. The safety information generation unit 21 can generate safety information based on input data from the input device 32 that indicates a specific area of the construction site. The safety information generation unit 21 can register the symbol 51 or the symbol 52 based on the input data from the input device 32. The user can register the symbol 51 or the symbol 52 by operating the input device 32.

[0055] As shown in FIG. 9, the user can operate the input device 32 to determine the position where the symbol 51 or symbol 52 is to be placed. A pin 14 is displayed at the position determined by operating the input device 32. Once the position where the symbol 51 or symbol 52 is to be placed is determined, a registration screen 15 for manually registering the symbol 51 or symbol 52 is displayed as a pop-up. The registration screen 15 includes a first selection button 15A that is pressed when registering the symbol 51, a selection button 15B that is pressed when registering the symbol 52, a cancel button 15C that is pressed when canceling the registration process, and a registration screen transition button 15D that is pressed when continuing the registration process. FIG. 9 shows an example in which the first selection button 15A is pressed. After the first selection button 15A is pressed, the registration process continues by pressing the registration screen transition button 15D.

[0056] Fig. 10 is a diagram showing a manual registration screen for a symbol 51 according to the embodiment. When the first selection button 15A is pressed and then the registration screen transition button 15D is pressed, the display screen of the display device 33 transitions from the manual registration screen shown in Fig. 9 to the manual registration screen shown in Fig. 10. The manual registration screen shown in Fig. 10 includes a registration information input unit 16 having a plurality of input units. The registration information input unit 16 is an example of the input device 32. The user can input registration information related to the first dangerous area into the registration information input unit 16.

[0057] 10, the registration information that the user can input includes the title given to the specific area, response progress, registration date and time (occurrence date and time), response completion date and time, hazard type, hazard level, area of the specific area, characteristic type, related heavy equipment, reporter, and a photo of the specific area. Note that the registration information that the user can input may include some of the title given to the specific area, response progress, registration date and time (occurrence date and time), response completion date and time, hazard type, hazard level, area of the specific area, characteristic type, related heavy equipment, reporter, and a photo of the specific area, or may be other information.

[0058] When "not yet handled" is selected in the handling progress item, the symbol 61 is attached to the registered symbol 51. When "handling completed" is selected, the symbol 62 is attached to the registered symbol 51.

[0059] In the danger type field, selecting "Danger Area" inputs that the specific area is a danger area. Selecting "No Entry" inputs that the specific area is a no-entry area. Selecting "Danger Prediction" inputs that the specific area is a danger prediction area where a dangerous situation is predicted to occur.

[0060] In the danger level section, the user can select one danger level from three levels. Note that it is also possible to select one danger level from two levels, or one danger level from four or more levels. In the characteristic type section, the user can input the topographical or geological characteristics of the specific area. In the related heavy equipment section, the user can input whether or not there is a work machine 4 working in the specific area, and can input specific information about the work machine 4 working in the specific area.

[0061] 10 includes a cancel button 17A and a register button 17B. Pressing the cancel button 17A cancels the registration process. Pressing the register button 17B causes input data including the registration information input to the registration information input unit 16 to be sent to the server 2. The safety information generation unit 21 generates safety information to be linked to the symbol 51 based on the input data. The safety information linked to the symbol 51 is stored in the memory unit 24.

[0062] 9 is pressed, a manual registration screen for registering the symbol 52 is displayed. The manual registration screen for registering the symbol 52 is similar to the manual registration screen for registering the symbol 51. The safety information generation unit 21 generates safety information linked to the symbol 52 based on the input data related to the symbol 52. The safety information linked to the symbol 52 is stored in the storage unit 24.

[0063] FIG. 11 is a diagram showing a site map screen when a symbol 51 according to the embodiment is selected. On the site map screen, a plurality of symbols 51 are superimposed on a map of the construction site. A user can point to one symbol 51. The display data generating unit 23 can display detailed information related to safety information linked to the symbol 51A pointed to by the user on the display device 33. A user can point to one symbol 51A by pressing that symbol 51A. The pointed symbol 51A is highlighted in a color different from the other symbols 51.

[0064] When symbol 51A is pointed to, a list of safety information linked to each of the multiple symbols 51 is displayed on the left side of the site map screen. The safety information linked to symbol 51A is displayed larger than the safety information linked to the other symbols 51. The display data for the safety information linked to symbol 51A includes a details button 18. Input data generated when the details button 18 is pressed is transmitted to the server 2. The details button 18 is an example of an input device 32. The display data generation unit 23 generates display data including detailed information on the safety information linked to symbol 51A based on the input data from the details button 18 that points to symbol 51A.

[0065] Fig. 12 is a diagram showing a details confirmation screen according to the embodiment. When the details button 18 is pressed, the display screen of the display device 33 transitions from the site map screen shown in Fig. 11 to the details confirmation screen shown in Fig. 12. The details confirmation screen displays detailed information related to the safety information linked to the symbol 51A. The detailed information related to the safety information is stored in the storage unit 24. The display data generation unit 23 can generate display data including the detailed information.

[0066] The detailed information includes registered information 19 related to the safety information linked to the symbol 51A. Examples of the registered information 19 include the title assigned to the specific area, response progress, registration date and time (occurrence date and time), response completion date and time, hazard type, hazard level, feature type, related heavy machinery, reporter, and a photo of the specific area, as described with reference to FIG. 10 . The detail confirmation screen also includes an input section 71 for detailed information related to safety measures. A user can input detailed information related to the safety measures into the input section 71. The input section 71 includes an action input section 71A for inputting the details of the response action related to the safety measures, and a memo input section 71B for inputting memos related to the safety measures. An edit button 72 is also displayed in the upper right corner of the detail confirmation screen. A user can change the safety information linked to the symbol 51A by pressing the edit button 72.

[0067] Fig. 13 is a diagram showing a detail editing screen according to the embodiment. When the edit button 72 is pressed, the display screen of the display device 33 transitions from the detail confirmation screen shown in Fig. 12 to the detail editing screen shown in Fig. 13. The detail editing screen shown in Fig. 13 includes an editing information input unit 73 having multiple input units. The editing information input unit 73 is an example of the input device 32. The user can input editing information to the editing information input unit 73 to change the safety information linked to the symbol 51A.

[0068] 10, the edited information that the user can input includes the title to be given to the specific area, response progress, registration date and time (occurrence date and time), response completion date and time, hazard type, hazard level, area requiring safety measures including the specific area, characteristic type, related heavy equipment, reporter, and a photo of the specific area. Note that the registration information that the user can input may include some of the title to be given to the specific area, response progress, registration date and time (occurrence date and time), response completion date and time, hazard type, hazard level, area of the specific area, characteristic type, related heavy equipment, reporter, and a photo of the specific area, or may be other information.

[0069] When "not yet handled" is selected in the handling progress item, a symbol 61 is attached to the edited symbol 51. When "handling completed" is selected, a symbol 62 is attached to the edited symbol 51.

[0070] 13 also includes a cancel button 74A and an update button 74B. Pressing the cancel button 74A cancels the editing process. Pressing the update button 74B sends the editing information input to the editing information input unit 73 to the server 2. The safety information generation unit 21 and the correspondence information generation unit 22 can update the safety information and correspondence information related to the symbol 51A stored in the memory unit 24 based on input data indicating the editing information from the editing information input unit 73. Pressing the delete button 75 displayed in the upper right corner of the detail editing screen deletes the safety information and correspondence information related to the symbol 51A.

[0071] 11, when symbol 52 is pressed, a details button 18 for symbol 52 is displayed. Pressing the details button 18 for symbol 52 displays a details confirmation screen for symbol 52. Pressing the edit button 72 displayed on the details confirmation screen for symbol 52 displays a details editing screen for symbol 52. When editing information is input to an editing information input unit 73 displayed on the details editing screen for symbol 52, the safety information and response information associated with symbol 52 stored in the memory unit 24 are updated.

[0072] FIG. 14 is a diagram illustrating a first dangerous area list screen according to the embodiment. For example, when the first dangerous area selection button 7B is pressed while the site map screen is displayed, the display screen of the display device 33 transitions from the site map screen to the first dangerous area list screen shown in FIG. 14. The first dangerous area list screen includes a list 76 of multiple first dangerous areas stored in the storage unit 24. The list 76 includes the registration date and time (occurrence date and time) of each of the multiple first dangerous areas, response information, title, type, risk level, response completion date, area, reporter, and management number. When one first dangerous area is selected from the list 76, a details confirmation screen such as that described with reference to FIG. 12 is displayed. An alert graph button 77 is displayed at the top of the first dangerous area list screen. A new registration button 78 is displayed in the upper right corner of the first dangerous area list screen. When the new registration button 78 is pressed, a manual registration screen such as that described with reference to FIG. 9 is displayed.

[0073] For example, when the second danger area selection button 7C is pressed while the site map screen is displayed, a second danger area list screen is displayed. The second danger area list screen includes a list of multiple second danger areas stored in the memory unit 24. As with the first danger area list screen, the second danger area list screen also displays an alert graph button 77 and a new registration button 78.

[0074] FIG. 15 is a diagram showing an alert graph screen according to the embodiment. When the alert graph button 77 is pressed, the display screen of the display device 33 transitions to the alert graph screen shown in FIG. 15. As described above, the safety information generator 21 determines the risk level of a specific area based on the number of times an object is detected by the camera 43. The alert graph is a graph showing the relationship between the date and time an object is detected and the number of times the object is detected. The alert graph screen shown in FIG. 15 is a graph showing the relationship between the date and time an object is detected in a second dangerous area and the number of times the object is detected. The alert graph screen includes a first alert graph 79 showing the relationship between the time period when an object was detected and the number of times the object was detected, and a second alert graph 80 showing the relationship between the day when the object was detected and the number of times the object was detected.

[0075] The alert graph screen may also display an alert graph showing the relationship between the date and time when an object is detected and the number of times the object is detected.

[0076] FIG. 16 is a diagram showing a site map screen including an overlapping symbol number 81 according to an embodiment. For example, symbols 51 may be crowded together on the site map screen due to factors such as the scale of the construction site map, the number of specific areas, and the relative distances between the specific areas. If multiple overlapping symbols 51 are displayed on the site map screen, it may be difficult for the user to view the site map screen. In an embodiment, when multiple overlapping symbols 51 are displayed, the display data generation unit 23 displays only one symbol 51 and displays an overlapping symbol number 81 indicating the number of overlapping symbols 51 on that symbol 51. Displaying the overlapping symbol number 81 prevents the user from having difficulty viewing the site map screen.

[0077] FIG. 17 is a diagram showing a site map screen including a narrowed-down symbol 51 according to an embodiment. When a selection button is pressed from among the multiple selection buttons displayed in the list 8, the symbols displayed on the site map screen are narrowed down. For example, on the site map screen described with reference to FIG. 16, when the first dangerous area selection button 8B is pressed, as shown in FIG. 17, symbol 51 is displayed, but symbols 52, 53, 54, and 55 are no longer displayed. Narrowing down the symbols displayed on the site map screen prevents the user from having difficulty viewing the site map screen. Furthermore, when the first dangerous area selection button 8B is pressed, a list 82 of first dangerous areas is displayed on the left side of the site map screen.

[0078] Figure 18 is a diagram showing a work site map screen including a narrowed-down symbol 53 according to the embodiment. As shown in Figure 18, when the work machine selection button 8D is pressed, the symbol 53 is displayed, but the symbols 51, 52, 54, and 55 are no longer displayed. Furthermore, when the work machine selection button 8D is pressed, a list 83 of the work machines 4 managed by the display system 1 is displayed on the left side of the work site map screen.

[0079] The same applies when the second hazardous area selection button 8C, the worker selection button 8E, and the field device selection button 8F are pressed.

[0080] Figure 19 is a diagram showing a work site map screen including a live camera button 84 according to the embodiment. When one work machine 4 is selected from the list 83 of work machines 4 described with reference to Figure 18, a live camera button 84 and a details button 85 for the selected work machine 4 are displayed as a pop-up, as shown in Figure 19. Pressing the details button 85 displays a details confirmation screen for the selected work machine 4. Pressing the live camera button 84 displays a live camera video screen.

[0081] Figure 20 is a diagram showing a live camera video screen according to the embodiment. When the live camera button 84 shown in Figure 19 is pressed, an image (video) captured by the camera 43 mounted on the selected work machine 4 is displayed on the live camera video screen, as shown in Figure 20. If the work machine 4 is equipped with multiple cameras 43, the video captured by each of the multiple cameras 43 is displayed on the live camera video screen. The user can check the situation around the work machine 4 by checking the live camera video screen.

[0082] Fig. 21 is a diagram showing a refined search screen according to the embodiment. For example, when the refine button 9 is pressed while the site map screen is displayed, the display screen of the display device 33 transitions from the site map screen to the refined search screen shown in Fig. 21. A search input unit 86 is displayed on the refined search screen. The search input unit 86 includes an input unit 86A for narrowing down the symbol registration date and time, and an input unit 86B for narrowing down the safety measure response status.

[0083] Also, a cancel button 87A, an execute button 87B, and a reset button 87C are displayed below the search input section 86. Pressing the cancel button 87A cancels the refined search process. Pressing the execute button 87B executes the refined search process. Pressing the reset button 87C resets the input data entered in the search input section 86.

[0084] 22 is a diagram showing a site map screen after the refined search process according to the embodiment. As shown in FIG. 22, when input data is entered into the search input section 86 and the execute button 87B is pressed, only symbols 51 of specific areas that match the refined search conditions entered into the search input section 86 are displayed on the site map screen.

[0085] [Computer System] FIG. 23 is a block diagram showing a computer system 1000 according to an embodiment. The server 2, the terminal controller 31, and the in-vehicle controller 41 each include a computer system 1000. The computer system 1000 includes a processor 1001 such as a central processing unit (CPU), a main memory 1002 including a nonvolatile memory such as a read-only memory (ROM) and a volatile memory such as a random access memory (RAM), a storage 1003, and an interface 1004 including an input / output circuit. The functions of the server 2, the terminal controller 31, and the in-vehicle controller 41 are stored in the storage 1003 as computer programs. The processor 1001 reads the computer programs from the storage 1003, loads them into the main memory 1002, and executes the above-described processes in accordance with the computer programs. The computer programs may be distributed to the computer system 1000 via a network.

[0086] According to the above-described embodiment, the computer program enables the computer system 1000 to acquire safety information indicating specific areas at a construction site that require safety measures and corresponding information indicating whether or not safety measures are in place, generate display data including a map of the construction site, the safety information, and the corresponding information, and display the display data on the display device 33.

[0087] [effect] As described above, the display system 1 includes a memory unit 24 that stores safety information indicating specific areas at a construction site where safety measures are required and corresponding information indicating whether or not the safety measures are being implemented, a display data generation unit 23 that generates display data including a map of the construction site, the safety information, and the corresponding information, and a terminal controller 31 that functions as a display control unit that displays the display data on a display device 33.

[0088] According to the embodiment, a user of the display system 1 can recognize specific areas at a construction site that require safety measures by checking the display data displayed on the display device 33. In addition, the user can recognize whether or not the safety measures have been implemented.

[0089] [Another embodiment] In the above-described embodiment, the external sensor that detects objects around the work machine 4 is the camera 43. The external sensor may be any sensor that can detect objects around the work machine 4 in a non-contact manner. The external sensor may be a radar sensor that detects objects by emitting radio waves and receiving the radio waves reflected by the object, or a laser sensor that detects objects by emitting laser light and receiving the laser light reflected by the object. The external sensor may also be a three-dimensional sensor such as a stereo camera or a laser range finder.

[0090] In the above-described embodiment, the work machine 4 is an excavator. The work machine 4 may be any work machine that has a work implement, and may be a bulldozer, a wheel loader, or a motor grader. The work machine 4 does not have to have a work implement. The work machine 4 may be any work machine that works at a construction site, and may be a dump truck.

[0091] In the above-described embodiment, the terminal controller 31 of the information terminal 3 may have some or all of the functions of the server 2. Some or all of the safety information generation unit 21, the correspondence information generation unit 22, the display data generation unit 23, and the storage unit 24 may be provided in the terminal controller 31 of the information terminal 3.

[0092] For example, the terminal controller 31 of the information terminal 3 may include a storage unit 24 that stores safety information indicating specific areas requiring safety measures at a construction site and corresponding information indicating whether or not safety measures are in place, a display data generation unit 23 that generates display data including a map of the construction site, the safety information, and the corresponding information, and a display control unit that displays the display data on the display device 33. When all of the functions of the server 2 are provided in the terminal controller 31 of the information terminal 3, the server 2 may be omitted.

[0093] The safety information generating unit 21, the correspondence information generating unit 22, the display data generating unit 23, the storage unit 24, and the display control unit may be provided in separate hardware (computer systems). [Explanation of symbols]

[0094] 1...Display system, 2...Server, 3...Information terminal, 4...Work machine, 4A...Traveling body, 4B...Rotating body, 4C...Work machine, 5A...Input section, 5B...Input section, 5C...Login button, 6A...List, 6B...Site name, 6C...Map, 6D...Detailed information, 6E...Site selection button, 7...List, 7A...Map selection button, 7B...First danger area selection button, 7C...Second danger area selection button, 7D...Work machine selection button, 7E...Worker selection button, 7F...Site equipment selection button, 7G...Camera selection button, 8...List, 8A...Map selection button, 8B...First danger area selection button, 8C...Second danger area selection button, 8D...Work machine selection button, 8E...Worker selection button, 8F...Site equipment selection button, 9...Refine button, 10...Register button , 11...heat map display selection button, 12...scale change button, 13...heat map image, 13A...element image, 13B...element image, 14...pin, 15...registration screen, 15A...first selection button, 15B...selection button, 15C...cancel button, 15D...registration screen transition button, 16...registration information input section, 17A...cancel button, 17B...registration button, 18...details button, 19...registration information, 21...safety information generation section, 22...correspondence information generation section, 23...display data generation section, 24...memory section, 31...terminal controller, 32...input device, 33...display device, 41...on-board controller, 42...position sensor, 43...camera, 51...symbol, 51A...symbol, 52...symbol, 53...symbol, 54...symbol, 55...symbol, 61...symbol, 62...symbol, 71...input section, 71A...action input section, 71B...memo input section, 72...edit button, 73...edit information input section, 74A...cancel button, 74B...update button, 75...delete button, 76...list, 77...alert graph button, 78...new registration button, 79...first alert graph, 80...second alert graph, 81...number of duplicate symbols, 82...list, 83...list, 84...live camera button, 85...details button, 86...search input section, 86A...input section, 86B...input section, 87A...cancel button, 87B...execute button, 87C...reset button, 100...communication system, 1000...computer system, 1001...processor, 1002...main memory, 1003...storage, 1004...interface.

Claims

1. a storage unit that stores safety information indicating specific areas requiring safety measures at a construction site and corresponding information indicating whether or not the safety measures are being implemented; a display data generating unit that generates display data including a map of the construction site, the safety information, and the response information; a display control unit that displays the display data on a display device, Display system.

2. the display data generation unit generates the display data such that the safety information symbol and the corresponding information symbol are superimposed on the map. The display system of claim 1 .

3. the storage unit stores detailed information related to the safety information; the display data includes the detailed information, The display system of claim 2 .

4. the display data generation unit generates display data including the detailed information based on input data from an input device that indicates a symbol of the safety information. The display system of claim 3 .

5. A work machine is operated at the construction site, The work machine has a position sensor that detects a position of the work machine and an external sensor that detects objects around the work machine, a safety information generation unit that generates the safety information based on the detection data of the position sensor and the detection data of the external sensor; The storage unit stores the safety information generated by the safety information generation unit. The display system of claim 1 .

6. the specific area includes the position of the work machine when the object is detected; The display system of claim 5 .

7. the safety information generation unit determines a risk level of the specific area based on the number of times the object is detected; The safety information includes the risk level. The display system of claim 6.

8. the display data generation unit generates the display data so that a heat map image showing a relationship between each of the plurality of specific areas and the risk level is superimposed on the map. The display system of claim 7.

9. The specific area of the first danger level is a specific area in which the number of times the object has been detected is less than a frequency threshold, The specific area of the second risk level is a specific area in which the number of times the object has been detected is equal to or greater than a frequency threshold. The display system of claim 7.

10. the safety information generation unit determines a degree of danger for the specific area based on a distance between the work machine and the object; The safety information includes the risk level. The display system of claim 6.

11. the display data generation unit generates display data such that the safety information symbol and the corresponding information symbol are superimposed on the map; the safety information includes first safety information indicating a specific area of a first risk level and second safety information indicating a specific area of a second risk level; The symbols include a first symbol indicating the first safety information and a second symbol indicating the second safety information. The display system of claim 10.

12. the specific area of the first risk level is an area where the distance between the work machine and the object is equal to or greater than a distance threshold; the specific area of the second risk level is an area where the distance between the work machine and the object is less than a distance threshold. The display system of claim 11.

13. The specific area of the first risk level is an area where a dangerous situation is predicted to occur, The specific area with the second risk level is an area where a dangerous situation has occurred. The display system of claim 11.

14. a safety information generating unit that generates the safety information based on input data from an input device that indicates the specific area; The storage unit stores the safety information generated by the safety information generation unit. The display system of claim 1 .

15. a response information generation unit that generates the response information based on input data from an input device that indicates whether or not the safety measure has been implemented; the storage unit stores the correspondence information generated by the correspondence information generation unit; The display system of claim 1 .

16. a storage unit that stores safety information indicating specific areas requiring safety measures at a construction site and corresponding information indicating whether or not the safety measures are being implemented; a display data generating unit that generates display data including a map of the construction site, the safety information, and the response information; a display control unit that displays the display data on a display device, Information terminal.

17. Acquiring safety information indicating specific areas requiring safety measures at the construction site and corresponding information indicating whether or not the safety measures are being implemented; generating display data including a map of the construction site, the safety information, and the response information; and displaying the display data on a display device. Display method.

Images