Road maintenance support system, image processing server, information and communication terminal, and image processing method

The road maintenance support system addresses gaps in real-time data acquisition by using an information and communication terminal and image processing server to superimpose and transmit location and work status information on maps, improving operational efficiency in road maintenance tasks.

JP2026074654APending Publication Date: 2026-05-07AERO ASAHI CORPORATION +2
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
AERO ASAHI CORPORATION
Filing Date
2024-10-21
Publication Date
2026-05-07

AI Technical Summary

Technical Problem

Existing road maintenance systems require dedicated centralized operators and operation command operators, leading to gaps in acquiring real-time information on work status and position for tasks that do not involve these operators, especially for vehicles without such systems.

Method used

A road maintenance support system comprising an information and communication terminal and an image processing server that acquires and superimposes location and work status information on a map, enabling real-time data transmission and display for vehicles performing road maintenance tasks.

Benefits of technology

Enables real-time tracking and monitoring of road maintenance operations, facilitating easy grasp of vehicle locations and work statuses, thereby enhancing operational efficiency and information availability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026074654000001_ABST
    Figure 2026074654000001_ABST
Patent Text Reader

Abstract

This system provides road maintenance support, which is suitable for assisting with road environment maintenance and management tasks, including manual labor. [Solution] The image processing server constituting the system is communicatively connected to an information and communication terminal and a communication terminal corresponding to a work vehicle for performing predetermined tasks related to road maintenance, and includes a data communication processing unit 61 that acquires location information of the work vehicle and work status information relating to the work status of the predetermined task corresponding to the location information from the information and communication terminal, a map information acquisition unit 63 that acquires map information, and a video playback processing unit 66 that generates a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on a road on a map, and a second image which is an image in which information relating to the current work status of the work vehicle is superimposed on the first image. The data communication processing unit 61 also transmits the image data of the image generated by the video playback processing unit 66 to the communication terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0006] , ,

[0005] , , , ,

[0001] The present invention relates to a road maintenance management business support system, an image processing server, an information communication terminal, and an image processing method.

Background Art

[0002] Conventionally, when inspecting road structures including road structures related to the road surface and attached structures installed around the road surface, an inspector has confirmed an image captured by a camera or the like mounted on an inspection vehicle.

[0003] Patent Document 1 discloses a technique in which an operation command operator mounted on each of different road maintenance work vehicles such as a light snow plow vehicle, a wet salt spraying vehicle, a watering vehicle, and a marking device is controlled by a centralized operator wirelessly connected to the operation command operator, and this single centralized operator issues an operation command corresponding to an individual work process of each work vehicle.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technique described in Patent Document 1, a dedicated centralized operator and an operation command operator corresponding to this centralized operator are required, and the centralized operator acquires information on the work situation by controlling the in-vehicle operation command operator. In addition, work for maintaining and managing the road environment includes work performed manually, and work vehicles include vehicles not equipped with an operation command operator. Therefore, for work that does not require operation of the operation command operator, there is a risk that information on the work situation, position information during work, etc. cannot be obtained.

[0006] The present invention was devised in view of the above-mentioned prior art, and aims to provide a road maintenance support system, an image processing server, an information and communication terminal, and a road maintenance support method that are suitable for acquiring real-time information on the work status during work, in order to support road maintenance and management work, including work performed manually. [Means for solving the problem]

[0007] To solve the above-mentioned problems, a road maintenance support system according to one aspect of the present invention is a road maintenance support system comprising: an information and communication terminal corresponding to a work vehicle for performing predetermined work related to the maintenance or management of the road environment of an expressway; a communication terminal; and an image processing server that is communicatively connected to the information and communication terminal and the communication terminal via a communication line. The image processing server comprises: a first work information acquisition means for acquiring location information of the work vehicle and work status information relating to the work status of the predetermined work corresponding to the location information from the information and communication terminal; a map information acquisition means for acquiring map information; an image generation processing means for generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map and a second image which is an image in which information relating to the current work status of the work vehicle is superimposed on the first image; and an image data transmission means for transmitting image data of the image generated by the image generation processing means to the communication terminal. The information communication terminal is a portable terminal that can be carried by the occupant of the work vehicle, and comprises: location information acquisition means for acquiring location information of the terminal itself; input means for the occupant to input information; second work information acquisition means for acquiring work status information based on the input information input via the input means; and information transmission means for transmitting the location information acquired by the location information acquisition means and the work status information acquired by the second work information acquisition means to the image processing server. The communication terminal also comprises image display means for displaying an image based on the image data from the image processing server.

[0008] In this configuration, the occupants of the work vehicle can transmit information indicating the work status, such as the start of travel from the base, the start of work at the site, the status of the work site, and the completion of work, as well as time information and location information, in real time to the image processing server via an information and communication terminal. The image processing server can then generate an image on a map showing the current location of the work vehicle and information indicating the work status at the current location, or an image superimposed on the map, based on the data received in real time, and transmit the image data of the generated image to the communication terminal. The communication terminal can then receive the image data from the image processing server and display this image data, making it easy to grasp the real-time location of the work vehicle and the real-time work status at the site.

[0009] On the other hand, in order to solve the above-mentioned problems, an image processing server according to one aspect of the present invention is an image processing server that is communicably connected to an information and communication terminal via a communication line, and includes: an information and communication terminal corresponding to a work vehicle for performing predetermined work related to the maintenance or management of the road environment of an expressway; a work information acquisition means for acquiring location information of the work vehicle and work status information relating to the work status of the predetermined work corresponding to the location information from the information and communication terminal; a map information acquisition means for acquiring map information; an image generation processing means for generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map and a second image which is an image superimposed on the first image containing information relating to the current work status of the work vehicle; and an image data transmission means for transmitting image data of the image generated by the image generation processing means to the communication terminal. With this configuration, the same level of functionality and effectiveness as the image processing server of the road maintenance support system described above can be achieved.

[0010] Furthermore, in order to solve the above-mentioned problems, an information communication terminal according to one aspect of the present invention is an information communication terminal corresponding to a work vehicle for performing predetermined work related to the maintenance or management of the road environment of an expressway, and is a portable terminal that can be carried by the occupant of the work vehicle, and is connected to an image processing server via a communication line, and comprises: location information acquisition means for acquiring location information of the terminal itself; input means for the occupant to input information; work information acquisition means for acquiring work status information related to the work status of the predetermined work based on the input information input via the input means; and information transmission means for transmitting the location information acquired by the location information acquisition means and the work status information acquired by the work information acquisition means to the image processing server. With this configuration, the same level of work and effectiveness can be achieved as with the information and communication terminal of the road maintenance support system described above.

[0011] Furthermore, in order to solve the above-mentioned problems, an image processing method according to one aspect of the present invention is an image processing method for an information and communication terminal corresponding to a work vehicle for performing predetermined work related to the maintenance or management of the road environment of a highway, and an image processing server that is communicatively connected to the communication terminal via a communication line, comprising the steps of acquiring location information of the work vehicle and work status information relating to the work status of the predetermined work corresponding to the location information from the information and communication terminal,

[0012] The system includes the steps of: acquiring map information; generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map; generating a second image in which information regarding the current work status of the work vehicle is superimposed on the first image; and transmitting the image data of the generated images to the communication terminal. With this configuration, the same level of effectiveness as the image processing server of the road maintenance support system described above can be achieved. [Effects of the Invention]

[0013] According to the present invention, when assisting in operations related to the maintenance and management of road environments including manually performed operations, information indicating the real-time working state during operations can be obtained, so that real-time position information and working states can be easily grasped.

Brief Description of the Drawings

[0014] [Figure 1] It is a block diagram showing a configuration example of a road maintenance management operation support system according to the first embodiment. [Figure 2] It is a diagram showing an example of the hardware configuration of the image processing server 100. [Figure 3] It is a block diagram showing an example of the functional configuration of the image processing server 100. [Figure 4] It is a flowchart showing vehicle information display processing. [Figure 5] It is a diagram showing an example of the main screen of the system. [Figure 6] It is a diagram showing an example of the main screen after display switching. [Figure 7] It is a flowchart showing video playback processing. [Figure 8] It is a diagram showing an example of a screen when the video captured by the traffic PC 103 is played back on the main screen. [Figure 9] It is a diagram showing an example of a screen when the video captured by the wearable camera 300 is played back on the main screen. [Figure 10] It is a flowchart showing road temperature information display processing. [Figure 11] It is a diagram showing an example of a screen in which the road temperature measurement part of the highway image on the main screen is color-coded and displayed. [Figure 12] It is a diagram showing an example of a screen when the measured values of road temperature for each kilometer post in the specified time range of the selected route are graphically displayed. [Figure 13] It is a flowchart showing snow and freezing response vehicle monitoring processing. [Figure 14] It is a diagram showing an example of a screen for monitoring snow and freezing response vehicles corresponding to brine spraying processing. [Figure 15] (a) to (e) are diagrams showing examples of the display of icons and summary information during movement and work, which are displayed for each type of snow and freeze response vehicle. [Figure 16] It is a flowchart showing the snow and freeze patrol report display process. [Figure 17] It is a diagram showing an example of the display screen of the snow and freeze patrol report. [Figure 18] It is a diagram showing an example of the detailed display screen of the snow and freeze patrol report. [Figure 19] It is a flowchart showing the snow and freeze patrol report list display process. [Figure 20] It is a diagram showing an example of the list display screen of the snow and freeze patrol report. [Figure 21] It is a flowchart showing the brine plant inventory status display process. [Figure 22] It is a diagram showing an example of the display of the brine plant inventory status. [Figure 23] It is a flowchart showing the brine plant inventory status list display process. [Figure 24] It is a diagram showing an example of the list display screen of the brine plant inventory status. [Figure 25] It is a flowchart showing the snow and freeze response work report support process. [Figure 26] (a) to (c) are diagrams showing an example of an operation screen when reporting the working status of the anti-freezing work. [Figure 27] (a) to (b) are diagrams showing an example of an operation screen when reporting the working status of the anti-freezing work. [Figure 28] (a) to (b) are diagrams showing an example of an operation screen when reporting the working status of the anti-freezing work. [Figure 29] (a) to (d) are diagrams showing an example of an operation screen for setting the work type in each work other than the anti-freezing work. [Figure 30] (a) to (c) are diagrams showing an example of an operation screen when reporting the inventory quantity of the brine plant. [Figure 31]Figures (a) to (d) show examples of the operation screen used when reporting the work status and reporting items for snow and ice patrol work. [Figure 32] Figures (a) to (c) show examples of the operation screen used when reporting the work status and reporting items for snow and ice patrol work. [Figure 33] This figure shows an example of the operation screen used when reporting the work status and reporting items for snow and ice patrol work. [Figure 34] This is a block diagram showing an example configuration of a road maintenance support system according to the second embodiment. [Figure 35] Figure 34 is a block diagram showing an example of the functional configuration of the image processing server 100A. [Figure 36] This is a flowchart showing the process for displaying cleaning work information. [Figure 37] This figure shows an example of the cleaning management screen when real-time mode is selected. [Figure 38] This figure shows an example of the cleaning management screen when report mode is selected. [Figure 39] (a) is a diagram showing an example of display processing in real-time display mode, and (b) is a diagram showing an example of display processing in report display mode. [Figure 40] This figure shows an example of a print preview screen. [Figure 41] This figure shows an example of a cleaning management screen with photo icons displayed. [Figure 42] This is a flowchart showing the cleaning work report support process. [Figure 43] Figures (a) to (c) show examples of operation screens used when reporting the status of cleaning work. [Figure 44] (a) and (b) are diagrams showing examples of operation screens used when reporting the status of cleaning work. [Figure 45] Figures (a) to (c) show examples of operation screens used when reporting the status of cleaning work. [Figure 46] (a) and (b) are diagrams showing examples of operation screens used when reporting the status of cleaning work. [Figure 47] This figure shows an example of an operation screen used to report the status of cleaning work. [Modes for carrying out the invention]

[0015] The embodiments for carrying out the present invention will be described in detail below with reference to the attached drawings. The embodiments described below are merely examples of means for realizing the present invention and should be modified or changed as appropriate depending on the configuration of the apparatus to which the present invention is applied and various conditions. The present invention is not limited to the embodiments described below. Furthermore, in the drawings below, identical or similar parts are denoted by the same or similar reference numerals. However, it should be noted that the drawings are schematic and conceptual, and the vertical and horizontal dimensions and scale of the members or parts may differ from those of actual parts. Therefore, specific dimensions and scales should be determined by referring to the following explanation. It should also be noted that there are parts where the dimensional relationships and ratios differ between drawings. [First Embodiment] A first embodiment of the present invention will be described with reference to the drawings. Figures 1 to 33 show the first embodiment. 〔composition〕

[0016] Figure 1 is a block diagram showing an example configuration of a road maintenance support system according to the first embodiment. The road maintenance support system is a system that supports predetermined tasks related to maintaining or managing the road environment by work vehicles and their occupants in the operation of maintaining or managing the road environment of expressways.

[0017] As shown in Figure 1, the network 120 is connected to an image processing server 100 under the management of the system administrator, a communication terminal 102 used by system users, and a base station 130. In addition, a traffic patrol car 103 (hereinafter referred to as "traffic PC 103") equipped with a wireless communication device (not shown), a portable information and communication terminal 200 (hereinafter referred to as "portable communication terminal 200"), and a wearable camera 300 are connected via the base station 130.

[0018] The image processing server 100 can be configured, for example, from a cloud server. The cloud server is a server that provides cloud computing services and is composed of virtual servers. Furthermore, although not shown in the diagram, a database server for RDS (Relational Database Service) provided by the cloud server is connected to the network 120.

[0019] The communication terminal 102 consists of a terminal having the same configuration as the image processing server 100, or a terminal having the same functionality as a mobile phone such as a smartphone or tablet. The communication terminal 102 is configured to communicate with the image processing server 100 and the mobile communication terminal 200 via the network 120 and the base station 130.

[0020] As shown in Figure 1, the work vehicles include a traffic PC 103 that patrols expressways, measuring data such as road surface temperature using various on-board sensors, and taking moving images (videos) of the road and its surroundings using on-board cameras. Furthermore, the vehicles include a work vehicle 104 that performs work to prevent road freezing and snow / freeze patrols, a work vehicle 105 that melts snow accumulated on roads, a work vehicle 106 that removes snow from roads, a work vehicle 107 that clears snow from roads, and a work vehicle 108 that controls traffic.

[0021] In Figure 1, for visual identification purposes, work vehicle 104 is depicted as a water sprinkler, work vehicle 105 as a dump truck, work vehicle 106 as a bulldozer, work vehicle 107 as an excavator, and work vehicle 108 as a sign vehicle. However, various types of vehicles are used for each type of work, and are not limited to those shown in these illustrations. This also applies to the display of icons on the map image that follows.

[0022] Network 120 may be the Internet, a WAN (Wide Area Network), a LAN (Local Area Network) such as Ethernet (registered trademark) or Wi-Fi, or a mixture of the Internet, WAN, and LAN.

[0023] Base station 130 is a well-known mobile phone base station and communicates wirelessly with mobile communication terminals 200 and wireless communication devices mounted on work vehicles located within its assigned communication area (cell). It has the function of wirelessly transmitting packet data received via network 120 to the corresponding mobile communication terminals 200 and wireless communication devices within the area. Furthermore, it has the function of transmitting packet data received from mobile communication terminals 200 and wireless communication devices within the area to external devices such as image processing servers 100 via network 120.

[0024] The mobile communication terminal 200 mainly consists of mobile phones such as smartphones, tablets with functions equivalent to mobile phones, and notebook PCs (Personal Computers). The mobile communication terminal 200 is a portable terminal that has functions for receiving data transmitted from the image processing server 100, transmitting data to the image processing server 100, positioning to measure the terminal's location, inputting information, and displaying received and inputted information. The mobile communication terminal 200 also has a camera function for taking pictures. Furthermore, the mobile communication terminal 200 is carried by each occupant of the work vehicles 104 to 108 and moves along with the work vehicles.

[0025] Here, the positioning function consists of the mobile communication terminal 200 having, for example, GPS (Global Positioning System) functionality and acquiring location information using GPS functionality. The information input and display functions consist of, for example, a touch panel. The wireless data transmission and reception function consists of long-distance wireless communication functionality via a known mobile phone base station 130.

[0026] The wearable camera 300 (hereinafter referred to as "W Camera 300") is a portable camera with wireless communication capabilities equivalent to those of a mobile phone. The W Camera 300 can be used, for example, attached to a worker's helmet or worn around the neck with a strap. The W Camera 300 can also be carried by the occupants of traffic control PC 103 or work vehicles 104-108 and used when traveling with these vehicles. Here, in-vehicle cameras capture images at a predetermined angle and direction, limiting their shooting range. On the other hand, the W Camera 300 allows workers to take pictures outside the vehicle, supplementing areas that cannot be captured by in-vehicle cameras. Next, the hardware configuration of the image processing server 100 will be described based on Figure 2. Figure 2 shows an example of the hardware configuration of the image processing server 100.

[0027] As shown in Figure 2, the image processing server 100 consists of a CPU (Central Processing Unit) 30 that controls calculations and the entire system based on a control program, a ROM (Read Only Memory) 32 that stores the control program for the CPU 30 in a predetermined area, a RAM (Random Access Memory) 34 for storing data read from the ROM 32 and other memory, as well as calculation results necessary for the calculation process of the CPU 30, and an I / F (interface) 38 that mediates data input and output to external devices. These components are connected to each other and enable data exchange via a bus 39, which is a signal line for data transfer.

[0028] I / F38 is connected to external devices including an input device 50 consisting of a keyboard and mouse that can input data as a human interface, a storage device 52 that stores data and tables as files, a display device 54 that displays a screen based on an image signal, and a communication device 56 for data communication with a communication terminal 102, a traffic PC 103, a mobile communication terminal 200, a dual camera 300, etc. via a network 120.

[0029] Furthermore, the communication terminal 102 consists of either a stationary terminal like the image processing server 100 described above, or a portable terminal such as a notebook PC, smartphone, or tablet. Similar to the image processing server 100, the communication terminal 102 is equipped with a communication device that enables communication with the image processing server 100 via the network 120. Next, the functional configuration of the image processing server 100 will be explained based on Figure 3. Figure 3 is a block diagram showing an example of the functional configuration of the image processing server 100.

[0030] The image processing server 100 is a functional component realized by the CPU 30 executing a program. As a functional component, the image processing server 100 includes a data communication processing unit 61, a vehicle information display processing unit 62, a map information acquisition unit 63, and a road surface temperature information processing unit 64, as shown in Figure 3. In addition, it includes a video data processing unit 65, a video playback processing unit 66, a snow / freeze-resistant vehicle monitoring processing unit 67, a snow / freeze-resistant patrol report processing unit 68, a saltwater plant inventory status processing unit 69, and a snow / freeze-resistant work management unit 70.

[0031] Here, access to the image processing server 100 is managed by a login ID and password, and the content of the services provided by the image processing server 100 differs depending on the access rights set in the login ID and password. Specifically, the administrator of the communication terminal 102 is, for example, an employee of the headquarters of a company that manages expressways, and because they are in a position to manage road maintenance operations, they have virtually unlimited access rights. On the other hand, employees who perform work to maintain the road environment of expressways, or employees of subcontracting companies, are engaged in specific tasks, so their access rights are often restricted, for example, they are only permitted access to services for specific tasks of specific applications.

[0032] The data communication processing unit 61 has the function of transmitting data instructed to be transmitted from each component to external devices such as the communication terminal 102, traffic PC 103, and mobile communication terminal 200 via the network 120 and base station 130. Furthermore, it has the function of receiving data sent from external devices such as the communication terminal 102, traffic PC 103, and mobile communication terminal 200 via the base station 130 and network 120. In addition, the data communication processing unit 61 has the function of outputting the received data to the corresponding component.

[0033] The vehicle information display processing unit 62 acquires location information from the traffic PC 103 and location information from the mobile communication terminals 200 carried by the occupants of the work vehicles 104-108 via the data communication processing unit 61. Here, the location information from each mobile communication terminal 200 is treated as the location information of the work vehicles 104-108. Furthermore, the map information acquisition unit 63 acquires the highway map information stored in the storage device 52 from the storage device 52. Then, based on the acquired map information and the location information of each vehicle, an image is generated in which a sign image (hereinafter referred to as "icon") that allows recognition and identification of each vehicle is superimposed at the location on the road on the map that corresponds to the acquired location information. Then, in response to a display request from the communication terminal 102 acquired via the data communication processing unit 61, the image data of the generated image is transmitted to the requesting communication terminal 102 via the data communication processing unit 61. The vehicle information display processing unit 62 also performs processing to switch the display form of the icons according to the display conditions from the communication terminal 102. In addition, an image is generated in which a list of management information for the work vehicles corresponding to the displayed icons is displayed on the same screen. Then, in response to a display request from the communication terminal 102 obtained via the data communication processing unit 61, the image data of the generated image is transmitted to the requesting communication terminal 102 via the data communication processing unit 61.

[0034] The map information acquisition unit 63 acquires map information (GIS data) of expressways from, for example, an external GIS (Geographic Information System) server via the data communication processing unit 61 and stores it in the storage device 52. Each component that performs processing using the map information uses the GIS data stored in the storage device 52 to overlay and display various information on the map. Note that the GIS data may be stored in a database server instead of the storage device 52, or some of the frequently used data may be stored in the storage device 52 and all of it, including other parts, may be stored in the database server.

[0035] The road surface temperature information processing unit 64 collects measurement data from first road surface temperature sensors (not shown) installed at predetermined intervals along the road over almost the entire length of the expressway, associating this data with information on the measurement location and measurement time, and generates first monitoring information for the road surface temperature. The measurement data from multiple first road surface temperature sensors is collected, for example, by a relay device installed along the roadside, and sent to the image processing server 100 via the relay device. The relay device is connected to the network 120 wirelessly or via a wired connection. The first monitoring information is information that allows users to view the road surface temperature associating it with road type, such as the route name, and location on the road. In the first embodiment, for example, the temperature change at predetermined intervals is calculated, and information on the temperature change can also be viewed.

[0036] The road surface temperature information processing unit 64 further collects measurement data from the second road surface temperature sensor (not shown) equipped on the traffic PC 103, associating it with measurement location information and measurement time information, and generates second monitoring information for the road surface temperature. Then, in response to a display request from the communication terminal 102 obtained via the data communication processing unit 61, it transmits the image data of the generated first monitoring information and second monitoring information to the requesting communication terminal 102 via the data communication processing unit 61. The first and second road surface temperature sensors can be composed of, for example, infrared temperature sensors. If infrared temperature sensors are used, it becomes possible to measure the road surface temperature while the vehicle is in motion.

[0037] Furthermore, the road surface temperature information processing unit 64 generates an image in which the distribution of road surface temperature is superimposed on a map of roads, color-coded, based on the measured road surface temperature corresponding to the time range specified by the communication terminal 102, as monitoring information. It also generates an image in which a graph of road surface temperature is displayed at predetermined distances (e.g., 1-kilometer posts) corresponding to the route and time range specified by the communication terminal 102 is displayed. In this first embodiment, the first monitoring information identifies roads that may be susceptible to freezing, and the identified roads are patrolled by the traffic PC103 while the road surface temperature is measured by the on-board second road temperature sensor.

[0038] The video data processing unit 65 collects video data (also called video data) captured by the traffic PC 103 and W camera 300, associating it with measurement location information and measurement time information. The collected video data can be stored, for example, in the storage device 52 for real-time display and in the database server for all of it. The video data may also be stored in the storage device 52 or the database server via communication, or in the storage device 52 via a portable storage medium such as a USB (Universal Serial Bus) memory. Here, the video data is data that includes location information and time information acquired by the traffic PC 103 and W camera 300.

[0039] Furthermore, video data captured by each traffic control PC103 and W camera 300 can be registered in a work table built on the storage device 52 and used for real-time playback processing. In addition, completed video data can be registered in a video data table built on the database server and used for playback processing of past video footage, etc.

[0040] The video playback processing unit 66 controls the playback processing of video data captured by the traffic PC 103 or W camera 300 on the communication terminal 102. Video playback processing is performed in response to playback requests sent from the communication terminal 102. Playback processing includes playing back video captured by the traffic PC 103 or W camera 300 currently in motion in near real time, and playing back previously captured video selected from candidates or a list.

[0041] In real-time playback processing, when an icon 103i or 300i displayed on the map image 403a is selected via an input device, a button to initiate playback appears, and playback is initiated by pressing this button. In other words, pressing the button triggers the transmission of the latest video data currently being captured to the requesting communication terminal 102. Based on the received video data, the communication terminal 102 plays the video on a pop-up screen via the installed video playback software.

[0042] Furthermore, the process of playing back past footage involves, for example, selecting a predetermined location on a map via an input device in the communication terminal 102 to display a list of past footage candidates for playback, and then playing back the past footage selected from this list. Alternatively, by pressing a display image indicating the shooting point at the top of the screen of the played back footage, a list of titles of past footage from that shooting point can be displayed, and any past footage can be selected from this list and played back. In other words, in both cases, the video data of the selected footage from the list is sent to the requesting communication terminal 102.

[0043] The snow and ice response vehicle monitoring processing unit 67 performs processing to monitor the work status of work vehicles 104 to 108 that perform snow and ice response work, which is work related to maintaining or managing the road environment against snow and ice on expressways. Specifically, the snow and ice response vehicle monitoring processing performs the following: generating an image on a map in which icons are displayed that allow the current location of all or selected work vehicles 104 to 108 to be confirmed; and generating an image in which the current work status is superimposed by selecting the displayed icons. Furthermore, in the process of generating the image in which icons are displayed, based on work status information corresponding to location information and time information transmitted from the mobile communication terminal 200, the processing performs the generation of images in which different types of icons are displayed depending on the work status, such as working, moving, or stopped.

[0044] The snow- and ice-resistant vehicle monitoring processing unit 67 acquires information on the number of repetitions of tasks performed repeatedly on the same road surface as work status information corresponding to each task transmitted from the mobile communication terminal 200. Furthermore, it records the driving trajectory based on the location information during the work in the storage device 52 or database server. In addition, based on the information on the number of repetitions and the driving trajectory, it processes to generate an image in which the road at the work site is color-coded according to the number of repetitions. The snow and ice-resistant vehicle monitoring processing unit 67 transmits the image data of the various images generated above to the requesting communication terminal 102.

[0045] The snow and ice patrol report processing unit 68 performs tasks such as creating patrol reports for snow and ice patrols conducted by the water sprayer 104, and controlling the display of the patrol reports. Snow and ice patrols are one of the snow and ice response operations, and are conducted when there is a risk of the road surface freezing based on road surface temperature measurements, for example. In snow and ice patrols, the crew of the water sprayer 104 carries a mobile communication terminal 200 and transmits work status information related to snow and ice patrol operations to the image processing server 100 via a snow and ice patrol service of the Web application described later.

[0046] The snow and ice patrol report processing unit 68 creates a snow and ice patrol report (hereinafter referred to as "snow and ice P report") based on the work status information from the mobile communication terminal 200. The created snow and ice P report is registered in the snow and ice P report table built on the database server and is used for displaying the snow and ice P report in response to display requests from the communication terminal 102.

[0047] The brine plant inventory status processing unit 69 displays the inventory status of brine and sodium chloride in the brine plant, which stores brine for de-icing operations and sodium chloride for producing brine, and also displays the changes in inventory status over time. Multiple brine plants are scattered along the highway and are used by the brine spraying truck 104. Notification of the inventory levels of the brine plant to the image processing server 100 is performed by a person equipped with a mobile communication terminal 200. Specifically, the inventory levels are sent to the image processing server 100 via the brine plant service of the web application described later. The brine plant inventory status processing unit 69 performs inventory status and displays its changes over time based on inventory quantity information transmitted from the mobile communication terminal 200.

[0048] The Snow and Icy Work Management Department 70 processes the mobile communication terminal 200 to provide services corresponding to each task through a web application that supports snow and icy work. Snow and icy work includes de-icing work to prevent road freezing, snow melting work to melt snow accumulated on roads, snow removal work to remove snow accumulated on roads, snow removal work to remove the removed snow to snow removal points located outside the highway, snow and icy patrol work, and work to notify the status of saltwater plant inventory.

[0049] The type of work is determined based on the login ID (account). A login information table is built on the database server, and the login ID is registered in association with the identification information of the type of work. Therefore, the type of work can be determined when logging in from the mobile communication terminal 200, and information on the web page that provides the service corresponding to the type of work can be displayed on the mobile communication terminal 200. Details of the services provided for each type of work will be described later. Furthermore, the control of the display process of various images generated by the image processing server 100 to the communication terminal 102 and the mobile communication terminal 200 is performed, for example, in cooperation with browser software installed on the communication terminal 102 and the mobile communication terminal 200. [Vehicle information display processing] Next, we will describe the vehicle information display process performed by the image processing server 100. Figure 4 is a flowchart showing the vehicle information display process, Figure 5 is an example of the system's main screen, and Figure 6 is an example of the main screen after the display has been switched. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the vehicle information display process shown in the flowchart of Figure 4 according to that program. When the vehicle information display process is executed on the CPU 30, it first proceeds to step S100, as shown in Figure 4.

[0050] In step S100, the vehicle information display processing unit 62 determines whether a vehicle type and status have been selected based on instructions from the communication terminal 102. If it is determined that a vehicle type and status have been selected (Yes), the process proceeds to step S102; otherwise, it proceeds to step S108.

[0051] After the user logs into the system from the communication terminal 102, the main screen 400 is displayed, as shown in Figure 5. The main screen 400 displays a menu selection field 401, a display condition setting field 402, a map image display field 403, a vehicle information display field 404, a display switching field 405, and a layer data display setting field 406.

[0052] In the example shown in Figure 5, the map image display area 403 displays the map image 403a and the highway image 403b (the darker colored road portion) within the map image 403a. Furthermore, icons for all vehicle types are superimposed near the location corresponding to the current position information of each vehicle on the highway image 403b. Each icon is displayed in a speech bubble, and the corner of the speech bubble points to the location of each vehicle on the highway image 403b (displayed as a dot on the highway image 403b). For the work vehicles 104 to 108 that are used for snow and ice countermeasures, only the icon 104s indicating that the water sprayer 104 is stopped is displayed. That is, if the end of the icon's code is i, it indicates that it is in motion, and if it is s, it indicates that it is stopped. In the first embodiment, the map image 403a is, for example, an image of the surrounding area including the Metropolitan Expressway, and the highway image 403b is an image of the Metropolitan Expressway. Additionally, a zoom button 403c, consisting of + and - buttons, is displayed in the upper left corner of the map image display area 403. Pressing the + button zooms in on the map image, and pressing the - button zooms out. The icons also zoom in and out in accordance with the zoom level.

[0053] The display conditions setting section 402 consists of a vehicle number input field 402a, a vehicle type selection field 402b, a status selection field 402c, and a search button 402d. The vehicle number input field 402a is where you enter the vehicle number of the specific vehicle you want to display. The vehicle type selection field 402b is where you select a vehicle type, such as traffic PC 103 or watering truck 104. In the vehicle type selection field 402b, pressing the triangle mark on the far right will display a dropdown list (not shown), which displays a list of vehicle types. By selecting the desired vehicle type from this list, you can set the vehicle type in the vehicle type selection field 402b. Note that vehicles such as liaison vehicle 111 and W camera 300 can also be selected. The status selection field 402c is where you select the status you want to display for the selected vehicle type. There are three status types: all, moving, and stopped. All indicates all states, including moving and stopped. In the status selection field 402c, clicking the triangle icon on the far right will display a dropdown list (not shown), and selecting the desired status from this list will set the status in the status selection field 402c. In other words, in step S100, the user selects the vehicle type and condition they want to display in the vehicle type selection field 402b and the condition selection field 402c, and then presses the search button 402d.

[0054] If the process proceeds to step S102, the vehicle information display processing unit 62 generates an image in which icons corresponding to the selected vehicle type and status are superimposed near the highway image 403b on the map image 403a corresponding to the vehicle's location information. The image data of the generated image is then sent to the communication terminal 102. After that, the process proceeds to step S104. That is, the display content of the icons on the main screen 400 displayed on the display device of the communication terminal 102 is switched to the selected content. In the example shown in Figure 6, the result is that traffic PC103 is selected as the vehicle type and "moving" is selected as the status. In this case, only the icon 103i of the moving traffic PC103 is displayed near the location corresponding to each location information on the highway image 403b on the map image 403a.

[0055] In step S104, the vehicle information display processing unit 62 generates an image in the vehicle information display field 404 showing a list of vehicle management information corresponding to the selected vehicle type and status. The generated image data is then sent to the communication terminal 102. After that, the series of processes ends and the process returns to the original state. As a result, the display device of the communication terminal 102 displays an image in the vehicle information display field 404 showing a list of vehicle management information corresponding to the selected vehicle type and status.

[0056] Here, as management information, for example, as shown in the vehicle information display section 404 in Figures 5 and 6, information such as the vehicle number, vehicle type, and status of each vehicle corresponding to the display icon is displayed. In addition, in the case of a water spraying truck 104 that performs salt spraying, information indicating the work status, such as the number of spraying operations, is displayed.

[0057] On the other hand, if the vehicle type and status are not selected in step S100 and the system proceeds to step S106, the vehicle information display processing unit 62 determines whether or not the vehicle number has been entered based on instructions from the communication terminal 102. If it is determined that the vehicle number has been entered (Yes), the system proceeds to step S108; otherwise, it proceeds to step S100.

[0058] If the process proceeds to step S108, the vehicle information display processing unit 62 generates an image in which the icon of the vehicle corresponding to the entered vehicle number is superimposed near the location corresponding to the vehicle's location information on the highway image 403b on the map image 403a. The image data of the generated image is then transmitted to the communication terminal 102. After that, the process proceeds to step S110. As a result, the display device of the communication terminal 102 displays an image in which the icon corresponding to the entered vehicle number is superimposed near the highway image 403b on the map image 403a.

[0059] In step S110, the vehicle information display processing unit 62 generates an image in the vehicle information display field 404 showing a list of management information for the vehicle corresponding to the entered vehicle number. The generated image data is then sent to the communication terminal 102. After that, the series of processes ends and the process returns to the original state. As a result, the display device of the communication terminal 102 displays an image in the vehicle information display field 404 showing the management information for the vehicle corresponding to the entered vehicle number.

[0060] As shown in Figures 5 and 6, the display switching section 405 allows you to switch only the status. For example, as illustrated in Figure 6, if you select "All" in the display switching section 405 while only the icons for moving vehicles are displayed, the icons for stopped vehicles will also be displayed. Furthermore, the layer data display settings section 406 consists of a time range specification section 406a, an update button 406b, a road temperature checkbox 406c, a parked vehicle checkbox 406d, and a snow / freeze related selection button 406e. Details of these will be described later. [Video playback processing] Next, we will describe the video playback process performed on the image processing server 100. Figure 7 is a flowchart showing the video playback process, Figure 8 is an example screen showing the playback of video captured by traffic PC 103 on the main screen, and Figure 9 is an example screen showing the playback of video captured by W camera 300 on the main screen. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the video playback process shown in the flowchart of Figure 7 according to that program. When the video playback process is executed on the CPU 30, it first proceeds to step S200, as shown in Figure 7.

[0061] In step S200, the video playback processing unit 66 determines whether the icon for the traffic PC 103 or the W camera 300 has been selected based on the instructions from the communication terminal 102. If it is determined that it has been selected (Yes), the process proceeds to step S202; otherwise, it proceeds to step S216. When playing video from the moving traffic PC103 or W camera300, an icon indicating that the vehicle is in motion is displayed near the location corresponding to the respective location information on the highway image 403b on the map image 403a, as illustrated in Figures 7 and 8.

[0062] If the process proceeds to step S202, the video playback processing unit 66 generates an image in which summary information is displayed near the icons of the traffic PC 103 or W camera 300 on the main screen 400 displayed on the display device of the communication terminal 102. The image data of the generated image is then sent to the communication terminal 102. After that, the process proceeds to step S204. As a result, the display device of the communication terminal 102 displays an image in which summary information is displayed near the icons of the traffic PC 103 or W camera 300.

[0063] Here, as shown in Figure 8, the overview information for the traffic PC 103 is displayed as overview information 103v on the map image 403a. In overview information 103v, the vehicle number, status, and vehicle type information are displayed in a speech bubble image extending from the selected icon, and below that, a video play button and a stop distribution button are displayed. Similarly, as shown in Figure 9, the overview information for the W camera 300 is displayed as overview information 300v on the map image 403a. In overview information 300v, the organization information, status, and vehicle type (W camera) information of the W camera 300 are displayed in a speech bubble image extending from the selected icon, and below that, a video play button and a stop distribution button are displayed.

[0064] In step S204, the video playback processing unit 66 determines whether or not the button to play the video has been pressed based on the instruction from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S206; otherwise, it proceeds to step S200.

[0065] If the process proceeds to step S206, the video playback processing unit 66 determines whether the number of videos currently being played is less than the maximum number of videos being played. If it determines that the number is less than the maximum number of videos being played (Yes), the process proceeds to step S208. Otherwise, it proceeds to step S214. In other words, the maximum number of videos that can be played simultaneously on the communication terminal 102 (for example, 4) is predetermined.

[0066] If the process proceeds to step S208, the video playback processing unit 66 starts the process of sending the video data being recorded by the vehicle with the selected icon to the communication terminal 102, and then proceeds to step S210. That is, the video playback processing unit 66 sends the video data currently being recorded to the communication terminal 102 that made the request. The communication terminal 102 then streams the received video data to a display device, for example.

[0067] Here, for the video from traffic control PC 103, for example, as shown in Figure 8, the video playback screen 450C is displayed as a pop-up screen near the selected icon 103i. On the other hand, for the video from W camera 300, for example, as shown in Figure 9, the video playback screen 300w is displayed as a pop-up screen near the selected icon 300i. Note that the camera image displayed on icon 300i indicates that recording is currently being done by W camera 300.

[0068] In step S210, the video playback processing unit 66 determines, based on instructions from the communication terminal 102, whether the stop distribution button in the summary information or the × button in the upper right corner of the video playback screen has been pressed. If it is determined that the button has been pressed (Yes), the process proceeds to step S212; otherwise, the series of processes ends and the process returns to the original state.

[0069] If the process proceeds to step S212, the video playback processing unit 66 erases the corresponding video playback screen and subtracts 1 from the total number used to determine the number of simultaneous playbacks. After that, the series of processes ends and the process returns to the original state. That is, the process of sending the corresponding video data to the communication terminal 102 is stopped, and an instruction to end playback is sent.

[0070] On the other hand, if it is determined in step S206 that the number of simultaneous playbacks has exceeded the maximum number and the process proceeds to step S214, an image is generated with a message indicating that the upper limit of simultaneous playback has been reached displayed in a pop-up window or the like. The generated image data is then sent to the communication terminal 102, ending the series of processes and returning to the original process. As a result, a message such as "The upper limit of simultaneous playback has been exceeded" is displayed in a pop-up window on the display device of the communication terminal 102.

[0071] Furthermore, if no icon is selected in step S200 and the process proceeds to step S216, it is determined whether or not there is a video currently playing. If it is determined that there is a video currently playing (Yes), the process proceeds to step S210; otherwise, it proceeds to step S200. [Road temperature information display processing] Next, we will explain the road temperature information display process performed by the image processing server 100.

[0072] Figure 10 is a flowchart showing the road temperature information display process, and Figure 11 is an example screen showing the road temperature measurement area of ​​the highway image on the main screen in different colors. Figure 12 is an example screen showing a graph of the road temperature measurements for each kilometer post within a specified time range for the selected route. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the road temperature information display process shown in the flowchart of Figure 10 according to that program. When the road temperature information display processing is executed in the CPU 30, it first proceeds to step S300, as shown in Figure 10.

[0073] In step S300, the road surface temperature information processing unit 64 determines, based on instructions from the communication terminal 102, whether the road temperature checkbox 406c is checked in the layer data display setting section 406 of the main screen 400. If it is determined to be checked (Yes), the process proceeds to step S302; otherwise, the determination process is repeated until the road temperature checkbox 406c is checked.

[0074] If the process proceeds to step S302, the road surface temperature information processing unit 64 generates an image on the top of the main screen 400 displaying the road temperature contour scale 407. The generated image data is then sent to the communication terminal 102, and the process proceeds to step S304. As a result, the display device of the communication terminal 102 displays the image showing the road temperature contour scale 407.

[0075] Here, Scale 407, as shown in Figure 11, is a scale used to display road surface temperature using color coding, indicating the correspondence between road surface temperature ranges and colors. The numbers below Scale 407 represent road surface temperature, and the colors above the numbers correspond to each road surface temperature range. Lighter colors indicate lower temperatures, and darker colors indicate higher temperatures. Note that, for improved visibility, different colors may be used instead of the shades shown in the figure.

[0076] In step S304, the road surface temperature information processing unit 64 acquires the time range information entered in the time range specification field 406a of the layer data display setting field 406 based on instructions from the communication terminal 102. Then, the process proceeds to step S306. In the example shown in Figure 11, the time range from 1 hour ago to the present is acquired.

[0077] In step S306, an image is generated on the highway image 403b within the map image 403a on the main screen 400, displaying road temperature information measured within a specified time range. The image data of the generated image is then transmitted to the communication terminal 102, and the process proceeds to step S308. As a result, the display device of the communication terminal 102 displays the image with the road temperature information.

[0078] Here, the display of road temperature information involves coloring the highway image 403b with a color corresponding to the measured road temperature, based on the measured road temperature and scale 407 measured within a specified time range, as shown in Figure 11. This allows for a visual understanding of the road surface temperature distribution 103t on the highway.

[0079] In step S308, the road surface temperature information processing unit 64 determines, based on instructions from the communication terminal 102, whether or not the update button 406b in the layer data display setting field 406 has been pressed. If it is determined that the button has been pressed (Yes), the process proceeds to step S304; otherwise, it proceeds to step S310. In other words, if the time range is re-entered on the communication terminal 102 and the update button 406b is pressed, the system acquires that time range and updates the road temperature information to be displayed.

[0080] If the process proceeds to step S310, the road surface temperature information processing unit 64 determines, based on instructions from the communication terminal 102, whether or not the road surface temperature check box 406c has been unchecked. If it is determined that it has been unchecked (Yes), the process proceeds to step S312; otherwise, it proceeds to step S314.

[0081] If the process proceeds to step S312, the road surface temperature information processing unit 64 performs a process to erase the road surface temperature information and scale 407 from the main screen 400, thereby ending the series of processes and returning to the original process. As a result, the display device of the communication terminal 102 displays an image of the main screen 400 with the scale 407 erased.

[0082] On the other hand, if the checkbox is not unchecked in step S310 and the process proceeds to step S314, the road surface temperature information processing unit 64 determines, based on instructions from the communication terminal 102, whether or not the "overall" button for selecting the overall menu in the menu selection field 401 has been pressed. If it is determined that the overall button has been pressed (Yes), the process proceeds to step S316; otherwise, it proceeds to step S308.

[0083] If the process proceeds to step S316, the road surface temperature information processing unit 64 generates an image in which the route road temperature information screen 408 is displayed as a pop-up superimposed on the main screen 400. The image data of the generated image is then transmitted to the communication terminal 102, and the process proceeds to step S318. As a result, the route road temperature information screen 408 is displayed as a pop-up on the display device of the communication terminal 102.

[0084] Here, the route road temperature information screen 408, as shown in Figure 12, for example, has a selection field for the route name, a selection field for the direction (up / down), an input field for the time range, a search button, a button for setting the zoom level, and to the right of this button, a simplified diagram of the selected route and the location of the kilometer posts are displayed. In addition, below the simplified diagram, a graph of road temperature information for each kilometer post is displayed. In other words, more detailed road temperature information for any route can be checked on the route road temperature information screen 408.

[0085] In step S318, the road surface temperature information processing unit 64 determines whether the search button has been pressed based on the instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S320; otherwise, it proceeds to step S324. If the process proceeds to step S320, the road surface temperature information processing unit 64 acquires the route, direction, and set time range, and then proceeds to step S322.

[0086] In step S322, the road surface temperature information processing unit 64 generates an image displaying a simplified diagram of the selected route and a graph of road surface temperature information for each kilometer post of the selected route. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S324. As a result, the display device of the communication terminal 102 displays an image displaying a simplified diagram of the selected route and a graph of road surface temperature information for each kilometer post of the selected route. In other words, on the route road temperature information screen 408, the communication terminal 102 can select the route name, select the direction of travel, input the time range, and then press the search button to check the road temperature information for the desired route.

[0087] In step S324, the road surface temperature information processing unit 64 determines whether the overall button has been pressed based on the instructions from the communication terminal 102. If it is determined that the overall button has been pressed (Yes), the process proceeds to step S326; otherwise, it proceeds to step S318.

[0088] If the process proceeds to step S326, the road surface temperature information processing unit 64 performs a process to clear the route road temperature information screen 408 and then proceeds to step S308. As a result, the display device of the communication terminal 102 displays an image of the main screen 400 with the route road temperature information screen 408 cleared. [Snow and ice-resistant vehicle monitoring process] Next, we will describe the snow- and ice-resistant vehicle monitoring process performed by the image processing server 100.

[0089] Figure 13 is a flowchart showing the monitoring process for snow-freezing vehicles, and Figure 14 is a diagram showing an example screen for monitoring snow-freezing vehicles in response to saltwater spraying. Figures 15(a) to (e) are diagrams showing examples of displays for icons indicating whether a vehicle is in transit or working, along with summary information, for each type of snow-freezing vehicle. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the snow- and ice-resistant vehicle monitoring process shown in the flowchart of Figure 13 according to that program. When the snow and ice-resistant vehicle monitoring process is executed on the CPU 30, it first proceeds to step S400, as shown in Figure 13.

[0090] In step S400, the snow-freezing vehicle monitoring processing unit 67 determines, based on instructions from the communication terminal 102, whether or not a box for snow-freezing related work has been checked from the snow-freezing work selection box group 406f. If it is determined that a box has been checked (Yes), the process proceeds to step S402; otherwise, the determination process is repeated until a box is checked. Here, as shown in Figure 14, when the snow / freeze related selection button 406e is pressed on the communication terminal 102, an image showing the snow / freeze response work selection box group 406f below it is displayed on the display device of the communication terminal 102.

[0091] If the process proceeds to step S402, the snow-freezing vehicle monitoring processing unit 67 determines, based on instructions from the communication terminal 102, whether or not one of the boxes for the anti-freezing work has been checked. If it is determined that it has been checked (Yes), the process proceeds to step S404; otherwise, it proceeds to step S406.

[0092] If the process proceeds to step S404, the snow / freeze-resistant vehicle monitoring processing unit 67 generates an image in which icons corresponding to each work vehicle 104 are displayed near the location corresponding to the location information of each work vehicle 104 on the highway image 403b on the map image 403a of the main screen 400. The generated image data is then sent to the communication terminal 102, and the process proceeds to step S422. Specifically, the snow and ice response vehicle monitoring processing unit 67 acquires location information and work status information from the mobile communication terminal 200 carried by the occupants of each work vehicle 104, from departure from the base station, through the work site, and back to the base station. Based on this acquired information, the snow and ice response vehicle monitoring processing unit 67 displays an icon of the type corresponding to the work status information at the location corresponding to the location information of each work vehicle 104. The location information of each work vehicle 104 is the location information of the mobile communication terminal 200 carried by the occupants of each work vehicle 104. The same applies to work vehicles 105 to 108. Furthermore, the snow and ice response vehicle monitoring processing unit 67 generates an image displaying the icon of a watering truck as an image displaying the icons of the work vehicles 104 corresponding to the work status of the de-icing work. That is, the display device of the communication terminal 102 displays an image displaying the icon of a watering truck.

[0093] On the other hand, if the process proceeds to step S406, the snow-freezing vehicle monitoring processing unit 67 determines whether one of the boxes for the snow-melting work has been checked based on the instructions from the communication terminal 102. If it is determined that one has been checked (Yes), the process proceeds to step S408; otherwise, it proceeds to step S410.

[0094] If the process proceeds to step S408, the snow-freezing vehicle monitoring processing unit 67 generates an image displaying a dump truck icon corresponding to the snow-melting work status, based on location information and work status information from the mobile communication terminal 200 held by the crew of the work vehicle 105. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S422. As a result, the display device of the communication terminal 102 displays an image displaying a dump truck icon.

[0095] Furthermore, if the process proceeds to step S410, the snow-freezing vehicle monitoring processing unit 67 determines whether the snow removal work box has been checked based on the instructions from the communication terminal 102. If it is determined that it has been checked (Yes), the process proceeds to step S412; otherwise, it proceeds to step S414.

[0096] If the process proceeds to step S412, the snow-freezing vehicle monitoring processing unit 67 generates an image displaying a bulldozer icon corresponding to the snow removal work status, based on location information and work status information from the mobile communication terminal 200 held by the crew of the work vehicle 106. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S422. As a result, the display device of the communication terminal 102 displays an image displaying a bulldozer icon.

[0097] Furthermore, if the process proceeds to step S414, the snow-freezing vehicle monitoring processing unit 67 determines whether the snow removal box has been checked based on instructions from the communication terminal 102. If it is determined that it has been checked (Yes), the process proceeds to step S416; otherwise, it proceeds to step S418.

[0098] If the process proceeds to step S416, the snow-freezing vehicle monitoring processing unit 67 generates an image displaying an excavator icon corresponding to the snow removal work status, based on location information and work status information from the mobile communication terminal 200 held by the crew of the work vehicle 107. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S422. As a result, the display device of the communication terminal 102 displays an image displaying an excavator icon. The process then proceeds to step S422.

[0099] Furthermore, if the process proceeds to step S418, the snow-freezing vehicle monitoring processing unit 67 determines whether the control work box has been checked based on the instructions from the communication terminal 102. If it is determined that it has been checked (Yes), the process proceeds to step S420; otherwise, it proceeds to step S402.

[0100] If the process proceeds to step S420, the snow-freezing vehicle monitoring processing unit 67 generates an image displaying an icon of a regulated vehicle corresponding to the work status of the regulated work, based on location information and work status information from the mobile communication terminal 200 held by the occupant of the work vehicle 108. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S422. As a result, the display device of the communication terminal 102 displays an image displaying an icon of a regulated vehicle. The process then proceeds to step S422.

[0101] As described above, the display process displays a scale at the top of the main screen 400, and icons corresponding to the work status are superimposed near the current location on the highway image 403b in the map image 400a. In the example shown in Figure 14, since the saltwater spraying box is checked, a scale 409 representing the number of sprays required for saltwater spraying is displayed to the right of the search button 402d, and icons 104c and 104s of water trucks are displayed near the current location on the highway image 403b. The numbers below the scale 409 indicate the number of sprays, and the color above the numbers corresponds to each number of sprays. In the example shown in Figure 14, lighter colors indicate fewer sprays, and darker colors indicate more sprays. Note that for improved visibility, different colors may be used instead of the shades shown in the figure. In step S422, the snow and ice-resistant vehicle monitoring processing unit 67 acquires information within the set time range based on instructions from the communication terminal 102, and then proceeds to step S424.

[0102] In step S424, an image is generated in which the driving trajectory information corresponding to the displayed work vehicle is superimposed on the highway image 403b of the map image 403a. Then, the image data of the generated image is sent to the communication terminal 102, and the process proceeds to step S426. As a result, the display device of the communication terminal 102 displays the image in which the driving trajectory information is superimposed on the highway image 403b.

[0103] Here, the snow and ice-resistant vehicle monitoring processing unit 67 acquires location information and work status information from the mobile communication terminals 200 carried by the occupants of the work vehicles 104 to 108, as described above. The work status information includes the work content, the number of repetitions of repetitive tasks, and information indicating whether the vehicle is moving, working, or temporarily suspending work. Based on the acquired work status information and location information, the snow and ice-resistant vehicle monitoring processing unit 67 records the driving trajectory during work in the storage device 52 or database server, associating it with time information. In other words, the snow and ice-resistant vehicle monitoring processing unit 67 generates an image on the highway image 403b in a different color than usual, based on the recorded driving trajectory information, showing the driving trajectory of the vehicle during work within the set time range.

[0104] Furthermore, if a work vehicle performing repeated tasks on the same road section is displayed, the snow-freezing vehicle monitoring processing unit 67 generates an image as driving trajectory information, in which the driving trajectory is color-coded according to the number of repetitions. As a result, in the example shown in Figure 14, the driving trajectory 104t is displayed on the display device of the communication terminal 102, color-coded according to the number of times the snow was spread.

[0105] In step S426, the snow-freezing vehicle monitoring processing unit 67 determines whether the update button 406b has been pressed based on instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S422; otherwise, it proceeds to step S428.

[0106] If the process proceeds to step S428, the snow-freezing vehicle monitoring processing unit 67 determines, based on instructions from the communication terminal 102, whether or not the boxes in the snow-freezing work selection box group 406f have been unchecked. If it is determined that the boxes have been unchecked (Yes), the process proceeds to step S430; otherwise, it proceeds to step S426.

[0107] If the process proceeds to step S430, the snow-freezing vehicle monitoring processing unit 67 performs a process to clear the driving trajectory information and other data from the screen, ending the series of processes and returning to the original process. As a result, the display device of the communication terminal 102 will show, for example, the screen before checking the boxes related to snow-freezing work.

[0108] The snow-freezing vehicle monitoring processing unit 67 can generate an image with a speech bubble displaying summary information about the current work status and work details when an icon superimposed near the current location on the highway image 403b is selected. In the example shown in Figure 14, the icon 104c of a water truck with a camera indicating work in progress is selected, and the summary information 104vc is displayed. In this case, the speech bubble image displays "Nishi-Shio Spreading 1" as the name of the work team, "Spreading" as the work status, "Water Truck (Yellow)" as the vehicle type, and "1st Spreading" as the number of times spraying has been performed. Remarks are also displayed, and the remarks can be edited by pressing the edit button on the communication terminal 102. If the vehicle is not currently working but is moving to the work site, the summary information 104v is displayed as shown in the left diagram of Figure 15(a). In the summary information 104v, only the name of the work team, the work status, and the vehicle type are displayed, and the work status is "Moving". Additionally, depending on the type of de-icing work that has been checked (for example, the type of material being sprayed), a water truck icon of a color other than yellow (for example, blue, white, etc.) will be displayed.

[0109] Similarly, for work vehicle 105 performing snow melting operations, icons 105i and 105c and summary information 105v and 105vc are displayed, as shown in the left (moving) and right (working) figures of Figure 15(b). In addition, "Moving" is displayed as the work status during snow melting operations. Similarly, for work vehicle 106 performing snow removal operations, icons 106i and 106c and summary information 106v and 106vc are displayed, as shown in the left (moving) and right (working) figures of Figure 15(c). In addition, "Snow removal in progress" is displayed as the work status during snow removal operations. Similarly, for work vehicle 107 performing snow removal operations, icons 107i and 107c and summary information 107v and 107vc are displayed, as shown in the left (moving) and right (working) figures of Figure 15(d). In addition, "Snow removal in progress" is displayed as the work status during snow removal operations. Furthermore, if the work vehicle 108 is performing traffic control work, icons 108i and 108c and summary information 108v and 108vc will be displayed, as shown in the left (moving) and right (working) figures of Figure 15(f). In the case of traffic control work, "Traffic Control in Progress" will be displayed as the work status. [Snow and Freeze P Report Display Processing] Next, we will describe the snow and ice P report display process performed by the image processing server 100. Figure 16 is a flowchart showing the snow-freezing P report display process, and Figure 17 is a diagram showing an example of the snow-freezing P report viewing screen. Figure 18 is a diagram showing an example of the snow-freezing P report detail display screen. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52, and executes the snow and ice P report display process shown in the flowchart of Figure 16 according to that program. When the snow and ice P report display process is executed on the CPU 30, it first proceeds to step S500, as shown in Figure 16.

[0110] In step S500, the snow-freezing P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not the snow-freezing P report box has been checked among the snow-freezing response work selection box group 406f. If it is determined that it has been checked (Yes), the process proceeds to step S502; otherwise, the determination process is repeated until it is checked. If the process proceeds to step S502, the snow and ice P report processing unit 68 obtains information on the set time range based on instructions from the communication terminal 102 and proceeds to step S504.

[0111] In step S504, the snow and ice P report processing unit 68 generates an image in which the snow and ice P report icon 210 (hereinafter referred to as "report icon 210") is superimposed near each reporting location within the set time range of the highway image 403b of the map image 403a. The image data of the generated image is then transmitted to the communication terminal 102, and the process proceeds to step S506. As a result, the display device of the communication terminal 102 displays the image with the report icon 210 superimposed.

[0112] Here, the snow-freezing P report processing unit 68 acquires location information and work status information from a mobile communication terminal 200 held by the crew of a work vehicle 104 performing snow-freezing patrol work, for example. The work status information includes snow-freezing P report information that includes the results of the patrol work, and time information (report time information) and location information when the snow-freezing P report information was transmitted. Based on the acquired set time range, report time information and location information at the time of reporting, the snow-freezing P report processing unit 68 generates an image in which a report icon 210 is superimposed near the reporting location on the highway image 403b within the set time range, as shown in Figure 17.

[0113] The snow and ice patrol report information is based on information entered into the mobile communication terminal 200, and includes, for example, information indicating the condition of the road surface at the road location where snow and ice patrols are conducted, weather information, temperature information, road temperature information, and information on images of the road surface taken using the camera function of the mobile communication terminal 200.

[0114] In step S506, the snow and ice P report processing unit 68 determines whether or not the update button 406b has been pressed based on instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S508; otherwise, it proceeds to step S502. In other words, on the communication terminal 102 side, by entering an arbitrary time range in the time range specification field 406a shown in Figure 17 and pressing the update button 406b, the report icon 210 of snow and frost P reports reported within the arbitrary time range can be displayed.

[0115] If the process proceeds to step S508, the snow-freezing P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not one of the displayed report icons 210 has been pressed. If it is determined that one has been pressed (Yes), the process proceeds to step S510; otherwise, it proceeds to step S524.

[0116] If the process proceeds to step S510, the snow and ice P report processing unit 68 generates an image in which the summary information 210v corresponding to the pressed report icon 210 is superimposed near the selected report icon 210 on the map image 403a. The image data of the generated image is then sent to the communication terminal 102, and the process proceeds to step S512. As a result, the display device of the communication terminal 102 displays the image with the summary information 210v superimposed. As shown in Figure 17, the summary information 210v is displayed as a speech bubble image, which shows the name of the work team, the date and time of the patrol, the weather, the temperature, and the road temperature, with a details button displayed below it.

[0117] In step S512, the snow and ice P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not the details button in the displayed summary information 210v has been pressed. If it is determined that the button has been pressed (Yes), the process proceeds to step S514; otherwise, it proceeds to step S520.

[0118] If the process proceeds to step S514, the snow-freeze P report processing unit 68 performs a process to transition to the report details screen and then proceeds to step S516. Specifically, it generates an image displaying the report details screen 210vd as a separate screen from the main screen 400. Then, it performs a process to send the image data of the generated image to the communication terminal 102.

[0119] As a result, the display device of the communication terminal 102 displays a report details screen 210vd showing the details of the snow and ice P report, as shown in Figure 18. The report details screen 210vd displays the title of the snow and ice P report details, the report information 210di obtained from the mobile communication terminal 200, such as road surface conditions, weather, air temperature, and road temperature, and the image (photo) 210p taken during the snow and ice patrol. In addition, a "Return to List" button 210bp is displayed to the right of the title to return to the main screen 400 where the report icon 210 is displayed, and a download button 210dp is displayed to the lower left of the image 210p to download the image 210p. By pressing the download button 210dp, the image data of image 210p can be downloaded to the communication terminal 102.

[0120] In step S516, the snow and ice P report processing unit 68 determines whether the button 210bp to return to the list has been pressed, based on instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S518; otherwise, the determination process is repeated until the button is pressed.

[0121] If the process proceeds to step S518, the snow-freezing P report processing unit 68 generates an image of the main screen 400 with the report icon 210 displayed. The generated image data is then sent to the communication terminal 102, and the process proceeds to step S506. As a result, the display device of the communication terminal 102 displays an image of the main screen 400 with the report icon superimposed.

[0122] On the other hand, if the details button is not pressed in step S512 and the process proceeds to step S520, the snow-freeze P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not the × button displayed in the upper right corner of the summary information 210v bubble was pressed. If it is determined that the button was pressed (Yes), the process proceeds to step S522; otherwise, it proceeds to step S512.

[0123] If the process proceeds to step S522, the snow-freeze P report processing unit 68 performs a process to erase the summary information 210v, and then proceeds to step S506. As a result, the display device of the communication terminal 102 displays an image of the main screen 400 with the summary information 210v erased.

[0124] Furthermore, if the report icon 210 is not pressed in step S508 and the process proceeds to step S524, the snow-freeze P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not the checkbox for the snow-freeze P report has been unchecked. If it is determined that the checkbox has been unchecked (Yes), the process proceeds to step S526; otherwise, it proceeds to step S506.

[0125] If the process proceeds to step S526, the snow-freeze P report processing unit 68 removes the report icon 210 and other elements from the map image 403a, ending the series of processes and returning to the original process. As a result, the display device of the communication terminal 102 will show, for example, the screen before checking the snow-freeze P report box. [Snow and Freezing P Report List Display Processing] Next, we will explain the process of displaying a list of snow and ice reports, which is performed on the image processing server 100. Figure 19 is a flowchart showing the process for displaying a list of snow and ice P reports, and Figure 20 is a diagram showing an example of the display screen for the snow and ice P report list. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52, and executes the snow and ice P report list display process shown in the flowchart of Figure 19 according to that program. When the snow and ice P report list display process is executed on CPU 30, it first proceeds to step S550, as shown in Figure 19.

[0126] In step S550, the snow-freeze P report processing unit 68 determines whether the snow-freeze P report list has been selected from the menu displayed when the snow-freeze response function in the menu selection field 401 is pressed, based on instructions from the communication terminal 102. If it is determined that it has been selected (Yes), the process proceeds to step S552; otherwise, the determination process is repeated until it is selected.

[0127] If the process proceeds to step S552, the snow-freeze P report processing unit 68 obtains the set reporting date range based on the instructions from the communication terminal 102 and proceeds to step S554. Here, before displaying the snow-freeze P report list, the reporting date range set by default is obtained. In step S554, the snow-freezing P report processing unit 68 generates an image displaying a list of snow-freezing P reports corresponding to the range of acquired reporting dates. The image data of the generated image is then sent to the communication terminal 102, and the process proceeds to step S556.

[0128] As a result, the display device of the communication terminal 102 displays, for example, a summary list of snow-freezing P reports corresponding to the set reporting date range, as shown in Figure 20. Specifically, the screen that displays the snow-freezing P report list displays a reporting date specification field 221, a list display field 222, and a details button 223, as shown in Figure 20. The reporting date specification field 221 consists of a range specification field 221a and a search button 221b. The report summary includes the date and time of reporting, location, road surface conditions, snow depth (cm), weather, temperature (°C), road surface temperature (°C), whether or not photos were taken, and any remarks.

[0129] In step S556, the snow and ice P report processing unit 68 determines whether the search button 221b has been pressed based on the instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S552; otherwise, the process proceeds to step S558. In other words, by entering a range of reporting dates in the range selection field 221a and pressing the search button 221b, you can set a range of reporting dates, and a summary list of snow frost P reports submitted within the set reporting date range will be displayed in the list display field 222.

[0130] If the process proceeds to step S558, the snow-freeze P report processing unit 68 determines whether the details button 223 was pressed based on the instructions from the communication terminal 102. If it is determined that the button was pressed (Yes), the process proceeds to step S560; otherwise, it proceeds to step S566.

[0131] If the process proceeds to step S560, the snow-freezing P report processing unit 68 performs a process to transition to the report details screen and proceeds to step S562. Specifically, it generates an image displaying the report details screen 210vd as a separate screen from the main screen 400 (see Figure 18). Then, it performs a process to send the image data of the generated image to the communication terminal 102.

[0132] In step S562, the snow and ice P report processing unit 68 determines whether the button 210bp to return to the list has been pressed, based on instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S564; otherwise, the determination process is repeated until the button is pressed.

[0133] If the process proceeds to step S564, the snow-freeze P report processing unit 68 generates an image of the main screen 400 displaying the snow-freeze P report list. The generated image data is then sent to the communication terminal 102, and the process proceeds to step S556. As a result, the display device of the communication terminal 102 displays the image of the main screen 400 displaying the snow-freeze P report list.

[0134] On the other hand, if the details button 223 is not pressed in step S558 and the process proceeds to step S566, the snow-freeze P report processing unit 68 determines, based on instructions from the communication terminal 102, whether or not the browser's back button or the like was pressed. If it is determined that it was pressed (Yes), the process proceeds to step S568; otherwise, it proceeds to step S556.

[0135] If the process proceeds to step S568, the Snow Freeze P Report Processing Unit 68 performs a process to transition to a screen corresponding to the pressed button or menu, then terminates the series of processes and returns to the original process. That is, it generates an image displaying the screen corresponding to the pressed button or menu, and sends the image data of the generated image to the communication terminal 102. [Saltwater plant inventory status display processing] Next, we will explain the brine plant inventory status display process (hereinafter referred to as the "brine plant inventory status display process") performed by the image processing server 100. Figure 21 is a flowchart showing the process for displaying the saltwater P inventory status, and Figure 22 is a diagram showing an example of the saltwater P inventory status display. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52, and executes the saltwater P inventory status display process shown in the flowchart of Figure 21 according to that program. When the saltwater P inventory status display process is executed on the CPU 30, it first proceeds to step S600, as shown in Figure 21.

[0136] In step S600, the saltwater P inventory status processing unit 69 determines, based on instructions from the communication terminal 102, whether the box for the saltwater P installation location has been checked from the snow / freeze response work selection box group 406f. If it is determined that it has been checked (Yes), the process proceeds to step S602; otherwise, the determination process is repeated until it is checked. If the process proceeds to step S602, the saltwater P inventory status processing unit 69 acquires information on the set time range based on instructions from the communication terminal 102 and proceeds to step S604. In step S604, the brine P inventory status processing unit 69 generates an image in which brine P icons are displayed at the installation locations of each brine plant on the map image 403a. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S606. As a result, as shown in Figure 22, the display device of the communication terminal 102 displays saltwater P icons 250 at each location of saltwater P on the map image 403a of the main screen 400.

[0137] In step S606, the saltwater P inventory status processing unit 69 determines whether or not the update button 406b has been pressed based on the instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S608; otherwise, it proceeds to step S602.

[0138] If the process proceeds to step S608, the saltwater P inventory status processing unit 69 determines, based on instructions from the communication terminal 102, whether or not one of the displayed saltwater P icons 250 has been pressed. If it is determined that one has been pressed (Yes), the process proceeds to step S610; otherwise, it proceeds to step S616.

[0139] If the process proceeds to step S610, the saltwater P inventory status processing unit 69 generates an image in which the inventory information 250v corresponding to the pressed saltwater P icon 250 is displayed near the selected saltwater P icon 250 on the map image 403a. The generated image data is then transmitted to the communication terminal 102, and the process proceeds to step S612.

[0140] As a result, the display device of the communication terminal 102 displays an image with inventory information 250v near the selected saltwater P icon 250. The inventory information 250v is displayed as a speech bubble image, as shown in Figure 22, and within the speech bubble, the name of the saltwater P, the latest update date and time within the set time range, the inventory amount of saltwater, and the inventory amount of sodium chloride (sodium chloride).

[0141] Here, the brine P inventory status processing unit 69 obtains information on the amount of brine and sodium chloride in each brine P from a mobile communication terminal 200 owned by the administrator who manages the inventory of each brine P. The information on the amount of brine and sodium chloride in each brine P includes the time information when the inventory amount was entered on the mobile communication terminal 200. In other words, on the communication terminal 102 side, by entering an arbitrary time range in the time range specification field 406a shown in Figure 22 and pressing the update button 406b, the inventory information 250v of saltwater P reported for the arbitrary time range can be displayed.

[0142] In step S612, the saltwater P inventory status processing unit 69 determines, based on instructions from the communication terminal 102, whether or not the × button displayed in the upper right corner of the inventory information 250v output has been pressed. If it is determined that the button has been pressed (Yes), the process proceeds to step S614; otherwise, the determination process is repeated until the button is pressed. If the process proceeds to step S614, the saltwater P inventory status processing unit 69 performs a process to erase the inventory information 250v, and then proceeds to step S616.

[0143] In step S616, the saltwater P inventory status processing unit 69 determines, based on instructions from the communication terminal 102, whether or not the check box for the saltwater P installation location has been unchecked. If it is determined that the check box has been unchecked (Yes), the process proceeds to step S618; otherwise, it proceeds to step S606.

[0144] If the process proceeds to step S618, the saltwater P inventory status processing unit 69 performs a process to remove the saltwater P icon 250 and other elements from the map image 403a, ending the series of processes and returning to the original process. As a result, the display device of the communication terminal 102 will display, for example, the screen before checking the boxes for saltwater P installation locations. [Displaying Saltwater P Inventory Status] Next, we will explain the process for displaying the inventory status of saltwater P, which is executed on the image processing server 100. Figure 23 is a flowchart showing the process for displaying the saltwater P inventory status list, and Figure 24 is a diagram showing an example of the saltwater P inventory status list display screen. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the saltwater P inventory status display process shown in the flowchart of Figure 23 according to that program. When the saltwater P inventory status display process is executed on the CPU 30, it first proceeds to step S650, as shown in Figure 19.

[0145] In step S650, the saltwater plant inventory status processing unit 69 determines whether the saltwater plant inventory status has been selected from the menu displayed when the snow / freeze response function in the menu selection field 401 is pressed, based on instructions from the communication terminal 102. If it is determined that it has been selected (Yes), the process proceeds to step S652; otherwise, the determination process is repeated until it is selected.

[0146] If the process proceeds to step S652, the brine P inventory status processing unit 69 obtains the configured jurisdiction information based on the instructions from the communication terminal 102 and proceeds to step S654. Here, each brine plant is assigned to a specific organization, and the jurisdiction information indicates the organization responsible for that plant. The brine P inventory status processing unit 69 also obtains the default jurisdiction information before displaying the brine P inventory status list.

[0147] In step S654, the brine P inventory status processing unit 69 generates an image displaying a brine P inventory status list showing the hourly changes in the inventory status of brine plants under the jurisdiction of the organization corresponding to the acquired jurisdiction information. The image data of the generated image is then transmitted to the communication terminal 102, and the process proceeds to step S656.

[0148] As a result, the display device of the communication terminal 102 displays, for example, the brine P inventory status list screen 260, which is a list of hourly changes in the inventory status of brine plants under the jurisdiction of the configured organization, as shown in Figure 24. Specifically, the brine P inventory status list screen 260 displays a jurisdiction input field 260a, a search button 260b, and an inventory status list table 260c, as shown in Figure 24. The inventory status list table 260c displays the hourly changes (increases and decreases) in the inventory status of brine and sodium chloride within the configured time range. In the example shown in Figure 24, there are three brine plants under the jurisdiction of the organization, the West Bureau, and a list of inventory status changes for these three brine plants is displayed.

[0149] In step S656, the saltwater P inventory status processing unit 69 determines whether the search button 260b has been pressed based on the instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S652; otherwise, the process proceeds to step S658.

[0150] In other words, on the communication terminal 102 side, by selecting an organization from the drop-box in the jurisdiction input field 260a of the saltwater P inventory status list screen 260, and then pressing the search button 260b, a list of changes in the inventory status of saltwater plants under the jurisdiction of the selected organization can be displayed.

[0151] If the process proceeds to step S658, the saltwater P inventory status processing unit 69 determines, based on instructions from the communication terminal 102, whether or not the browser's back button or the like was pressed. If it is determined that it was pressed (Yes), the process proceeds to step S660; otherwise, it proceeds to step S656. If the process proceeds to step S660, the saltwater P inventory status processing unit 69 performs a process to transition to a screen corresponding to the pressed button or menu, then terminates the series of processes and returns to the original process. [Support processing for reporting on snow and ice mitigation work]

[0152] Next, the snow and ice response work report support processing performed on the image processing server 100 will be described. The snow and ice response work report support processing is a web application provided by the image processing server 100. In the first embodiment, a login screen is displayed by accessing a dedicated URL using the browser software of the mobile communication terminal 200, and the service can be accessed by entering a login ID and password on the login screen. In other words, the snow and ice response work reporting support process is a process that supports the input of work status information for snow and ice response work via the mobile communication terminal 200, the acquisition of images showing the work status, and the reporting of work results, etc., within this web application. Figure 25 is a flowchart showing the snow and ice response work report support process. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the snow and ice response work report support process shown in the flowchart of Figure 25 according to that program. When the snow and ice response work report support processing is executed on the CPU 30, it first proceeds to step S700, as shown in Figure 25.

[0153] In step S700, the snow and ice response work management unit 70 determines whether or not a login to the web application has occurred based on instructions from the mobile communication terminal 200. If it is determined that a login has occurred (Yes), the process proceeds to step S702; otherwise, the determination process is repeated until a login is detected. If the process moves to step S702, the Snow and Icy Work Management Department 70 identifies the work team based on the login account (login ID) and moves to step S704. Here, the login ID is registered in a table on the database server, associated with each work team, and the Snow and Freezing Response Work Management Department 70 identifies the work team based on this table.

[0154] In step S704, the Snow and Icy Work Management Unit 70 performs a process to display a screen for the identified work team, and then proceeds to step S706. As a result, the display device of the logged-in mobile communication terminal 200 displays a screen for the snow and icy work to be performed by the identified work team. In this context, the process of displaying the image involves generating an image of the screen to be displayed on the display device of the mobile communication terminal 200, and then transmitting the image data of the generated image to the mobile communication terminal 200.

[0155] In step S706, the snow and ice response work management unit 70 executes operation processing corresponding to the operations on the snow and ice response work screen based on instructions from the mobile communication terminal 200. Subsequently, upon receiving a logout request from the mobile communication terminal 200, the series of processes ends and the unit returns to the original process. In addition, during the operation processing, images for displaying screens corresponding to various operations are generated, and the image data of the generated images is sent to the mobile communication terminal 200. The following provides specific examples to explain the operation processes on each screen used for snow and ice countermeasures. [Freezing prevention work] First, we will explain the processing of operations on the user interface when a work team performing anti-freezing work logs in, based on the diagram. Figures 26(a)-(c), 27(a)-(b), and 28(a)-(b) show examples of operation screens used when reporting the status of anti-freezing work.

[0156] When a work team performing de-icing work logs in, the initial screen of the de-icing operation screen 500A, shown in Figure 28(b), is displayed first. As shown in Figure 28(b), the initial screen displays the username, the work name "De-icing Work," and the word "Logout" at the top, and below these are the work type selection field 500a and the start-drive button 510a.

[0157] First, the worker touches the downward-facing inequality sign at the right end of the work type selection field 500a to display the work type drop-down list 520a, as shown in Figure 26(a). Then, the worker selects salt spraying from the drop-down list 520a. As a result, salt spraying is set in the work type selection field 500a, as shown in Figure 26(b). After that, the worker presses the start-drive button 510a to depart from the base in the work vehicle 104 and head to the work site on the highway. When the start-drive button 510a is pressed, information about the time of departure, the location information of the mobile communication terminal 200, and the set work type information are transmitted to the image processing server 100. Thereafter, the location information of the mobile communication terminal 200 is transmitted to the image processing server 100 at predetermined intervals.

[0158] When the start-drive button 510a is pressed, the screen switches to the one shown in Figure 26(c). Within the operation screen 500A, below the work type selection field 500a, the spray count input field 500b and the remarks field 500c are displayed. Below these, instead of the start-drive button 510a, the start-work button 510b and the back button 510c are displayed.

[0159] As shown in Figure 26(c), before pressing the start button 510, the operator touches the downward-facing inequality sign at the right end of the spray count input field 500b to display a dropdown list (not shown), and selects the spray count from the dropdown list. This sets the spray count (in this case, 1st spray) in the spray count input field 500b. Then, by pressing the start button 510b, the start confirmation screen 530b pops up as shown in Figure 27(a). By pressing the OK button on this screen, as shown in Figure 27(b), the operation screen 500A displays an image 540a showing the words "Defrosting in Progress (Saltwater Spraying)" instead of the start button 510a, start button 510b, and back button 510c. Furthermore, the pause button 510d and end button 510e are displayed instead of the start button 510b and back button 510c.

[0160] Furthermore, when the OK button is pressed on the work start confirmation screen 530b, information about the time the work started, the location information of the mobile communication terminal 200, the set number of spraying cycles, and the entered remarks are sent to the image processing server 100. Upon receiving the work start information, the image processing server 100 starts recording the travel trajectory of the work vehicle 104 based on the location information from the mobile communication terminal 200.

[0161] On the other hand, if the pause button 510d is pressed while the work in progress image 540a is displayed, the pause confirmation screen 530d will pop up, and if the end button 510e is pressed, the end confirmation screen 530e will be displayed. Then, if the OK button is pressed on the pause confirmation screen 530d, as shown in Figure 28(a), the operation screen 500A will display the paused work image 540b, which shows the text "Anti-freezing work paused (saltwater spraying)" instead of the work in progress image 540a. Furthermore, the resume work button 510f will be displayed instead of the pause button 510d. Furthermore, when the OK button is pressed on the work pause confirmation screen 530d, information about the time the work was paused and the location information of the mobile communication terminal 200 are transmitted to the image processing server 100.

[0162] Furthermore, if the resume work button 510f is pressed while the paused work image 540b is displayed, a resume work confirmation screen 530f will pop up. When the OK button is pressed on the resume work confirmation screen 530f, the screen returns to the screen shown in Figure 27(b). In addition, information about the time the work was resumed and the location information of the mobile communication terminal 200 are transmitted to the image processing server 100.

[0163] Furthermore, when the work completion button 510e is pressed on the screen shown in Figure 27(b) or Figure 28(a), and then the OK button is pressed on the work completion confirmation screen 530e, the operation screen 500A switches to the initial screen shown in Figure 28(b). Information on the time the work was completed and the location information of the mobile communication terminal 200 are also sent to the image processing server 100. This completes the series of operations for the saltwater spraying work in the de-icing work. In addition, the image processing server 100, upon receiving the information that the work has been completed, terminates the recording of the travel trajectory of the work vehicle 104 based on the location information from the mobile communication terminal 200. After that, you can log out of the web application by touching the word "Logout" on the operation screen 500A. Alternatively, if there is work at another site, you can continue by pressing the start travel button 510a and head to the next site. [Tasks other than anti-freezing work]

[0164] Next, based on the diagram, we will explain the screen used when workers in snow melting teams, snow removal teams, snow clearing teams, and traffic control teams (other than the anti-freezing team) select the type of work. Figures 29(a) to (d) show examples of operation screens for setting the type of work for each type of work other than anti-freezing work.

[0165] As shown in Figure 29(a), on the snow melting operation screen 500B, the user can select either sweeper or other from the drop-down list 520a as the work type. On the other hand, as shown in Figure 29(b), on the snow removal operation screen 500C, only snow removal can be selected as the work type, and as shown in Figure 29(c), on the snow removal operation screen 500D, only snow removal can be selected as the work type. Similarly, as shown in Figure 29(d), on the traffic control operation screen 500E, only traffic control can be selected as the work type. Other operation screens are the same as for de-icing operations, and the same procedure is followed. [Saltwater P inventory reporting work] Next, we will explain the processing of operations on the user interface when an administrator performing saltwater P inventory reporting tasks is logged in.

[0166] Figures 30(a) to (c) show an example of the operation screen when reporting the inventory level of a brine plant. When logged in with the account of the brine plant administrator, the operation screen 550 for the brine plant inventory reporting task is displayed as shown in Figure 30(a). As shown in Figures 30(a) and (b), the operation screen 550 displays the name of the organization that manages the plant under its jurisdiction as the username, the task name "Brine Plant Inventory Report", and the word "Logout" at the top. Further below these, the plant name selection field 550a, the sodium chloride usage / replenishment selection field 550b for selecting whether to use or replenish sodium chloride, and the usage / replenishment amount input field 550c, which is the input field for the amount used or replenished, are displayed. Further below, the brine remaining amount input field 550d and the save button 560 are displayed.

[0167] The plant name in the plant name selection field 550a is selected from the drop-down list 580a. Although not shown in the diagram, other selection fields are also entered by selecting from drop-down lists. Note that if numerical values ​​need to be entered, the system may be configured to allow direct input using the keypad on the mobile communication terminal 200.

[0168] In the example shown in Figure 30(c), "Haneda" is entered in the plant name selection field 550a, "Use" in the sodium salt usage / replenishment selection field 550b, "11 (unit: tons)" in the usage / replenishment amount input field 550c, and "120 (unit: cubic meters)" in the saltwater remaining amount input field 550d. After that, when the save button 560 is pressed, a screen (not shown) confirming saving, similar to the work start confirmation screen 530b, is displayed, and when the OK button is pressed there, the various entered information and the save time information are sent to the image processing server 100. [Snow frost P report work] Next, we will explain the processing of operations on the user interface when a worker performing snow and ice patrol work logs in. Figures 31(a)-(d), 32(a)-(c), and 33 show examples of the operation screen used when reporting the work status and reporting items for the snow freezing P reporting work.

[0169] When logged in with the account of a worker performing snow frost patrol work, the operation screen 570 for snow frost patrol reporting work is displayed, as shown in Figure 31(a). As shown in Figures 31(a) and (b), the username, the work name "Snow Frost Patrol Report," and the word "Logout" are displayed at the top of the operation screen 570.

[0170] Furthermore, as shown in Figure 31(c), below these, the route name selection field 570a, the direction selection field 570b, and the kilometer post input field 570c are displayed. Further below these, the road surface condition selection field 570d, the snow depth input field 570e, and the weather selection field 570f are displayed. Further below these, the word "Next" is displayed.

[0171] First, to select a route name, the operator presses the downward-pointing inequality sign at the right end of the route name selection field 570a to display the drop-down list 580a, as shown in Figure 31(a). Then, they select the appropriate route name from the list in drop-down list 580a. Next, to select a direction, the operator presses the downward-pointing inequality sign at the right end of the direction selection field 570b to display the drop-down list 580b, as shown in Figure 31(b). Then, they select the appropriate direction of travel (up or down) from the list in drop-down list 580b. Next, as shown in the elliptical area of ​​Figure 31(c), enter the kilometer post into the kilometer post input field 570c. This is done manually using the keypad of the mobile communication terminal 200. Note that entering the kilometer post is optional and can be omitted.

[0172] Next, to select the road surface condition, press the downward-pointing inequality sign at the right end of the road surface condition selection field 570d to display the drop-down list 580d, as shown in Figure 31(d). Then, select the appropriate road surface condition from the list in the drop-down list 580d. Next, as shown in the elliptical area of ​​Figure 32(a), enter the snow depth into the snow depth input field 570e. The snow depth can be entered, for example, by a worker getting out of the vehicle and measuring it using a snow depth gauge. Note that entering the snow depth is optional and can be omitted.

[0173] Next, to select the weather, press the downward-pointing inequality sign at the right end of the weather selection field 570f to display the dropdown list 580f, as shown in Figure 32(b). Then, select the appropriate weather from the list in dropdown list 580f. Note that the weather selection is made by the operator judging and entering the current weather. Next, by pressing the "Next" button at the bottom of the screen, the screen shown in Figure 32(c) will appear. This screen displays, from top to bottom, the temperature input field 570g, the road temperature input field 570h, the remarks input field 570i, the shooting selection field 570k, and the save button 590.

[0174] First, the input of air temperature, road temperature, and remarks into the air temperature input field 570g, road temperature input field 570h, and remarks input field 570i is done manually using the keypad of the mobile communication terminal 200. Note that this input is optional and can be omitted. Furthermore, the air temperature should be entered using, for example, a vehicle-mounted thermometer or a portable thermometer, and the road temperature should be entered using, for example, a portable road temperature thermometer.

[0175] Next, the worker presses the shooting selection field 570k to take a photograph of the road surface conditions, etc. This displays a screen for selecting how to register the photographic image, as shown in Figure 33(a). On this screen, the worker can choose to register by taking a photograph using the camera function installed in the mobile communication terminal 200, register by selecting from the data folder of the mobile communication terminal 200, or register by selecting from the photos registered in the photo folder. In other words, if a photo has already been taken, select that image data; if a photo hasn't been taken yet, select the image data of a photo taken on the spot using the camera function and register it as the image data for reporting.

[0176] Subsequently, as shown in Figure 33(b), pressing the save button 590 displays a confirmation screen 592, and pressing the OK button on the confirmation screen 592 registers the snow and ice patrol report. That is, the snow and ice patrol report information, including the information set in the various selection and input fields, the registered image data, and the registered location and time information, is sent to the image processing server 100. [Effects of the First Embodiment]

[0177] As described above, according to the first embodiment described above, the occupants of the work vehicles 104 to 108 transmit information indicating the work status, such as the start of travel from the base, the start of work at the site, the status of the work site, and the end of work, as well as time information and location information, to the image processing server 100 in real time via the mobile communication terminal 200. The image processing server 100 generates an image in which sign images (icons) that can recognize the current location of the work vehicles 104 to 108 and information indicating the work status at the current location (summary information, etc.) are superimposed on the highway image 403b of the map image 403a or on the map image 403a, based on the data sent in real time, and transmits the image data of the generated image to the communication terminal 102. The communication terminal 102 receives the image data from the image processing server 100 and displays this image data on a display device. As a result, the communication terminal 102 can easily grasp the real-time location and work status of the work vehicles 104 to 108.

[0178] Furthermore, the communication terminal 102 sends instructions regarding image display to the image processing server 100, and the image processing server 100 generates an image in accordance with the instructions from the communication terminal 102 and sends the image data of the generated image back to the communication terminal 102. This makes it easy to check the work status information of a specified work vehicle.

[0179] Furthermore, according to the first embodiment described above, the image processing server 100 generates images for real-time monitoring of the work status of each vehicle related to snow and ice countermeasures, based on location information and work status information from the mobile communication terminals 200 carried by the occupants of the work vehicles 104 to 108 related to snow and ice countermeasures. The generated image data is then transmitted to the communication terminal 102. This makes it easy to grasp the work status related to snow and ice countermeasures, thus facilitating management and appropriate instructions.

[0180] Furthermore, according to the first embodiment described above, the worker can transmit location information and work status information related to snow and ice countermeasures work to the image processing server 100 through a simple input operation to a mobile communication terminal 200 using a web application. This reduces the effort required for work reporting and improves the efficiency of operations. Here, since expressways are roads with relatively narrow shoulders, it is not possible to reopen the road with snow piled up on the shoulders. Therefore, in addition to snow removal, it is also necessary to dispose of the removed snow onto the shoulders.

[0181] Furthermore, according to the first embodiment described above, as information indicating the work status, the W camera 300 acquires image information (video) related to the work status taken outside the vehicle, and transmits the acquired image information to the image processing server 100 in real time. This allows, for example, road sections and ancillary equipment that cannot be captured by the field of view of the in-vehicle camera (drive recorder) to be captured by the W camera 300, the video data of which is transmitted to the image processing server 100, and the video image data received can be played back on the communication terminal 102. As a result, it becomes possible to identify abnormal areas that might have been missed by the in-vehicle camera footage alone, enabling more appropriate responses.

[0182] Furthermore, according to the first embodiment described above, the image processing server 100 starts acquiring location information from the mobile communication terminal 200 when it receives information from the mobile communication terminal 200 indicating the start of driving, records the driving trajectory based on the acquired location information when it receives information from the mobile communication terminal 200 indicating the start of work, and stops recording the driving trajectory when it receives information from the mobile communication terminal 200 indicating the end of work. In addition, the image processing server 100 generates an image in which the driving trajectory is superimposed on the highway image 403b of the map image 403a based on the recorded driving trajectory, and transmits the image data of the generated image to the communication terminal 102. As a result, the communication terminal 102 can easily visually grasp which road locations are being worked on and how much work has progressed.

[0183] Furthermore, according to the first embodiment described above, the image processing server 100 acquires information from the mobile communication terminal 200 regarding the number of repetitions of tasks that are repeatedly performed on the same road location, such as saltwater spraying, as work status information. Based on the time range instructed by the communication terminal 102, the acquired information on the number of repetitions, and the recorded driving trajectory information, the server generates an image in which the driving trajectory within the time range is color-coded according to the number of repetitions and superimposed. This allows the communication terminal 102 to easily grasp the number of repetitions of the task from the color of the driving trajectory. This enables, for example, to appropriately perform tasks such as saltwater spraying to prevent freezing.

[0184] Furthermore, according to the first embodiment described above, the image processing server 100 generates an image in which a plant marker image (saltwater P icon 250) for recognizing the location of a saltwater plant that stores saltwater and sodium chloride used in saltwater spraying operations for freeze prevention is superimposed on the map image 403a, and an image in which information regarding the inventory status of saltwater and sodium chloride at the saltwater plant corresponding to instructions from the communication terminal 102 is superimposed near the saltwater P icon 250 on the map image 403a. As a result, the communication terminal 102 can easily grasp the inventory status of the saltwater plant and reliably receive saltwater from the nearest available saltwater plant.

[0185] Furthermore, according to the first embodiment described above, the image processing server 100 generates an image displaying information showing the changes in the inventory status of the brine plant at predetermined intervals (e.g., every hour) in response to instructions from the communication terminal 102. This allows the communication terminal 102 to easily grasp the changes in the inventory status of the brine plant, enabling it to appropriately perform tasks such as issuing instructions to increase the amount of brine or managing the inventory of sodium chloride.

[0186] Furthermore, according to the first embodiment described above, as part of the snow and ice response work, patrol work is performed on expressways to address snow and ice accumulation. The image processing server 100 acquires patrol report information from the mobile communication terminal 200 as work status information corresponding to the patrol work, which includes information indicating the condition of the road surface at the road location to be patrolled, weather information at the road location, and information on images of the road surface at the road location taken with the shooting function. The server uses the location information at the time the patrol report information was acquired as reporting location information to generate an image in which a reporting sign image (report icon 210) for recognizing the reporting location of the patrol report information is superimposed on the expressway image 403b of the map image 403a, and an image in which a patrol report containing patrol report information corresponding to the report icon 210 corresponding to the instruction from the communication terminal 102 is superimposed near the report icon 210 of the map image 403a. This allows the communication terminal 102 to easily grasp the location of the snow and ice patrol report and the desired content of the patrol report. For example, it can identify areas where additional saltwater spraying is needed or areas where snow removal is insufficient, and take appropriate measures.

[0187] Furthermore, according to the first embodiment described above, as a predetermined task related to the maintenance or management of the expressway, road surface temperature measurement work is performed using a work vehicle (traffic PC 103) equipped with a first road surface temperature sensor for measuring the road surface temperature, a location information measuring device for measuring the vehicle's position information, and a communication device capable of communicating with an image processing server via a communication line. In addition, a second road surface temperature sensor is installed at predetermined intervals along the expressway to measure the road surface temperature over the entire or nearly entire road area, and the road surface temperature is monitored based on these measurement results. Furthermore, road surface temperature measurement work is performed on road locations when a road location is detected where the road surface temperature measured by the second road surface temperature sensor is below a predetermined temperature or where the change in this road surface temperature is above a predetermined temperature. In addition, the image processing server 100 generates an image in which the distribution of measured road surface temperatures at the relevant road location is superimposed along the road on a map, based on the road surface temperature information and location information from the work vehicle (traffic PC 103) corresponding to the road surface temperature measurement work.

[0188] This allows for monitoring of road temperature based on the measurement results from the second road temperature sensor across the entire road area, and enables road temperature measurement using the first road temperature sensor mounted on the work vehicle in areas where there is a risk of road freezing. As a result, road temperature measurement and monitoring can be carried out appropriately by the work vehicle, making de-icing work more effective.

[0189] Furthermore, according to the first embodiment described above, the image processing server 100 generates an image in which the roads on the map are color-coded according to the highway image 403b of the map image 403a, based on the measurement values ​​of the first road temperature sensor. As a result, the communication terminal 102 can visually grasp the road temperature situation by the color of the roads, making it easy to grasp the road temperature.

[0190] Furthermore, according to the first embodiment described above, the image processing server 100 generates an image in which multiple types of sign images (icons) different for each predetermined task, each movement state of the work vehicle, or each predetermined task's work state are superimposed. In addition, based on instructions from the communication terminal 102 regarding the task content, movement state, or work state, it generates an image in which only the sign images of the type corresponding to the instruction are superimposed on the map image 403a. This allows the communication terminal 102 to narrow down the display to only the work vehicles whose status is to be known, thus helping to find the desired icon. [Correspondence in the first embodiment] In the first embodiment, the main screen 400 shown in Figures 5 and 6 corresponds to the first and second images, and the main screen 400 on which summary information is displayed on the map image 403a shown in Figures 8 and 9 corresponds to the second image. Furthermore, in the first embodiment, Figure 11 corresponds to the 13th image, Figure 14 corresponds to the 3rd image, Figure 17 corresponds to the 6th and 7th images, and Figure 22 corresponds to the 4th and 5th images. Furthermore, in the first embodiment, the data communication processing unit 61 corresponds to the image data transmission means and the first work information acquisition means, the map information acquisition unit 63 corresponds to the map information acquisition means, and the snow and ice response work management unit 70 corresponds to the first work information acquisition means.

[0191] Furthermore, in the first embodiment, the image generation processing by the vehicle information display processing unit 62, road surface temperature information processing unit 64, video playback processing unit 66, snow / freeze-resistant vehicle monitoring processing unit 67, snow / freeze patrol report processing unit 68, and saltwater plant inventory status processing unit 69 of the image processing server 100 corresponds to the image generation processing means. Furthermore, in the first embodiment, the mobile communication terminal 200 corresponds to an information communication terminal, the GPS function of the mobile communication terminal 200 corresponds to a location information acquisition means, and an input device such as a touch panel of the mobile communication terminal 200 corresponds to an input means. Furthermore, in the first embodiment, the browser software executed on the mobile communication terminal 200 corresponds to the second work information acquisition means, and the browser software and wireless communication function executed on the mobile communication terminal 200 correspond to the information transmission means. Furthermore, in the first embodiment, the browser software and display device executed on the communication terminal 102 correspond to the image display means, and the browser software and communication device executed on the communication terminal 102 correspond to the instruction transmission means. Furthermore, in the first embodiment, the camera function of the mobile communication terminal 200 corresponds to the camera means, and the process of recording the driving trajectory in the snow-freezing vehicle monitoring processing unit 67 corresponds to the driving trajectory recording means. [Second Embodiment] Next, a second embodiment of the present invention will be described with reference to the drawings. Figures 34 to 47 show the second embodiment. 〔composition〕 The second embodiment differs from the first embodiment in that the system of the first embodiment is applied to support the operation of cleaning work on expressways. The following describes in detail the parts that differ from the first embodiment described above, and the explanations of overlapping parts will be omitted as appropriate.

[0192] Figure 34 is a block diagram showing an example configuration of a road maintenance support system according to the second embodiment. The road maintenance support system is a system that supports predetermined cleaning work related to maintaining the road environment by work vehicles and their occupants in cleaning work, which is one of the tasks for maintaining the road environment of expressways.

[0193] As shown in Figure 34, the network 120 is connected to an image processing server 100A, a communication terminal 102, and a base station 130. In addition, a portable communication terminal 200 carried by a cleaning worker (hereinafter referred to as "cleaning worker") is connected via the base station 130. The image processing server 100A has the same hardware configuration as the first embodiment described above.

[0194] The mobile communication terminal 200 is carried by the occupants of the work vehicle 109 and moves with the work vehicle 109. That is, as in the first embodiment described above, the location information of the mobile communication terminal 200 is used as the location information of the work vehicle 109. Hereinafter, the work vehicle 109 involved in cleaning work will be referred to as the "cleaning vehicle 109". Examples of cleaning vehicles 109 include road sweepers that can clean the road surface while driving, cleaning vehicles equipped with suction machines that can suck up debris lying on the road surface, cleaning vehicles that collect debris picked up manually, and vehicles used by specialized work teams to transport tools to the work site. Next, the functional configuration of the image processing server 100A will be explained based on Figure 35. Figure 35 is a block diagram showing an example of the functional configuration of the image processing server 100A.

[0195] The image processing server 100A is a functional component realized by the execution of a program by the CPU 30. As a functional component, the image processing server 100A includes a data communication processing unit 61, a map information acquisition unit 63, a real-time (RT) cleaning information display processing unit 71, a cleaning work report processing unit 72, and a cleaning work management unit 73, as shown in Figure 35.

[0196] The RT cleaning information display processing unit 71 acquires location information from a mobile communication terminal 200 held by a cleaning worker in the cleaning vehicle 109, and cleaning work status information from the mobile communication terminal 200. Based on the acquired location information and work status information, it generates an image that displays the current location of the work vehicle, the current status of the cleaning work, etc., in near real-time. Furthermore, it records a first and second travel trajectory based on location information during movement without cleaning and during movement with cleaning work in the storage device 52 or database server. Based on this travel trajectory information, it generates an image in which travel trajectory information including non-cleaning sections and cleaning sections is superimposed on the highway image 403b of the map image 403a. Furthermore, it transmits the image data of the generated image to the requesting communication terminal 102 and displays it on the display device of the communication terminal 102.

[0197] The cleaning work report processing unit 72 acquires location information from a mobile communication terminal 200 held by a cleaning worker in the cleaning vehicle 109, and cleaning work status information from this mobile communication terminal 200. Based on the acquired location information and work status information, it generates a cleaning report, which is a report of the cleaning work, and generates an image in which an image showing a list of the generated cleaning reports is superimposed on the map image 403a. In addition, based on the recorded information of the first and second driving trajectories, it generates an image in which information of the first and second driving trajectories, including non-cleaning sections and cleaning sections, is displayed on the highway image 403b of the map image 403a. Furthermore, it transmits the image data of the generated image to the requesting communication terminal 102 and displays it on the display device of the communication terminal 102.

[0198] The Cleaning Operations Management Department 73 processes a web application (also called a mobile app) to the mobile communication terminal 200 to provide services corresponding to each cleaning task. The cleaning tasks involve cleaning the roads and related facilities of the expressway.

[0199] Furthermore, the work team is determined on the image processing server 100A based on the login ID (account). A login information table is built on the database server, and the login ID is registered in association with the work team name. Therefore, the work team name can be determined when logging in from the mobile communication terminal 200. [Cleaning work information display processing] Next, we will explain the cleaning work information display process performed by the image processing server 100A.

[0200] Figure 36 is a flowchart showing the cleaning work information display process, Figure 37 is an example of the cleaning management screen when real-time mode is selected, and Figure 38 is an example of the cleaning management screen when report mode is selected. Note that the cleaning work information display process is executed on the main screen (not shown) after the "Cleaning Work Button" is pressed. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52, and executes the cleaning work information display process shown in the flowchart of Figure 36 according to that program. When the cleaning work information display process is executed on the CPU 30, it first proceeds to step S800, as shown in Figure 36.

[0201] In step S800, the RT cleaning information display processing unit 71 determines whether the real-time button 402Ca has been pressed based on instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S802; otherwise, it proceeds to step S810.

[0202] Here, after the user logs into the system from the communication terminal 102 and presses the cleaning operation button on the main screen, the cleaning management screen 400C is displayed on the display device of the communication terminal 102, as shown in Figures 37 and 38. The cleaning management screen 400C displays a menu selection field 401C, a display condition setting field 402C, a map image display field 403, a display switching field 405C, and a photo type selection field 406C. In addition, a contour scale 407C of the travel trajectory is displayed. The color of the scale 407C corresponds to the color of the first travel trajectory when moving, and the color of the second travel trajectory when cleaning.

[0203] In the examples shown in Figures 37 and 38, the map image display area 403 displays the map image 403a and the highway image 403b within the map image 403a. Furthermore, vehicle icons 109i, 109c, and 109s corresponding to all states of the street sweeper 109 are superimposed near the highway image 403b. Specifically, if the last character of the vehicle icon is 'i', it indicates that the vehicle is moving; if it is 's', it indicates that the vehicle is stopped; and if it is 'c', it indicates that the vehicle is cleaning. These vehicle icons can be hidden by unchecking the checkbox in the display switching area 405C.

[0204] In the display condition setting field 402C, as shown in the example in Figure 37, a real-time button 402Ca and a report button 402Cb are displayed to switch the display mode between real-time display mode and report display mode. In addition, a jurisdiction selection field 402Cc, a company selection field 402Cd, a work group selection field 402Ce, a status selection field 402Cf, and a search button 402Cg are displayed. On the other hand, in the example shown in Figure 38, a period setting field 402Ch is additionally displayed to the right of the report button 402Cb, and a report search button 402Ck is displayed instead of the search button 402Cg. Furthermore, a batch print button 402Cm is additionally displayed to the right of this report search button 402Ck.

[0205] The jurisdiction selection field 402Cc is for selecting the organization that has jurisdiction over multiple cleaning sections of the highway. The company selection field 402Cd is for selecting the name of the cleaning company. The work crew selection field 402Ce is for selecting the cleaning crew belonging to the selected cleaning company. The status selection field 402Cf is for selecting the status to display for the vehicle icon of cleaning vehicle 109 from among moving, stopped, and cleaning.

[0206] Furthermore, the search button 402Cg in real-time display mode is used to search for vehicles that match the setting conditions set in the various selection fields. In addition, the period setting field 402Ch in report display mode is used to set the period for which the list of cleaning reports will be displayed, the report search button 402Ck is used to search for cleaning reports that match the setting conditions set in the various selection fields, and the batch print button 402Cm is used on the communication terminal 102 to print out the cleaning reports of the search results in a batch. Additionally, clicking the triangle icon on the far right of each selection field will display a dropdown list (not shown), allowing you to select your desired option from the displayed list.

[0207] If the process proceeds to step S802, the RT cleaning information display processing unit 71 determines whether the search button 402Cg has been pressed based on the instructions from the communication terminal 102. If it is determined that the button has been pressed (Yes), the process proceeds to step S804; otherwise, it proceeds to step S800. In the example shown in Figure 37, where the real-time button 402Ca is pressed and the real-time display mode is set, the vehicle information display area 404C is displayed in the upper left of the map image display area 403 on the cleaning management screen 400C.

[0208] If the process proceeds to step S804, the RT cleaning information display processing unit 71 acquires the setting information set in the display condition setting field 402C and generates an image in which the icons of the cleaning vehicles 109 corresponding to the acquired setting conditions are superimposed on the map image 403a. Then, the image data of the generated image is sent to the communication terminal 102 and the process proceeds to step S806.

[0209] In the example shown in Figure 37, only the status selection field 402Cf is set, and the RT cleaning information display processing unit 71 generates an image to display icons for all cleaning vehicles 109 corresponding to the set "all". As a result, as shown in Figure 37, icons for all cleaning vehicles 109 corresponding to all states—moving, stopped, and cleaning—are superimposed on the display device of the communication terminal 102 near the location corresponding to the current position of each cleaning vehicle 109 in the highway image 403b of the map image 403a. Note that in the example shown in Figure 37, icons 109i, 109s, and 109c are not pictures of vehicles but pictures of cleaning workers (people). Next to each picture of a cleaning worker, a stop mark is displayed if the vehicle is stopped, a square mark is displayed if the vehicle is cleaning, and nothing is displayed if the vehicle is moving.

[0210] In step S806, the RT cleaning information display processing unit 71 generates an image in the vehicle information display field 404C showing a list of management information for the cleaning vehicle 109 corresponding to the set conditions. The generated image data is then sent to the communication terminal 102, and the process proceeds to step S808. As a result, the display device of the communication terminal 102 displays an image in the vehicle information display field 404C showing a list of management information for the cleaning vehicle 109. Here, as management information, as shown in the vehicle information display section 404C of Figure 37, the work team name, work status (moving, stopped, or cleaning), vehicle type (only one type: cleaning vehicle), and update time are displayed for each of the 109 cleaning vehicles corresponding to the display icon.

[0211] In step S808, the RT cleaning information display processing unit 71 executes real-time information display processing in response to various inputs based on instructions from the communication terminal 102, and then finishes the series of processes and returns to the original process. During the real-time information display processing, an image is generated to display information based on various input information from the communication terminal 102, and the image data of the generated image is transmitted to the communication terminal 102. As a result, various images are displayed on the display device of the communication terminal 102. Here, Figure 39(a) shows an example of the display processing in real-time display mode.

[0212] Specifically, in real-time display mode, as shown in Figure 39(a), when icon 109c located at point A in Figure 39(a) is selected on the communication terminal 102 side, detailed information 109v showing the current work status is superimposed on the map image 403a. The detailed information 109v is configured to display information within a speech bubble image. In addition, the travel trajectory 109t of the cleaning vehicle 109 corresponding to the selected icon 109c is superimposed along the road on the highway image 403b. Furthermore, the travel trajectory 109t is displayed in two colors: non-cleaning sections (non-cleaning travel sections) and cleaning sections where cleaning was performed. The detailed information 109v includes information such as company name, work team, status, work content, work route, base departure time, work start time, and work end time. Also, since the status is cleaning in progress, the base arrival time is blank.

[0213] On the other hand, if the real-time button 402Ca is not pressed in step S800 and the process proceeds to step S810, the cleaning work report processing unit 72 determines whether or not the report button 402Cb was pressed based on instructions from the communication terminal 102. If it is determined that it was pressed (Yes), the process proceeds to step S812; otherwise, it proceeds to step S800.

[0214] If the process proceeds to step S812, the cleaning work report processing unit 72 determines whether the report search button 402Ck was pressed based on the instructions from the communication terminal 102. If it is determined that the button was pressed (Yes), the process proceeds to step S814; otherwise, it proceeds to step S800. In the example shown in Figure 38, where the report button 402Cb is pressed and the report display mode is set, the report search results display area 408C is displayed in the upper left of the map image display area 403 on the cleaning management screen 400C.

[0215] If the process proceeds to step S814, the cleaning work report processing unit 72 retrieves information on the setting conditions set in the display condition setting field 402C and searches for cleaning reports corresponding to the retrieved setting conditions. The list of cleaning reports found through this search generates an image displayed in the report search results display field 408C. The image data of the generated image is then sent to the communication terminal 102, and the process proceeds to step S816. As a result, the display device of the communication terminal 102 displays an image in the report search results display field 408C showing a list of cleaning report search results.

[0216] As shown in Figure 38, the search results for cleaning reports consist of information on the date and time of the work, the duration of the work, the details of the work, and the work route. In other words, the search results display an overview of the cleaning work for which a report was created. A print button is also displayed for each search result.

[0217] In step S816, the cleaning work report processing unit 72 executes a display process for report information in response to various inputs based on instructions from the communication terminal 102, and then finishes the series of processes and returns to the original process. During the report information display process, an image is generated to display information based on the various inputs from the communication terminal 102, and the image data of the generated image is transmitted to the communication terminal 102. As a result, the various images are displayed on the display device of the communication terminal 102. Here, FIG. 39(b) is a diagram showing an example of display processing in the report display mode. Also, FIG. 40 is a diagram showing an example of a print preview screen. Further, FIG. 41 is a diagram showing an example of a cleaning management screen on which a photo icon is displayed.

[0218] Specifically, in the report display mode, as shown in the portion surrounded by a dashed line in the report search result display column 408C of FIG. 39(b), when any summary information in the search result list is selected on the communication terminal 102 side, the detailed information 408Cd of the cleaning report is displayed below it. As the detailed information 408Cd, information such as company name, work team, work content, work route, departure time from the base, work start time, work end time, and arrival time at the base is displayed. Further, information on the number of work status photos and the number of abnormal location photos is displayed. Also, a photo display button is displayed to the right of each number. The work status photos are, for example, photos taken of the cleaning locations before and after cleaning, and the abnormal location photos are, for example, photos taken of the abnormal locations when an abnormality is found in a road or its ancillary facilities. Although not shown in the figure, when the photo display button is pressed on the communication terminal 102 side, a screen for displaying, for example, a thumbnail list of work status photos or a thumbnail list of abnormal location photos is displayed on the display device of the communication terminal 102. Then, by selecting a thumbnail on the communication terminal 102 side, the selected photo image is displayed on the display device of the communication terminal 102. Also, in the report display mode as well, similar to the real-time display mode, the travel trajectory 109t of the cleaning vehicle 109 corresponding to the searched cleaning report is superimposed and displayed in color along the road on the highway image 403b. <e000900>

[0219] Also, instead of the summary information in the report search result display column 408C, as shown by the dashed circle in FIG. 39(b), select the point B on the driving track 109t displayed on the highway image 403b on the map image 403a on the communication terminal 102 side via the input device. As a result, as shown in FIG. 39(b), the summary information 109vr of the cleaning operation corresponding to the selected driving track 109t is superimposed and displayed on the map image 403a. The summary information 109vr is configured such that various types of information are displayed in the balloon image, and the company name, work team, work content, and work route information are displayed.

[0220] Also, on the communication terminal 102, by pressing the print button displayed to the right of each summary information in the report search result display column 408C, as shown in FIG. 40, the print preview screen 408CP of the work report of the cleaning operation can be displayed. On the upper side of the print preview screen 408CP, the information of the company name, work team name, work content, work route, departure time from the base, work start time, work end time, and arrival time at the base is displayed. Further, below these information, a map image 408CR with the driving track of the section where the cleaning operation was performed is displayed. Further, below the map image 408CR, an image 408CWP of the work status photo is displayed. In the example shown in FIG. 40, only the image 408CWP of the work status photo is displayed, but if a photo of the abnormal location is taken, an image of the photo of the abnormal location is also displayed below the image 408CWP of the work status photo. In the state where the print preview screen 408CP is displayed, by using the print function of the browser software, the work report of the cleaning operation can be printed and output on the communication terminal 102 side.

[0221] Furthermore, in report display mode, by selecting any summary information in the search results list and checking at least one of the checkboxes 406Ca and 406Cb in the photo type selection field 406C, the photo icons 110 can be displayed as shown in Figure 41. The photo icons 110 are superimposed on the road where the travel trajectory 109t corresponding to the selected summary information is displayed. In the example shown in Figure 41, both checkboxes 406Ca and 406Cb are checked, so if there are photos taken, photo icons 110 corresponding to both work status photos and abnormal location photos are displayed. The photo icons 110 are numbered in the order in which the photos were taken. In addition, the photo icons 110 are displayed on the road at the shooting location based on the location information of the location where the work status photo or abnormal location photo was taken. Therefore, it is possible to grasp the shooting location and shooting order at a glance.

[0222] Furthermore, by selecting any of the photo icons 110 on the communication terminal 102, the summary information 110v of the photo can be overlaid on the map image 403a. The summary information 110v is configured to display various information within a speech bubble image, including the company name, work team, work date and time, work details, and work route. Below this information, a thumbnail image 110wp of the selected photo is displayed. By selecting the thumbnail image 110wp on the communication terminal 102, a screen 110sc can be displayed that allows the photo image to be enlarged or reduced. Within this screen 110sc, the photo image 110wpz can be enlarged or reduced to any size by pressing the enlarge button 110sz or the reduce button 110sr. [Cleaning work report support processing]

[0223] Next, the cleaning work report support processing performed by the image processing server 100A will be described. The cleaning work report support processing is the process of providing the cleaning work report support service offered by the image processing server 100A to the mobile communication terminal 200. The cleaning work report support processing is implemented by running a mobile version of the application software on the mobile communication terminal 200. In the second embodiment, when the mobile version of the application software is run on the mobile communication terminal 200, a login screen is displayed, and the cleaning work report support service can be received by entering the login ID and password on the login screen. The mobile version of the application software has the same functionality as browser software. In other words, the cleaning work report support process is a process that supports the input of cleaning work status information via the mobile communication terminal 200, the acquisition of images (photographs) showing the work status, and the reporting of work results, etc., using this mobile application. Figure 42 is a flowchart showing the cleaning work report support process. The CPU 30 starts a predetermined program stored in a predetermined area of ​​the storage device 52 and executes the cleaning work report support process shown in the flowchart of Figure 25 according to that program. When the cleaning work report support process is executed on the CPU 30, it first proceeds to step S900, as shown in Figure 42.

[0224] In step S900, the cleaning work management unit 73 determines whether or not a login to the mobile application has occurred based on instructions from the mobile communication terminal 200. If it is determined that a login has occurred (Yes), the process proceeds to step S902; otherwise, the determination process is repeated until a login is detected. If the process proceeds to step S902, the cleaning work management department 73 identifies the work team based on the login account (login ID) and proceeds to step S904. Here, the login ID is registered in a table on the database server, associated with each work team, and the cleaning work management department 73 identifies the work team based on this table.

[0225] In step S904, the cleaning work management unit 73 performs a process to display a screen for the identified work team, and then proceeds to step S906. As a result, the display device of the logged-in mobile communication terminal 200 displays an operation screen showing the name of the identified work team. In this context, the process of displaying the image involves generating an image of the screen to be displayed on the display device of the mobile communication terminal 200, and then transmitting the image data of the generated image to the mobile communication terminal 200.

[0226] In step S906, the cleaning work management unit 73 executes operation processing corresponding to the operation on the cleaning operation screen based on instructions from the mobile communication terminal 200. Subsequently, upon receiving a logout request from the mobile communication terminal 200, the series of processes ends and the unit returns to the original process. In addition, during the operation processing, images for displaying screens corresponding to various operations are generated, and the image data of the generated images is sent to the mobile communication terminal 200. The following provides specific examples to explain the operation process on the control screen for cleaning tasks. Figures 43(a)-(c), 44(a)-(b), 45(a)-(c), 46(a)-(b), and 47 show examples of operation screens used when reporting the status of cleaning work.

[0227] When a cleaning crew logs in, the initial screen of the cleaning operation screen 600, shown in Figure 43(a), is displayed first. As shown in Figure 43(a), the initial screen displays the username, the work name "Cleaning Work," and the word "Logout" at the top, and below these are the crew name display field 600a, the work content selection field 600b, the work route selection field 600c, and the base departure button 610a. The crew name display field 600a is automatically displayed when the crew is identified upon login.

[0228] The cleaning worker first touches the downward V-shaped arrow at the right end of the work selection field 600b to display the work drop-down list 620b, as shown in Figure 43(b). Then, the cleaning worker selects "cleaning within lane restrictions" from the drop-down list 620b. As a result, "cleaning within lane restrictions" is set in the work selection field 600b, as shown in Figure 43(b). In the second embodiment, multiple work items can be selected simultaneously, and the selected text is displayed to the right of the selected work item. Other work items can then be selected in this state.

[0229] Next, the cleaning worker touches the downward V-shaped arrow in the work route selection field 600c to display a drop-down list of work routes (not shown). The cleaning worker selects the No. 5 Ikebukuro Line (East) from the drop-down list. As a result, the No. 5 Ikebukuro Line (East) is set in the work route selection field 600c, as shown in Figure 43(c). Next, the base departure button 610a is pressed, as shown by the dashed rectangle in Figure 43(c). This causes the base departure confirmation screen 630a to pop up. By pressing the OK button on this screen, work status information, including the time of departure from the base, the location information of the mobile communication terminal 200, and the set work content and work route information, is transmitted from the mobile communication terminal 200 to the image processing server 100A. Thereafter, the location information of the mobile communication terminal 200 is transmitted to the image processing server 100 at predetermined intervals (for example, every 10 seconds). As a result, the image processing server 100 starts recording the first travel trajectory without cleaning work.

[0230] Furthermore, when the OK button is pressed on the base departure confirmation screen 630a, the screen switches to the one shown in Figure 44(a), and within the operation screen 600, the work team name display field 600a and the work content selection field 600b are replaced with a moving image 640a displaying the text "moving to the site." In addition, the work route selection field 600c is replaced with a work content confirmation button 650, which displays a left-pointing V-shaped arrow and the text "Confirm work content" to its right. Furthermore, the base departure button 610a is replaced with a work start button 610b.

[0231] On this screen, when the work content confirmation button 650 is pressed, the operation screen 600 for confirming work content is displayed as shown in Figure 44(b). The operation screen 600 for confirming work content displays the set work team name display field 600a, the work content selection field 600b, and the work route selection field 600c. Furthermore, below these, the save button 610c and the back button 610d are displayed. The operation screen 600 for confirming work content allows users to check and change the settings. If changes are made, pressing the save button 610c sends the changed information to the image processing server 100A. Pressing the back button 610d returns the user to the screen shown in Figure 44(a).

[0232] On the other hand, if the work start button 610b is pressed, a work start confirmation screen 630b pops up, as shown in Figure 44(a). When the OK button is pressed on this screen, the operation screen 600 displays a work in progress image 640b with the words "Cleaning in Progress" instead of the moving image 640a, as shown in Figure 45(a). In addition, the work start button 610b is replaced by a photo capture / selection button 610e, a work pause button 610f, and a work end button 610g. Furthermore, when the OK button is pressed on the work start confirmation screen 630b, work status information, including the time the work started and the location information of the mobile communication terminal 200, is transmitted from the mobile communication terminal 200 to the image processing server 100A. As a result, the image processing server 100 ends recording of the first travel trajectory and starts recording of the second travel trajectory, which involves cleaning.

[0233] When the photo capture / selection button 610e is pressed on this screen, the photo capture / selection operation screen 600 is displayed, as shown in Figure 45(b). On this operation screen 600, the photo type selection field 600d is displayed in place of the working image 640b, and below that, the capture button 611e and the file selection button 612e are displayed. Further below these, the send button 613e and the cancel button 614e are displayed.

[0234] On the photo-taking / selection operation screen 600, the user selects a photo type in the photo type selection field 600d to set the selected photo type as either "work status" or "abnormal location". Then, with this setting, pressing the capture button 611e activates the camera function of the mobile communication terminal 200, allowing the user to take a photograph. The captured photograph is stored as an image file in the folder corresponding to the selected photo type within the work status folder or abnormal location folder configured in the storage device of the mobile communication terminal 200. Pressing the cancel button 614e on the photo-taking / selection operation screen 600 returns the user to the operation screen 600 shown in Figure 45(a).

[0235] After the cleaning worker takes a photograph, they can select the image file to send to the image processing server 100A by pressing the file selection button 612e. Once an image file is selected, the image 615e of the selected image file is displayed on the operation screen 600, as shown in Figure 45(c). Pressing the send button 613e in this state will display a photo transmission confirmation screen 616e as a pop-up. When the OK button is pressed on the photo transmission confirmation screen 616e, the image file, information about the time the image file was sent, and work status information including the location information of the mobile communication terminal 200 are sent to the image processing server 100A.

[0236] Furthermore, on the operation screen 600 where the work in progress image 640b shown in Figure 46(a) is displayed, when the work pause button 610f is pressed, the work pause confirmation screen 630f pops up, and when the work end button 610g is pressed, the work end confirmation screen 630g is displayed. Then, when the OK button is pressed on the work pause confirmation screen 630f, as shown in Figure 46(b), the operation screen 600 displays a work pause image 640c with the text "Cleaning work paused" instead of the work in progress image 640b. In addition, the work resume button 610h is displayed instead of the work pause button 610f. Also, when the OK button is pressed on the work suspension confirmation screen 630f, the information on the time when the work was suspended and the position information of the mobile communication terminal 200 are transmitted to the image processing server 100A.

[0237] Also, when the work restart button 610h is pressed during the display of the work suspension image 540b, a work restart confirmation screen (not shown) pops up. Then, when the OK button is pressed on the work restart confirmation screen, the screen returns to the screen of FIG. 46(a). Also, the information on the time when the work was restarted and the position information of the mobile communication terminal 200 are transmitted to the image processing server 100A.

[0238] Also, when the work end button 610g is pressed on the screen shown in FIG. 46(a) or the screen shown in FIG. 46(b), and then the OK button is pressed on the work end confirmation screen 630g, the screen switches to the operation screen 600 shown in FIG. 47. On this operation screen 600, instead of the work in progress image 640b or the work suspension image 640c, a moving image 640d with the text "Moving to the base" is displayed, and a work content confirmation button 650 is displayed on the lower side. Further, a base arrival button 610i is displayed below the work content confirmation button 650. Also, when the OK button is pressed on the work end confirmation screen 630g, the information on the time when the work was ended and the position information of the mobile communication terminal 200 are transmitted to the image processing server 100A. As a result, on the image processing server 100, the recording of the second travel trajectory ends, and the recording of the first travel trajectory starts again.

[0239] Also, after the cleaning vehicle 109 arrives at the base, when the base arrival button 610i is pressed by the cleaning operator, a base arrival confirmation screen 630i pops up. Then, when the OK button is pressed by the cleaning operator on the base arrival confirmation screen 630i, the information on the time when the vehicle arrived at the base and the position information of the mobile communication terminal 2 are transmitted to the image processing server 100A. After that, by touching the "Logout" text within the operation screen 600, it is possible to logout from the mobile app. 〔Effects of the Second Embodiment〕

[0240] As described above, according to the second embodiment described above, cleaning work is performed as a predetermined task related to the maintenance or management of the expressway, and the crew of the cleaning vehicle 109 transmits information indicating the work status, such as departure from the base, start of cleaning work at the site, photos of the work status and abnormal areas, completion of cleaning work, and arrival at the base, as well as time information and location information for each of these, to the image processing server 100A in real time via the mobile communication terminal 200. The image processing server 100A generates an image in which a sign image (icon 109i) that can recognize the current location of the work vehicle 109 and information indicating the work status at the current location (detailed information 109v, summary information 109vr, etc.) are superimposed on the expressway image 403b of the map image 403a or on the map image 403a, based on the data sent in real time, and transmits the image data of the generated image to the communication terminal 102. The communication terminal 102 receives the image data from the image processing server 100A and displays this image data on a display device. This allows the communication terminal 102 to easily grasp the real-time location of the work vehicle 109 and the status of the cleaning work.

[0241] Furthermore, according to the second embodiment described above, the image processing server 100A, upon receiving information from the mobile communication terminal 200 indicating that it has departed the base station, begins to acquire location information from the mobile communication terminal 200 that sent this information, and also begins recording a first travel trajectory without cleaning work. In addition, upon receiving information from the mobile communication terminal 200 indicating the start of work, it terminates the recording of the first travel trajectory and begins recording a second travel trajectory with cleaning work based on the acquired location information, and upon receiving information from the mobile communication terminal 200 indicating the end of work, it terminates the recording of the second travel trajectory. Furthermore, upon receiving information indicating the end of work, it begins recording the first travel trajectory, and upon receiving information indicating arrival at the base station, it terminates the recording of the first travel trajectory.

[0242] Furthermore, the image processing server 100A generates an image in which the first and second driving trajectories are superimposed on the highway image 403b of the map image 403a, based on the recorded first and second driving trajectories, and transmits the image data of the generated image to the communication terminal 102. This allows the communication terminal 102 to easily and visually understand which roads are being used to reach the site, which road locations are being used for cleaning work, and how far the cleaning work has progressed.

[0243] Furthermore, according to the second embodiment described above, the image processing server 100A generates a cleaning report based on work status information corresponding to the cleaning work from the mobile communication terminal 200, which includes information on the cleaning worker who performed the cleaning work (cleaning company name, team name, etc.), information indicating the content of the cleaning work, information on the work location (route name, etc.), time information for departure from the base, start of work, end of work, and arrival at the base, as well as images related to the work status and images of abnormal locations. In addition, it generates an image (see Figure 38) displaying a summary list of cleaning reports searched using search conditions (report date period, company name, team name, status, etc.) corresponding to the instructions from the communication terminal 102. Furthermore, it generates an image (see detailed information 408Cd in Figure 39(b)) displaying the details of the cleaning report corresponding to the summary selected from the summary list in response to the instructions from the communication terminal 102. As a result, cleaning workers, who are the crew of the cleaning vehicle 109, can send information indicating their work status, time information, location information, etc., to the image processing server 100A via the mobile communication terminal 200. The image processing server 100A can then generate a cleaning report, enabling more accurate cleaning reports and reducing the effort required for cleaning workers to submit them. Furthermore, the communication terminal 102 allows users to select a desired cleaning report from the search results that meet the desired conditions and display its details. This makes it easier for managers to verify and inspect cleaning work using on-site photos and detailed reports. Consequently, cleaning operations management can be made more efficient.

[0244] Furthermore, according to the second embodiment described above, the mobile communication terminal 200 transmits information about images related to the cleaning work status and images of abnormal locations to the image processing server 100A, along with information about the date and time of transmission and location information at the time of transmission. The image processing server 100A generates an image in which a photographic marker image (see photo icon 110 in Figure 41) for recognizing the transmission order and transmission location of images related to the cleaning work status and images of abnormal locations is superimposed on the highway image 403b of the map image 403a, and an image in which information about images related to the work status or images of abnormal locations corresponding to the selection result (see summary information 110v and screen 110sc in Figure 41) is superimposed based on the selection result of the photographic marker image from the communication terminal 102. As a result, the communication terminal 102 can easily visually grasp the location and transmission order of the photographic image data, and can manage photographs by number. In addition, any photographic image and its summary can be displayed, so images related to the work status or images of abnormal locations can be easily checked. In addition, since the photographic images can be enlarged or reduced, the content of the photographic images can be easily checked. [Correspondence in the second embodiment] In the second embodiment described above, the process of recording the first travel trajectory of the RT cleaning information display processing unit 71 corresponds to the first travel trajectory recording means, and the process of recording the second travel trajectory of the RT cleaning information display processing unit 71 corresponds to the second travel trajectory recording means.

[0245] Furthermore, in the second embodiment described above, the cleaning report generation process of the cleaning work report processing unit 72 corresponds to the cleaning report generation means, Figure 37 corresponds to the first and eighth images, Figure 39(a) corresponds to the second image, Figure 38 corresponds to the ninth image, Figure 39(b) corresponds to the second and tenth images, and Figure 41 corresponds to the eleventh and twelfth images. [Variation] In the above embodiment, the operator selects and inputs the number of repetitions, such as the number of spraying cycles. However, the configuration is not limited to this, and the server may store the number of cycles for each work group and automatically input the number of spraying cycles plus one.

[0246] Furthermore, in the first embodiment and its modifications, the system may be configured to optimize operations based on the driving trajectory of the work vehicle corresponding to the snow and ice countermeasures work, information on the number of repetitions of the repeated work, information on the content of the snow and ice countermeasures work, environmental information such as weather, temperature, humidity, and road temperature during the work, and information on the work results. For example, the image processing server may associate this information and store it in the storage device 52 or database server to form big data from the past to the present, and based on this big data, an AI (Artificial Intelligence) model may be trained using, for example, driving trajectory data as training data. Then, the trained model may be used to estimate the optimal driving route and work content (e.g., the number of times saltwater is sprayed) corresponding to the work content to be performed and the environmental information at the time of execution. The same configuration can be applied to the cleaning work of the second embodiment.

[0247] In this case, for example, the information of the estimation result is output to the communication terminal 102, and the work manager using the communication terminal 102 transmits the information of the estimation result or the instructions decided by referring to this information to the occupants (workers) of the work vehicle. This transmission may be carried out by sending the instruction information from the communication terminal 102 to the mobile communication terminal 200 via the network 120, or, if the work vehicle is equipped with a digital radio, voice transmission by radio may be used. Furthermore, while the second embodiment and its modified form described above are configured specifically for cleaning work, the system is not limited to this configuration. Other configurations are also possible, such as one that incorporates the system of the first embodiment described above.

[0248] Furthermore, the present invention is not limited to the embodiments described above, and includes various modifications. For example, the embodiments described above are described in detail to make the present invention easier to understand, and are not necessarily limited to those having all the configurations described. Also, it is possible to replace parts of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of each embodiment with other configurations. [Explanation of symbols]

[0249] 100 Image processing server, 30 CPU, 32 ROM, 34 RAM, 38 I / F, 50 Input device, 52 Storage device, 54 Display device, 56 Communication device, 102 Communication terminal, 103 Traffic patrol car, 103i~108i, 103c~108c, 103s~108s icons, 103v, 104v~108v, 104vc~108vc, 109v, 109vr, 110v, 210v, 300v Overview information, 104~108 Work vehicles, 110 Photo icon, 120 Network, 130 Base station, 200 Information and communication terminal, 250 Saltwater P icon, 300 Wearable camera, 400, 400C Main screen, 403a Map image, 403b Highway image

Claims

1. A road maintenance management support system comprising: an information and communication terminal corresponding to a work vehicle for performing prescribed work related to the maintenance or management of the road environment of an expressway; a communication terminal; and an image processing server that is connected to the information and communication terminal and the communication terminal via a communication line, The aforementioned image processing server is A first work information acquisition means that acquires location information of the work vehicle and work status information relating to the work status of the predetermined work corresponding to the location information from the information communication terminal, A means for acquiring map information, Image generation processing means for generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map, and a second image which is an image in which information regarding the current working status of the work vehicle is superimposed on the first image. The system includes an image data transmission means for transmitting image data of the image generated by the image generation processing means to the communication terminal, The aforementioned information and communication terminal is This is a portable terminal that can be carried by the occupants of the aforementioned work vehicle. A means for acquiring location information to obtain the location information of the device, An input means on which the crew member can input information, A second work information acquisition means that acquires the work status information based on the input information input via the input means, The system includes an information transmission means that transmits the location information acquired by the location information acquisition means and the work status information acquired by the second work information acquisition means to the image processing server, The aforementioned communication terminal is A road maintenance support system characterized by comprising image display means for displaying an image based on the image data from the image processing server.

2. The communication terminal includes instruction transmission means for transmitting instructions related to image display to the image processing server. The road maintenance support system according to claim 1, characterized in that the image generation processing means generates a second image in which information regarding the working status of the work vehicle corresponding to the instruction is superimposed on the first image based on an instruction from the communication terminal.

3. The road maintenance and management support system according to claim 2, characterized in that the predetermined work includes at least one of the following: snow and ice response work, which is work related to maintaining or managing the road environment of the expressway in relation to snow accumulation and freezing, and cleaning work for maintaining the road environment of the expressway.

4. The road maintenance management support system according to claim 3, characterized in that the work status information includes information on the worker performing the predetermined work, information indicating the work content, information on the date and time of the work, identification information for identifying the work location, and information indicating the work status.

5. The aforementioned information and communication terminal is equipped with a means for taking images, The road maintenance support system according to claim 4, characterized in that the information indicating the work status includes image information relating to the work status taken by the photographic means outside the vehicle.

6. The second work information acquisition means acquires, as work status information, information indicating the start of travel of the work vehicle from the base, information indicating the start of work, and information indicating the end of work. The first work information acquisition means, upon acquiring the information indicating the start of driving, starts acquiring the location information from the information communication terminal that is the source of the information, The image processing server includes a driving trajectory recording means that, when the first work information acquisition means acquires information from the information communication terminal indicating the start of the work, records the driving trajectory based on the location information acquired by the first work information acquisition means, and when the first work information acquisition means acquires information from the information communication terminal indicating the end of the work, terminates the recording of the driving trajectory. The road maintenance support system according to claim 4, characterized in that the image generation processing means generates a third image in which the driving trajectory recorded by the driving trajectory recording means is superimposed along the road on the map.

7. The aforementioned snow and ice countermeasures include work that is repeatedly performed on the same road section. The work status information corresponding to the snow and ice countermeasure work further includes information on the number of times the work is repeated, The second work information acquisition means acquires information indicating the number of repetitions as work status information, The road maintenance support system according to claim 6, characterized in that the image generation processing means generates a third image in which the driving trajectory in the time range is superimposed and color-coded according to the number of repetitions, based on the time range instructed by the communication terminal and the information on the number of repetitions acquired by the first work information acquisition means.

8. The aforementioned repeated operations include the operation of spraying salt water on the road surface. The road maintenance support system according to claim 7, characterized in that the image generation processing means generates a fourth image in which a plant sign image for recognizing the location of a brine plant that stores brine and sodium chloride for producing brine is superimposed on the map, and a fifth image which is an image in which information regarding the inventory status of brine and sodium chloride at the brine plant in response to instructions from the communication terminal is superimposed on the fourth image.

9. The road maintenance support system according to claim 8, characterized in that the image generation processing means generates a fifth image in which information showing changes in the inventory status of the saltwater plant at predetermined intervals in response to instructions from the communication terminal is displayed.

10. The aforementioned snow and ice response operations include patrol operations for snow and ice on the aforementioned expressway, The work status information corresponding to the patrol work includes patrol report information which includes information indicating the condition of the road surface at the road location to be patrolled, information on the weather at the road location, and information on images of the road surface at the road location taken by the photographic means. The road maintenance support system according to claim 5, characterized in that the image generation processing means generates a sixth image in which a reporting sign image for recognizing the reporting location of the patrol report information is superimposed on the road on the map, using the location information obtained when the first work information acquisition means acquires the patrol report information as reporting location information, and a seventh image in which a patrol report including the patrol report information corresponding to the reporting sign image corresponding to the instruction from the communication terminal is superimposed on the sixth image.

11. The second work information acquisition means acquires work status information corresponding to the cleaning work, including information indicating departure from the base, information indicating the start of work, information on at least images relating to the work status from among images relating to the work status and images of abnormal areas taken by the photography means, information indicating completion of work, and information indicating arrival at the base. The first work information acquisition means, upon acquiring information indicating that the base has departed, starts acquiring the location information from the information communication terminal that is the source of the information, The aforementioned image processing server is A first travel trajectory recording means records a first travel trajectory, which is a travel trajectory during movement without cleaning work based on the location information acquired by the first work information acquisition means, when the first work information acquisition means acquires information from the information communication terminal indicating that the base has departed or information indicating that the work has been completed, and terminates recording of the first travel trajectory when the first work information acquisition means acquires information from the information communication terminal indicating that the base has arrived, The system includes a second travel trajectory recording means which, when the first work information acquisition means acquires information from the information communication terminal indicating the start of the work, records a second travel trajectory which is a travel trajectory involving cleaning work based on the location information acquired by the first work information acquisition means, and when the first work information acquisition means acquires information from the information communication terminal indicating the end of the work, it terminates the recording of the second travel trajectory. The road maintenance support system according to claim 5, characterized in that the image generation processing means generates an eighth image in which the first and second driving trajectories recorded by the first and second driving trajectory recording means are superimposed on the map with the first and second driving trajectories color-coded along the roads.

12. The image processing server includes a cleaning report generation means that generates a cleaning report based on work status information corresponding to the cleaning work from the information and communication terminal, which includes information on the worker who performed the cleaning work, information indicating the content of the cleaning work, information on the work location, time information for departure from the base, start of work, end of work and arrival at the base, and at least information on images related to the work status and images of abnormal locations, wherein the cleaning report includes information on images related to the work status and images related to abnormal locations. The road maintenance support system according to claim 5, characterized in that the image generation processing means generates a ninth image displaying a summary list of the cleaning reports searched using search conditions corresponding to instructions from the communication terminal, and generates a tenth image in which the details of the cleaning report corresponding to the summary selected from the summary list are superimposed on the ninth image in response to instructions from the communication terminal.

13. The information transmission means transmits images relating to the status of the cleaning work and images of the abnormal areas to the image processing server, along with information on the date and time of transmission and location information at the time of transmission. The road maintenance support system according to claim 12, characterized in that the image generation processing means generates an 11th image in which photographic marker images for recognizing the transmission order and transmission position of images relating to the work status of the cleaning work and images of abnormal locations are superimposed on the road on the map, and a 12th image in which information relating to the work status or images of abnormal locations corresponding to the selection result is superimposed on the 11th image based on the selection result of the photographic marker images in the 11th image from the communication terminal.

14. The aforementioned predetermined work includes road surface temperature measurement work using a work vehicle equipped with a first road surface temperature sensor for measuring road surface temperature, a position information measuring device for measuring the vehicle's position information, and a communication device capable of communicating with the image processing server via the communication line, The aforementioned expressway has second road surface temperature sensors installed at predetermined intervals along the road to measure the road surface temperature throughout the entire road or in a predetermined area. The aforementioned road temperature measurement operation is performed on road locations where the road temperature measured by the second road temperature sensor is below a predetermined temperature or where the change in said road temperature is above a predetermined temperature. The road maintenance support system according to claim 3, characterized in that the image generation processing means generates a 13th image in which the distribution of measured road surface temperatures at the relevant road location is superimposed along the road on a map, based on road surface temperature information and location information from a work vehicle corresponding to the road temperature measurement work using the first road temperature sensor.

15. The road maintenance support system according to claim 14, characterized in that the image generation processing means generates, as the 13th image, an image in which the roads on the map are color-coded along the roads on the map based on the measured values.

16. The road maintenance support system according to claim 3, characterized in that the image generation processing means generates an image as the first image in which multiple types of sign images different for each predetermined task, each movement state of the work vehicle, or each work state of the predetermined task are superimposed, and based on instructions from the communication terminal regarding the task, the movement state, or the work state, generates the first image in which only the type of sign image corresponding to the instruction is superimposed on the map.

17. An information and communication terminal corresponding to a work vehicle for performing prescribed tasks related to the maintenance or management of the road environment of a highway, and an image processing server that is connected to the communication terminal via a communication line, A work information acquisition means that acquires location information of the work vehicle from the information and communication terminal and work status information relating to the work status of the predetermined work corresponding to the location information, A means for acquiring map information, Image generation processing means for generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map, and a second image which is an image in which information regarding the current working status of the work vehicle is superimposed on the first image. An image processing server characterized by comprising an image data transmission means for transmitting image data of an image generated by the image generation processing means to the communication terminal.

18. An information and communication terminal for a work vehicle used to perform prescribed tasks related to the maintenance or management of the road environment on a highway, This is a portable terminal that can be carried by the occupants of the aforementioned work vehicle. The image processing server is connected via a communication line, enabling communication. A means for acquiring location information to obtain the location information of the device, An input means on which the crew member can input information, A work information acquisition means that acquires work status information relating to the work status of a predetermined work based on input information input via the input means, An information communication terminal characterized by comprising: an information transmission means for transmitting the location information acquired by the location information acquisition means and the work status information acquired by the work information acquisition means to the image processing server.

19. An information and communication terminal corresponding to a work vehicle for performing prescribed work related to the maintenance or management of the road environment of a highway, and an image processing method for an image processing server that is connected to the communication terminal via a communication line, The steps include: acquiring location information of the work vehicle from the information and communication terminal and work status information relating to the work status of the predetermined work corresponding to the location information; Steps to obtain map information, The steps include generating a first image in which a sign image for recognizing the current location of the work vehicle is superimposed on the road on the map, The steps include generating a second image which is an image in which information regarding the current working status of the work vehicle is superimposed on the first image, An image processing method characterized by comprising the step of transmitting the image data of the generated image to the communication terminal.

Citation Information

Patent Citations

  • Integrated operation machine for road maintenance working vehicle

    JP2011008383A