Information processing device, information processing system, information processing method, and program

Abstract

The purpose of the present invention is to provide an information processing device that makes it possible to appropriately perform vehicle monitoring in accordance with the situation of a monitor. This information processing device (100) comprises an acquisition means (101) that acquires vehicle situation information about the situation of a vehicle that is a monitoring target, a detection means (102) that detects attention-requiring states that require attention during monitoring of the vehicle on the basis of the vehicle situation information, an estimation means (103) that estimates a characteristic of a monitor of the vehicle on the basis of an image captured of the monitor, and an output control means (104) that controls output of warnings to the monitor on the basis of the estimated characteristic.

Description

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium.

[0002] A technology is known in which a monitoring center remotely monitors a vehicle using images captured inside and outside the vehicle, vehicle location information, and the like. For example, the monitoring center is equipped with a monitoring device for monitoring the vehicle, and the monitoring device displays the status of the monitored vehicle on a display device. Furthermore, when a state requiring attention in vehicle monitoring (hereinafter referred to as a "caution-requiring state") is detected, the monitoring device displays a warning (alert), thereby enabling efficient monitoring. However, if too many warnings are issued relative to the number of monitors, there is a risk of a delay in response. Therefore, it is desirable to appropriately set the conditions for issuing the warning.

[0003] As a related technique, Patent Document 1 discloses an information processing system that acquires location information of a vehicle to be monitored and determines a monitoring priority of the vehicle based on movement information related to the movement of the vehicle. The information processing system generates presentation information for monitoring the vehicle based on the monitoring priority and outputs the presentation information to a presentation device.

[0004] Furthermore, when there are multiple monitors, the information processing system can change the monitoring priority according to their experience in dealing with situations requiring attention. For example, suppose that monitor A has dealt with "merging" more often in the past than monitor B. In this case, the information processing system can change the monitoring priority so that monitor A is given priority over monitor B in dealing with "merging."

[0005] Japanese Patent Application Laid-Open No. 2020-061121

[0006] It is desirable for the monitoring ability of a monitor to remain constant regardless of the monitoring timing. However, monitoring ability can change depending on the monitor himself or herself and the surrounding circumstances. For example, if a monitor is in poor health, the monitor's monitoring ability may decline. In such a case, it is also expected that the monitoring ability of the monitoring center as a whole will decline.

[0007] In view of the above-mentioned problems, the object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that are capable of appropriately monitoring vehicles according to the situation of the monitor.

[0008] The information processing device according to the present disclosure comprises an acquisition means for acquiring vehicle status information relating to the status of a vehicle being monitored; a detection means for detecting a state requiring caution in monitoring the vehicle based on the vehicle status information; an estimation means for estimating characteristics of a monitor based on an image of the monitor of the vehicle; and an output control means for controlling the output of a warning to the monitor regarding the state requiring caution based on the estimated characteristics.

[0009] The information processing system according to the present disclosure comprises a sensor that acquires vehicle status information regarding the status of a vehicle being monitored, and an information processing device, wherein the information processing device has: an acquisition means that acquires the vehicle status information from the sensor; a detection means that detects a state requiring attention when monitoring the vehicle based on the vehicle status information; an estimation means that estimates characteristics of the monitor based on an image of the monitor of the vehicle; and an output control means that controls the output of a warning regarding the state requiring attention to the monitor based on the estimated characteristics.

[0010] The information processing method disclosed herein acquires vehicle status information regarding the status of a vehicle being monitored, detects a state requiring caution in monitoring the vehicle based on the vehicle status information, estimates characteristics of the monitor based on an image of the monitor of the vehicle, and controls the output of a warning regarding the state requiring caution to the monitor based on the estimated characteristics.

[0011] A non-transitory computer-readable medium storing a program according to the present disclosure causes a computer to execute the following processes: an acquisition process for acquiring vehicle status information regarding the status of a vehicle being monitored; a detection process for detecting a state requiring attention in monitoring the vehicle based on the vehicle status information; an estimation process for estimating characteristics of a monitor based on an image of the monitor of the vehicle; and an output control process for controlling the output of a warning regarding the state requiring attention to the monitor based on the estimated characteristics.

[0012] The present disclosure makes it possible to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that are capable of appropriately monitoring a vehicle depending on the situation of the monitor.

[0013] 1 is a block diagram showing the configuration of an information processing device according to a first embodiment; FIG. 2 is a flowchart showing processing performed by the information processing device according to the first embodiment; FIG. 3 is a block diagram showing the configuration of an information processing system according to a second embodiment; FIG. 4 is a diagram showing an example of an integrated monitoring screen and a detailed monitoring screen displayed on a display unit according to the second embodiment; FIG. 5 is a diagram showing an example of screen switching between the integrated monitoring screen and the detailed monitoring screen according to the second embodiment; FIG. 6 is a flowchart showing processing performed by the information processing device according to the second embodiment; and FIG. 7 is a block diagram showing an example of the hardware configuration of a computer that realizes the information processing device etc. according to the second embodiment.

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.

[0015] First Embodiment A first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of an information processing device 100 according to this embodiment. The information processing device 100 includes an acquisition unit 101, a detection unit 102, an estimation unit 103, and an output control unit 104.

[0016] The acquisition unit 101 acquires vehicle status information relating to the status of the vehicle being monitored. The detection unit 102 detects a caution-requiring state that requires careful monitoring of the vehicle based on the vehicle status information. The estimation unit 103 estimates characteristics of the monitor based on an image of the monitor. The output control unit 104 controls the output of a warning to the monitor regarding the caution-requiring state based on the estimated characteristics.

[0017] The information processing device 100 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processing according to this embodiment. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of an acquisition unit 101, a detection unit 102, an estimation unit 103, and an output control unit 104.

[0018] Next, the process performed by the information processing device 100 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the process performed by the information processing device 100.

[0019] First, the acquisition unit 101 acquires vehicle status information regarding the status of the vehicle being monitored (S101). Next, the detection unit 102 detects a caution-requiring state that requires careful monitoring of the vehicle based on the vehicle status information (S102). Next, the estimation unit 103 estimates characteristics of the monitor based on an image of the monitor (S103). Then, the output control unit 104 controls the output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristics (S104).

[0020] With this configuration, the information processing device 100 according to this embodiment estimates the characteristics of the observer using an image of the observer. The information processing device 100 also controls the output of a warning based on the estimation result. This enables the information processing device 100 to appropriately monitor the vehicle depending on the situation of the observer.

[0021] <Embodiment 2> Next, embodiment 2 will be described. Embodiment 2 is a specific example of embodiment 1 described above. Fig. 3 is a block diagram showing the configuration of an information processing system 50 according to this embodiment. As shown in the figure, the information processing system 50 includes an information processing device 10, a monitoring device 20, an in-vehicle device 30, and infrastructure 40. The information processing system 50 is an information processing system that can monitor vehicles located in remote locations by performing predetermined information processing.

[0022] The information processing device 10, the monitoring device 20, the in-vehicle device 30, and the infrastructure 40 are connected to each other via a network (not shown). The network is a wired or wireless communication line. The network may be, for example, the Internet, a dedicated line, a telephone line, a mobile communication network, or other communication line. The network may also be a combination of these.

[0023] (Monitoring Center C) The monitoring center C is an area that serves as a base for remotely monitoring vehicles. A monitor is assigned to monitor the vehicles at the monitoring center C. Although one monitor A is shown in the figure, the monitoring center C may assign multiple monitors.

[0024] The monitoring center C is equipped with a monitoring device 20, a display unit 22, an operation unit 23, and a monitor camera 25. For the sake of explanation, the display unit 22, the operation unit 23, and the monitor camera 25 are shown external to the monitoring device 20, but some or all of these may be configured to be built into the monitoring device 20.

[0025] The monitoring device 20 performs predetermined information processing for monitoring the vehicle. The monitoring device 20 may be, for example, a personal computer (PC). Alternatively, the monitoring device 20 may be configured to communicate with the information processing device 10, the in-vehicle device 30, or the infrastructure 40 via a web browser over the Internet or the like.

[0026] The display unit 22 displays the vehicle to be monitored. Furthermore, when a caution-requiring state is detected, the display unit 22 displays a warning about the caution-requiring state. The display unit 22 is, for example, a display device such as a display. The display unit 22 may be a display with a touch panel that allows input operations to be performed by touching it with a finger or the like. Furthermore, the monitoring center C may be provided with a plurality of display units 22. The monitoring center C may be provided with a display unit 22 corresponding to each of a plurality of monitors.

[0027] Here, a caution-requiring state indicates a state that requires careful monitoring of the vehicle. A caution-requiring state is, for example, a state in which an abnormality has occurred in the vehicle or its occupants. An example of a vehicle abnormality is an abnormality in the vehicle body. An abnormality in the vehicle body can be anything related to the vehicle body, such as a breakdown, an accident, or a lack of power. Vehicle abnormalities can also include vehicle stoppages due to these abnormalities. For example, vehicle abnormalities can also include cases in which a bus or truck is not running on schedule or is delayed at its destination.

[0028] Examples of occupant abnormalities include abnormalities of the driver or passengers. An occupant abnormality is, for example, poor physical condition of the driver or passengers. If the vehicle is a bus or the like, occupant abnormalities may include poor physical condition of passengers, injuries of passengers, trouble between passengers, or trouble with passengers getting on and off. For example, abnormalities may include the occurrence of a situation where the bus cannot depart due to passengers getting on and off, or the occurrence of passengers requesting assistance.

[0029] The above-described abnormality is merely an example, and the condition requiring attention may include other conditions. For example, the condition requiring attention may be related to the environment around the vehicle. For example, the condition requiring attention may include the collapse of surrounding buildings, damage to road facilities, or the occurrence of a disaster.

[0030] The monitoring device 20 includes a display control unit 21 that controls display on the display unit 22. The display control unit 21 acquires video from the information processing device 10 and displays the video on the display unit 22. The video may include a monitored vehicle. The display control unit 21 may display the video in real time. Note that in this disclosure, "video" may refer to video data, which is data of the video. Similarly, in this disclosure, "image" may refer to image data, which is data of the image.

[0031] The display control unit 21 also acquires warning information from the information processing device 10 and displays the warning on the display unit 22. The warning information is information for warning an observer about a caution-requiring state. The warning information may be information for notifying that a vehicle is in a caution-requiring state. The warning information may include information for identifying the vehicle in which the caution-requiring state has been detected and information about the content of the caution-requiring state.

[0032] The warning information may be, for example, text information or image information indicating a state requiring attention. The warning information may also be audio information output by an audio output device (not shown). The warning information is not limited to these, and various types of information such as lighting, a buzzer, or vibration may also be used. The warning information may also be a combination of the above-mentioned information.

[0033] The monitor A shown in the figure can monitor vehicles by visually checking the display on the display unit 22. Furthermore, the monitor A can recognize a vehicle for which a cautionary state has been detected (hereinafter, may be referred to as a "cautionary vehicle") by receiving a warning. This allows the monitor A to monitor vehicles more carefully than usual. Furthermore, the monitor A takes action against the cautionary vehicle as necessary.

[0034] Here, examples of screens displayed on the display unit 22 will be described with reference to Fig. 4. Fig. 4 is a diagram showing examples of the integrated monitoring screen 22a and the detailed monitoring screen 22b displayed on the display unit 22. The integrated monitoring screen 22a is a screen that simultaneously displays multiple vehicles. The detailed monitoring screen 22b is a screen that displays vehicles that require the attention or intervention of a monitor. In the example shown in the figure, the integrated monitoring screen 22a displays a screen for monitoring each of vehicles 1 to 10. Note that although the figure uses the same diagram as an example of a screen display for vehicles 1 to 10, in reality, images corresponding to each vehicle are displayed in each display area.

[0035] The display control unit 21 automatically switches between the integrated monitoring screen 22a and the detailed monitoring screen 22b depending on the status of the vehicles 1 to 10. For example, the display control unit 21 displays the integrated monitoring screen 22a when no caution-requiring state is detected in the vehicles 1 to 10. When a caution-requiring state is detected among the vehicles 1 to 10, the display control unit 21 switches the display to the detailed monitoring screen 22b, which displays the caution-requiring vehicle that has entered the caution-requiring state. The display control unit 21 may switch between the integrated monitoring screen 22a and the detailed monitoring screen 22b depending on the operation of the monitor.

[0036] The lower part of the figure shows a detailed monitoring screen 22b when a caution-requiring state is detected for the vehicle 1. The display control unit 21 displays the detailed monitoring screen 22b that displays the vehicle 1. For example, if an abnormality occurs inside or outside the vehicle 1 and an action is required, the monitor can remotely control the vehicle 1 to avoid an accident or the like.

[0037] Here, an example of screen switching performed on the display unit 22 when multiple monitors are assigned will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of screen switching between an integrated monitoring screen 22a and a detailed monitoring screen 22b. In this example, monitors A and B are assigned for monitoring. Monitor A uses the display unit 221, and monitor B uses the display unit 222.

[0038] During normal monitoring, the display units 221 and 222 each display the integrated monitoring screen 22a, so that the monitors A and B each monitor the vehicle by viewing the integrated monitoring screen 22a.

[0039] The upper part of the figure shows an example of a screen when a caution-requiring state is detected in vehicle 3 and a warning is output. The display control unit 21 displays the warning in the display area of ​​vehicle 3. Here, it is assumed that monitor A is in charge of monitoring vehicle 3. The responsible monitor can be determined by the information processing device 10.

[0040] The display control unit 21 causes the display unit 221 to display a detailed monitoring screen 22b relating to the vehicle 3. The display control unit 21 changes the integrated monitoring screen 22a that has been displayed up until then to display the detailed monitoring screen 22b that displays the vehicle 3. As a result, when a warning is issued for the vehicle 3, the screen of the display unit 221 is automatically switched to the detailed monitoring screen 22b. The monitor A monitors the vehicle 3 by viewing the detailed monitoring screen 22b after the switch. In the example shown in the figure, the monitor B continues monitoring by viewing the normal integrated monitoring screen 22a.

[0041] Here, it is assumed that a caution-requiring state is detected in vehicle 5 and a warning is issued. For example, the display control unit 21 identifies the screens displayed on the display units 221 and 222, and selects the display unit that will display the detailed monitoring screen 22b for vehicle 5. As shown in the figure, it is assumed that monitor A is currently attending to vehicle 3, and the display unit 221 is displaying the detailed monitoring screen 22b for vehicle 3.

[0042] The display control unit 21 selects the display unit 222 on which the integrated monitoring screen 22a is displayed, and displays the detailed monitoring screen 22b related to the vehicle 5. As a result, when a warning is issued to the vehicle 5, the display screen of the display unit 222 is automatically switched to the detailed monitoring screen 22b. The monitor B can monitor the vehicle 5 by visually checking the display unit 222.

[0043] In this way, the display control unit 21 switches the display on the display unit 22 depending on whether or not there is a vehicle requiring attention. This reduces the monitoring and operation burden on the monitor. It also enables a small number of monitors to monitor a large number of vehicles.

[0044] Returning to FIG. 3 , the explanation of the monitoring center C will be continued. The operation unit 23 accepts operations from the monitor. For example, the operation unit 23 accepts input of instructions to be given by the monitor to the vehicle 35. The operation unit 23 transmits the accepted content to the information processing device 10. The monitor can remotely control the vehicle 35 by operating the operation unit 23. This allows the monitor to deal with abnormalities in the vehicle or occupants and resolve the state requiring attention.

[0045] The monitor camera 25 is a photographing device that photographs the monitor. The monitor camera 25 is installed, for example, at a predetermined position in the monitoring center C. The monitor camera 25 transmits an image photographed by the monitor camera 25 (hereinafter, sometimes referred to as a "monitor image") to the information processing device 10. The image may be a still image or a moving image. A microphone that captures sound emitted by the monitor may be installed together with the monitor camera 25.

[0046] Here, an example of monitoring performed by the monitor will be described. The monitor monitors high-risk traffic scenes. High-risk traffic scenes include, for example, places with heavy traffic, places with many people, or places with blind spots. The monitor also monitors the driving performed by the driver of the vehicle 35. For example, the monitor monitors whether the driver is driving safely. Specifically, the monitor monitors whether the driver stops, obeys traffic lights, obeys speed limits, etc.

[0047] The monitor also monitors the operating status of the vehicle 35. The monitor monitors whether the vehicle 35 is running or stopped, the running position of the vehicle 35, whether the vehicle 35 is running as planned, and the like.

[0048] Next, an example of an operation performed by the monitor will be described. The monitor uses the operation unit 23 to give instructions to the vehicle 35 via the information processing device 10. This allows the operation unit 23 to accept input from the monitor and control the vehicle 35.

[0049] For example, the monitor intervenes in the driving control of the vehicle 35. The monitor may cause the vehicle 35 to perform a predetermined automatic driving mode, or the monitor may directly operate the vehicle 35 by manually driving the vehicle 35. Examples of predetermined automatic driving include immediately stopping the vehicle 35, or moving the vehicle 35 to the side of the road and then stopping it. The monitor may switch (override) from manual driving to automatic driving, or from automatic driving to manual driving.

[0050] When switched to manual driving, the operation unit 23 manually drives the vehicle 35 in response to the operation of the monitor. In this way, the monitor remotely controls the vehicle 35 using the operation unit 23. For example, the monitor issues an emergency stop instruction to the vehicle 35, thereby bringing the vehicle 35 to an emergency stop. The monitor may also make an announcement on the vehicle to passengers in the vehicle 35.

[0051] Although the present embodiment shows an example in which a monitor deals with a cautionary state, the monitoring center C may also have a separate operator assigned to deal with the situation.

[0052] (On-Vehicle Device 30) The on-vehicle device 30 is an information processing device mounted on a vehicle 35 to be monitored. The on-vehicle device 30 is a so-called edge-side device. The on-vehicle device 30 acquires vehicle status information related to the status of the vehicle to be monitored using a sensor (not shown) and transmits the information to the information processing device 10. An on-vehicle device 30 may be provided in each of multiple vehicles to be monitored. The vehicle status information is, for example, an image captured of the vehicle or the area around the vehicle. Other examples of the vehicle status information include three-dimensional measurement information measured by a sensor such as a laser, radar, or LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging). The vehicle status information may be the speed or acceleration of the vehicle 35. The vehicle status information may be operation information of the vehicle 35, such as a steering wheel angle, brake pressure, or opening and closing of a vehicle door. The vehicle status information may be position information of the vehicle 35.

[0053] The in-vehicle device 30 includes a video transmission unit 31, an information transmission unit 32, and a vehicle control unit 33. The video transmission unit 31 transmits video of the situation of the vehicle 35 to the information processing device 10. The video is captured using a camera (not shown). The camera is installed inside or outside the vehicle 35 and can capture the interior or exterior of the vehicle. The vehicle 35 may be equipped with both an in-vehicle camera and an exterior camera. The video of the interior of the vehicle may include video of the passengers inside the vehicle. For example, if the vehicle 35 is a bus or a taxi, the video transmission unit 31 acquires video including passengers and transmits the video. Note that, although not shown, the in-vehicle device 30 may not only acquire video but also acquire information on audio generated inside or outside the vehicle 35 and transmit the video to the information processing device 10.

[0054] The information transmission unit 32 acquires information from a sensor (not shown) provided in the vehicle 35, and transmits the acquired information to the information processing device 10. For example, the information transmission unit 32 acquires position information of the vehicle 35 using a position sensor. The position sensor detects the current position of the vehicle 35. The position sensor receives positioning signals transmitted from a plurality of artificial satellites such as GNSS (Global Navigation Satellite System), and performs positioning based on these positioning signals.

[0055] The information transmitting unit 32 may acquire information about the vehicle 35 in addition to the location information and transmit it to the information processing device 10 .

[0056] The vehicle control unit 33 receives instruction information from the information processing device 10. The vehicle control unit 33 controls the running and operation of the vehicle 35 based on the instruction information. For example, the vehicle control unit 33 controls the running of the vehicle 35 using a vehicle control ECU (Electronic Control Unit) (not shown) in accordance with instructions from the information processing device 10. The vehicle control ECU may include, for example, a power unit control ECU and a brake ECU that perform acceleration / deceleration control of the vehicle 35.

[0057] (Infrastructure 40) The infrastructure 40 is equipment (for example, traffic lights) installed near a road. The infrastructure 40 includes a sensor that acquires vehicle status information. Here, an infrastructure camera 45 will be used as an example of the sensor. The infrastructure camera 45 is an imaging device that captures images of the road or the area around the road. The infrastructure camera 45 may also include a microphone that captures audio of the road or the area around the road.

[0058] The video transmission unit 41 transmits the video captured by the infrastructure camera 45 to the information processing device 10. The video transmission unit 41 may be provided in an information processing device such as a PC. Note that the information processing system 50 may include other components capable of transmitting vehicle status information to the information processing device 10, in addition to the in-vehicle device 30 and the infrastructure 40. The information processing system 50 may also be configured to include either the in-vehicle device 30 or the infrastructure 40.

[0059] (Information processing device 10) The information processing device 10 is an example of the above-mentioned information processing device 100. The information processing device 10 includes an acquisition unit 11, a detection unit 12, an estimation unit 13, an output control unit 14, a calculation unit 15, an information transmission unit 16, a video transmission unit 17, a warning processing unit 18, and a storage unit 19. The information processing device 10 may be realized, for example, by a cloud computing system.

[0060] The acquisition unit 11 is an example of the acquisition unit 101 described above. The acquisition unit 11 acquires vehicle status information including information about the status of the vehicle. The vehicle status information is, for example, a video image of the vehicle or the area around the vehicle. The vehicle status information may also be vehicle location information.

[0061] The detection unit 12 is an example of the detection unit 102 described above. The detection unit 12 detects a vehicle state requiring attention based on vehicle status information. For example, the detection unit 12 detects the state requiring attention based on video transmitted from the in-vehicle device 30. The detection unit 12 can detect the state requiring attention using well-known image recognition technology.

[0062] For example, the detection unit 12 estimates the posture of the passengers inside the vehicle. As a result, the detection unit 12 detects, for example, that a bus passenger has fallen. The detection unit 12 may also perform object recognition based on video. For example, the detection unit 12 detects a child running out in front of the vehicle. When the detection unit 12 detects such an object, it determines that the vehicle has transitioned to a caution state.

[0063] The detection unit 12 may also detect a caution-requiring state based on position information of the vehicle 35 transmitted from the in-vehicle device 30. For example, the detection unit 12 detects the movement status of the vehicle 35 based on changes in the position information. The detection unit 12 detects the caution-requiring state when the movement status of the vehicle 35 does not satisfy a predetermined condition. The predetermined condition may be, for example, an arrival time at a destination. The predetermined condition may be set in advance. The predetermined condition may also be set using a travel route, a travel speed, or the like.

[0064] The detection unit 12 may appropriately set a detection level for the caution state. The detection unit 12 may set the detection level, for example, based on a priority corresponding to the caution state. The priority may be set in advance according to the caution level indicated by the caution state. The caution level is, for example, information indicating the degree of possibility of danger to the vehicle or occupants. The caution level becomes higher as the possibility of a serious accident or trouble occurring increases. The priority may be set to correspond to the importance of the monitor addressing the caution state.

[0065] The detection level may be set in advance according to the monitoring quality desired by the administrator of the information processing system 50, for example, by receiving an input from the administrator. The detection unit 12 sets the detection level so that the higher the monitoring quality, the lower the level of the warning state to be detected. The detection unit 12 may select a vehicle for which a warning state is to be detected, based on the vehicle type or the like.

[0066] The estimation unit 13 is an example of the estimation unit 103 described above. The estimation unit 13 estimates the characteristics of the monitor (hereinafter, may be referred to as "monitor characteristics") based on an image of the monitor monitoring the vehicle. Here, the monitor characteristics indicate the nature of the monitor. The monitor characteristics may affect the quality of monitoring.

[0067] Specifically, the estimation unit 13 acquires an observer image captured by the observer camera 25. The estimation unit 13 can estimate the characteristics of the observer included in the observer image using image recognition technology, etc. The observer image may include multiple observers.

[0068] The observer characteristics may include, for example, number-of-persons information indicating the number of observers stationed at the monitoring center C. The estimation unit 13 acquires the number-of-persons information based on the observer image.

[0069] The observer characteristics may also include physical condition information related to the observer's physical condition. The physical condition information is, for example, information indicating the observer's physical condition, health state, fatigue level, level of drowsiness, heart rate, or concentration level. The estimation unit 13 estimates the physical condition information based on the observer image. For example, the estimation unit 13 detects the observer's line of sight movement based on the observer image. For example, the estimation unit 13 can estimate the observer's concentration level by calculating the number of times the observer has looked away. The estimation unit 13 may estimate the physical condition information based on the observer's physical condition reported by the observer himself / herself, in addition to the observer image.

[0070] If there are multiple monitors, the estimation unit 13 can estimate the physical condition information of each of the multiple monitors.

[0071] The output control unit 14 is an example of the above-mentioned output control unit 104. The output control unit 14 controls the output of a warning to the monitor regarding a state requiring caution, based on the estimated monitor characteristics.

[0072] The output control unit 14 controls the output amount of warnings or the output destination of warnings based on, for example, the monitor characteristics. The output amount indicates the number of warnings output to the display unit 22. The output amount may be the number of warnings for one monitor or the total number of warnings for multiple monitors.

[0073] The output destination indicates the display destination where the warning is to be displayed. The display destination indicates the responsible monitor who will be responsible for dealing with the warning. The output control unit 14 controls the output destination of the warning by switching the screen of the responsible monitor's display unit 22 from the integrated monitoring screen 22 a to the detailed monitoring screen 22 b.

[0074] For example, the output control unit 14 controls the amount of warning output based on the number of people information. For example, assume that five people are assigned to monitoring center C. The output control unit 14 determines the amount of warning output that can be handled by the five monitors. The amount of output that can be handled per person may be set in advance. Also, the amount of output that can be handled may be set for each monitor. Furthermore, the amount of output that can be handled for each corresponding content may be set. The output control unit 14 determines the amount of warning output with the amount of output that can be handled by one or more assigned monitors as the upper limit. This allows the output control unit 14 to adjust the frequency of warning output.

[0075] The output control unit 14 may also control the output destination of the warning based on the physical condition information. The output control unit 14 compares the physical condition information of multiple monitors and determines the output destination by giving priority to a monitor who is in good physical condition over a monitor who is not in good physical condition.

[0076] The output control unit 14 may also control the output of warnings based on the priorities corresponding to the caution-requiring states. For example, the output control unit 14 determines the output amount so as to output warnings with the top five priorities.

[0077] The output control unit 14 may determine the output amount so as to output a warning for a caution-requiring state whose priority is equal to or greater than a predetermined threshold. The predetermined threshold may be set in advance. The threshold may also be changed as appropriate depending on the required monitoring quality, etc.

[0078] The output control unit 14 may also determine the output amount based on a predetermined bias or weight. The predetermined bias and weight may be set in advance and may be changed as appropriate. For example, the output control unit 14 determines the total number of warnings to be output based on a bias set for the total number of warnings. Also, for example, the output control unit 14 determines the output amount of warnings based on weighting set according to the content of the attention-requiring state. In this way, the output control unit 14 can determine the output amount using weights according to the priority.

[0079] The output control unit 14 may control the output of the warning depending on the number of caution-requiring conditions detected in one vehicle. For example, the output control unit 14 may determine the output amount so as to issue a warning only when there are multiple caution-requiring conditions.

[0080] The output control unit 14 may also control the output destination of the warning based on capability information indicating the capability of the monitor. The capability information may include history information indicating the status of driving assistance provided by the monitor in the past. Here, the history information is stored in the storage unit 19 as warning history information 192. The output control unit 14 refers to the warning history information 192 and determines the output destination to be a monitor who can appropriately handle the warning.

[0081] In this way, the output control unit 14 can allocate warnings to supervisors who are familiar with how to deal with specific situations requiring attention. Note that the output control unit 14 may determine the output destination based on information such as the aptitude of the supervisor, in addition to the warning history information 192.

[0082] Examples of how to sort warnings based on capability information include the following: (1) By vehicle type (e.g., large / medium / small, bus / truck / motorcycle / passenger car, by manufacturer, construction machinery / agricultural machinery / passenger car) (2) By region (e.g., Kanto / Kansai / Chubu) (3) By industry (e.g., bus operator / transportation / taxi) (4) By country (e.g., China / Russia / India / USA / Europe) (5) By language (e.g., Spanish / English / Chinese) (6) Whether there have been any past cases of response (e.g., by warning / by main road / by route / by scene)

[0083] The calculation unit 15 calculates the characteristics of the monitor required to obtain a predetermined monitoring quality. The predetermined monitoring quality may be set in advance by an administrator of the information processing system 50, etc. The calculation unit 15 may calculate the necessary characteristics of the monitor based on a predetermined detection amount of a caution-requiring state. The predetermined detection amount may be an amount at which the detection of a caution-requiring state is expected, or may be a fixed value.

[0084] For example, the calculation unit 15 calculates the number of monitors required to obtain the desired monitoring quality based on a predetermined detection amount and a desired monitoring quality. Furthermore, for example, the calculation unit 15 calculates the capability information of the monitors required to obtain the desired monitoring quality and identifies the monitors who have the capability information. This allows the allocation of the monitors required to obtain the desired monitoring quality.

[0085] In this way, a monitoring system can be established according to the status of the monitors. Furthermore, if there are not enough monitors to achieve a predetermined monitoring quality, it is possible to consider increasing the number of staff. Furthermore, since the monitor characteristics necessary to achieve a predetermined monitoring quality are required, the information processing system 50 can optimize the monitoring system according to the actual situation on site. Furthermore, since it is possible to prevent excessive burdens on monitors, it also leads to management of monitors.

[0086] Examples of optimization tailored to the actual situation at the site include the following: (1) Number of supervisors (load setting according to the number of supervisors) (2) Supervisor skills (monitoring allocation according to pre-registered skills) (Examples of skills: vehicle type, area, driving ability, cumulative monitoring time) (3) Monitoring time (break time acquisition status) (4) Supervisor allocation (skilled personnel according to the monitoring situation, allocation of required personnel, increase in personnel, allocation plan) (5) Switching monitoring modes (Example: thorough monitoring / best effort in order of occurrence / priority order)

[0087] The information transmitting unit 16 transmits information to the in-vehicle device 30. The information transmitting unit 16 transmits, for example, instruction information generated by the warning processing unit 18 to the information processing device 10.

[0088] The video transmission unit 17 transmits the video acquired by the acquisition unit 11 to the monitoring device 20. The video transmission unit 17 may transmit the video at predetermined time intervals. For example, the video transmission unit 17 transmits the video in real time. This allows the monitor to monitor the status of the vehicle in real time.

[0089] The warning processing unit 18 performs processing in response to the warning. The warning processing unit 18 generates instruction information indicating a control instruction for the vehicle 35 in a caution state. The warning processing unit 18 transmits the generated instruction information to the in-vehicle device 30 via the information transmission unit 16. The warning processing unit 18 stores a history of warning output in the storage unit 19 as warning history information 192.

[0090] In addition, the warning processing unit 18 may instruct the in-vehicle device 30 to connect the monitoring device 20 and the in-vehicle device 30 so that, for example, an in-vehicle announcement from the monitoring center C to the vehicle 35 can be made.

[0091] For example, suppose the vehicle 35 in the caution state is a bus. The warning processing unit 18 makes an announcement inside the bus using a microphone installed inside the bus. This allows the monitoring center C to call out to passengers inside the bus. The announcement inside the bus may be, for example, an announcement to respond to trouble inside the bus or an announcement to prevent accidents.

[0092] The storage unit 19 stores vehicle status information 191 and warning history information 192. The storage unit 19 also stores a computer program in which the processing of the information processing method according to this embodiment is implemented.

[0093] The vehicle status information 191 is information about the status of the monitored vehicle. The vehicle status information 191 is, for example, images of the inside and outside of the vehicle and vehicle position information. The vehicle status information 191 may include information other than the images and position information.

[0094] The warning history information 192 is information about warnings given to supervisors, and is information that associates, for example, the warning date and time, the warning content, the supervisor in charge, and the countermeasure content.

[0095] The configuration of the information processing system 50 has been described above. Note that the configuration of the information processing system 50 described above is merely an example and may be modified as appropriate. For example, when some or all of the components of the information processing device 10 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 10 may be provided in a SaaS (Software as a Service) format.

[0096] 3, the information processing device 10 is provided outside the monitoring center C, but the information processing device 10 may be provided inside the monitoring center C. Also, the monitoring device 20 may be configured to have the functions of the information processing device 10.

[0097] Next, the processing performed by the information processing device 10 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the processing performed by the information processing device 10. Here, as shown in Fig. 3, it is assumed that a plurality of vehicles 35 are the targets of monitoring. It is also assumed that a plurality of monitors are stationed at the monitoring center C, as shown in the example of Fig. 5. It is also assumed that the monitor camera 25 at the monitoring center C is capturing images of the plurality of monitors.

[0098] First, the acquisition unit 11 acquires vehicle status information from the in-vehicle device 30 (S11). The vehicle status information is, for example, an image of the inside or outside of the vehicle 35, or location information of the vehicle 35.

[0099] Next, the detection unit 12 detects a caution-requiring state of the vehicle 35 based on the vehicle status information (S12). For example, the detection unit 12 detects a caution-requiring state by using a well-known image recognition technique on the acquired video. For example, the detection unit 12 detects a child running out in front of the vehicle 35, an abnormality on the road, or trouble between passengers in the vehicle.

[0100] Next, the estimation unit 13 determines whether or not a caution-requiring state has been detected in the vehicle 35 (S13). If a caution-requiring state has not been detected (NO in S13), the process returns to step S11. If a caution-requiring state has been detected (YES in S13), the estimation unit 13 estimates the observer characteristics based on an image of the observer (S14).

[0101] The observer characteristics may be, for example, number of observers information indicating the number of observers, or physical condition information indicating the physical condition of the observers. Physical condition information is, for example, information indicating the physical condition, health state, fatigue level, level of drowsiness, heart rate, or concentration level of the observers. The estimation unit 13 may estimate the number of observers information or physical condition information using image recognition technology.

[0102] Next, the output control unit 14 controls the output of a warning to the monitor based on the estimated characteristics (S15). For example, the output control unit 14 controls the output amount or output destination of the warning to the display unit 22 based on the monitor characteristics. The output amount may be the number of warnings for one monitor or the total number of warnings for multiple monitors. The output control unit 14 controls the output amount of the warning depending on the number of people information.

[0103] The output control unit 14 may control the output of the warning based on the priority corresponding to the attention-requiring state. The output control unit 14 may also control the output of the warning according to the number of attention-requiring states detected in one vehicle. For example, the output control unit 14 may control the output so as to output a warning when the number of attention-requiring states detected is equal to or greater than a threshold.

[0104] The output control unit 14 may also determine a monitor in charge of a vehicle that has been warned due to a cautionary condition, and control the output destination of the warning. The output control unit 14 switches the screen display of the display unit 22 used by the monitor in charge. An example of screen switching has been described using the examples shown in Figures 4 and 5. The output control unit 14 controls the output destination of the warning by switching the screen of the display unit 22 of the monitor in charge from the integrated monitoring screen 22a to the detailed monitoring screen 22b.

[0105] Furthermore, the output control unit 14 may control the output of the warning based on capability information indicating the capability of the monitor. For example, the output control unit 14 refers to the warning history information 192 and acquires the status of driving assistance performed by the monitor. The output control unit 14 determines the monitor who can deal with the detected caution-requiring state as the responsible monitor.

[0106] Next, the warning processing unit 18 determines whether or not there is an instruction from the monitor regarding the warning (S16). The warning processing unit 18 receives the instruction from the monitor via the operation unit 23. If there is no instruction from the monitor (NO in S16), the process returns to step S11. Alternatively, the output control unit 14 may issue the warning again, or may change the person in charge and output the warning to another monitor. If there is an instruction from the monitor (YES in S16), the warning processing unit 18 generates instruction information and transmits it to the in-vehicle device 30 (S17).

[0107] As a result, the vehicle 35 automatically drives in accordance with the instruction information. Alternatively, the vehicle 35 may be manually driven by remote control from the supervisor. The vehicle 35 may also broadcast the supervisor's voice or the like inside the vehicle.

[0108] Although not shown in the figure, the calculation unit 15 may calculate the characteristics of the monitors required to obtain a predetermined monitoring quality, thereby making it possible to determine, for example, the number and skills of the monitors required to obtain the predetermined monitoring quality.

[0109] 6 may be changed as appropriate. For example, the example in FIG. 6 illustrates estimating the observer characteristics after a cautionary state is detected (S13, S14). Alternatively, the estimation unit 13 may acquire observer images at predetermined time intervals and estimate observer characteristics as needed. In this manner, the estimation unit 13 can estimate the number of observers and the physical condition information of the observers in advance.

[0110] As described above, in the information processing system 50 according to this embodiment, the information processing device 10 estimates the characteristics of the observer based on an image of the observer in the vehicle. The information processing device 10 controls the output of a warning to the observer based on the estimated characteristics.

[0111] In this way, the information processing device 10 can control the number of warnings issued to the supervisor and output warnings that are appropriate for the supervisor's physical condition and ability, thereby achieving a balance between the supervisor and the number of warnings.

[0112] For example, the information processing device 10 can set the amount of warning (workload) according to the number of monitors and the processing capabilities of the monitors. This allows the amount of warning to be adjusted appropriately from the viewpoint of the monitor. In this way, one monitor can monitor multiple vehicles (e.g., five vehicles). Therefore, a monitoring system can be established without a shortage of monitors.

[0113] Furthermore, if the number of warnings is small compared to the number of monitors, the monitors will have to wait. However, the information processing system 50 according to the present embodiment can calculate an appropriate number of monitors, thereby solving this problem.

[0114] Furthermore, since the information processing device 10 can appropriately determine the monitor who will deal with the detected caution state, for example, when a vehicle stops abnormally, it is possible to grasp whether there is a factor impeding the vehicle's travel and quickly identify that factor. Furthermore, since the information processing device 10 can assign a caution state vehicle to a monitor according to the monitor's ability, the monitor in charge can quickly resolve the caution state.

[0115] In this way, by having a supervisor appropriately monitor the vehicle and remotely operate it according to the situation, the information processing device 10 can ensure that the vehicle runs appropriately. For example, if the vehicle is a bus, the vehicle can be operated on schedule without stopping in unexpected places. Furthermore, even if a problem occurs inside or outside the vehicle, the problem can be discovered early and dealt with promptly. This allows the situation to be resolved quickly and operation to be resumed.

[0116] Therefore, the information processing system 50 according to this embodiment can appropriately monitor a vehicle depending on the situation of the monitor.

[0117] (Example of Hardware Configuration) Each functional component of the information processing device 10, the monitoring device 20, and the in-vehicle device 30 (hereinafter referred to as "information processing device 10, etc.") may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it). Below, a case where each functional component of the information processing device 10, etc. is realized by a combination of hardware and software will be further described.

[0118] 7 is a block diagram illustrating an example of the hardware configuration of a computer 900 that realizes the information processing device 10, etc. The computer 900 may be a dedicated computer designed to realize the information processing device 10, etc., or may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or a tablet terminal.

[0119] For example, by installing a predetermined application on the computer 900, the computer 900 realizes each function of the information processing device 10, etc. The application is configured by a program for realizing the functional components of the information processing device 10, etc.

[0120] The computer 900 has a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to a bus connection.

[0121] The processor 904 is a variety of processors, such as a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), or a quantum processor (quantum computer control chip). The memory 906 is a main storage device realized using a random access memory (RAM) or the like. The storage device 908 is an auxiliary storage device realized using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.

[0122] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, the input / output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.

[0123] The network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0124] The storage device 908 stores programs (programs that realize the above-mentioned applications) that realize the various functional components of the information processing device 10, etc. The processor 904 reads these programs into the memory 906 and executes them to realize the various functional components of the information processing device 10, etc.

[0125] Each processor executes one or more programs containing instructions for causing a computer to perform the algorithms described with reference to the figures. The programs contain instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable or tangible storage media. By way of example and not limitation, non-transitory computer-readable or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted over various types of transitory computer-readable or communication media. By way of example and not limitation, transitory computer-readable or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0126] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure.

[0127] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0128] (Supplementary Note 1) An information processing device comprising: an acquisition means for acquiring vehicle status information related to the status of a vehicle to be monitored; a detection means for detecting a caution-requiring state requiring careful monitoring of the vehicle based on the vehicle status information; an estimation means for estimating characteristics of a monitor based on an image of a monitor of the vehicle; and an output control means for controlling output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristics. (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the characteristics include headcount information indicating the number of monitors, and the output control means controls output of the warning based on the headcount information. (Supplementary Note 3) The information processing device according to Supplementary Note 1 or 2, wherein the characteristics include physical condition information indicating the physical condition of the monitor, and the output control means controls output of the warning based on the physical condition information. (Supplementary Note 4) The information processing device according to any one of Supplements 1 to 3, wherein the output control means controls output of the warning based on a priority corresponding to the caution-requiring state. (Supplementary Note 5) The information processing device according to any one of Supplements 1 to 4, wherein the output control means controls the output of the warning according to the amount of the caution required states detected in one of the vehicles. (Supplementary Note 6) The information processing device according to any one of Supplements 1 to 5, wherein the output control means controls the output of the warning further based on ability information indicating the ability of the monitor. (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein the ability information includes history information indicating a status of driving assistance provided by the monitor. (Supplementary Note 8) The information processing device according to any one of Supplements 1 to 7, further comprising calculation means for calculating characteristics of the monitor required to obtain a predetermined monitoring quality. (Supplementary Note 9) An information processing system comprising: a sensor that acquires vehicle status information regarding the status of a vehicle being monitored; and an information processing device, wherein the information processing device has: an acquisition means that acquires the vehicle status information from the sensor; a detection means that detects a state requiring attention in monitoring the vehicle based on the vehicle status information; an estimation means that estimates characteristics of a person monitoring the vehicle based on an image of the person; and an output control means that controls the output of a warning regarding the state requiring attention to the person monitoring the vehicle based on the estimated characteristics.(Supplementary Note 10) The information processing system according to Supplementary Note 9, wherein the characteristics include headcount information indicating the number of monitors, and the output control means controls the output of the warning based on the headcount information. (Supplementary Note 11) An information processing method comprising: acquiring vehicle status information regarding the status of a vehicle to be monitored; detecting a caution-requiring state requiring attention in monitoring the vehicle based on the vehicle status information; estimating characteristics of the monitor based on an image of a person monitoring the vehicle; and controlling the output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristics. (Supplementary Note 12) The information processing method according to Supplementary Note 11, wherein the characteristics include headcount information indicating the number of monitors, and the control of the output of the warning controls the output of the warning based on the headcount information. (Supplementary Note 13) A non-transitory computer-readable medium storing a program that causes a computer to execute the following: an acquisition process for acquiring vehicle status information regarding the status of a vehicle to be monitored, a detection process for detecting a caution-requiring state that requires careful monitoring of the vehicle based on the vehicle status information, an estimation process for estimating characteristics of a monitor based on an image of the monitor of the vehicle, and an output control process for controlling output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristics. (Supplementary Note 14) The non-transitory computer-readable medium according to Supplementary Note 13, wherein the characteristics include headcount information indicating the number of the monitors, and the output control process controls output of the warning based on the headcount information.

[0129] REFERENCE SIGNS LIST 10 Information processing device 11 Acquisition unit 12 Detection unit 13 Estimation unit 14 Output control unit 15 Calculation unit 16 Information transmission unit 17 Video transmission unit 18 Warning processing unit 19 Memory unit 20 Monitoring device 21 Display control unit 22, 221, 222 Display unit 22a Integrated monitoring screen 22b Detailed monitoring screen 23 Operation unit 25 Surveillance camera 30 In-vehicle device 31 Video transmission unit 32 Information transmission unit 33 Vehicle control unit 35 Vehicle 40 Infrastructure 41 Video transmission unit 45 Infrastructure camera 50 Information processing system 100 Information processing device 101 Acquisition unit 102 Detection unit 103 Estimation unit 104 Output control unit 191 Vehicle status information 192 Warning history information 900 Computer 902 Bus 904 Processor 906 Memory 908 Storage device 910 Input / output interface 912 Network interface A, B Monitor C Monitoring center

Claims

1. an acquisition means for acquiring vehicle status information relating to the status of a vehicle to be monitored; a detection means for detecting a state requiring attention in monitoring the vehicle based on the vehicle status information; an estimation means for estimating characteristics of the observer based on an image of the observer of the vehicle; and an output control means for controlling output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristic. Information processing device.

2. the characteristics include number information indicating the number of the monitors; The output control means controls the output of the warning based on the number of people information. The information processing device according to claim 1 .

3. the characteristics include physical condition information indicating a physical condition of the monitor, The output control means controls the output of the warning based on the physical condition information.

3. The information processing device according to claim 1 or 2.

4. The output control means controls the output of the warning based on a priority corresponding to the attention-requiring state.

3. The information processing device according to claim 1 or 2.

5. The output control means controls the output of the warning in accordance with the number of the caution-requiring conditions detected in one of the vehicles.

3. The information processing device according to claim 1 or 2.

6. The output control means controls the output of the warning further based on ability information indicating the ability of the monitor.

3. The information processing device according to claim 1 or 2.

7. The capability information includes history information indicating the status of driving assistance provided by the monitor. The information processing device according to claim 6 .

8. a sensor that acquires vehicle status information regarding the status of a vehicle being monitored; an information processing device, The information processing device includes: an acquisition means for acquiring the vehicle status information from the sensor; a detection means for detecting a state requiring attention in monitoring the vehicle based on the vehicle status information; an estimation means for estimating characteristics of the observer based on an image of the observer of the vehicle; and an output control means for controlling output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristic. Information processing system.

9. Acquire vehicle status information regarding the status of the vehicle being monitored; Detecting a state requiring attention that requires attention in monitoring the vehicle based on the vehicle status information; Estimating characteristics of the observer based on an image of the observer of the vehicle; and controlling output of a warning regarding the condition requiring attention to the supervisor based on the estimated characteristic. Information processing methods.

10. an acquisition process for acquiring vehicle status information relating to the status of the vehicle being monitored; a detection process for detecting a state requiring attention in monitoring the vehicle based on the vehicle status information; an estimation process for estimating characteristics of the observer based on an image of the observer of the vehicle; an output control process for controlling output of a warning regarding the caution-requiring state to the monitor based on the estimated characteristics; A program that a computer runs.