Information processing device, information processing system, information processing method, and program

The information processing device addresses inconsistent monitoring capacity by estimating monitor characteristics and controlling warning output, ensuring effective vehicle monitoring despite variations in supervisor condition and circumstances.

JP7852741B2Active Publication Date: 2026-04-28NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
NEC CORP
Filing Date
2022-12-07
Publication Date
2026-04-28

AI Technical Summary

Technical Problem

Existing vehicle monitoring systems face challenges in maintaining consistent monitoring capacity due to variations in supervisor condition and surrounding circumstances, leading to potential delays in response when multiple warnings occur.

Method used

An information processing device that acquires vehicle status information, detects attention-requiring states, estimates monitor characteristics based on images, and controls warning output to prioritize and manage warnings effectively based on these characteristics.

Benefits of technology

The system ensures appropriate vehicle monitoring by adapting to the circumstances of individual monitors, reducing the monitoring burden and enabling efficient handling of multiple vehicles with varying warning conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007852741000001
    Figure 0007852741000001
  • Figure 0007852741000002
    Figure 0007852741000002
  • Figure 0007852741000003
    Figure 0007852741000003
Patent Text Reader

Abstract

The purpose of the present invention is to provide an information processing device that makes it possible to appropriately perform vehicle monitoring in accordance with the situation of a monitor. This information processing device (100) comprises an acquisition means (101) that acquires vehicle situation information about the situation of a vehicle that is a monitoring target, a detection means (102) that detects attention-requiring states that require attention during monitoring of the vehicle on the basis of the vehicle situation information, an estimation means (103) that estimates a characteristic of a monitor of the vehicle on the basis of an image captured of the monitor, and an output control means (104) that controls output of warnings to the monitor on the basis of the estimated characteristic.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing system, an information processing method, and a non-temporary computer-readable medium.

Background Art

[0002] There is known a technique for remotely monitoring a vehicle at a monitoring center using an image taken inside and outside the vehicle, the position information of the vehicle, and the like. For example, the monitoring center includes a monitoring device for monitoring the vehicle, and the monitoring device causes a display device to display the status of the monitored vehicle. Further, when a state that requires attention in vehicle monitoring (hereinafter referred to as "attention-required state") is detected, the monitoring device can efficiently perform monitoring by displaying a warning (alert). However, when many warnings occur with respect to the number of monitors, there is a risk of a delay in response. Therefore, it is desirable to appropriately set the warning generation conditions.

[0003] As a related technique, Patent Document 1 discloses an information processing system that acquires the position information of a vehicle to be monitored and determines the monitoring priority of the vehicle according to movement information related to the movement of the vehicle. The information processing system generates presentation information for monitoring the vehicle based on the monitoring priority and outputs the presentation information to a presentation device.

[0004] Further, when there are a plurality of monitors, the information processing system can change the monitoring priority according to the coping experience with respect to the attention-required state. For example, it is assumed that monitor A has dealt with "merging" more in the past than monitor B. In this case, the information processing system can change the monitoring priority so that monitor A is preferentially dealt with "merging" rather than monitor B.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

[0006] Ideally, the monitoring capacity of a supervisor should remain constant regardless of the timing of the monitoring. However, monitoring capacity can change depending on the supervisor's own condition and the surrounding circumstances. For example, if a supervisor is unwell, their monitoring capacity may decrease. In such cases, it is also expected that the overall monitoring capacity of the monitoring center may decrease.

[0007] The purpose of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that can appropriately monitor vehicles according to the circumstances of the monitor, in light of the above-mentioned problems. [Means for solving the problem]

[0008] The information processing device relating to this disclosure is A means for acquiring vehicle status information regarding the status of a vehicle being monitored, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of the monitor based on an image of the monitor of the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-requiring state based on the estimated characteristics.

[0009] The information processing system relating to this disclosure is A sensor that acquires vehicle status information regarding the status of the vehicle being monitored, Equipped with an information processing device, The aforementioned information processing device is An acquisition means for acquiring the vehicle status information from the aforementioned sensor, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of the monitor based on an image of the monitor of the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-requiring state based on the estimated characteristics.

[0010] The information processing method relating to this disclosure is: Obtain vehicle status information regarding the status of the vehicle being monitored, Based on the aforementioned vehicle status information, a state requiring attention during vehicle monitoring is detected. Based on images of the vehicle's monitor, the characteristics of the monitor are estimated. Based on the estimated characteristics, the system controls the output of warnings to the monitor regarding the attention-requiring state.

[0011] The non-temporary computer-readable medium on which the program relating to this disclosure is stored is, The process involves acquiring vehicle status information regarding the status of the vehicle being monitored, and A detection process that detects a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation process is performed to estimate the characteristics of the monitor based on images taken of the monitor of the vehicle, Based on the estimated characteristics, an output control process controls the output of a warning to the monitor regarding the attention-sensitive state, It is something that is executed by a computer. [Effects of the Invention]

[0012] This disclosure provides an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that can appropriately monitor vehicles according to the circumstances of the monitor. [Brief explanation of the drawing]

[0013] [Figure 1] This is a block diagram showing the configuration of the information processing device according to Embodiment 1. [Figure 2] This is a flowchart showing the processing performed by the information processing device according to Embodiment 1. [Figure 3] It is a block diagram showing the configuration of the information processing system according to Embodiment 2. [Figure 4] It is a diagram showing an example of an integrated monitoring screen and a detailed monitoring screen displayed on the display unit according to Embodiment 2. [Figure 5] It is a diagram showing an example of screen switching between the integrated monitoring screen and the detailed monitoring screen according to Embodiment 2. [Figure 6] It is a flowchart showing the processing performed by the information processing apparatus according to Embodiment 2. [Figure 7] It is a block diagram exemplifying the hardware configuration of a computer that realizes the information processing apparatus and the like according to Embodiment 2.

Mode for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals. For the sake of clarity of explanation, duplicate explanations are omitted as necessary.

[0015] <Embodiment 1> Referring to FIG. 1, Embodiment 1 will be described. FIG. 1 is a block diagram showing the configuration of an information processing apparatus 100 according to the present embodiment. The information processing apparatus 100 includes an acquisition unit 101, a detection unit 102, an estimation unit 103, and an output control unit 104.

[0016] The acquisition unit 101 acquires vehicle status information regarding the status of a vehicle that is a monitoring target. The detection unit 102 detects a caution-required state that requires attention in the monitoring of the vehicle based on the vehicle status information. The estimation unit 103 estimates the characteristics of the monitor based on an image of the monitor of the vehicle. The output control unit 104 controls the output of a warning regarding the caution-required state to the monitor based on the estimated characteristics.

[0017] The information processing device 100 includes a processor, memory, and storage device (not shown). The storage device stores a computer program on which the processing according to this embodiment is implemented. The processor can load the computer program from the storage device into memory and execute the computer program. In this way, the processor realizes the functions of the acquisition unit 101, the detection unit 102, the estimation unit 103, and the output control unit 104.

[0018] Next, we will explain the processes performed by the information processing device 100 with reference to Figure 2. Figure 2 is a flowchart showing the processes performed by the information processing device 100.

[0019] First, the acquisition unit 101 acquires vehicle status information regarding the status of the vehicle being monitored (S101). Next, the detection unit 102 detects a state requiring attention to vehicle monitoring based on the vehicle status information (S102). Subsequently, the estimation unit 103 estimates the characteristics of the vehicle monitor based on an image of the monitor (S103). Then, the output control unit 104 controls the output of a warning regarding the state requiring attention to the monitor based on the estimated characteristics (S104).

[0020] With this configuration, the information processing device 100 according to this embodiment estimates the characteristics of the observer using images of the observer. The information processing device 100 also controls the output of warnings based on the estimation results. This enables the information processing device 100 to appropriately monitor the vehicle according to the observer's situation.

[0021] <Embodiment 2> Next, Embodiment 2 will be described. Embodiment 2 is a specific example of Embodiment 1 described above. Figure 3 is a block diagram showing the configuration of the information processing system 50 according to this embodiment. As shown in the figure, the information processing system 50 comprises an information processing device 10, a monitoring device 20, an in-vehicle device 30, and infrastructure 40. The information processing system 50 is an information processing system that can monitor vehicles located in remote locations by performing predetermined information processing.

[0022] The information processing device 10, the monitoring device 20, the in-vehicle device 30, and the infrastructure 40 are each connected via a network (not shown). The network is a wired or wireless communication line. The network may be, for example, the internet, a dedicated line, a telephone line, a mobile communication network, or other communication lines. The network may also be a combination of these.

[0023] (Monitoring Center C) Monitoring Center C is the area that serves as the base for remotely monitoring vehicles. Monitoring Center C is staffed with monitors to monitor the vehicles. Although the diagram shows one monitor A, Monitoring Center C may be staffed with multiple monitors.

[0024] Monitoring Center C comprises a monitoring device 20, a display unit 22, an operation unit 23, and a monitoring camera 25. For illustrative purposes, the display unit 22, operation unit 23, and monitoring camera 25 are shown outside the monitoring device 20, but some or all of these may be configured to be built into the monitoring device 20.

[0025] The monitoring device 20 performs predetermined information processing for monitoring the vehicle. The monitoring device 20 may be, for example, a PC (Personal Computer). Alternatively, the monitoring device 20 may be configured to communicate with the information processing device 10, the in-vehicle device 30, or the infrastructure 40 via a web browser over the internet or the like.

[0026] The display unit 22 displays the vehicle being monitored. The display unit 22 also displays a warning when a warning condition is detected. The display unit 22 is, for example, a display device such as a screen. The display unit 22 may also be a touch panel display that allows input operations by touching it with a finger. The monitoring center C may have multiple display units 22. The monitoring center C may have display units 22 corresponding to each of multiple monitors.

[0027] Here, a "cautionary condition" indicates a state that requires attention to monitoring the vehicle. A cautionary condition is, for example, a state in which an abnormality has occurred in the vehicle or its occupants. Examples of vehicle abnormalities include abnormalities in the vehicle body. Examples of abnormalities in the vehicle body include malfunctions, accidents, or running out of power. Furthermore, the stopping of the vehicle due to these abnormalities may also be included in vehicle abnormalities. For example, if a bus or truck is not running on schedule or is experiencing delays to its destination, these may also be included in vehicle abnormalities.

[0028] Furthermore, examples of crew abnormalities include abnormalities in the driver or passengers. Crew abnormalities include, for example, poor health of the driver or passengers. In the case of vehicles such as buses, passengers' poor health, injuries to passengers, disputes between passengers, or problems with passengers boarding or alighting may also be included in crew abnormalities. For example, situations where the vehicle cannot depart due to passenger boarding or alighting, or passengers requesting assistance, may be considered abnormalities.

[0029] The abnormalities described above are just examples; therefore, a "cautionary state" may include other conditions. For example, a "cautionary state" may be related to the environment surrounding the vehicle. For instance, the collapse of nearby buildings, damage to road infrastructure, or the occurrence of a disaster could be included in a "cautionary state."

[0030] The monitoring device 20 includes a display control unit 21 that controls the display on the display unit 22. The display control unit 21 acquires video from the information processing device 10 and displays the video on the display unit 22. The video may include the vehicle being monitored. The display control unit 21 may display the video in real time. In this disclosure, "video" may mean video data, which is the data of the video. Similarly, in this disclosure, "image" may mean image data, which is the data of the image.

[0031] The display control unit 21 also acquires warning information from the information processing device 10 and displays the warning on the display unit 22. The warning information is information for warning the observer about a state requiring attention. The warning information may be information for notifying that the vehicle is in a state requiring attention. The warning information may include information for identifying the vehicle in which the state requiring attention has been detected, and information regarding the content of the state requiring attention.

[0032] Warning information may be, for example, textual or visual information indicating a state requiring attention. Warning information may also be audio information output by an audio output device (not shown). However, various other types of information, such as lighting, buzzers, or vibrations, may be used as warning information. Furthermore, warning information may be a combination of the above-mentioned types of information.

[0033] As shown in the diagram, monitor A can monitor vehicles by visually checking the display on the display unit 22. Furthermore, monitor A can recognize vehicles that have been detected as requiring attention (hereinafter sometimes referred to as "vehicles requiring attention") when a warning is output. This allows monitor A to monitor vehicles with greater caution than usual. Monitor A can also take action regarding vehicles requiring attention as needed.

[0034] Here, with reference to Figure 4, an example of a screen displayed on the display unit 22 will be explained. Figure 4 shows an example of the integrated monitoring screen 22a and the detailed monitoring screen 22b displayed on the display unit 22. The integrated monitoring screen 22a is a screen that displays multiple vehicles simultaneously. The detailed monitoring screen 22b is a screen that displays vehicles that require the attention or intervention of the monitor. In the example shown in the figure, the integrated monitoring screen 22a displays the screen for monitoring each of vehicles 1 to 10. Note that although the same figure is used as an example of the screen display for vehicles 1 to 10, in reality, the video corresponding to each vehicle will be displayed in each display area.

[0035] The display control unit 21 automatically switches between the integrated monitoring screen 22a and the detailed monitoring screen 22b depending on the status of vehicles 1 to 10. For example, if no warning status is detected for vehicles 1 to 10, the display control unit 21 displays the integrated monitoring screen 22a. If a warning status is detected for any of vehicles 1 to 10, the display control unit 21 switches the display to the detailed monitoring screen 22b, which displays the vehicle in the warning status. The display control unit 21 may also switch between the integrated monitoring screen 22a and the detailed monitoring screen 22b according to the operator's actions.

[0036] The lower part of the diagram shows the detailed monitoring screen 22b when a warning state is detected for vehicle 1. The display control unit 21 displays the detailed monitoring screen 22b showing vehicle 1. For example, if an abnormality occurs inside or outside vehicle 1 and action is required, the monitor can avoid accidents or other incidents by remotely controlling vehicle 1.

[0037] Here, with reference to Figure 5, an example of screen switching performed by the display unit 22 when multiple monitors are stationed will be explained. Figure 5 shows an example of screen switching between the integrated monitoring screen 22a and the detailed monitoring screen 22b. In this example, monitors A and B are stationed for monitoring. Monitor A uses the display unit 221, and monitor B uses the display unit 222.

[0038] During normal monitoring, the display units 221 and 222 each display the integrated monitoring screen 22a. Therefore, monitors A and B each monitor the vehicle by viewing the integrated monitoring screen 22a.

[0039] The upper part of the diagram shows an example of the screen when a warning is issued after a cautionary state is detected for vehicle 3. The display control unit 21 displays the warning in the display area of ​​vehicle 3. Here, it is assumed that monitor A is responsible for monitoring vehicle 3. The determination of the assigned monitor may be performed by the information processing device 10.

[0040] The display control unit 21 displays the detailed monitoring screen 22b for vehicle 3 on the display unit 221. The display control unit 21 switches from the previously displayed integrated monitoring screen 22a to the detailed monitoring screen 22b that displays vehicle 3. As a result, when a warning occurs for vehicle 3, the screen on the display unit 221 automatically switches to the detailed monitoring screen 22b. Monitor A monitors vehicle 3 by viewing the switched detailed monitoring screen 22b. In the example shown in the figure, monitor B continues monitoring by viewing the normal integrated monitoring screen 22a.

[0041] Now, let's assume that a warning is issued for vehicle 5. The display control unit 21 identifies the screens being displayed by, for example, display units 221 and 222, and selects the display unit that will display the detailed monitoring screen 22b for vehicle 5. As shown in the figure, here, monitor A is dealing with vehicle 3, and display unit 221 is displaying the detailed monitoring screen 22b for vehicle 3.

[0042] The display control unit 21 selects the display unit 222, which is displaying the integrated monitoring screen 22a, and displays the detailed monitoring screen 22b for vehicle 5. As a result, when a warning occurs for vehicle 5, the display screen of the display unit 222 automatically switches to the detailed monitoring screen 22b. Monitor B can monitor vehicle 5 by visually checking the display unit 222.

[0043] In this way, the display control unit 21 switches the display on the display unit 22 depending on whether or not there is a vehicle requiring attention. This reduces the monitoring and operational burden on the supervisor. It also makes it possible for a small number of supervisors to monitor a large number of vehicles.

[0044] Returning to Figure 3, we continue the explanation of the monitoring center C. The operation unit 23 receives operations from the monitor. For example, the operation unit 23 receives input of instructions that the monitor gives to the vehicle 35. The operation unit 23 transmits the received information to the information processing device 10. The monitor can remotely control the vehicle 35 by operating the operation unit 23. This allows the monitor to deal with abnormalities in the vehicle or occupants and resolve the alert status.

[0045] The surveillance camera 25 is a camera that photographs the surveillance person. The surveillance camera 25 is installed, for example, at a predetermined location in the surveillance center C. The surveillance camera 25 transmits the image it has captured (hereinafter sometimes referred to as "surveillance image") to the information processing device 10. The image may be a still image or a moving image. In addition, a microphone that acquires voices emitted from the surveillance person may be provided together with the surveillance camera 25.

[0046] Here, we will explain examples of monitoring performed by the supervisor. The supervisor monitors high-risk traffic situations. High-risk traffic situations include, for example, areas with heavy traffic, crowded areas, or areas with blind spots. The supervisor also monitors the driving of the vehicle 35. For example, the supervisor monitors whether the driver is driving safely. Specifically, the supervisor monitors whether the driver is stopping at stops, obeying traffic signals, or adhering to speed limits.

[0047] The supervisor also monitors the operating status of vehicle 35. The supervisor monitors whether vehicle 35 is moving or stopped, the location of vehicle 35, and whether vehicle 35 is operating according to plan.

[0048] Furthermore, an example of operations performed by the supervisor will be described. The supervisor uses the operation unit 23 to give instructions to the vehicle 35 via the information processing device 10. In this way, the operation unit 23 can receive input from the supervisor and control the vehicle 35.

[0049] For example, the supervisor intervenes in the driving control of vehicle 35. The supervisor may have vehicle 35 perform a predetermined automated driving procedure, or the supervisor may directly operate vehicle 35 by manually driving it themselves. Examples of predetermined automated driving procedures include immediately stopping vehicle 35, or moving vehicle 35 to the side of the road and then stopping it. The supervisor may switch (override) from manual driving to automated driving, or from automated driving to manual driving.

[0050] When the control unit 23 is switched to manual operation, it manually operates the vehicle 35 in response to the operator's commands. This allows the operator to remotely control the vehicle 35 using the control unit 23. For example, the operator can bring the vehicle 35 to an emergency stop by issuing an emergency stop command. The operator may also make announcements to the passengers of the vehicle 35.

[0051] In this embodiment, an example is shown where a monitor handles a situation requiring attention; however, the monitoring center C may have a separate operator to handle such situations.

[0052] (In-vehicle device 30) The in-vehicle device 30 is an information processing device mounted on the vehicle 35 that is being monitored. The in-vehicle device 30 is a so-called edge-side device. The in-vehicle device 30 uses sensors (not shown) to acquire vehicle status information regarding the status of the vehicle being monitored and transmits it to the information processing device 10. The in-vehicle device 30 may be installed on each of multiple vehicles being monitored. The vehicle status information is, for example, an image taken of the vehicle or its surroundings. Other examples of vehicle status information include 3D measurement information measured by sensors such as lasers, radars, or LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging). The vehicle status information may also include the speed and acceleration of the vehicle 35. The vehicle status information may also include operation information of the vehicle 35, such as steering angle, brake pressure, or opening and closing of vehicle doors. The vehicle status information may also include location information of the vehicle 35.

[0053] The in-vehicle device 30 comprises a video transmission unit 31, an information transmission unit 32, and a vehicle control unit 33. The video transmission unit 31 transmits video footage of the vehicle 35 to the information processing device 10. The video footage is captured using a camera (not shown). The camera is installed inside or outside the vehicle 35 and can capture images of the interior or exterior of the vehicle. The vehicle 35 may be equipped with both an interior camera and an exterior camera. The video footage of the vehicle interior may include images of the occupants inside the vehicle. For example, if the vehicle 35 is a bus or a taxi, the video transmission unit 31 acquires video footage including passengers and transmits the video. Although not shown, the in-vehicle device 30 may also acquire audio information generated inside or outside the vehicle 35 and transmit it to the information processing device 10, in addition to video information.

[0054] The information transmission unit 32 acquires information from sensors (not shown) provided by the vehicle 35 and transmits the acquired information to the information processing device 10. For example, the information transmission unit 32 acquires the location information of the vehicle 35 using a position sensor. The position sensor detects the current position of the vehicle 35. The position sensor receives positioning signals transmitted from multiple artificial satellites, such as GNSS (Global Navigation Satellite System), and performs positioning based on these positioning signals.

[0055] The information transmission unit 32 may acquire information about the vehicle 35 in addition to location information and transmit it to the information processing device 10.

[0056] The vehicle control unit 33 receives instruction information from the information processing device 10. Based on the instruction information, the vehicle control unit 33 controls the driving and operation of the vehicle 35. For example, the vehicle control unit 33 controls the driving of the vehicle 35 using a vehicle control ECU (Electronic Control Unit) (not shown) in accordance with instructions from the information processing device 10. The vehicle control ECU may include, for example, a power unit control ECU and a brake ECU that perform acceleration and deceleration control of the vehicle 35.

[0057] (Infrastructure 40) Infrastructure 40 is equipment installed near the road (for example, traffic lights). Infrastructure 40 is equipped with sensors that acquire vehicle status information. Here, an infrastructure camera 45 is used as an example of a sensor. Infrastructure camera 45 is a camera that takes pictures of the road or the area around the road. Infrastructure camera 45 may also be equipped with a microphone that acquires sound from the road or the area around the road.

[0058] The video transmission unit 41 transmits the video acquired by the infrastructure camera 45 to the information processing device 10. The video transmission unit 41 may be provided in an information processing device such as a PC. In addition to the in-vehicle device 30 and infrastructure 40, the information processing system 50 may also include other configurations that can transmit vehicle status information to the information processing device 10. Furthermore, the information processing system 50 may be configured to include either the in-vehicle device 30 or the infrastructure 40.

[0059] (Information processing device 10) The information processing device 10 is an example of the information processing device 100 described above. The information processing device 10 includes an acquisition unit 11, a detection unit 12, an estimation unit 13, an output control unit 14, a calculation unit 15, an information transmission unit 16, a video transmission unit 17, a warning processing unit 18, and a storage unit 19. The information processing device 10 may be implemented, for example, in a cloud computing system.

[0060] The acquisition unit 11 is an example of the acquisition unit 101 described above. The acquisition unit 11 acquires vehicle status information, which includes information about the vehicle's condition. The vehicle status information is, for example, video footage of the vehicle or its surroundings. The vehicle status information may also be vehicle location information.

[0061] The detection unit 12 is an example of the detection unit 102 described above. The detection unit 12 detects a vehicle in a state requiring attention based on vehicle status information. For example, the detection unit 12 detects a state requiring attention based on video transmitted from the in-vehicle device 30. The detection unit 12 may detect a state requiring attention using well-known image recognition technology.

[0062] For example, the detection unit 12 estimates the posture of the occupants inside the vehicle. This allows the detection unit 12 to detect, for example, that a bus passenger has fallen. The detection unit 12 may also perform object recognition based on the video. For example, the detection unit 12 may detect a child who has run out in front of the vehicle. If these are detected, the detection unit 12 detects that the vehicle has transitioned to a state requiring attention.

[0063] The detection unit 12 may also detect a warning state based on the location information of the vehicle 35 transmitted from the in-vehicle device 30. For example, the detection unit 12 detects the movement status of the vehicle 35 based on changes in location information. The detection unit 12 detects a warning state if the movement status of the vehicle 35 does not meet predetermined conditions. The predetermined conditions may be, for example, the time of arrival at the destination. The predetermined conditions can be set in advance. The predetermined conditions may be set using the driving route or driving speed, etc.

[0064] The detection unit 12 may appropriately set the detection level for a warning state. The detection unit 12 may set the detection level based, for example, on the priority corresponding to the warning state. The priority may be set in advance according to the warning level indicated by the warning state. The warning level is, for example, information indicating the magnitude of the possibility of danger to the vehicle or occupants. The warning level increases as the possibility of a serious accident or trouble increases. The priority may be set to correspond to the importance of the monitor addressing the warning state.

[0065] The detection level can be set in advance, for example, by receiving input from the administrator of the information processing system 50, according to the monitoring quality required by the administrator. The detection unit 12 sets the detection level so that the higher the monitoring quality, the lower the level of the warning condition it detects. The detection unit 12 may also select vehicles to be targeted for detection of warning conditions based on the vehicle type, etc.

[0066] The estimation unit 13 is an example of the estimation unit 103 described above. The estimation unit 13 estimates the characteristics of the monitor (hereinafter sometimes referred to as "monitor characteristics") based on images of the monitor monitoring the vehicle. Here, monitor characteristics indicate the properties that the monitor possesses. Monitor characteristics can affect the quality of monitoring.

[0067] Specifically, the estimation unit 13 acquires images of observers captured by the observer camera 25. The estimation unit 13 can estimate the characteristics of the observers included in the observer images using image recognition technology or the like. The observer images may include multiple observers.

[0068] The monitor characteristics may include, for example, information indicating the number of monitors stationed at monitoring center C. The estimation unit 13 acquires the information on the number of monitors based on the monitor images.

[0069] Furthermore, the monitor characteristics may include health information related to the monitor's physical condition. Health information may include, for example, information indicating the monitor's physical condition, health status, fatigue level, drowsiness level, heart rate, or concentration level. The estimation unit 13 estimates health information based on the monitor image. For example, the estimation unit 13 detects the monitor's eye movements based on the monitor image. For example, the estimation unit 13 can estimate the monitor's concentration level by calculating the number of times the monitor looks away. In addition to the monitor image, the estimation unit 13 may also estimate health information based on the physical condition reported by the monitor themselves.

[0070] Furthermore, if there are multiple monitors, the estimation unit 13 can estimate the health information of each of the multiple monitors.

[0071] The output control unit 14 is an example of the output control unit 104 described above. The output control unit 14 controls the output of warnings regarding a watchful state for the monitor based on the estimated monitor characteristics.

[0072] The output control unit 14 controls, for example, the amount of warning output or the destination of the warning output based on the monitor characteristics. The output amount indicates the number of warnings output to the display unit 22. The output amount may be the number of warnings for one monitor, or the total number of warnings for multiple monitors.

[0073] The output destination indicates the display location where the warning will be shown. The display destination indicates the assigned monitor responsible for addressing the warning. The output control unit 14 controls the output destination of the warning by switching the screen of the assigned monitor's display unit 22 from the integrated monitoring screen 22a to the detailed monitoring screen 22b.

[0074] For example, the output control unit 14 controls the amount of warning output based on the number of people. For example, suppose there are 5 people stationed at monitoring center C. The output control unit 14 determines the amount of warning output that the 5 monitors can handle. The amount of output that each person can handle may be set in advance. Alternatively, the amount of output that each monitor can handle may be set. Furthermore, the amount of output that each person can handle may be set. The output control unit 14 determines the amount of warning output with the amount that one or more of the stationed monitors can handle as the upper limit. This allows the output control unit 14 to adjust the frequency of warning output.

[0075] Furthermore, the output control unit 14 may control the destination of the warning based on the health information. The output control unit 14 compares the health information of multiple monitors and sends a warning to the monitor whose health is good, and to the monitor whose health is good. defective The destination of the output is determined with priority over the monitor.

[0076] The output control unit 14 may also control the output of warnings based on the priority corresponding to the attention-requiring state. For example, the output control unit 14 may determine the output amount so as to output the top five warnings by priority.

[0077] The output control unit 14 may determine the output amount to output a warning for a critical state where the priority exceeds a predetermined threshold. The predetermined threshold may be set in advance. The threshold may also be changed as appropriate depending on the required monitoring quality, etc.

[0078] The output control unit 14 may also determine the output amount based on a predetermined bias or weight. The predetermined bias and weight may be set in advance and may be changed as appropriate. For example, the output control unit 14 may determine the total number of warnings to output based on a bias set for the total number of warnings. Alternatively, the output control unit 14 may determine the output amount of a warning based on a weight set according to the content of the attention state. In this way, the output control unit 14 can determine the output amount using a weight according to priority.

[0079] The output control unit 14 may control the output of a warning according to the number of attention-sensitive conditions detected in a single vehicle. For example, the output control unit 14 may determine the output amount to issue a warning only when there are multiple attention-sensitive conditions.

[0080] The output control unit 14 may also control the destination of the warning based on capability information indicating the capabilities of the monitor. The capability information may include history information indicating the status of driving assistance performed by the monitor in the past. Here, the history information is stored in the storage unit 19 as warning history information 192. The output control unit 14 refers to the warning history information 192 to determine which monitor capable of appropriately addressing the warning will be the destination.

[0081] In this way, the output control unit 14 can distribute warnings to monitors who are familiar with dealing with specific attention-grabbing conditions. The output control unit 14 may also determine the output destination based on information such as the monitor's suitability, not just the warning history information 192.

[0082] One example of how warnings are distributed based on capability information is as follows: (1) By vehicle type (e.g., large / medium / small, bus / truck / motorcycle / passenger car, by manufacturer, construction machinery / agricultural machinery / passenger car) (2) By region (e.g., Kanto / Kansai / Chubu) (3) By industry (e.g., bus operators / transportation / taxi) (4) By country (e.g., China / Russia / India / United States / Europe) (5) By language (e.g., Spanish / English / Chinese) (6) Availability of past response cases (e.g., by warning type / by main road / by route / by scenario)

[0083] The calculation unit 15 calculates the characteristics of the monitor necessary to obtain a predetermined monitoring quality. The predetermined monitoring quality may be set in advance by the administrator of the information processing system 50 or the like. The calculation unit 15 can calculate the necessary monitor characteristics based on a predetermined detection amount of a warning state. The predetermined detection amount may be an amount at which detection of a warning state is expected, or it may be a fixed value.

[0084] For example, the calculation unit 15 calculates the number of monitors required to obtain a predetermined monitoring quality based on a predetermined detection quantity and the desired monitoring quality. Alternatively, the calculation unit 15 calculates the competency information of the monitors required to obtain the desired monitoring quality and identifies monitors who possess that competency information. This allows the necessary number of monitors to be assigned to obtain the predetermined monitoring quality.

[0085] In this way, a monitoring system tailored to the circumstances of the monitors can be established. Furthermore, if there are insufficient monitors to achieve the required monitoring quality, it becomes possible to consider increasing the number of monitors. Additionally, since the monitor characteristics necessary to achieve the required monitoring quality are required, the information processing system 50 can optimize the monitoring system to match the actual situation on site. Moreover, it prevents excessive workload on monitors, which also contributes to better monitoring management.

[0086] Examples of optimization tailored to the actual situation on site include the following: (1) Number of monitors (load settings adjusted according to the number of monitors) (2) Supervisor skills (supervision allocation based on pre-registered skills) (Examples of skills: vehicle type, region, driving skill, total monitoring time) (3) Monitoring time (status of break time acquisition) (4) Placement of supervisors (placement of personnel with the necessary skills according to the monitoring situation, additional personnel, and placement plan) (5) Switching monitoring modes (e.g., intensive monitoring / best-effort first / priority order)

[0087] The information transmission unit 16 transmits information to the in-vehicle device 30. For example, the information transmission unit 16 transmits instruction information generated by the warning processing unit 18 to the information processing device 10.

[0088] The video transmission unit 17 transmits the video acquired by the acquisition unit 11 to the monitoring device 20. The video transmission unit 17 may transmit the video at predetermined time intervals. For example, the video transmission unit 17 may transmit the video in real time. This allows the monitor to monitor the vehicle's status in real time.

[0089] The warning processing unit 18 performs processing in response to the warning. The warning processing unit 18 generates instruction information indicating a control instruction for the vehicle 35 that is in a caution state. The warning processing unit 18 transmits the generated instruction information to the in-vehicle device 30 via the information transmission unit 16. The warning processing unit 18 stores the history of warning output as warning history information 192 in the storage unit 19.

[0090] Furthermore, the warning processing unit 18 may, for example, instruct the in-vehicle device 30 to connect the monitoring device 20 and the in-vehicle device 30 so that in-vehicle broadcasts from the monitoring center C to the vehicle 35 can be made.

[0091] For example, suppose the vehicle 35 in a state of alert is a bus. The warning processing unit 18 uses a microphone installed inside the bus to make an announcement. This allows the monitoring center C to communicate with passengers on the bus. The announcements could include, for example, announcements to address problems inside the bus or announcements to prevent accidents.

[0092] The memory unit 19 stores vehicle status information 191 and warning history information 192. The memory unit 19 also stores a computer program in which the processing of the information processing method according to this embodiment is implemented.

[0093] Vehicle status information 191 is information regarding the status of the monitored vehicle. Vehicle status information 191 may include, for example, video footage from inside and outside the vehicle and location information of the vehicle. Vehicle status information 191 may also include information other than video footage and location information.

[0094] Warning history information 192 is information related to warnings issued to monitors. Warning history information 192 includes, for example, the date and time of the warning, the content of the warning, the monitor in charge, or the actions taken.

[0095] The configuration of the information processing system 50 has been described above. Note that the configuration of the information processing system 50 described above is merely an example and can be modified as appropriate. For example, if some or all of the components of the information processing device 10 are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form where each is connected via a communication network, such as a client-server system or a cloud computing system. Furthermore, the functions of the information processing device 10 may be provided in SaaS (Software as a Service) format.

[0096] For example, in the example shown in Figure 3, the information processing device 10 is located outside the monitoring center C, but the information processing device 10 may also be located inside the monitoring center C. Furthermore, the monitoring device 20 may be configured to perform the functions of the information processing device 10.

[0097] Next, with reference to Figure 6, the processing performed by the information processing device 10 will be explained. Figure 6 is a flowchart showing the processing performed by the information processing device 10. Here, as shown in Figure 3, multiple vehicles 35 are assumed to be the targets of monitoring. Also, as shown in the example in Figure 5, multiple monitors are assumed to be stationed at the monitoring center C. Furthermore, at the monitoring center C, the monitor camera 25 is assumed to be capturing images of multiple monitors.

[0098] First, the acquisition unit 11 acquires vehicle status information from the in-vehicle device 30 (S11). Vehicle status information includes, for example, images of the inside or outside of the vehicle 35 or location information of the vehicle 35.

[0099] Next, the detection unit 12 detects a warning state of the vehicle 35 based on the vehicle status information (S12). For example, the detection unit 12 detects a warning state by using well-known image recognition technology on the acquired video. For example, the detection unit 12 detects a child running out in front of the vehicle 35, an abnormality on the road, or trouble between passengers inside the vehicle.

[0100] Next, the estimation unit 13 determines whether or not a warning state has been detected in the vehicle 35 (S13). If no warning state is detected (NO in S13), the process returns to step S11. If a warning state is detected (YES in S13), the estimation unit 13 estimates the characteristics of the observer based on the image of the observer (S14).

[0101] The observer characteristics may include, for example, information indicating the number of observers, or information indicating the observers' physical condition. The physical condition information may include, for example, information indicating the observer's physical condition, health status, fatigue level, level of drowsiness, heart rate, or level of concentration. The estimation unit 13 may estimate the number of observers or the physical condition information using image recognition technology.

[0102] Next, the output control unit 14 controls the output of warnings to the monitors based on the estimated characteristics (S15). For example, the output control unit 14 controls the amount of warning output to the display unit 22 or the output destination based on the monitor characteristics. The output amount may be the number of warnings for one monitor, or the total number of warnings for multiple monitors. The output control unit 14 controls the amount of warning output according to the number of people information.

[0103] The output control unit 14 may control the output of warnings based on the priority corresponding to the attention state. Alternatively, the output control unit 14 may control the output of warnings according to the amount of attention states detected in a single vehicle. For example, the output control unit 14 may control the output to output a warning when a attention state exceeding a threshold is detected.

[0104] The output control unit 14 may also determine the assigned monitor for the vehicle that has entered a warning state and become subject to a warning, and control the destination of the warning output. The output control unit 14 switches the screen display of the display unit 22 used by the assigned monitor. An example of screen switching is explained using the example shown in Figures 4 and 5. The output control unit 14 controls the destination of the warning output by switching the screen of the assigned monitor's display unit 22 from the integrated monitoring screen 22a to the detailed monitoring screen 22b.

[0105] Furthermore, the output control unit 14 may control the output of warnings based on capability information indicating the capabilities of the supervisor. For example, the output control unit 14 refers to the warning history information 192 to obtain the status of driving assistance provided by the supervisor. The output control unit 14 determines the supervisor who is capable of dealing with the detected attention-grabbing condition as the responsible supervisor.

[0106] Next, the warning processing unit 18 determines whether or not there is an instruction from the monitor regarding the warning (S16). The warning processing unit 18 receives the instruction from the monitor via the operation unit 23. If there is no instruction from the monitor (NO in S16), the process returns to step S11. Alternatively, the output control unit 14 may issue the warning again, or change the responsibility and output the warning to another monitor. If there is an instruction from the monitor (YES in S16), the warning processing unit 18 generates instruction information and transmits it to the in-vehicle device 30 (S17).

[0107] As a result, vehicle 35 will perform autonomous driving according to the instructions. Alternatively, vehicle 35 may be driven manually by remote control from a supervisor. Vehicle 35 may also broadcast the supervisor's voice or other information inside the vehicle.

[0108] Although not shown in the diagram, the calculation unit 15 may also calculate the characteristics of the monitors necessary to obtain a predetermined monitoring quality. This allows, for example, the number and skills of the monitors required to obtain a predetermined monitoring quality.

[0109] Furthermore, the processing order shown in Figure 6 may be changed as appropriate. For example, the figure illustrates an example in which monitor characteristics are estimated after a warning state is detected (S13, S14). However, the estimation unit 13 may acquire monitor images at predetermined time intervals and estimate monitor characteristics as needed. In this way, the estimation unit 13 can estimate the number of monitors and monitor health information in advance.

[0110] As described above, in the information processing system 50 according to this embodiment, the information processing device 10 estimates the characteristics of the vehicle monitor based on an image of the monitor. Based on the estimated characteristics, the information processing device 10 controls the output of a warning to the monitor.

[0111] In this way, the information processing device 10 can control the amount of warnings issued to the monitor and output warnings that are appropriate to the monitor's physical condition and abilities. This allows for a balance between the monitor and the amount of warnings issued.

[0112] For example, the information processing device 10 can set the warning level (workload) according to the number of monitors and their processing capacity. This allows the monitors to adjust the warning level to an appropriate level from their perspective. In this way, one monitor can monitor multiple vehicles (for example, five vehicles). Therefore, a monitoring system can be established without causing a shortage of monitors.

[0113] Furthermore, if the number of warnings is low compared to the number of monitors, the monitors will be put on standby. However, the information processing system 50 according to this embodiment can calculate an appropriate number of monitors, so this problem can also be solved.

[0114] Furthermore, the information processing device 10 can appropriately determine a monitor to deal with the detected attention-grabbing condition. For example, in the case of a vehicle that has stopped abnormally, it can quickly identify any factors that may be hindering its operation and pinpoint those factors. In addition, the information processing device 10 can assign attention-grabbing vehicles to monitors according to their capabilities, allowing the assigned monitor to quickly resolve the attention-grabbing condition.

[0115] In this way, by having a supervisor appropriately monitor the vehicle and remotely control it as needed, the information processing device 10 can ensure the vehicle is driven properly. For example, if the vehicle is a bus, it can be operated on schedule without stopping in unexpected places. Furthermore, even if a problem occurs inside or outside the vehicle, the problem can be detected early and dealt with promptly. This allows for a quick recovery from the situation and the resumption of operations.

[0116] Therefore, according to the information processing system 50 of this embodiment, it is possible to appropriately monitor vehicles according to the status of the monitor.

[0117] (Example hardware configuration) Each functional component of the information processing device 10, the monitoring device 20, and the in-vehicle device 30 (hereinafter referred to as "information processing device 10, etc.") may be implemented by hardware that realizes each functional component (e.g., hardwired electronic circuits, etc.), or by a combination of hardware and software (e.g., a combination of electronic circuits and programs that control them, etc.). The case in which each functional component of the information processing device 10, etc. is implemented by a combination of hardware and software will be further explained below.

[0118] Figure 7 is a block diagram illustrating the hardware configuration of a computer 900 that implements the information processing device 10, etc. The computer 900 may be a dedicated computer designed to implement the information processing device 10, etc., or it may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or tablet terminal.

[0119] For example, by installing a predetermined application on the computer 900, the various functions of the information processing device 10, etc., are realized on the computer 900. The above application consists of a program for realizing the functional components of the information processing device 10, etc.

[0120] Computer 900 includes a bus 902, a processor 904, memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, memory 906, storage device 908, input / output interface 910, and network interface 912 to send and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to bus connection.

[0121] The processor 904 is a variety of processors, such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), or quantum processor (quantum computer control chip). The memory 906 is the main memory, implemented using RAM (Random Access Memory), etc. The storage device 908 is the auxiliary storage, implemented using a hard disk, SSD (Solid State Drive), memory card, or ROM (Read Only Memory), etc.

[0122] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, input devices such as keyboards and output devices such as display devices are connected to the input / output interface 910.

[0123] The network interface 912 is an interface for connecting computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0124] The storage device 908 stores programs that implement each functional component of the information processing device 10, etc. (programs that implement the aforementioned applications). The processor 904 reads these programs into memory 906 and executes them to implement each functional component of the information processing device 10, etc.

[0125] Each processor executes one or more programs containing a set of instructions for causing the computer to perform the algorithms described with reference to the drawings. These programs, when loaded into the computer, contain a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable medium or tangible storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The programs may also be transmitted over various types of transient computer-readable medium or communication medium. For example, and not an exhaustive, temporary computer-readable or communication media include propagating signals of electrical, optical, acoustic, or other forms.

[0126] This disclosure is not limited to the embodiments described above, and may be modified as appropriate without departing from its intent.

[0127] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0128] (Note 1) A means for acquiring vehicle status information regarding the status of a vehicle being monitored, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of the monitor based on an image of the monitor of the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-requiring state based on the estimated characteristics. Information processing device. (Note 2) The aforementioned characteristics include information indicating the number of observers, The output control means controls the output of the warning based on the number of people information. The information processing device described in Appendix 1. (Note 3) The aforementioned characteristics include health information indicating the health condition of the observer, The output control means controls the output of the warning based on the physical condition information. The information processing device described in Appendix 1 or 2. (Note 4) The output control means controls the output of the warning based on the priority corresponding to the attention state. An information processing device as described in any one of the appendices 1 to 3. (Note 5) The output control means controls the output of the warning according to the amount of the cautionary state detected in one of the vehicles. An information processing device as described in any one of the appendices 1 to 4. (Note 6) The output control means further controls the output of the warning based on capability information indicating the capabilities of the monitor. An information processing device as described in any one of the appendices 1 to 5. (Note 7) The aforementioned capability information includes historical information showing the status of driving assistance provided by the supervisor. The information processing device described in Appendix 6. (Note 8) The system further comprises a calculation means for calculating the characteristics of the monitor necessary to obtain a predetermined monitoring quality. An information processing device as described in any one of the items 1 to 7 of the appendix. (Note 9) A sensor that acquires vehicle status information regarding the status of the vehicle being monitored, Equipped with an information processing device, The aforementioned information processing device is An acquisition means for acquiring the vehicle status information from the aforementioned sensor, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of the monitor based on an image of the monitor of the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-sensitive state based on the estimated characteristics. Information processing system. (Note 10) The aforementioned characteristics include information indicating the number of observers, The output control means controls the output of the warning based on the number of people information. The information processing system described in Appendix 9. (Note 11) Obtain vehicle status information regarding the status of the vehicle being monitored, Based on the aforementioned vehicle status information, a state requiring attention during vehicle monitoring is detected. Based on images of the vehicle's monitor, the characteristics of the monitor are estimated. Based on the estimated characteristics, control the output of a warning to the monitor regarding the attention-seeking condition. Information processing methods. (Note 12) The aforementioned characteristics include information indicating the number of observers, In controlling the output of the warning, the output of the warning is controlled based on the number of people information. The information processing method described in Appendix 11. (Note 13) The process involves acquiring vehicle status information regarding the status of the vehicle being monitored, and A detection process that detects a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation process is performed to estimate the characteristics of the monitor based on images taken of the monitor of the vehicle, Based on the estimated characteristics, an output control process controls the output of a warning to the monitor regarding the attention-sensitive state, A non-temporary, computer-readable medium containing programs to be executed by a computer. (Note 14) The aforementioned characteristics include information indicating the number of observers, In the output control process, the output of the warning is controlled based on the number of people information. Non-temporary computer-readable media as described in Appendix 13. [Explanation of Symbols]

[0129] 10 Information Processing Devices 11 Acquisition Department 12 Detection unit 13 Estimation part 14 Output Control Unit 15 Calculation Section 16 Information Transmission Section 17. Video transmission unit 18 Warning Processing Unit 19 Memory section 20 Monitoring equipment 21 Display Control Unit 22, 221, 222 display section 22a Integrated monitoring screen 22b Detailed monitoring screen 23 Control section 25 Surveillance cameras 30 Onboard equipment 31 Video transmission unit 32 Information Transmission Unit 33 Vehicle Control Unit 35 vehicles 40 Infrastructure 41 Video transmission unit 45 Infrastructure Cameras 50 Information Processing Systems 100 Information Processing Devices 101 Acquisition Department 102 Detection unit 103 Estimation part 104 Output Control Unit 191 Vehicle Status Information 192 Warning History Information 900 Computers 902 Bus 904 Processor 906 memory 908 Storage Devices 910 Input / Output Interface 912 Network Interface A, B Observer C Monitoring Center

Claims

1. A means for acquiring vehicle status information regarding the status of a vehicle being monitored, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of a monitor based on an image of a monitor remotely monitoring the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-requiring state based on the estimated characteristics. Information processing device.

2. The aforementioned characteristics include information indicating the number of observers, The output control means controls the output of the warning based on the number of people information. The information processing apparatus according to claim 1.

3. The aforementioned characteristics include health information indicating the health condition of the observer, The output control means controls the output of the warning based on the physical condition information. The information processing apparatus according to claim 1 or 2.

4. The output control means controls the output of the warning based on the priority corresponding to the attention state. The information processing apparatus according to claim 1 or 2.

5. The output control means controls the output of the warning according to the amount of the cautionary state detected in one of the vehicles. The information processing apparatus according to claim 1 or 2.

6. The output control means further controls the output of the warning based on capability information indicating the capabilities of the monitor. The information processing apparatus according to claim 1 or 2.

7. The aforementioned capability information includes historical information showing the status of driving assistance provided by the supervisor. The information processing apparatus according to claim 6.

8. A sensor that acquires vehicle status information regarding the status of the vehicle being monitored, Equipped with an information processing device, The aforementioned information processing device is An acquisition means for acquiring the vehicle status information from the aforementioned sensor, A detection means for detecting a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation means for estimating the characteristics of a monitor based on an image of a monitor remotely monitoring the vehicle, The system includes output control means that controls the output of a warning to the monitor regarding the attention-sensitive state based on the estimated characteristics. Information processing system.

9. A computer, Obtain vehicle status information regarding the status of the vehicle being monitored, Based on the aforementioned vehicle status information, a state requiring attention during vehicle monitoring is detected. Based on images of the monitor remotely monitoring the vehicle, the characteristics of the monitor are estimated. Based on the estimated characteristics, control the output of a warning to the monitor regarding the attention-seeking condition. Information processing methods.

10. The process involves acquiring vehicle status information regarding the status of the vehicle being monitored, and A detection process that detects a state requiring attention to vehicle monitoring based on the aforementioned vehicle status information, An estimation process is performed to estimate the characteristics of the monitor based on images taken of the monitor remotely monitoring the vehicle, Based on the estimated characteristics, an output control process controls the output of a warning to the monitor regarding the attention-sensitive state, A program that is executed by a computer.

Citation Information

Patent Citations

  • Information presentation device, method, and program

    JP2016024711A

  • Information processing method, and information processing system

    JP2020061119A

  • Information processing method, and information processing system

    JP2020061121A

  • Remote controller and automatic driving system

    JP2020154631A

  • Vehicle and remote control system

    JP2021064206A