Remote support system, remote support method, and remote support program
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- TOYOTA JIDOSHA KK
- Filing Date
- 2023-01-25
- Publication Date
- 2026-06-09
AI Technical Summary
【0009】 本開示の技術によれば、複数の監視カメラに関し、車両との現在の相対的関係だけでなく車両との将来の相対的関係も考慮に入れることで、どの監視カメラが遠隔サポートを行う上でより有用な映像を提供する監視カメラなのか判断することが可能となる。これにより、複数の監視カメラで取得された映像のうち遠隔サポートに有用な映像を選定して遠隔オペレータに対して表示することができる。
Smart Images

Figure 0007871712000001 
Figure 0007871712000002 
Figure 0007871712000003
Abstract
Claims
1. A remote support system for providing remote support to a vehicle, A display device that shows video to a remote operator, At least one processor, The system comprises at least one memory storing a plurality of instructions that can be executed by the at least one processor, The plurality of instructions are provided to at least one processor, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects an image from among the images acquired by the multiple surveillance cameras to be displayed on the display device. It is configured to display the selected image on the display device and to perform the following actions: The video related to the operation of the aforementioned vehicle includes video showing the aforementioned vehicle. Selecting the image to be displayed on the display device includes prioritizing the image from a surveillance camera in which the vehicle is in the field of view for a longer period of time. The plurality of instructions are provided to at least one processor, The system is configured to prioritize surveillance camera footage in which the vehicle is in the field of view for a longer period of time, as the vehicle's speed increases. A remote support system characterized by the following features.
2. A remote support system for providing remote support to a vehicle, A display device that shows video to a remote operator, At least one processor, The system comprises at least one memory storing a plurality of instructions that can be executed by the at least one processor, The plurality of instructions are provided to at least one processor, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects an image from among the images acquired by the multiple surveillance cameras to be displayed on the display device. It is configured to display the selected image on the display device and to perform the following actions: The display device includes multiple screens, The plurality of instructions are provided to at least one processor, In accordance with predetermined allocation rules, each of the multiple surveillance cameras is associated with one of the multiple screens, Each of the aforementioned multiple screens is configured to select the video to display from the video acquired by the associated surveillance camera. A remote support system characterized by the following features.
3. A remote support system for providing remote support to a vehicle, A display device that shows video to a remote operator, At least one processor, The system comprises at least one memory storing a plurality of instructions that can be executed by the at least one processor, The plurality of instructions are provided to at least one processor, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects an image from among the images acquired by the multiple surveillance cameras to be displayed on the display device. The selected video is displayed on the display device, The system is configured to perform the following actions: to display the selected video on the display device in a different manner depending on the current and future relative relationship between the surveillance camera that captured the selected video and the vehicle; The display device includes multiple screens, The selected video includes multiple selected videos. The plurality of instructions are provided to at least one processor, The system is configured to perform the following actions: to arrange the multiple selected images on the multiple screens differently depending on the current and future relative relationship between the surveillance camera corresponding to each of the multiple selected images and the vehicle. A remote support system characterized by the following features.
4. A remote support system for providing remote support to a vehicle, A display device that shows video to a remote operator, At least one processor, The system comprises at least one memory storing a plurality of instructions that can be executed by the at least one processor, The plurality of instructions are provided to at least one processor, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects an image from among the images acquired by the multiple surveillance cameras to be displayed on the display device. It is configured to display the selected image on the display device and to perform the following actions: The image displayed on the aforementioned display device is an image that does not show the vehicle. The plurality of instructions are provided to at least one processor, The system is configured to perform a process to remove or hide the vehicle from the selected video footage that contains the vehicle. A remote support system characterized by the following features.
5. A remote support system for providing remote support to a vehicle, A display device that shows video to a remote operator, At least one processor, The system comprises at least one memory storing a plurality of instructions that can be executed by the at least one processor, The plurality of instructions are provided to at least one processor, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects an image from among the images acquired by the multiple surveillance cameras to be displayed on the display device. It is configured to display the selected image on the display device and to perform the following actions: The image displayed on the aforementioned display device is an image that does not show the vehicle. The plurality of instructions are provided to at least one processor, The system is configured to display an image on the display device that does not show the vehicle from the time the vehicle approaches the intersection until it passes through the intersection. A remote support system characterized by the following features.
6. In the remote support system described in Claim 5, The plurality of instructions are provided to at least one processor, The system is configured to display an image on the display device that does not show the vehicle when the vehicle's speed is above a predetermined speed, and to display an image on the display device that shows the vehicle when the vehicle's speed is below the predetermined speed. A remote support system characterized by the following features.
7. In the remote support system described in Claim 6, The plurality of instructions are provided to at least one processor, When displaying an image of the vehicle on the display device, the device is configured to superimpose an arrow indicating the direction of travel of the vehicle at the intersection onto the display device. A remote support system characterized by the following features.
8. A remote support method for providing remote support to a vehicle, The computer acquires video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, The computer selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator, based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle. The computer includes displaying the selected image on the display device, The video related to the operation of the aforementioned vehicle includes video showing the aforementioned vehicle. Selecting the image to be displayed on the display device includes prioritizing the image from a surveillance camera in which the vehicle is in the field of view for a longer period of time. The computer further includes prioritizing surveillance camera footage in which the vehicle is in the field of view for a longer period of time as the vehicle's speed increases. A remote support method characterized by the following features.
9. A remote support method for providing remote support to a vehicle, The computer acquires video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, The computer selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator, based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle. The computer includes displaying the selected image on the display device, The display device includes multiple screens, The computer associates each of the multiple surveillance cameras with one of the multiple screens according to a predetermined allocation rule, The computer further includes selecting, for each of the multiple screens, a video to be displayed from among the videos acquired by the associated surveillance camera. A remote support method characterized by the following features.
10. A remote support method for providing remote support to a vehicle, The computer acquires video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, The computer selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator, based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle. The computer displays the selected image on the display device, The computer includes, in order to display the selected image on the display device differently depending on the current and future relative relationship between the surveillance camera that captured the selected image and the vehicle, The display device includes multiple screens, The selected video includes multiple selected videos. The computer further includes different arrangements of the multiple selected images on the multiple screens according to the current and future relative relationship between the surveillance camera corresponding to each of the multiple selected images and the vehicle. A remote support method characterized by the following features.
11. A remote support method for providing remote support to a vehicle, The computer acquires video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, The computer selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator, based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle. The computer includes displaying the selected image on the display device, The image displayed on the aforementioned display device is an image that does not show the vehicle. The computer further includes performing a process to remove or hide the vehicle from the selected video in which the vehicle is visible. A remote support method characterized by the following features.
12. A remote support method for providing remote support to a vehicle, The computer acquires video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, The computer selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator, based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle. The computer includes displaying the selected image on the display device, The image displayed on the aforementioned display device is an image that does not show the vehicle. The computer further includes displaying on the display device an image that does not show the vehicle from the time the vehicle approaches the intersection until it passes through the intersection. A remote support method characterized by the following features.
13. A remote support method according to claim 12, The computer further includes displaying an image on the display device that does not show the vehicle when the vehicle's speed is above a predetermined speed, and displaying an image on the display device that shows the vehicle when the vehicle's speed is below the predetermined speed. A remote support method characterized by the following features.
14. A remote support method according to claim 13, When the computer displays an image of the vehicle on the display device, it further includes superimposing an arrow indicating the direction of travel of the vehicle at the intersection onto the display device. A remote support method characterized by the following features.
15. A remote support program for providing remote support to a vehicle, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator. The system is configured to display the selected image on the display device and to cause the computer to perform the following actions: The video related to the operation of the aforementioned vehicle includes video showing the aforementioned vehicle. Selecting the image to be displayed on the display device includes prioritizing the image from a surveillance camera in which the vehicle is in the field of view for a longer period of time. The computer is configured to further prioritize surveillance camera footage in which the vehicle is in the field of view for a longer period of time, as the vehicle's speed increases. A remote support program characterized by the following features.
16. A remote support program for providing remote support to a vehicle, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator. The system is configured to display the selected image on the display device and to cause the computer to perform the following actions: The display device includes multiple screens, In accordance with predetermined allocation rules, each of the multiple surveillance cameras is associated with one of the multiple screens, Each of the aforementioned multiple screens is configured to further cause the computer to select the video to display from among the videos acquired by the associated surveillance camera. A remote support program characterized by the following features.
17. A remote support program for providing remote support to a vehicle, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator. The selected video is displayed on the display device, The system is configured to cause a computer to perform the following actions: to display the selected video on the display device in a different manner depending on the current and future relative relationship between the surveillance camera that captured the selected video and the vehicle; The display device includes multiple screens, The selected video includes multiple selected videos. The computer is further configured to perform the following actions: to arrange the multiple selected images on the multiple screens differently, depending on the current and future relative relationship between the surveillance camera corresponding to each of the multiple selected images and the vehicle. A remote support program characterized by the following features.
18. A remote support program for providing remote support to a vehicle, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator. The system is configured to display the selected image on the display device and to cause the computer to perform the following actions: The image displayed on the aforementioned display device is an image that does not show the vehicle. The system is configured to further cause the computer to perform a process to remove or hide the vehicle from the selected video footage that shows the vehicle. A remote support program characterized by the following features.
19. A remote support program for providing remote support to a vehicle, Acquiring video footage related to the operation of the vehicle from multiple surveillance cameras installed along or near the vehicle's route, Based on information regarding the current and future relative relationship between each of the multiple surveillance cameras and the vehicle, the system selects from the images acquired by the multiple surveillance cameras to be displayed on a display device for the remote operator. The system is configured to display the selected image on the display device and to cause the computer to perform the following actions: The image displayed on the aforementioned display device is an image that does not show the vehicle. The system is configured to further cause the computer to display an image on the display device that does not show the vehicle from the time the vehicle approaches the intersection until it passes through the intersection. A remote support program characterized by the following features.