Remote Vehicle Control with Synthetic Surround View Handover
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote vehicle control technologies lack convenience and operability, as users face challenges in effectively controlling vehicles from a distance due to limitations in visual feedback and control authority management.
Innovation Solution
A remote vehicle control device and method that generates synthetic images from multiple camera views, allowing users to control vehicles while receiving real-time feedback, and manages control authority transfer between devices for improved coordination and safety.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote vehicle control is implemented using existing technologies, then vehicle control from distance is enabled, but convenience and operability are not satisfactory
Solution Approach 1:
The system provides real-time visual feedback through synthetic images generated from multiple camera views, allowing the remote operator to see the vehicle surroundings from a bird's eye perspective. This feedback mechanism enables the operator to make informed control decisions and improves operability by creating a sense of presence and spatial awareness that was missing in existing remote control systems
Solution Approach 2:
The patent introduces an authority managing unit as an intermediary that coordinates control authority between multiple remote control devices. This mediator resolves conflicts when multiple users attempt to control the vehicle simultaneously, ensuring reliable and conflict-free operation by systematically managing who has control at any given time
2Adaptability or versatility
If multiple remote control devices are used for vehicle control, then coordination between users is improved, but control authority conflicts may occur
Solution Approach 1:
The authority managing unit serves multiple functions: it detects when multiple devices are connected, determines which device should have control authority, manages the transfer of authority between devices, and prevents conflicting control inputs. This universal control mechanism handles all aspects of multi-device coordination through a single integrated system, making the complexity manageable while enabling versatile multi-user control
3Loss of information
If synthetic images from multiple cameras are used, then surrounding area visibility is improved, but system complexity increases
Solution Approach 1:
The system merges images from multiple cameras positioned at different locations on the vehicle into a single synthetic bird's eye view image. This combining process integrates information from all camera sources to create a comprehensive overview of the surrounding area, eliminating blind spots and providing complete visibility while managing the complexity through automated image synthesis algorithms
Data Source
AI summary
A remote vehicle control device includes: a display unit; an operation unit configured for controlling a vehicle; a signal generating unit configured to generate control signals for the vehicle, based on operations on the operation unit; a communication unit configured to perform communication with the vehicle and another remote vehicle control device; and an authority managing unit that manages a control authority for the vehicle. Synthetic images showing a surrounding area of the vehicle as seen from a virtual viewpoint each are generated on the basis of plural images acquired by plural on-board cameras mounted on the vehicle, respectively, and the display unit displays the synthetic images. The communication unit transmits the control signals to the vehicle. The authority managing unit performs transfer of the control authority for the vehicle in cooperation with the another remote vehicle control device via the communication unit.