Remote Vehicle View Sharing With Gaze-Based Sight Area Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to provide a satisfactory sense of realism for both occupants in mobile objects and users at different locations, particularly in vehicle communication scenarios.
Innovation Solution
An information processing system with a first device in the mobile object and a second device at a different location, utilizing cameras, communication devices, and display units to enhance realism by displaying images and indicators based on user orientation and sight direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If images are shared through communication between devices, then information transmission is achieved, but the sense of realism is insufficient for both occupants and remote users
Solution Approach 1:
The patent adds the dimension of spatial orientation and viewpoint by detecting the user's orientation direction and transmitting this metadata along with the image data. This allows the occupant's device to understand not just what the user sees, but from what angle and direction, creating a more immersive and realistic shared experience that transcends simple 2D image transmission.
Solution Approach 2:
The system implements feedback by detecting the user's orientation direction and using this information to dynamically adjust and select which images are transmitted. The sight area identification based on orientation feedback allows the system to prioritize transmitting relevant visual information, enhancing the realism of the shared experience while optimizing data transmission efficiency.
2Quantity of substance
If all images captured by the camera unit are transmitted, then complete visual information is provided, but communication data volume and processing load increase
Solution Approach 1:
The patent extracts only the essential visual information by identifying the sight area based on the user's orientation direction. Instead of transmitting all captured images, the system extracts and transmits only the relevant portion that corresponds to where the user is looking, significantly reducing data volume while maintaining the quality of the shared experience.
Solution Approach 2:
The system transmits a partial set of images - specifically those within the identified sight area - rather than all captured images. This partial action approach is sufficient to convey the essential visual information the user wants to share, avoiding the excessive energy consumption that would result from transmitting complete 360-degree or all-camera footage.
3Adaptability or versatility
If the system displays images from multiple cameras including inside cameras, then comprehensive viewing experience is achieved, but device complexity increases
Solution Approach 1:
The camera unit is designed with multi-functionality, where the same camera system serves both external environment capture and internal cabin monitoring. The inside cameras positioned on seats can capture both the occupant's perspective and the cabin interior, allowing a single hardware configuration to support multiple viewing scenarios without requiring separate dedicated camera systems.
Solution Approach 2:
The system dynamically selects which camera feeds and which portions of those feeds to transmit based on the user's orientation direction. Rather than continuously transmitting all camera inputs, the system adaptively adjusts the transmitted content in real-time, reducing the effective complexity of data processing while maintaining comprehensive viewing capability when needed.
Data Source
AI summary
An information processing system includes a first device that is mounted in a mobile object which an occupant boards and a second device that is used by a user at a place different from the mobile object. The first device includes a first communication device configured to communicate with a second communication device of the second device and a camera unit including one or more cameras. The second device includes the second communication device configured to communicate with the first communication device, a detection device configured to detect an orientation direction of the user, and a display device configured to display an image corresponding to the orientation direction when seen from the predetermined seat out of images captured by the camera unit. The second device identifies a sight area to which a sightline of the user is directed in the image, and the first device displays the sight area received via the first communication device in a predetermined mode on a display device.