Remote Assistance Guidance via Multi-Directional Image Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote assistance systems are inefficient in guiding users to a requested capture position, particularly when relying solely on captured images from a single direction, which can lead to misalignment and require multiple recaptures.
Innovation Solution
A remote assistance system comprising a terminal device and a remote device that captures and transmits images from multiple directions, allowing the remote device to derive and display guidance images to help users align with the requested capture position, with features like transparency adjustment based on misalignment and virtual markers for precise positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If guidance is provided using only a captured image from a single direction, then the system complexity is low, but the guidance accuracy and user alignment to the requested capture position deteriorates
Solution Approach 1:
The captured image is segmented into multiple directional views (first directional view and second directional view) representing different spatial perspectives. This segmentation allows the system to provide comprehensive guidance information from multiple angles, improving guidance accuracy without requiring a completely new complex system architecture.
Solution Approach 2:
The system transitions from displaying a single two-dimensional captured image to presenting multiple directional views that represent three-dimensional spatial information. By adding the dimension of multiple viewing angles, the system enhances guidance accuracy while maintaining relatively simple system complexity through software-based image processing.
2Measurement precision
If multiple images from different directions are captured and transmitted, then the guidance accuracy improves, but the data transmission volume and processing complexity increases
Solution Approach 1:
The system extracts only the essential directional view information needed for guidance from the captured images. By selecting and transmitting only the first and second directional views rather than all possible image data, the system reduces data transmission volume while maintaining sufficient guidance accuracy for user alignment.
Solution Approach 2:
The system transmits a partial set of directional views (specifically the first and second directional views) rather than complete omnidirectional data. This partial action approach provides sufficient guidance information for practical use while significantly reducing the data transmission burden and processing requirements.
3Ease of operation
If transparency adjustment based on misalignment is implemented, then the guidance intuitiveness improves, but the processing complexity and computational load increases
Solution Approach 1:
The system implements feedback by adjusting the transparency of guidance images based on the user's alignment status with the requested capture position. When misalignment is detected, the guidance image with higher transparency provides stronger visual feedback, guiding the user to adjust their position. This feedback mechanism enhances guidance intuitiveness through relatively simple transparency adjustment processing.
Solution Approach 2:
The system changes the transparency parameter of the guidance image dynamically based on misalignment conditions. By adjusting this single visual parameter rather than redesigning the entire guidance system, the patent achieves improved guidance intuitiveness with minimal processing complexity increase.
Data Source
AI summary
A remote assistance system includes a terminal device and a remote device, the terminal device including a first processor configured to: transmit information of multiple images obtained by capturing a subject from respectively different directions to the remote device; receive display information for displaying a guidance image that guides a user to a requested capture position, the guidance image being derived by the remote device using the image information; and display the guidance image indicated by the received display information, the remote device including a second processor configured to: receive the information of multiple images from the terminal device; display images indicated by the received information of multiple images; receive a selection of an image captured from the requested capture position from among the displayed images; derive the display information using the selected image; and transmit the derived display information to the terminal device.