Remote Collaboration Robot with HMD and Projector
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote collaboration systems face challenges in efficiency and comfort due to limitations in device types, such as low task efficiency for remote users and difficulty for local guides in observing remote spaces, especially with narrow camera angles and user discomfort with wearable devices.
Innovation Solution
A remote collaboration system combining a head-mounted display with a robot device equipped with a projector and multiple cameras, allowing for panoramic and high-resolution image capture and display, enabling efficient communication and information provision between remote and local users without the need for users to hold or wear devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a mobile device is used for remote collaboration, then accessibility is improved, but task efficiency deteriorates
Solution Approach 1:
The patent introduces a robot device as an intermediary between the remote user and the local guide. The robot captures panoramic images of the remote space and transmits them to the HMD, enabling the local guide to observe the remote environment without the remote user needing to hold or wear a device. This resolves the contradiction by maintaining accessibility while improving task efficiency through automated image capture and display.
2Ease of operation
If a wearable device is used for remote collaboration, then device holding is eliminated, but user comfort deteriorates
Solution Approach 1:
The robot device serves as an intermediary that captures panoramic images of the remote space and transmits them to the HMD. The remote user wears the HMD to observe the remote space through panoramic images, eliminating the need to hold a device while maintaining comfort through the robot's automated capture function.
3Difficulty of detecting and measuring
If a robot device with narrow angle camera is used, then remote space observation is improved, but local guide observation capability deteriorates
Solution Approach 1:
The patent employs a panoramic camera on the robot device to capture 360-degree images of the remote space, transforming the narrow angle limitation into a comprehensive spherical view. This allows the local guide to observe the entire remote environment by controlling the robot's movement, resolving the contradiction between observation coverage and observation capability.
4Loss of information
If a monitor display is used for remote user, then explanation reception is improved, but task efficiency deteriorates
Solution Approach 1:
The patent transitions from traditional 2D monitor display to 3D panoramic image display through the HMD. The remote user can observe the remote space in immersive three dimensions while receiving explanations, eliminating the need to switch between monitor and task, thus improving task efficiency while maintaining information reception.
Data Source
AI summary
In a remote interaction method performed by a remote collaboration system comprising a robot device and a head mounted display, the robot device is located in a remote space and comprising a projector, a panoramic camera and a high resolution camera. The head mounted display is located in a local space apart from the remote space. A communication between the robot device and the head mounted display is established based on a communication request. The remote space is observed by the head mounted display based on first image information and second image information. The first image information is collected by the panoramic camera and received from the robot device. The second image information is collected by the high resolution camera and received from the robot device. Necessary information to be provided to the remote space is searched by the head mounted display based on a result of observing the remote space. The necessary information received from the head mounted display is provided by the robot device to the remote space using the projector.