Robot Force Visualization Using Onomatopoeia and Image Overlays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current tactile-sense devices limit the reproduction of force senses to a local area and do not allow users to intuitively recognize external forces received by a robot operating in a remote location as they occur.
Innovation Solution
A force-sense visualization apparatus that acquires image and force-sense data, converts the force sense into text information using onomatopoeia, and superimposes this information onto images of the robot's surroundings, enabling users to intuitively recognize external forces through visual feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If tactile-sense devices are used to reproduce force senses, then force sense reproduction is achieved, but the reproduction is limited to a local place and the types of force senses that can be reproduced are limited
Solution Approach 1:
The patent replaces the mechanical tactile-sense device with a visual information system. The force-sense visualization apparatus converts force sense data into visual representations (arrows, colors, text) that are superimposed on images, allowing users to perceive force senses remotely through visual channels rather than requiring physical contact through tactile devices.
Solution Approach 2:
The patent introduces visual information as an intermediary between the robot's force sense experience and the user's perception. Instead of directly transmitting tactile sensations, the system uses visual metaphors (arrows indicating direction, colors indicating magnitude, text descriptions) to mediate the communication of force senses across distance.
2Loss of information
If traditional tactile-sense devices are used, then force sense data is collected, but users cannot intuitively and immediately recognize external forces received by remote robots
Solution Approach 1:
The patent uses color variations to encode different aspects of force senses. The visualization system displays arrows and regions in different colors to indicate the magnitude, direction, and nature of external forces, making the information immediately recognizable and intuitive for users without requiring interpretation of raw data.
Solution Approach 2:
The patent transforms force sense data from an invisible physical quantity into a visual dimension that can be perceived by users. By projecting force information onto the 2D image plane through arrows, colors, and text overlays, the system adds a visual dimension to the user's understanding of remote force interactions.
3Adaptability or versatility
If force sense data is transmitted through network, then remote operation capability is expanded, but the user's understanding of force nature and location may be insufficient
Solution Approach 1:
The patent merges force sense information with visual image data into a single composite display. The visualization system superimposes force indicators (arrows, colored regions, text) directly onto the video feed from the robot's camera, combining spatial location information from images with force magnitude and direction data in one integrated view.
Solution Approach 2:
The patent implements visual feedback that provides continuous information about external forces acting on the robot. The system processes force sensor data in real-time and immediately displays visual representations to the user, enabling the user to understand the force nature and location as events occur during remote operation.
Data Source
AI summary
A force-sense visualization apparatus includes a data acquisition unit configured to acquire image data and force-sense data, image data being obtained by taking an image of a surrounding environment of a robot, the force-sense data relating to a force sense that the robot has received from the outside, a conversion unit configured to convert the force sense into text information composed of onomatopoeia based on the force-sense data, and an image output unit configured to superimpose the text information on the image of the image data and output the resultant image data.