Portable Image Annotation Positioning Using Sensor and Vision Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image and video annotation systems on portable devices face challenges in precision and robustness of annotation placement, particularly when multiple positions are considered or ambiguity exists regarding the optimal position in the image, and they often require high bandwidth and computational resources.
Innovation Solution
A computerized method for placing annotations on images that involves obtaining an original image, determining the probability of feature presence at various positions using sensors and computer vision, and forming an annotated image by placing the annotation at the position with the highest probability, while also considering the reliability and precision of different techniques to maximize robustness and precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple techniques are used to determine annotation positions, then precision is enhanced, but device complexity and computational load increase
Solution Approach 1:
The patent segments the annotation position determination into multiple independent techniques (sensor-based techniques using GPS, compass, accelerometer; image-based techniques using feature detection and matching). Each technique operates independently and can be selected or combined based on availability and reliability, allowing precision enhancement without requiring all techniques to be simultaneously complex.
Solution Approach 2:
The system implements partial action by allowing selective use of techniques based on conditions. Not all techniques need to be executed in all cases - the system can use sensor-based techniques alone, image-based techniques alone, or combine them, depending on what is available and what level of precision is required. This reduces computational load while maintaining the capability for high precision when needed.
2Measurement precision
If image transmission to remote server is performed, then annotation recognition is improved, but bandwidth consumption and delay increase
Solution Approach 1:
The patent extracts and processes critical features locally on the portable device rather than transmitting entire images. Image-based techniques detect and match features (edges, corners, distinctive patterns) locally, sending only feature data or processed information to remote servers, significantly reducing bandwidth consumption while maintaining recognition accuracy.
Solution Approach 2:
The system performs preliminary processing of images locally before transmission. Feature detection, preprocessing, and initial analysis are conducted on the portable device, so that when data is transmitted to remote servers, it is already in a optimized format requiring less bandwidth and processing time, thereby reducing both bandwidth consumption and delay.
3Productivity
If annotation is placed without probability determination, then processing speed is improved, but annotation precision deteriorates
Solution Approach 1:
The system implements partial probability determination - rather than calculating exhaustive probabilities for all possible positions, it determines probabilities only for candidate positions identified by sensor data and image features. This selective probability calculation maintains annotation precision while avoiding the computational burden of evaluating all possible positions, thus preserving processing speed.
Data Source
AI summary
A system for automated annotation of images and videos points a mobile device towards an object of interest, such as a building or landscape scenery, for the device to display an image of the scene with an annotation for the object. An annotation can include names, historical information, and links to databases of images, videos, and audio files. Different techniques can be used for determining positional placement of annotations, and, by using multiple techniques, positioning can be made more precise and reliable. The level of detail of annotation information can be adjusted according to the precision of the techniques used. A trade-off can be taken into account between precision of annotation and communication cost, delay and/or power consumption. An annotation database can be updated in a self-organizing way. Public information as available on the web can be converted to annotation data.