Annotated Object Model Creation for Robotic Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robotic systems require extensive manual effort to define properties of new objects in their environment for action planning, as they lack the ability to automatically learn and understand their surroundings.
Innovation Solution
A system that predicts properties for new objects, allowing operators to correct, confirm, or dismiss these predictions using gestures, speech, or gaze, thereby reducing the workload in annotating object models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual annotation of object properties is performed from scratch, then completeness and accuracy of object model information is improved, but time consumption and operator effort increase significantly
Solution Approach 1:
The system performs preliminary annotation by automatically predicting object properties (category, color, material, shape) before the operator provides final input. This preliminary action generates a draft object model that is then refined by the operator, significantly reducing the time required for complete annotation while maintaining accuracy.
Solution Approach 2:
The system creates a copy of the object model with predicted properties that serves as a template for the operator to review and correct. This copying approach allows the operator to work with a pre-filled model rather than creating everything from scratch, reducing annotation time while preserving completeness through operator verification.
2Productivity
If automatic prediction of object properties is implemented, then annotation speed and productivity are improved, but accuracy and reliability of object model information may deteriorate
Solution Approach 1:
The system implements a feedback loop where the operator reviews and corrects the automatically predicted properties. The operator's corrections feed back into the system, allowing it to learn and improve prediction accuracy over time. This ensures that while speed is improved through automation, accuracy is maintained through human verification and continuous learning.
Solution Approach 2:
The automatic prediction provides a preliminary version of object properties that serves as a starting point for refinement. This preliminary action increases productivity by handling the initial annotation work, while the subsequent operator review ensures accuracy by correcting any prediction errors.
3Adaptability or versatility
If comprehensive object properties and relations are defined manually, then robot's understanding of environment is improved, but system complexity and development effort increase
Solution Approach 1:
The system copies object models from databases or similar objects to create initial models for new objects. This copying mechanism allows comprehensive properties and relations to be transferred automatically, improving the robot's environmental understanding without requiring manual configuration of each property, thus reducing system complexity.
Solution Approach 2:
The system performs preliminary configuration of object models by automatically generating comprehensive properties and relations before the operator needs to use them. This preliminary action ensures the robot has a complete understanding of the environment ready in advance, without requiring complex manual setup at the time of deployment.
4Measurement precision
If detailed object annotations are created interactively from scratch, then precision of object model is improved, but ease of operation deteriorates due to time-consuming process
Solution Approach 1:
The system provides self-service by automatically generating object annotations using prediction algorithms. This reduces the manual effort required from the operator, improving ease of operation. The operator only needs to review and correct predictions rather than creating annotations from scratch, while the system handles the time-consuming generation process automatically.
Solution Approach 2:
The system performs preliminary annotation work by automatically predicting object properties before the operator intervenes. This preliminary action creates a draft model that is already quite precise, requiring only minor corrections from the operator. This maintains high precision while dramatically improving ease of operation by eliminating the need for complete manual annotation.
Data Source
AI summary
A method and corresponding system for creating an annotated object model of a real world object. The method comprises providing an initial object model for an object for which an annotated object model shall be created, predicting properties of the object, visualizing a representation of the object based on the initial object model wherein the predicted object properties are displayed associated with the representation, and obtaining selection information based on at least one of a user gesture, user pointing operation, user speech input, and user gaze perceived by a user perception device. The method determines a portion of the object corresponding to the selection information, receives property information from a user input and associates the input property information with the corresponding portion of the object.


