Annotated Object Model Creation for Robotic Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic systems require extensive manual effort to define properties of new objects in their environment for action planning, as they lack the ability to automatically learn and understand their surroundings.

Innovation Solution

A system that predicts properties for new objects, allowing operators to correct, confirm, or dismiss these predictions using gestures, speech, or gaze, thereby reducing the workload in annotating object models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual annotation of object properties is performed from scratch, then completeness and accuracy of object model information is improved, but time consumption and operator effort increase significantly

Engineering Contradiction:
Improvecompleteness of object propertiesVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary annotation by automatically predicting object properties (category, color, material, shape) before the operator provides final input. This preliminary action generates a draft object model that is then refined by the operator, significantly reducing the time required for complete annotation while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the object model with predicted properties that serves as a template for the operator to review and correct. This copying approach allows the operator to work with a pre-filled model rather than creating everything from scratch, reducing annotation time while preserving completeness through operator verification.

Inventive Principle:
Principle #26Copying

2Productivity

If automatic prediction of object properties is implemented, then annotation speed and productivity are improved, but accuracy and reliability of object model information may deteriorate

Engineering Contradiction:
Improveannotation speedVSAvoidaccuracy of object properties
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system implements a feedback loop where the operator reviews and corrects the automatically predicted properties. The operator's corrections feed back into the system, allowing it to learn and improve prediction accuracy over time. This ensures that while speed is improved through automation, accuracy is maintained through human verification and continuous learning.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The automatic prediction provides a preliminary version of object properties that serves as a starting point for refinement. This preliminary action increases productivity by handling the initial annotation work, while the subsequent operator review ensures accuracy by correcting any prediction errors.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If comprehensive object properties and relations are defined manually, then robot's understanding of environment is improved, but system complexity and development effort increase

Engineering Contradiction:
Improverobot's environmental understandingVSAvoidsystem configuration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system copies object models from databases or similar objects to create initial models for new objects. This copying mechanism allows comprehensive properties and relations to be transferred automatically, improving the robot's environmental understanding without requiring manual configuration of each property, thus reducing system complexity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary configuration of object models by automatically generating comprehensive properties and relations before the operator needs to use them. This preliminary action ensures the robot has a complete understanding of the environment ready in advance, without requiring complex manual setup at the time of deployment.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If detailed object annotations are created interactively from scratch, then precision of object model is improved, but ease of operation deteriorates due to time-consuming process

Engineering Contradiction:
Improveprecision of object annotationsVSAvoidease of annotating objects
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system provides self-service by automatically generating object annotations using prediction algorithms. This reduces the manual effort required from the operator, improving ease of operation. The operator only needs to review and correct predictions rather than creating annotations from scratch, while the system handles the time-consuming generation process automatically.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary annotation work by automatically predicting object properties before the operator intervenes. This preliminary action creates a draft model that is already quite precise, requiring only minor corrections from the operator. This maintains high precision while dramatically improving ease of operation by eliminating the need for complete manual annotation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12243181B2Method and system for creating an annotated object model for a new real-world object
Publication Date: 2025.03.04 HONDA MOTOR CO LTD
  • US12243181B2 patent drawing
  • US12243181B2 patent drawing
  • US12243181B2 patent drawing

AI summary

A method and corresponding system for creating an annotated object model of a real world object. The method comprises providing an initial object model for an object for which an annotated object model shall be created, predicting properties of the object, visualizing a representation of the object based on the initial object model wherein the predicted object properties are displayed associated with the representation, and obtaining selection information based on at least one of a user gesture, user pointing operation, user speech input, and user gaze perceived by a user perception device. The method determines a portion of the object corresponding to the selection information, receives property information from a user input and associates the input property information with the corresponding portion of the object.