Object Detection Display Controller for Tabletop Image Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing apparatuses face challenges in displaying images when multiple objects are placed on a tabletop, as multiple images are displayed simultaneously, making it difficult for users to easily view the images.

Innovation Solution

An information processing apparatus that includes a first detector to detect objects based on captured image information, a second detector to detect user operations involving changes in the state of the objects, and a display controller to generate and display images associated with the objects and user operations only when such operations occur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple images are displayed simultaneously for multiple objects, then information completeness is improved, but ease of operation deteriorates due to difficulty in viewing images

Engineering Contradiction:
Improveinformation completenessVSAvoidease of viewing images
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The display system dynamically adjusts the number of displayed images based on user interactions. When a user touches or operates an object, the system activates display of images for that object. When no operations are detected, the system reduces or hides displayed images. This dynamic adaptation resolves the contradiction by providing complete information when needed while maintaining ease of viewing when no interaction occurs.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system periodically monitors user operations on objects and adjusts image display accordingly. The display controller continuously detects whether user operations are being performed and toggles image display states based on these periodic detections. This periodic action ensures information is available when users interact with objects while preventing visual clutter during non-interaction periods.

Inventive Principle:
Principle #19Periodic action

2Loss of information

If images are displayed for all objects, then information completeness is improved, but device complexity increases due to management of multiple images

Engineering Contradiction:
Improveinformation completenessVSAvoidimage management complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system extracts and displays only the images relevant to currently operated objects, separating them from images of non-operated objects. The display controller identifies which objects are being operated and extracts only those specific images for display, leaving other images hidden. This extraction approach maintains information completeness for active operations while simplifying the management burden by not requiring simultaneous management of all possible images.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The image management system dynamically adjusts which images are active and displayed based on real-time detection of user operations. The display controller modifies the display state according to operational status, activating images only when their corresponding objects are being operated. This dynamic management reduces complexity compared to static management of all images simultaneously.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If no images are displayed unless user operations occur, then ease of operation is improved, but loss of information increases

Engineering Contradiction:
Improveease of viewing imagesVSAvoidinformation availability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system prepares image data for all objects in advance but only activates display when user operations occur. The display controller has image data ready and can immediately display relevant images when operations are detected, without requiring additional processing time. This preliminary preparation ensures information is available when needed while maintaining ease of viewing during non-interaction periods.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from user operations to control image display. The display controller continuously monitors for user operations and responds by displaying or hiding images based on this feedback. This feedback mechanism ensures information is provided exactly when users need it (during operations) while maintaining simplicity during non-operational states, balancing information availability with ease of operation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12211227B2Information processing apparatus
Publication Date: 2025.01.28 NTT DOCOMO INC
  • US12211227B2 patent drawing
  • US12211227B2 patent drawing
  • US12211227B2 patent drawing

AI summary

An information processing apparatus includes a first detector configured to detect an object based on captured image information generated by an image capturing apparatus; a second detector configured to, in response to the object being detected by the first detector, detect a user operation carried out with regard to the object, the user operation involving a change in a state of the object; and a display controller configured to, in response to the user operation being detected by the second detector, generate an image that is associated with the object and the user operation, to display the generated image on a display apparatus.