Information Processing Apparatus for Disappeared Object Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in obtaining information about objects in moving images, especially when the object has disappeared from the screen, particularly in scenarios where playback position manipulation is not allowed, such as broadcast TV or internet streaming.

Innovation Solution

An information processing apparatus that stores and retrieves specifying operation information, including moving image identification, time, and object position, to provide information about objects even after they have disappeared by identifying objects within a predetermined time frame and distance from the specified position, and adjusts presentation based on user tendencies and object attributes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a user performs a specifying operation to obtain information about an object in a moving image, then information about the object can be provided, but the object may have already disappeared from the screen making specification impossible

Engineering Contradiction:
Improveobject information provision reliabilityVSAvoidobject specification ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by automatically detecting and specifying objects within a predetermined time period before the user's specifying operation, even when the object has disappeared from the screen. This preliminary object specification enables the system to retrieve and provide object information without requiring the user to manually locate and specify the object, thus resolving the contradiction between reliable information provision and ease of operation.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If a rewind operation is performed to make a disappeared object appear again for specification, then the object can be specified, but this operation is unavailable for broadcast TV or internet streaming

Engineering Contradiction:
Improveobject specification easeVSAvoidmoving image type adaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

Instead of requiring users to perform rewind operations to replay moving images, the system creates a copy of the object information from the predetermined time period and presents it directly to the user. This copying approach eliminates the need for playback position manipulation while maintaining adaptability across all moving image types including broadcast TV and internet streaming where rewind is unavailable.

Inventive Principle:
Principle #26Copying

3Reliability

If the system stores specifying operation information for all users to retrieve objects within a predetermined time period, then information about disappeared objects can be provided, but the system complexity increases

Engineering Contradiction:
Improveobject information provision reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system applies local quality by implementing object detection and information retrieval only within a predetermined time period before the user's specifying operation, rather than analyzing the entire moving image history. This localized approach reduces computational complexity and system resource requirements while maintaining the ability to provide information about disappeared objects effectively.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9712879B2Information processing apparatus, information processing method, and information processing program
Publication Date: 2017.07.18 RAKUTEN GROUP INC
  • US9712879B2 patent drawing
  • US9712879B2 patent drawing
  • US9712879B2 patent drawing

AI summary

An information processing apparatus obtains the moving image identification information of a moving image, the time at which a specifying operation was performed, and a position specified on a display unit. When an object was specified, the information processing apparatus further obtains object information. The information processing apparatus obtains, from storage means, object information corresponding to all of the following: the obtained moving image identification information; a time being within a predetermined period of time ending at the obtained time; and a position being within a predetermined distance from the obtained position. The information processing apparatus causes information about an object indicated by the obtained object information to be presented to a user.