Device Linking via Appearance Recognition and Server Mediation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality applications, recognizing objects without pre-recorded marker images is challenging, especially for unknown or dynamically changing applications, as they lack distinct features for recognition.

Innovation Solution

An information processing apparatus that acquires and sends appearance information, including image and communication details, to link devices by recognizing the device's appearance, allowing for real-time identification and communication without pre-recorded dictionary data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If marker images or pre-recorded dictionary data are used for object recognition, then recognition accuracy is improved, but the system cannot recognize unknown or dynamically changing applications

Engineering Contradiction:
Improverecognition accuracyVSAvoidability to recognize unknown applications
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary actions by having the target device send its appearance information (screen capture, device specifications, application list) in advance to the server. This allows the recognizing device to retrieve and compare this pre-prepared information with captured images, enabling recognition without requiring pre-recorded marker images or dictionary data for each specific application

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A server acts as an intermediary between the recognizing device and the target device. The server stores appearance information sent from target devices and provides it to recognizing devices for comparison. This intermediary mechanism enables indirect recognition without requiring direct pre-recording of features for each application, thus handling unknown and dynamically changing applications

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If marker images are added to objects for recognition, then object recognition is enabled, but the method becomes complicated and requires additional tagging

Engineering Contradiction:
Improveobject recognition capabilityVSAvoidrequirement for marker images
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The invention extracts and uses the device's own appearance information (screen display, specifications, application list) as the recognition target, eliminating the need for external marker images. The system captures and compares the natural appearance of the device and its displayed content, removing the complexity of adding special tags while maintaining recognition capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The target device serves itself by automatically sending its appearance information to the server. The device's own screen display and specifications become the recognition features, eliminating the need for external markers or tags. This self-service approach simplifies the system by using the device's inherent characteristics for recognition

Inventive Principle:
Principle #25Self-service

3Productivity

If pre-recorded dictionary data is stored for recognition, then recognition speed is improved, but unknown applications cannot be recognized

Engineering Contradiction:
Improverecognition speedVSAvoidrecognition of dynamically changing applications
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system dynamically updates appearance information on the server as devices and applications change. Instead of using static pre-recorded dictionary data, the server stores current appearance information that can be updated in real-time. This dynamic approach maintains fast recognition speed through efficient database queries while adapting to new and changing applications automatically

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10360453B2Information processing apparatus and information processing method to link devices by recognizing the appearance of a device
Publication Date: 2019.07.23 SONY GROUP CORP
  • US10360453B2 patent drawing
  • US10360453B2 patent drawing
  • US10360453B2 patent drawing

AI summary

An information processing apparatus and method according to the present disclosure link devices by recognizing the appearance of a device, such as an unknown application or a dynamically changing application. The information processing apparatus includes an appearance information acquisition unit configured to acquire appearance information indicating a feature of appearance of an own device; and a sending unit configured to send the appearance information to communicate with another device that has imaged the appearance of the own device. According to such a configuration, it is possible to link devices by recognizing the appearance of a device, such as an unknown application or a dynamically changing application.