Multispectral Imaging for Game Subject Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current information processing systems lack the ability to effectively utilize multispectral data from images of bodies to provide immersive and interactive experiences by accurately identifying and responding to the type and status of subjects in real-world scenarios, limiting their integration into game environments.

Innovation Solution

An information processing system that captures images of subjects using a multispectral camera, analyzing light intensity in four or more wavelength bands to identify the type and status of subjects, and dynamically sets and displays corresponding game objects or executes actions based on this information, integrating real-world data into virtual or augmented reality games.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional imaging systems are used to capture images, then the system complexity is low, but the ability to identify subject type and status accurately is insufficient

Engineering Contradiction:
Improveidentification accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging system is segmented into multiple independent wavelength band imaging units, each capturing specific spectral information. This segmentation allows the system to achieve multispectral imaging capabilities while maintaining modular architecture that manages complexity through division of functions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The imaging system is designed to perform multiple functions: capturing visible light images, infrared images, and other wavelength band images simultaneously or sequentially. This multi-functionality enables comprehensive subject identification while sharing common processing infrastructure to manage system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multispectral data is captured and processed, then the identification accuracy of subject type and status is improved, but the data processing complexity increases

Engineering Contradiction:
Improvesubject identification accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Reference data for various subjects under different conditions is pre-collected and stored in databases before actual identification tasks. This preliminary action creates lookup tables and comparison datasets that simplify real-time identification processing, reducing the computational complexity during actual operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates digital copies of reference subjects with known characteristics and stores them as comparison data. These copied reference models enable pattern matching and identification without requiring complex real-time analysis of every subject feature, simplifying the processing burden.

Inventive Principle:
Principle #26Copying

3Ease of operation

If real-time identification and game object mapping is implemented, then the interactivity of the game environment is improved, but the processing time and system response speed may be affected

Engineering Contradiction:
Improvegame interactivityVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

Game objects and their corresponding real-world subject characteristics are pre-configured and mapped before runtime. This preliminary mapping allows the system to quickly match identified subjects to game objects without performing complex matching algorithms in real-time, reducing processing delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex real-time mechanical matching processes with database lookup and pattern recognition algorithms. This substitution enables faster identification and game object mapping by using computational methods rather than exhaustive real-time analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a novel and immersive experience by accurately reflecting the real-world status and appearance of subjects within game environments, enhancing the realism and interactivity of games through precise identification and feedback mechanisms.

Implementation Method 1

an imaging section that captures an image of a user-designated body and outputs multispectral data regarding a subject and indicative of light intensity in four or more wavelength bands

Methodology Applied
Scientific EffectMultispectral imaging:

Data Source

PatentUS10661176B2Information processing system and information processing method
Publication Date: 2020.05.26 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10661176B2 patent drawing
  • US10661176B2 patent drawing
  • US10661176B2 patent drawing

AI summary

Disclosed herein is an information processing system including an imaging section, an identification section, a setup section, and a display control section. The imaging section captures an image of a user-designated body and outputs multispectral data regarding a subject. The multispectral data indicates light intensity in four or more wavelength bands. The identification section identifies the type of the subject in accordance with the multispectral data regarding the subject. The setup section sets, based on the type of the subject, an object corresponding to the subject appearing in a game. The display control section causes the object to be displayed in the game in a manner based on the type of the subject.