Information Terminal AR Character Control with Live Motion and Sound
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional applications for information terminal devices lack variability in character behavior and dialogue, leading to monotonous interactions that fail to capture users' attention effectively.
Innovation Solution
A program and method that utilize an information terminal device with a processor, memory, input unit, and imaging sensor to display an augmented reality space with a character, where the character's behavior is produced based on live input motion and sound data from a performer, allowing for dynamic and engaging interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pre-recorded motion and dialogue data is used to control the character, then the character behavior can be reproduced consistently, but the behavior becomes monotonous and fails to attract users' attention
Solution Approach 1:
The patent transitions from static pre-recorded data to dynamic real-time data collection. The performer's actual motion and dialogue are captured live through sensors and transmitted to the information terminal device, allowing the character to exhibit varied and adaptive behaviors based on real-time input rather than repeating fixed pre-recorded sequences.
Solution Approach 2:
The system establishes a feedback loop where the character's behavior is continuously adjusted based on real-time performer input. The motion data and sound data from the performer are processed and immediately reflected in the character's actions and dialogue, creating an adaptive system that responds to user interaction dynamically.
2Device complexity
If pre-recorded data is used for character control, then the system complexity is reduced, but user engagement and attention are insufficient
Solution Approach 1:
The patent introduces an intermediary data transmission mechanism between the performer and the information terminal device. Motion data and sound data are collected by sensors, processed through a transmission unit, and then applied to control the character, enabling real-time interaction without requiring direct complex integration of all system components.
Data Source
AI summary
An image of an augmented reality space, in which a character is arranged with respect to an acquired image acquired by the imaging sensor, is displayed on the display unit, and the behavior of the character in the augmented reality space is produced on the basis of data transmitted from an external source, wherein the data is motion data and sound data that are input by a performer who plays live as the character.