Virtual Performance Character Feedback for Interactive Music Guidance

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing techniques for supporting musical instrument performance lack intuitive and interactive methods to enhance user engagement and guidance.

Innovation Solution

An information processing system that analyzes a user's performance in real space and displays a performance character in virtual space, controlling its actions to synchronize with the user's performance, providing guiding actions and reactions based on performance states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If automatic performance execution is used to support user performance, then performance support capability is improved, but user engagement and interactivity deteriorate

Engineering Contradiction:

Improveperformance support capabilityVSAvoiduser engagement and interactivity

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system analyzes the user's performance state in real-time and uses this feedback to dynamically control the performance character's actions. The performance character responds to the user's performance quality, tempo, and accuracy, creating an interactive loop that enhances engagement while maintaining reliable performance support through automated analysis and response generation.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

A virtual performance character serves as an intermediary between the automated performance support system and the user. This character mediates the interaction by visually representing performance guidance and reacting to user actions, thereby maintaining the reliability of automated support while significantly enhancing user engagement and perceived interactivity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If virtual reality and information communication technologies are integrated, then user experience is improved, but system complexity increases

Engineering Contradiction:

Improveuser experienceVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system integrates multiple functions including performance analysis, virtual character rendering, real-time communication, and visual display into a unified platform. By making the system multi-functional, it delivers enhanced user experience through virtual reality and interactive communication while managing complexity through integrated architecture rather than separate systems.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses virtual copying by creating a digital representation (performance character) that mirrors and responds to the user's physical performance. This copying approach enables rich virtual reality experiences and interactive communication without requiring complex physical equipment, as the virtual character can be rendered and controlled through software on standard display devices.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS20260050410A1Information processing method, information processing system, and non-transitory computer-readable storage medium storing information processing program

Publication Date: 2026.02.19 YAMAHA CORP

AI summary

An information processing method includes analyzing a state of a performance by a user in real space. The information processing system further includes displaying, on a display device, a performance character that performs in virtual space. The information processing system further includes controlling an action of the performance character in accordance with the state of the performance by the user.