Keyboard Practice Guidance With Overlaid Reference Performer Hands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
It is difficult for a trainer to be continually present near a person practicing keyboard instrument playing, especially in actual situations, and similar issues arise in multi-handed musical instrument performances.
Innovation Solution
An information processing system that includes an image obtaining circuit and a display control circuit, which obtains observation images of a first keyboard and displays reference images of a reference performer overlapping the first keyboard, using a display device to assist the performer in playing the instrument.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a trainer is present near a person practicing keyboard instrument playing, then guidance quality is improved, but availability and continuity of training are worsened due to practical constraints
Solution Approach 1:
The patent creates a virtual copy of the trainer (reference performer) that can be continuously displayed on the display device. This virtual trainer overlay contains captured images of the reference performer's hands and fingers playing the keyboard instrument, providing uninterrupted guidance without requiring the physical presence of a real trainer.
Solution Approach 2:
The patent transitions from physical-space training (requiring trainer presence) to digital-space training (using display devices). By projecting the trainer's images onto a different dimension (the display screen overlay), the system eliminates spatial constraints and enables continuous availability of training guidance.
2Measurement precision
If reference images of a reference performer are displayed overlapping the first keyboard, then guidance effectiveness is improved, but system complexity is worsened
Solution Approach 1:
The patent merges the observation image of the user's keyboard with the reference image of the reference performer's keyboard into a single composite display. This overlay technique combines multiple information layers (user view + reference guidance) into one unified display, improving guidance effectiveness without requiring separate physical systems.
Solution Approach 2:
The display device serves as an intermediary that reconciles the user's real-world keyboard view with the virtual reference performer images. This mediator layer processes and composites the images, providing intuitive guidance while keeping the underlying system architecture relatively simple.
3Speed
If observation images of the user's keyboard are captured and displayed, then real-time feedback is improved, but processing load and system complexity are worsened
Solution Approach 1:
The patent performs preliminary actions by capturing and preparing the reference performer images in advance, storing them as reference image data. This pre-processing allows the system to quickly overlay pre-rendered reference images onto the user's real-time keyboard view, achieving real-time feedback without heavy processing demands during actual use.
Data Source
AI summary
An information processing system includes an image obtaining circuit and a display control circuit. The image obtaining circuit is configured to obtain observation images of a first keyboard of a first keyboard instrument. The display control circuit is configured to display, on a display device, the observation images and reference images. The reference images include moving images of at least one hand and one or more fingers of a reference performer who is playing a second keyboard of a second keyboard instrument. The at least one hand and the one or more fingers of the reference performer are displayed overlapping the first keyboard included in the observation images.