Played key display method and intelligent musical instrument
By using motion capture technology to generate images of piano keys being pressed and images of hand playing, combined with multi-dimensional information feedback and adaptive perspective switching, the flexibility and adaptability issues of digitizing musical instruments in complex scenarios have been solved, improving the visual experience and information acquisition efficiency.
WO2026153473A1PCT designated stage Publication Date: 2026-07-23GRANMUS STAFF TECHNOLOGIES (CHONGQING) CO LTD
View PDF 0 Cites 0 Cited by
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- GRANMUS STAFF TECHNOLOGIES (CHONGQING) CO LTD
- Filing Date
- 2026-01-16
- Publication Date
- 2026-07-23
Smart Images

Figure CN2026073002_23072026_PF_FP_ABST
Abstract
The present application relates to the field of musical instrument digitization, and in particular to a played key display method and an intelligent musical instrument. The method comprises: acquiring a plurality of groups of motion capture results, wherein each group of motion capture results includes at least one of hand pose data of a player's hand and fingers and identifiers of keys, and key motion data, and the motion capture results are associated with a corresponding third timestamp; generating a plurality of groups of key press images on the basis of a plurality of groups of key motion data; generating a plurality of groups of hand playing images on the basis of the plurality of groups of hand pose data, and / or on the basis of the plurality of groups of key motion data, generating playing prompt icons corresponding to the plurality of groups of key press images; and on the basis of the third timestamp and the identifiers of the keys, superimposing the plurality of groups of key press images, the plurality of groups of hand playing images, and / or the playing prompt icons, and generating a continuous playing animation. The depth and personalization level of visual feedback in a playing animation are enhanced, so that a viewer obtains and understands playing behaviors more quickly and clearly.
Need to check novelty before this filing date? Find Prior Art