AR Guzheng Teaching System with Integrated Positioning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current AR-based supplementary teaching systems for guzheng lack immersion and portability, requiring multiple peripheral devices and re-tuning after installation, which complicates user experience and accuracy in fingering and string positioning.

Innovation Solution

An AR-based supplementary teaching system incorporating an AR device, data processing device, and positioning devices for key positions, which uses real scene data to generate string distribution data and superimpose virtual guidance, including fingering and musical notation, without the need for light bar indicators, and includes somatosensory feedback through vibration sensors for improved accuracy and user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a light bar indicating device is used to provide fingering instruction, then basic fingering guidance can be provided, but the device complexity increases and portability decreases due to requiring multiple peripheral devices and re-tuning

Engineering Contradiction:

Improvefingering guidanceVSAvoidperipheral devices

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the indicating device functionality directly into the guzheng code structure by integrating positioning devices for key positions onto the guzheng code itself. This eliminates the need for separate light bar indicating devices and other peripheral equipment, reducing device complexity while maintaining the fingering guidance function.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The guzheng code is designed to serve multiple functions: it provides musical notation information and simultaneously integrates positioning devices for key positions that provide fingering guidance. This multi-functionality eliminates the need for separate dedicated indicating devices, reducing overall system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Ease of operation

If a light bar indicating device is installed below the guzheng code, then fingering instruction can be provided, but re-tuning is required which reduces portability and increases ease of operation

Engineering Contradiction:

Improvefingering instructionVSAvoidre-tuning

Core Design Contradiction:

Ease of operationVSEase of manufacture

Solution Approach 1:

The positioning devices for key positions are pre-integrated onto the guzheng code during its manufacture. This preliminary integration ensures that the indicating device is properly positioned and calibrated before the instrument is used, eliminating the need for re-tuning after installation and improving portability.

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If positioning devices for key positions are installed on the guzheng code, then string distribution accuracy improves, but device complexity increases

Engineering Contradiction:

Improvestring distributionVSAvoidpositioning devices

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of adding complex positioning systems throughout the entire instrument, the patent applies positioning devices for key positions only at specific critical locations on the guzheng code. This localized approach provides accurate string distribution measurement while minimizing the overall complexity added to the system.

Inventive Principle:

Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user immersion and portability by providing virtual guidance directly on the guzheng without re-tuning, improves fingering accuracy through somatosensory feedback, and enables multi-user coordination and remote tutoring through cloud server interaction.

Implementation Method 1

an AR device, a data processing device, and a plurality of positioning devices for key positions... the AR device is used to obtain a real scene data; the data processing device is used to identify the guzheng and the positioning devices for key positions in the real scene data... and the AR device is also used to superimpose and display the virtual data with the real scene data

Methodology Applied

Scientific EffectAR (Augmented Reality):

Implementation Method 2

the sound input device is used to collect a sound data when the user plays and send the sound data to the data processing device; the data processing device is configured to identify the sound data, generate a tone data

Methodology Applied

Scientific EffectSound detection: Sound

Implementation Method 3

the somatosensory device is used to perform a vibration feedback

Methodology Applied

Scientific EffectVibration: Vibration

Data Source

PatentUS11580868B2AR-based supplementary teaching system for guzheng and method thereof

Publication Date: 2023.02.14 CHINA ACAD OF ART

AI summary

An AR-based supplementary teaching system for guzheng and method thereof, the system includes an AR device, a data processing device and positioning devices for key positions, the data processing device is signal-connected to the AR device, and the positioning devices is installed on the guzheng code of guzheng, the positioning devices corresponds to the guzheng code of guzheng one by one; the AR device is used to obtain real scene data; the data processing device is used to guzheng and the positioning devices identify and generate string distribution data; also used to obtain operation instruction based on user actions, execute the operation instruction and generate virtual data; the AR device is also used to convert all data based on the string distribution data The virtual data and the real scene data are superimposed and displayed.