Guqin fingering standardization exercise method and system

Abstract

The application discloses a kind of guzheng fingering standardization exercise method and system, wherein method includes: defining guzheng fingering, fingering action includes hand shape, plucking finger, string direction, plucking timing, plucking force point, plucking dynamics and plucking direction;Identify the fingering action of guzheng proficient, according to the fingering action of guzheng proficient to build standard index library;Standard index library includes the index and index data of different fingering, several fingering actions constitute the index of the same fingering;Identify the fingering action of guzheng practitioner, judge the corresponding fingering of the fingering action of guzheng practitioner, input the fingering action into standard index library, find the index and index data compared with the corresponding fingering, feedback fingering practice result.The guzheng fingering of the application is disassembled into several quantifiable fingering actions, provides detailed, fast and correct practice feedback for beginners learning guzheng, helps to correct the bad playing posture of beginners, and avoids beginners to repeatedly practice wrong actions.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of motor skill teaching and human-computer interaction, and particularly relates to a guzheng fingering standardization practice method based on hand action recognition. BACKGROUND

[0002] Guzheng fingering is one of the main contents of guzheng basic skill practice and is the core practice knowledge point at the initial stage. As a motor skill, guzheng fingering mainly includes relevant rules of action execution and muscle movement itself and does not involve subjective expression such as emotion and mood. However, the performance of guzheng fingering is related to not only the tone, smoothness and speed of playing but also the music expressiveness and instrument expression at the later stage. Therefore, the practice of guzheng fingering is extremely important. However, guzheng fingering is not only diverse but also involves hand posture, playing position, force mode and movement trajectory and other requirements, which is difficult for beginners. On the other hand, since the learning process of guzheng beginners at the initial stage is short, they have not established certain cognition of relevant knowledge points, so they cannot judge whether the action behavior result of their playing is correct when practicing alone, which easily leads to repeated practice of incorrect actions and invalid practice. SUMMARY

[0003] In order for the guzheng practitioner to accurately realize whether the fingering is correct when playing, the present application provides a guzheng fingering standardization practice method.

[0004] A guzheng fingering standardization practice method, comprising the following steps:

[0005] defining guzheng fingering, each fingering including a plurality of fingering actions, the fingering actions including hand shape, plucking finger, string touching direction, plucking timing, plucking force point, plucking strength and plucking direction;

[0006] recognizing the fingering actions of guzheng skilled players and obtaining relevant data of the fingering actions, and constructing a standard index library according to the fingering actions and relevant data of guzheng skilled players;

[0007] the standard index library includes indexes and index data of different fingerings, and a plurality of the fingering actions constitute an index of the same fingering;

[0008] recognizing the fingering actions of guzheng practitioners, analyzing and judging the corresponding fingering of the fingering actions of the guzheng practitioners, inputting the fingering actions into the standard index library, searching for the indexes and index data of the corresponding fingering, and feeding back the fingering practice result.

[0009] This step specifically splits the guzheng fingering into fingering actions, so that each fingering action becomes a quantifiable index value.

[0010] Further, the finger action of the Guzheng practitioner or Guzheng learner specifically includes:

[0011] establishing a coordinate system; measuring the vertical component of the palm normal vector, the palm concave degree, the distance from the finger distal joint to the palm center, the time point of the distance change, the finger tip speed, and the angle between the vector of the finger distal joint and the coordinate axis;

[0012] The palm concave degree and the angle between the vector of the finger distal joint and the coordinate axis represent the hand shape, the distance change of the finger distal joint to the palm center represents the plucking direction, the angle between the vector of the finger distal joint and the coordinate axis represents the string touching direction, the finger tip speed represents the plucking strength, the time point of the distance change represents the plucking timing, and the vertical component of the palm normal vector, the palm concave degree, and the angle between the vector of the finger distal joint and the coordinate axis represent the plucking force point.

[0013] Further, analyzing and judging the corresponding finger action of the Guzheng learner's finger action specifically includes: judging the finger action at this time as any one of the Guzheng finger actions according to the plucking finger or the plucking timing.

[0014] Further, constructing a standard index library specifically includes:

[0015] obtaining the specific numerical value of the index data of each finger action of the Guzheng practitioner;

[0016] analyzing the specific numerical value to obtain the change range of the index data;

[0017] expanding the change range to obtain the practice threshold range;

[0018] The practice threshold ranges of different finger actions constitute the standard index library.

[0019] Further, it also includes dividing the finger practice of the Guzheng learner into a primary stage and an advanced stage; the primary stage and the advanced stage have different standard index libraries.

[0020] Further, expanding the critical value of the change range specifically includes: dividing the finger practice of the Guzheng learner into a primary stage and an advanced stage, expanding the change range of the index data by 15% to obtain the practice threshold range of the primary stage, and expanding the change range of the index data by 10% to obtain the practice threshold range of the advanced stage.

[0021] Further, the establishment of the coordinate system specifically includes:

[0022] The palm center is taken as a coordinate origin, a ray in a direction that is parallel to a piano surface, perpendicular to a hand back plane and upward is taken as a Y axis, a ray in a direction along a finger is taken as a Z axis, and a ray in a direction that is perpendicular to the finger direction and away from a thumb in the hand back plane is taken as an X axis.

[0023] The application further discloses a guzheng fingering standardization practice system, which comprises:

[0024] a data storage unit configured to store a standard index library constructed according to fingering actions of a guzheng expert and related data of the fingering actions, wherein the standard index library comprises indexes and index data of different fingerings;

[0025] a data capture unit configured to capture fingering actions of a guzheng player and related data of the fingering actions, wherein the fingering actions comprise a hand shape, a plucking finger, a string touching direction, a plucking timing, a plucking force point, a plucking strength and a plucking direction;

[0026] a gesture recognition unit configured to analyze and determine corresponding fingerings of the fingering actions;

[0027] a data processing unit configured to find indexes and index data of the corresponding fingerings in combination with the standard index library stored in the data storage unit;

[0028] a result feedback unit configured to feed back a fingering practice result.

[0029] Further, the data capture unit comprises a Leap motion, and the Leap motion is fixedly arranged.

[0030] Further, the result feedback unit comprises an electronic screen, and the electronic screen presents a current fingering, a determination result, indexes corresponding to the fingering and a correct or incorrect result of specific indexes.

[0031] The application has the following beneficial effects:

[0032] The application specifically disassembles guzheng fingerings, divides the fingerings into fingering actions that can be quantified, combines specific values of the fingering actions into indexes of each fingering, provides detailed, fast and correct practice feedback for guzheng learners in a learning stage in which specific cognition of knowledge points has not been established, helps to correct bad playing postures of the learners, avoids repeated practice of wrong actions by the learners and causes ineffective practice problems. Furthermore, the application helps the learners to better master related technical points by dividing practice stages, and achieves a learning purpose of step by step. BRIEF DESCRIPTION OF DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description only show some of the embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without any creative effort.

[0034] Figure 1 is a flowchart of the method;

[0035] Figure 2 is a schematic diagram of guzheng fingering classification;

[0036] Figure 3 is a schematic diagram of establishing a coordinate system and finger joint angles in the method;

[0037] Figure 4 is a schematic diagram of the system. DETAILED DESCRIPTION

[0038] In order to make the application purposes, features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be described clearly and completely in the following with reference to the drawings in the embodiments of the present application. Obviously, the following described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without any creative effort are within the scope of protection of the present application.

[0039] The present application will be further illustrated in the following with reference to the drawings and specific embodiments.

[0040] Embodiment 1

[0041] A guzheng fingering standardization practice method, as shown in Figure 1 , includes the following steps:

[0042] S1, define guzheng fingering, each fingering includes a plurality of fingering actions, and the fingering action includes hand shape, plucking finger, string touching direction, plucking timing, plucking force point, plucking strength and plucking direction. Each fingering action contains a plurality of related fingering data for measuring and defining the fingering action.

[0043] Define guzheng fingering, as shown in Figure 2 , the guzheng fingering is divided into non-plucking gestures and performance gestures, the non-plucking gestures are preparation hand shapes, and the performance gestures include single finger fingering, combined fingering and double hand fingering. The hand shape in the fingering action can represent the non-plucking fingering of the preparation hand shape.

[0044] Single finger methods include hook, wipe, drag, hit and split; combined finger methods include large pinch, small pinch, supporting tone and flower finger; double hand finger methods include hook + up-sliding tone, hook + down-sliding tone, hook + tremolo, etc. Each finger method includes a plurality of finger actions, each of which has corresponding index data. Among them, the double hand finger method named in the guzheng teaching material does not involve the specific finger method of the right hand, and is only represented as "up-sliding tone", "down-sliding tone", "tremolo" and the like. In actual playing, according to the requirements of the specific score of the music, the right hand finger method is played and matched with the left hand finger action to complete the double hand finger method. In order to clearly define the specific playing of the double hand finger method, in the present application, the name of the single finger method + the name of the double hand finger method is used to define all the names of the double hand finger method that may be encountered in the specific playing.

[0045] S2, identify the finger action of the guzheng expert and obtain the related data of the finger action, and construct a standard index library according to the finger action of the guzheng expert. The guzheng expert is generally selected from guzheng teachers, guzheng performers and the like. The standard index library includes indexes of different finger methods and corresponding index data.

[0046] Among them, the specific method for constructing the standard index library is as follows:

[0047] S21, obtaining the specific value of the index data of each finger action of the guzheng expert.

[0048] S22, analyzing the specific value to obtain the change range of the index data.

[0049] S23, expanding the change range to obtain the practice threshold range.

[0050] S24, the practice threshold range of different finger methods constitutes the standard index library.

[0051] The combined finger method and the double hand finger method have requirements for playing time in addition to action requirements. Therefore, when constructing the corresponding index of the combined finger method and the double hand finger method, the requirement for playing time is increased.

[0052] The double hand finger method has certain differences in the requirements for the left hand hand action in addition to the above requirements. Therefore, when constructing the corresponding index of the double hand finger method, the requirement for the left hand finger method is increased, specifically including playing the corresponding finger and pressing the string direction.

[0053] S3, identifying the finger action of the guzheng practitioner, analyzing and judging the corresponding finger method of the finger action of the guzheng practitioner.

[0054] S4, inputting the finger action of the guzheng practitioner in S3 into the standard index library constructed in S2, finding the index and index data corresponding to the corresponding finger method, and feeding back the finger practice result.

[0055] In the embodiment, in order to have stages to practice, the finger practicing of the Guzheng practitioner is divided into a primary stage and an advanced stage; the primary stage and the advanced stage have different standard index libraries.

[0056] The first way is to set a standard index library with the same index but different index data.

[0057] When the practicing is divided into stages, in step S23, the range of different values is expanded to generate different ranges of practicing thresholds - the range of practicing thresholds of the primary stage is obtained by expanding the range of index data by 15%, and the range of practicing thresholds of the advanced stage is obtained by expanding the range of index data by 10%. This way helps the practitioner to improve Guzheng finger practicing skills through different numerical standards, and plays a role of gradual progress.

[0058] The second way is to set different indexes, the indexes of the primary stage are less, and the indexes of the advanced stage are increased. For example, the indexes of the primary stage are to correctly master the hand shape and clearly know the string plucking direction and the plucking finger; the indexes of the advanced stage are to master the force point and force strength of the hand finger on the basis of the primary stage. However, the range of expansion is unchanged, that is, only the indexes are different, and the range of practicing thresholds is the same. This way is different from the first way, which can make the practitioner focus on different technical points in different practicing stages, and more focus on the primary technical points in the primary stage, and focus on more difficult technical points in the advanced stage, to realize different energy distribution in different stages.

[0059] The analysis in step S22 includes filtering and noise reduction processing of the recognized gesture data, to facilitate subsequent determination of the range of values.

[0060] Before recognizing the finger practicing action, whether it is to recognize the finger practicing action of a Guzheng skilled person or to recognize the finger practicing action of a Guzheng practitioner, a coordinate system needs to be established to obtain related data of the finger practicing action through the coordinate system.

[0061] The specific process of establishing the coordinate system is as follows:

[0062] As shown in Figure 3 , the palm center of the player is taken as the coordinate origin, the ray parallel to the surface of the Guzheng and perpendicular to the plane where the back of the hand is located and directed upward is taken as the Y axis, the ray along the direction of the finger is taken as the Z axis, and the ray perpendicular to the direction of the finger and located in the plane where the back of the hand is located and away from the thumb is taken as the X axis.

[0063] The relevant data of the fingering action are measured as follows: by measuring the vertical component of the palm normal vector, the palm depression degree G, the distance M(x) from the distal joint of the finger to the palm center, the change time T of the distance from the distal joint of the finger to the palm center, the finger tip velocity TipVelocity, and the angle between the vector of the distal joint of the finger and the coordinate axis, since the directions of the positions of the five fingers in the guzheng playing gesture are slightly different, the angle between the vector of the distal joint of the index finger and the x-axis is ∠μ, and the angles between the vectors of the distal joints of the other four fingers and the z-axis are ∠α, ∠θ, ∠β and ∠γ, respectively.

[0064] These specific measured values can represent specific indicators in the fingering.

[0065] The palm depression degree G and the angles between the vectors of the distal joints of the fingers and the coordinate axis ∠μ, ∠α, ∠θ, ∠β and ∠γ represent the hand shape; the change direction of the distance M(x) from the distal joint of the finger to the palm center represents the plucking direction, the angle between the vector of the distal joint of the finger and the coordinate axis represents the string touching direction, the finger tip velocity TipVelocity represents the plucking strength, the change time T of the distance from the distal joint of the finger to the palm center represents the plucking timing, and the vertical component of the palm normal vector, the palm depression degree G and the angle between the vector of the distal joint of the finger and the coordinate axis represent the plucking force point.

[0066] In step S3, the corresponding fingering of the guzheng player's fingering action is determined, and whether the fingering action at this time is single finger fingering, combined fingering or two-hand fingering is determined according to the plucking finger or the plucking timing, and then the specific fingering belonging to the single finger fingering, the combined fingering or the two-hand fingering is determined. The specific process is as follows:

[0067] Firstly, whether the current state is a non-playing gesture or a playing gesture is determined by whether the distance M(x) from the distal joint of each finger to the palm center changes, if M(x) changes, it is a playing gesture, and if M(x) does not change, it is a non-playing gesture, i.e. a preparation hand shape.

[0068] If it is determined to be a playing gesture, the specific playing fingering category is further determined. If only the M(x) data of one finger changes once, it is determined to be single finger fingering; if the M(x) of the left hand index finger, middle finger and ring finger changes, and the M(x) of a finger of the right hand changes, it is determined to be two-hand fingering; and the rest is determined to be combined fingering.

[0069] If the single finger gesture is determined, the specific finger of M(x) change and the positive or negative change of M(x) are determined. For example, if the middle finger M(middle) changes and the other four fingers M(x) do not change, the gesture "hook" is determined. For example, the gestures "split" and "hold", if the thumb M(Thumb) changes and the change is negative, i.e. away from the palm (coordinate origin), it is determined as "split", and if the change is positive, i.e. close to the origin, it is determined as "hold".

[0070] If the combined gesture is determined, the specific gesture is determined according to the specific finger of M(x) change and the numerical value change time T. For example, the combined gesture "big pinch", if the middle finger M(middle) and the thumb M(Thumb) change at the same time, and the other three fingers do not change, it is determined as the gesture "big pinch". For example, the combined gesture "small pinch", if the index finger M(Index) and the thumb M(Thumb) change at the same time, and the other three fingers do not change, it is determined as the gesture "small pinch".

[0071] If the two-hand gesture is determined, the specific gesture is determined according to the specific finger of M(x) change of the right hand, and the time before and after and the number of times of the left index finger, middle finger and ring finger M(x) change. For example, the combined gestures "wipe + up slide" and "down slide + wipe", if the right index finger M(Index) data changes, and within a certain time after the right index finger M(Index) changes, the left index finger M(Index), M(middle) and M(Ring) data change at the same time, and the other fingers do not change, it is determined as the combined gesture "wipe + up slide"; if the left index finger M(Index), M(middle) and M(Ring) data change at the same time, and the other fingers do not change, and within a certain time after the left data changes, the right index finger M(Index) data changes, it is determined as "down slide + wipe".

[0072] In step S4, the index corresponding to the gesture and the index data are searched and compared. The meaning of the index and the application of the index in the specific gesture are described to explain how to determine whether it is correct.

[0073] The meaning of the index and the application of the index in the specific gesture are described as follows.

[0074] (1) The vertical component of the palm gesture vector represents the height of the wrist, which is used to determine whether the "wrist is parallel" in the "preparation hand shape" index of the non-picking gesture; the word "parallel" does not mean strict parallel, within the range of index data, it is called parallel.

[0075] (2) The palm depression degree G represents the palm state, which is used to determine whether the palm is in a half fist shape in the "preparation hand shape" index of the non-picking gesture.

[0076] (3) The distance M(x) from the distal phalanx of each finger to the palm represents the movement state of finger x, i.e., whether it is currently stationary or in motion, and the direction of finger x's movement. It is used to identify non-playing gestures and playing gestures, and to determine the corresponding hand gesture and playing direction index for playing gesture fingering. Among them, the positive and negative changes of the value of M(x) are used to determine the plucking direction. For example, the indexes of the single-finger fingering "hook" are "whether the middle finger is used" and "whether the plucking direction is inward".

[0077] (4) Tip Velocity at the end of the five fingers indicates the plucking force of the finger x. The greater the force, the faster the speed. It is used to judge the force exertion of the finger technique in playing gestures. For example, the indicator of the single finger technique "hook" is "whether the force exerted by the small joint of the middle finger is in place".

[0078] (5) The angle between the distal joint vector and the coordinate axis indicates the current direction of the distal phalanx. Since the placement of the five fingers in a guzheng playing gesture varies slightly—the thumb points downwards and outwards, while the other four fingers hang naturally—the angle between the distal joint vector of the thumb and the x-axis is ∠μ, and the angles between the distal joint vector of the other four fingers and the z-axis are ∠α, ∠θ, ∠β, and ∠γ, respectively. This is used to represent the "preparatory hand shape" indicator for non-playing gestures ("whether the fingers are slightly bent and naturally downwards"), and the finger-to-string direction indicator for playing gestures, such as the indicator for the single-finger fingering "hook" ("whether the distal phalanx of the middle finger touches the string parallel to the string"). The term "parallel" here does not refer to strict parallelism; within the scope of the indicator data, it is generally referred to as parallel.

[0079] (6) The time T of the distance M(x) from the distal interphalangeal joint of the five fingers to the palm is used to represent the timing of the finger x plucking the string. It is used to judge the timing of the corresponding playing gesture, such as the indicator of the combined finger technique "big pluck" "whether the thumb and middle finger pluck the string at the same time".

[0080] (7) The changes in three values—the angle between the distal joint vector and the coordinate axis, the degree of wrist concavity G, and the component of the palm normal vector—represent the point of force application. Based on the fact that the corresponding values ​​will change when force is applied, these values ​​are used to determine the point of force application for the corresponding fingering technique. For example, the indicator for the single-finger fingering technique "hook"—"whether the force is applied by the small joint of the middle finger"—is reflected in the fact that only the value of the angle between the distal joint vector and the coordinate axis changes when playing, while the degree of wrist concavity G and the component of the palm normal vector remain almost unchanged.

[0081] The following are examples of indicators used in specific finger placement techniques:

[0082] (1) Taking the single-finger finger technique "hook" as an example, the corresponding indicators include: A. Whether the middle finger is used; B. Whether the distal phalanx of the middle finger touches the string parallel to the ground; C. Whether the force is generated by the small joint of the middle finger; D. Whether the force generated by the small joint of the middle finger is in place; E. Whether the direction of plucking the string is towards the palm.

[0083] (2) Take the combination fingering "big shot" as an example, the corresponding indicators include: A. Whether to use the index finger and the middle finger; B. Whether the distal phalangeal joints of the index finger and the middle finger are parallel to touch the string; C. Whether to use the small joints of the index finger and the middle finger; D. Whether the index finger and the middle finger are simultaneously plucked; E. Whether the small joints of the index finger and the middle finger are in place; F. Whether the plucking direction of the index finger and the middle finger is towards the palm.

[0084] (3) Take the double-hand fingering "wipe + slide" as an example, the corresponding indicators include: A. Whether the right hand uses the index finger; B. Whether the distal phalangeal joint of the right hand index finger is parallel to touch the string; C. Whether the right hand is the small joint of the index finger; D. Whether the small joint of the right hand index finger is in place; E. Whether the plucking direction of the right hand index finger is inward; F. Whether the left hand uses the index finger, the middle finger and the ring finger; G. Whether the pressing direction of the three fingers of the left hand is downward; H. Whether the right hand plucks the string first and then the left hand presses the string; I. Whether the left hand is the whole hand force; J. Whether the pressing force of the three fingers of the left hand is in place.

[0085] The indicators described above, such as whether the force is in place, the plucking direction, the string touching direction, etc., call the corresponding practice threshold range in the standard index library, compare whether the corresponding value of the fingering action of the practitioner is within the practice threshold range in the standard index library, if it is within the threshold range, it is judged that the fingering is correct, otherwise it is judged that the fingering is incorrect.

[0086] For the standard index library with different indicators for the primary stage and the advanced stage, the comparison method is as follows:

[0087] Take "hook" as an example of single-finger fingering, the indicators of the primary stage are: A. Whether to use the middle finger; B. Whether the distal phalangeal joint of the middle finger is parallel to touch the string; C. Whether the plucking direction is inward;

[0088] The indicators of the advanced stage further include: D. Whether the small joints of the middle finger are used; E. Whether the small joints of the middle finger are in place.

[0089] Take the fingering "big shot" as an example of combination fingering, the indicators of the initial stage include: A. Whether to use the index finger and the middle finger; B. Whether the distal phalangeal joints of the index finger and the middle finger are parallel to touch the string; C. Whether the index finger and the middle finger are simultaneously plucked; D. Whether the plucking direction of the index finger and the middle finger is towards the palm;

[0090] The indicators of the advanced stage further include: E. Whether the small joints of the index finger and the middle finger are used; F. Whether the small joints of the index finger and the middle finger are in place.

[0091] For example, the two-finger method takes the finger method "wipe + up-sliding" as an example. The indexes of the initial stage include: A. whether the right hand uses the index finger; B. whether the distal phalanx of the right hand index finger is parallel to the string; C. whether the direction of the right hand index finger is inward; D. whether the left hand uses the index finger, middle finger and ring finger; E. whether the direction of the three fingers of the left hand is downward; F. whether the right hand plucks the string first and then the left hand presses the string;

[0092] The indexes of the advanced stage also include: G. whether the right hand uses the index finger knuckle; H. whether the right hand index finger knuckle force is in place; I. whether the left hand uses the three fingers; J. whether the pressing force of the three fingers of the left hand is in place.

[0093] No matter which way to distinguish the initial stage and the advanced stage, the same indexes are applied to the "preparation hand shape" because the preparation hand shape is the beginning of all finger methods: A. whether the wrist is level; B. whether the fingers are slightly curved and naturally downward; C. whether the palm is in a half-fist shape.

[0094] The results of the judgment include the current finger method, the specific content of the corresponding index, the correct or incorrect result of the finger method action and the correct or incorrect result of the specific index. For example, taking the non-plucking gesture "preparation hand shape" as an example, if the wrist is too high, the result is: "incorrect finger method: preparation hand shape"; "whether the wrist is level (incorrect)"; "whether the fingers are slightly curved and naturally downward (correct)"; "whether the palm is in a half-fist shape (correct)".

[0095] Embodiment 2

[0096] The embodiment discloses a guzheng finger method standardized practice system for implementing the method as described in Embodiment 1, as shown in Figure 4 , comprising:

[0097] A data storage unit is configured to store a standard index library constructed according to finger method actions of guzheng skilled players and related data of the finger method actions, and the standard index library includes indexes and index data of different finger methods.

[0098] A data capture unit is configured to capture finger method actions of guzheng players and related data of the finger method actions, and the finger method actions include hand shape, plucking finger, string touching direction, plucking timing, plucking force point, plucking force and plucking direction.

[0099] A gesture recognition unit is configured to analyze and judge the corresponding finger method of the finger method actions.

[0100] A data processing unit is configured to find and compare the indexes and index data of the corresponding finger method in combination with the standard index library stored in the data storage unit.

[0101] A result feedback unit is configured to feed back the finger method practice result.

[0102] The data capturing unit captures the fingering action of the guzheng player and the specific index data, and inputs the data into the data storage unit for processing and storage, thereby forming a standard index library.

[0103] The data step unit captures the fingering action of the guzheng player and the specific action data, and inputs the data into the gesture recognition unit for recognizing the corresponding fingering.

[0104] The fingering of the player recognized by the gesture recognition unit is compared with the standard index library stored in the data storage unit in the data processing unit, and finally the practice result is obtained and presented in the result feedback unit.

[0105] The data capturing unit in the embodiment is a Leap motion, which is fixedly placed, for example, by using a matching support.

[0106] The result feedback unit in the embodiment includes an electronic screen, which is used to present the current fingering, the judgment result, the index corresponding to the fingering, and the correct or incorrect result of the specific index.

[0107] In several embodiments provided in the present application, it should be understood that the disclosed system and method can be implemented in other manners. For example, the system embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. There can be another division manner for actual implementation. For example, a plurality of units can be combined or integrated into another device, or some features can be ignored or not executed.

[0108] The units can or can not be physically separate, and the components displayed as units can be one physical unit or a plurality of physical units, which can be located in one place or distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0109] The above description includes examples of one or more embodiments. Of course, it is impossible to describe all possible combinations of components or methods for describing the above embodiments, but those of ordinary skill in the art should recognize that various embodiments can be further combined and arranged. Therefore, the embodiments described herein are intended to cover all such changes, modifications and variations falling within the scope of the appended claims. In addition, with respect to the term "comprising" used in the specification or claims, the coverage is similar to the term "including", as explained in the interpretation of "including" as a transitional phrase in the claims. In addition, any term "or" used in the claims is intended to mean "non-exclusive or".

[0110] The above merely illustrates the specific embodiments of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of the changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A standardized practice method for guzheng fingering, characterized in that, Includes the following steps: Define the guzheng fingering, each fingering includes several fingering actions, including hand shape, plucking fingers, string contact direction, plucking timing, plucking force point, plucking force, and plucking direction. Identify the fingering movements of skilled guzheng players and obtain relevant data on these movements; construct a standard index library based on the fingering movements and relevant data of skilled guzheng players. The specific fingering techniques used to identify skilled guzheng players or guzheng learners include: Establish a coordinate system; measure the vertical component of the palm normal vector, the degree of palm concavity, the distance from the distal interphalangeal joint of the finger to the center of the palm, the time points of change of the distance from the distal interphalangeal joint of the finger to the center of the palm, the fingertip velocity, and the angle between the vector of the distal interphalangeal joint of the finger and the coordinate axis. The degree of palm concavity and the angle between the vector of the distal joint of the finger and the coordinate axis represent the hand shape; the change in the distance from the distal joint of the finger to the palm represents the direction of plucking the string; the angle between the vector of the distal joint of the finger and the coordinate axis represents the direction of touching the string; the speed of the fingertip represents the plucking force; the time point of the change in the distance from the distal joint of the finger to the palm represents the timing of plucking the string; and the vertical component of the palm normal vector, the degree of palm concavity, and the angle between the vector of the distal joint of the finger and the coordinate axis represent the point of force application for plucking the string. The establishment of the coordinate system specifically includes: With the palm of the hand as the origin, the Y-axis is the ray that runs upward from the plane where the palm is parallel to the piano surface and perpendicular to the back of the hand; the Z-axis is the ray along the direction of the fingers; and the X-axis is the ray that runs perpendicular to the direction of the fingers in the plane where the back of the hand is located and away from the thumb. The standard indicator library includes indicators and indicator data for different finger techniques, and several finger technique actions constitute the indicators of the same finger technique. The system identifies the fingering movements of a guzheng player, analyzes and determines the corresponding fingerings, inputs the fingering movements into a standard index database, searches and compares the corresponding indexes and index data, and provides feedback on the fingering practice results.

2. The standardized practice method for guzheng fingering according to claim 1, characterized in that, Analyze and determine the corresponding fingering techniques for the guzheng practitioner's fingering movements, specifically including: Based on the fingers used to pluck the strings or the timing of the pluck, the fingering action at this moment can be determined to be any of the guzheng fingering techniques.

3. The standardized practice method for guzheng fingering according to claim 1, characterized in that, Constructing a standard indicator library, specifically including: To obtain the specific numerical values ​​of the index data for each finger technique movement of a skilled guzheng player; Analyze the specific numerical values ​​to obtain the range of variation of the indicator data; Expanding the range of variation yields the range of practice thresholds; The practice threshold ranges for different finger techniques constitute the standard index library.

4. The standardized practice method for guzheng fingering according to claim 1, characterized in that, It also includes dividing the fingering practice of guzheng practitioners into a primary stage and an advanced stage; the primary stage and the advanced stage have different standard indicator libraries.

5. The standardized practice method for guzheng fingering according to claim 3, characterized in that, The critical value for expanding the range of variation specifically includes: dividing the fingering practice of guzheng practitioners into a primary stage and an advanced stage, expanding the range of variation of the indicator data by 15% to obtain the practice threshold range for the primary stage, and expanding the range of variation of the indicator data by 10% to obtain the practice threshold range for the advanced stage.

6. A standardized practice system for guzheng fingering, characterized in that, include: A data storage unit is used to store a standard index library constructed based on the fingering movements and related data of skilled guzheng players. The standard index library includes indicators and index data for different fingering techniques. The data capture unit is used to capture the fingering movements of the guzheng player and related data of the fingering movements, including hand shape, plucking fingers, string contact direction, plucking timing, plucking force point, plucking force, and plucking direction. The specific fingering techniques used to identify skilled guzheng players or guzheng learners include: Establish a coordinate system; measure the vertical component of the palm normal vector, the degree of palm concavity, the distance from the distal interphalangeal joint of the finger to the center of the palm, the time points of change of the distance from the distal interphalangeal joint of the finger to the center of the palm, the fingertip velocity, and the angle between the vector of the distal interphalangeal joint of the finger and the coordinate axis. The degree of palm concavity and the angle between the vector of the distal joint of the finger and the coordinate axis represent the hand shape; the change in the distance from the distal joint of the finger to the palm represents the direction of plucking the string; the angle between the vector of the distal joint of the finger and the coordinate axis represents the direction of touching the string; the speed of the fingertip represents the plucking force; the time point of the change in the distance from the distal joint of the finger to the palm represents the timing of plucking the string; and the vertical component of the palm normal vector, the degree of palm concavity, and the angle between the vector of the distal joint of the finger and the coordinate axis represent the point of force application for plucking the string. The establishment of the coordinate system specifically includes: With the palm of the hand as the origin, the Y-axis is the ray that runs upward from the plane where the palm is parallel to the piano surface and perpendicular to the back of the hand; the Z-axis is the ray along the direction of the fingers; and the X-axis is the ray that runs perpendicular to the direction of the fingers in the plane where the back of the hand is located and away from the thumb. A gesture recognition unit is used to analyze and determine the corresponding finger gesture for the gesture action; The data processing unit is used to combine the standard indicator library stored in the data storage unit to search and compare the indicators and indicator data of the corresponding finger method. The result feedback unit is used to provide feedback on the results of fingering practice.

7. The standardized guzheng fingering practice system according to claim 6, characterized in that, The data capture unit includes a Leap motion, which is fixedly positioned.

8. The standardized guzheng fingering practice system according to claim 7, characterized in that, The result feedback unit includes an electronic screen that displays the current finger placement, the judgment result, the index corresponding to the finger placement, and the correctness of the specific index.

Images