A method and system for automatically calibrating the sensitivity of a virtual musical instrument keyboard

Abstract

The present invention proposes a method and system for automatically calibrating the sensitivity of a virtual musical instrument keyboard. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard includes: initializing a virtual musical instrument keyboard to obtain an initialized virtual musical instrument keyboard; collecting operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user in real time, and using the operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; real-time monitoring of the real-time operation data information of the virtual musical instrument keyboard during the audio playing process of the user, and using the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard. The system includes modules corresponding to the steps of the method.

Description

Technical Field

[0001] The invention provides a virtual musical instrument keyboard sensitivity automatic calibration method and system, belonging to the technical field of virtual musical instrument keyboard automatic calibration. Background Art

[0002] With the continuous development of science and technology, virtual technology is being used more and more widely in various fields, especially in music education and music creation. As an important music input device, virtual instrument keyboards are favored for their portability and customizability. Compared with traditional piano keyboards, virtual instrument keyboards require more frequent calibration than traditional keyboards to ensure accuracy when playing and simulation authenticity. However, virtual instrument keyboards need to be manually calibrated before pressing keys, and cannot be automatically calibrated according to the actual situation of the keys. Summary of the invention

[0003] The present invention provides a method and system for automatically calibrating the sensitivity of a virtual musical instrument keyboard, which is used to solve the problem that the virtual musical instrument keyboard needs to be manually calibrated before pressing a key, and cannot be adaptively and automatically calibrated according to the actual situation of the key. The technical solution adopted is as follows:

[0004] A virtual musical instrument keyboard sensitivity automatic calibration method, the virtual musical instrument keyboard sensitivity automatic calibration method comprising:

[0005] Initializing a virtual musical instrument keyboard to obtain an initialized virtual musical instrument keyboard; wherein the virtual musical instrument keyboard is used to imitate a piano keyboard;

[0006] Collecting in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after completing the verification, and using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after completing the verification to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard;

[0007] Real-time operation data information of the virtual musical instrument keyboard during the user's audio playing process is monitored in real time, and the real-time operation data information of the virtual musical instrument keyboard is combined with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard.

[0008] Further, the virtual musical instrument keyboard is initialized to obtain the initialized virtual musical instrument keyboard, including:

[0009] Loading the virtual musical instrument keyboard;

[0010] After the virtual musical instrument keyboard is loaded, the pitch corresponding to the keys included in the virtual musical instrument keyboard is initialized to obtain the virtual musical instrument keyboard after the pitch is initialized and adjusted;

[0011] An initial threshold configuration is performed on the virtual musical instrument keyboard after the initialization adjustment of the pitch, wherein the initial threshold includes a pressing response time threshold and a sound playing response time threshold.

[0012] Furthermore, the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification is completed is collected in real time, and the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification is completed is used to perform the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard, including:

[0013] Retrieve verification audio from the database;

[0014] Collecting in real time the operation data information of the virtual musical instrument keyboard during the playing of the verification audio; wherein the operation data information includes the pressing response time and the sound playing response time contained in the playing of the verification audio;

[0015] The operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user is used to perform the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; wherein, the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is the initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard.

[0016] Further, the operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user is used to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard, including:

[0017] Extracting the pressing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process;

[0018] Extracting the sound playing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process;

[0019] Obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard;

[0020] Obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard;

[0021] The initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by utilizing the pressing completion duration of the verified audio playing and the audio playback completion duration corresponding to the verified audio playing in combination with the pressing response time adjustment factor and the sound playback response time adjustment factor.

[0022] Furthermore, obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard includes:

[0023] Retrieving the pressing response time data corresponding to each note included in the verification audio;

[0024] The first adjustment coefficient is obtained by using the pressure response time data corresponding to each note; wherein the first adjustment coefficient is obtained by the following formula:

[0025]

[0026] Among them, K 01 represents the first adjustment coefficient; n represents the number of notes contained in the calibration audio; T i represents the pressing response time corresponding to the i-th note; T i-1 represents the pressing response time corresponding to the i-1th note;

[0027] The second adjustment coefficient is obtained by using the press response time data and the press response time threshold corresponding to each note in the verification audio; wherein the second adjustment coefficient is obtained by the following formula:

[0028]

[0029] Among them, K 02 Represents the second adjustment coefficient; T y01 Indicates the press response time threshold;

[0030] The first adjustment coefficient and the second adjustment coefficient are used to obtain a press response time adjustment factor, wherein the press response time adjustment factor is obtained by the following formula:

[0031]

[0032] Wherein, K represents the compression response time adjustment factor.

[0033] Further, obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard includes:

[0034] Retrieving the sound playing response time data corresponding to each note included in the verification audio;

[0035] Retrieving the pressing response time data corresponding to each note included in the verification audio;

[0036] The sound playing response time adjustment factor is obtained by using the sound playing response time data and the pressing response time data corresponding to each note, wherein the sound playing response time adjustment factor is obtained by the following formula:

[0037]

[0038] Where S represents the sound playback response time adjustment factor; n represents the number of notes contained in the calibration audio; T y02Indicates the sound playback response time threshold; T si represents the sound playback response time corresponding to the i-th note; T i represents the pressing response time corresponding to the i-th note; S 01 and S 02 represent the third adjustment coefficient and the fourth adjustment coefficient respectively, and the third adjustment coefficient and the fourth adjustment coefficient are obtained by the following formula:

[0039]

[0040]

[0041] Among them, T y01 Indicates the press response time threshold.

[0042] Further, the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by using the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing in combination with the pressing response time adjustment factor and the sound playing response time adjustment factor, including:

[0043] Retrieving the pressing response time adjustment factor and the sound playing response time adjustment factor;

[0044] The pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing are retrieved to obtain the duration offset parameter; wherein, the duration offset parameter is obtained by the following formula:

[0045]

[0046] Among them, T p Indicates the duration offset parameter; T a and T b They respectively represent the pressing completion time of the verified audio playing and the audio playing completion time corresponding to the verified audio playing;

[0047] The press response time of the virtual musical instrument keyboard is initially automatically calibrated using the duration offset parameter combined with the press response time adjustment factor to obtain the press response time after the initial automatic calibration; wherein the press response time after the initial automatic calibration is obtained by the following formula:

[0048]

[0049] Among them, T ac represents the press response time after the initial automatic calibration; T ae represents the average value of the press response time before calibration;

[0050] The duration offset parameter is combined with the sound playing response time adjustment factor to obtain an initial automatic calibration of the sound playing response time of the virtual musical instrument keyboard, and the sound playing response time after the initial automatic calibration is obtained; wherein the sound playing response time after the initial automatic calibration is obtained by the following formula:

[0051]

[0052] Among them, T yc Indicates the sound playback response time after initial automatic calibration; T ye It represents the average value of the sound playback response time before the initial automatic calibration; S represents the sound playback response time adjustment factor.

[0053] The initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard.

[0054] Furthermore, real-time operation data information of the virtual musical instrument keyboard during the user's audio playing is monitored in real time, and the sensitivity of the virtual musical instrument keyboard is automatically calibrated in real time and dynamically using the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time, including:

[0055] Real-time collection of the user's corresponding pressing response time and sound playing response time for each audio playing;

[0056] Using the pressing response time and the sound playing response time after the initial automatic calibration of the virtual musical instrument keyboard sensitivity as the initial pressing response time and the initial sound playing response time;

[0057] The dynamic adjustment factor of the pressing response time is obtained by using the pressing response time corresponding to each audio playing of the user and the initial pressing response time; wherein the dynamic adjustment factor of the pressing response time is obtained by the following formula:

[0058]

[0059] Among them, K d represents the dynamic adjustment factor of the pressing response time; m represents the number of notes contained in the audio playing; T j represents the pressing response time corresponding to the jth note; T ac Indicates the press response time after the initial automatic calibration;

[0060] The sound playing response time corresponding to each audio playing of the user and the initial sound playing response time are used to obtain the sound playing response time dynamic adjustment factor; wherein the sound playing response time dynamic adjustment factor is obtained by the following formula:

[0061]

[0062] Among them, S d represents the dynamic adjustment factor of the sound playback response time; m represents the number of notes contained in the audio playing; T sj represents the sound playback response time corresponding to the jth note; T yc Indicates the sound playback response time after initial automatic calibration; T j represents the pressing response time corresponding to the jth note;

[0063] Using the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration on the pressing response time and the sound playing response time of the virtual musical instrument keyboard;

[0064] Among them, the real-time dynamic automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard.

[0065] Furthermore, the pressing response time and the sound playing response time of the virtual musical instrument keyboard are automatically and dynamically calibrated in real time using the pressing response time dynamic adjustment factor and the sound playing response time dynamic adjustment factor, including:

[0066] Retrieving the dynamic adjustment factor of the pressing response time;

[0067] The press response time of the virtual musical instrument keyboard is automatically and dynamically calibrated in real time using the press response time dynamic adjustment factor, wherein the press response time after the real-time dynamic automatic calibration is obtained by the following formula:

[0068]

[0069]

[0070] Among them, T ad represents the pressing response time after real-time dynamic automatic calibration; k represents the first adjustment factor; m represents the number of notes contained in the audio playing; T ac represents the press response time after the initial automatic calibration; T j represents the pressing response time corresponding to the jth note; T j-1 represents the pressing response time corresponding to the j-1th note; K d Indicates the dynamic adjustment factor of the press response time;

[0071] Retrieve the sound playback response time dynamic adjustment factor;

[0072] The sound playing response time dynamic adjustment factor is used to perform real-time dynamic automatic calibration on the sound playing response time of the virtual musical instrument keyboard, wherein the sound playing response time after the real-time dynamic automatic calibration is obtained by the following formula:

[0073]

[0074]

[0075] Among them, T yd represents the sound playback response time after real-time dynamic automatic calibration; s represents the second adjustment factor; m represents the number of notes contained in the audio playing; T sj represents the sound playback response time corresponding to the jth note; T sj-1 S represents the sound playback response time corresponding to the j-1th note; d Indicates the dynamic adjustment factor of the sound playback response time.

[0076] A virtual musical instrument keyboard sensitivity automatic calibration system, the virtual musical instrument keyboard sensitivity automatic calibration system comprising:

[0077] An initialization module, used to initialize the virtual musical instrument keyboard to obtain the initialized virtual musical instrument keyboard; wherein the virtual musical instrument keyboard is used to imitate a piano keyboard;

[0078] An initial calibration module is used to collect in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user, and use the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard;

[0079] The real-time calibration module is used to monitor the real-time operation data information of the virtual musical instrument keyboard during the user's audio playing process, and use the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration on the sensitivity of the virtual musical instrument keyboard.

[0080] Beneficial effects of the present invention:

[0081] The present invention proposes a method and system for automatically calibrating the sensitivity of a virtual musical instrument keyboard, which makes the response characteristics of the virtual musical instrument keyboard closer to a real piano keyboard, thereby improving the user's comfort and sense of reality during the playing process. The system can monitor the user's playing process in real time, and dynamically adjust the sensitivity of the virtual musical instrument keyboard in real time according to the user's playing habits and real-time data. The above adjustment method enables the response characteristics of the virtual musical instrument keyboard to always be consistent with the user's playing needs, thereby improving the adaptability and flexibility of the system. The user can personalize the sensitivity of the virtual musical instrument keyboard by adjusting the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playback response time according to his or her playing habits and needs. The above personalized setting method enables the system to meet the personalized needs of different users, thereby improving the customizability and usability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0082] Figure 1 is a flow chart of the method of the present invention;

[0083] Figure 2 The system block diagram of the system of the present invention. DETAILED DESCRIPTION

[0084] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0085] The embodiment of the present invention provides a method for automatically calibrating the sensitivity of a virtual musical instrument keyboard. Figure 1 As shown, the virtual musical instrument keyboard sensitivity automatic calibration method includes:

[0086] S1, initializing the virtual musical instrument keyboard to obtain the initialized virtual musical instrument keyboard; wherein the virtual musical instrument keyboard is used to imitate a piano keyboard;

[0087] S2, collecting in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification, and using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard;

[0088] S3. Real-time monitoring of the real-time operation data information of the virtual musical instrument keyboard during the user's audio playing process, and real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard by using the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time.

[0089] The working principle of the above technical solution is as follows: first, the system initializes the virtual instrument keyboard to ensure that the virtual instrument keyboard can normally imitate the basic characteristics of the piano keyboard in the initial state.

[0090] When the user plays a specific calibration audio, the system will collect the operation data information of the virtual instrument keyboard in real time. The above data includes the force, speed, duration of the user's key presses, etc., which are used to analyze the user's playing habits and the initial response state of the virtual instrument keyboard. Then, the system automatically calibrates the sensitivity of the virtual instrument keyboard based on the above data, so that the initial response state of the virtual instrument keyboard is closer to the response characteristics of a real piano keyboard.

[0091] While the user is playing audio, the system will continuously monitor the real-time operation data of the virtual instrument keyboard. The above data includes not only the strength, speed, and duration of the key press, but also the response time of the key press and the response time of the sound playback after the user presses the key. The system will automatically calibrate the sensitivity of the virtual instrument keyboard in real time and dynamically based on the above real-time data and two dynamic adjustment factors (dynamic adjustment factor for the key press response time and dynamic adjustment factor for the sound playback response time). These two dynamic adjustment factors can be dynamically adjusted according to the user's playing habits and needs to achieve precise control of the sensitivity of the virtual instrument keyboard.

[0092] The effect of the above technical solution is: through the automatic calibration of the sensitivity of the virtual instrument keyboard, the response characteristics of the virtual instrument keyboard are made closer to the real piano keyboard, thereby improving the user's comfort and sense of reality during the playing process. The system can monitor the user's playing process in real time, and dynamically adjust the sensitivity of the virtual instrument keyboard in real time according to the user's playing habits and real-time data. The above adjustment method enables the response characteristics of the virtual instrument keyboard to always be consistent with the user's playing needs, improving the adaptability and flexibility of the system. Users can personalize the sensitivity of the virtual instrument keyboard by adjusting the dynamic adjustment factor of the press response time and the dynamic adjustment factor of the sound playback response time according to their own playing habits and needs. The above personalized setting method enables the system to meet the personalized needs of different users and improves the customizability and usability of the system.

[0093] In one embodiment of the present invention, the virtual musical instrument keyboard is initialized to obtain the initialized virtual musical instrument keyboard, including:

[0094] S101, loading the virtual musical instrument keyboard;

[0095] S102, after the virtual musical instrument keyboard is loaded, initializing the pitch corresponding to the keys included in the virtual musical instrument keyboard to obtain a virtual musical instrument keyboard after the pitch is initialized and adjusted;

[0096] S103, performing initial threshold configuration on the virtual musical instrument keyboard after the initialization adjustment of the pitch, wherein the initial threshold includes a pressing response time threshold and a sound playing response time threshold.

[0097] The working principle of the above technical solution is: the system will load the relevant data and functions of the virtual instrument keyboard, which usually involves reading the graphical interface, key layout, pitch data, etc. of the virtual instrument keyboard from the server or local storage, and displaying it on the user's device.

[0098] After the virtual instrument keyboard is loaded, the system will initialize the pitch corresponding to each key of the virtual instrument keyboard. The above process usually involves checking and adjusting the pitch, timbre, length and other pitch-related parameters of each key to ensure that they have similar pitch characteristics to the corresponding keys of the real piano keyboard. In this way, when users use the virtual instrument keyboard to play, they can get a pitch experience similar to that of a real piano.

[0099] After the initial pitch adjustment is completed, the system will configure the initial threshold of the virtual instrument keyboard. The thresholds here mainly include the press response time threshold and the sound playback response time threshold. The press response time threshold refers to the time calibration range from the user pressing the key to the system recognizing this action and responding; the sound playback response time threshold refers to the time calibration range from pressing the key to playing the corresponding sound. The configuration of the initial threshold is crucial to ensure the response speed and accuracy of the virtual instrument keyboard.

[0100] The effect of the above technical solution is: by initializing and adjusting the pitch of the virtual instrument keyboard, it can be ensured that each key of the virtual instrument keyboard has a pitch characteristic similar to that of a real piano keyboard, thereby improving the pitch accuracy of the user when playing the virtual instrument keyboard. The configuration of the initial threshold can ensure that the virtual instrument keyboard can respond quickly after receiving the user's key signal and play the corresponding sound. It can not only improve the response speed of the virtual instrument keyboard, but also reduce the playing error caused by delay. Through the above initialization process, the virtual instrument keyboard has been optimized in terms of pitch, response speed, etc., so as to provide users with a playing experience closer to a real piano. It can not only improve user satisfaction, but also promote the application and development of virtual instrument keyboards in fields such as music education and music creation.

[0101] In one embodiment of the present invention, the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user is collected in real time, and the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user is used to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard, including:

[0102] S201, retrieve the verification audio from the database;

[0103] S202, collecting in real time the operation data information of the virtual musical instrument keyboard during the playing of the verification audio; wherein the operation data information includes the pressing response time and the sound playing response time contained in the playing of the verification audio;

[0104] S203, using the operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; wherein, the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is the initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard.

[0105] The working principle of the above technical solution is as follows: the system first retrieves a preset calibration audio from a database. The above calibration audio usually contains a series of standard notes or scales, which are used to test the response performance and pitch of the virtual instrument keyboard.

[0106] When the user plays the above verification audio, the system will collect the operation data information of the virtual instrument keyboard in real time. The above data mainly includes the pressing response time and sound playing response time of each note during the user's playing. The pressing response time refers to the time required from the user pressing the key of the virtual instrument keyboard to the system recognizing this action and generating a response; the sound playing response time refers to the time required from the system receiving the key signal to playing the corresponding sound.

[0107] The system uses the above real-time collected operation data information to perform initial automatic calibration of the sensitivity of the virtual instrument keyboard. The above calibration process is actually to adjust the virtual instrument keyboard's press response time and sound playback response time. The system will analyze the response data when the user plays the calibration audio, and compare it with the preset standard value or range, and then adjust the relevant parameters of the virtual instrument keyboard to make its response time and playback time closer to the preset standard value or range.

[0108] The effect of the above technical solution is: by real-time collection of the operating data information when the user plays the verification audio, and performing initial automatic calibration, the response time and playback time of the virtual instrument keyboard can be ensured to be more accurate and reliable. The above technical solution helps to improve the user's experience in the subsequent playing process. Since the system is calibrated according to the user's actual playing data, the above method can be personalized according to the habits and preferences of different users. The above technical solution helps to improve the adaptability and flexibility of the virtual instrument keyboard. By performing initial automatic calibration of the sensitivity of the virtual instrument keyboard, its response performance and pitch accuracy can be optimized. Not only can the user satisfaction be improved, but also the application and development of virtual instrument keyboards in the fields of music education and music creation can be promoted. By improving the response performance and pitch accuracy of the virtual instrument keyboard, a more realistic and natural playing experience can be brought to the user. The above technical solution helps to improve the comfort and satisfaction of the user when using the virtual instrument keyboard.

[0109] In one embodiment of the present invention, the operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user is used to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard, including:

[0110] S2031, extracting the pressing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process;

[0111] S2032, extracting the sound playing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process;

[0112] S2033, obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard;

[0113] S2034, obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard;

[0114] S2035, using the verification audio playing pressing completion time and the verification audio playing corresponding audio playing completion time combined with the pressing response time adjustment factor and the sound playing response time adjustment factor to perform initial automatic calibration on the sensitivity of the virtual musical instrument keyboard.

[0115] The working principle of the above technical solution is: when the user plays the verification audio, the system will record the pressing response time and sound playing response time of each note in real time. These two times are key indicators for evaluating the sensitivity of the virtual instrument keyboard.

[0116] Based on the extracted press response time, the system obtains an adjustment factor based on the press response time. The above factor reflects the difference between the current press response time and the ideal press response time, and is used for subsequent sensitivity adjustment. Similarly, the system obtains an adjustment factor based on the extracted sound playback response time. The above factor reflects the difference between the current sound playback response time and the ideal sound playback response time.

[0117] The completion time of pressing the verification audio playing is the total time required for the user to complete the pressing of all notes during the entire verification audio playing process. The completion time of the audio playback corresponding to the verification audio playing is the total time required for the system to play all the notes in the verification audio. The system will combine the above two time lengths with the previously calculated pressing response time adjustment factor and sound playback response time adjustment factor to perform an initial automatic calibration of the sensitivity of the virtual instrument keyboard. The above process will adjust certain parameters of the virtual instrument keyboard, such as the sensitivity of key recognition, the delay of sound playback, etc., to ensure that the response time and playback time of the virtual instrument keyboard are more in line with user expectations.

[0118] The effect of the above technical solution is: by extracting the actual pressing response time and sound playing response time, and calibrating them in combination with the duration and adjustment factor, the sensitivity of the virtual instrument keyboard can be ensured to be more accurate and reliable. The calibrated virtual instrument keyboard is closer to the user's expectations in terms of response time and playing time, thereby improving the user's playing experience. Since the calibration process is based on the user's actual playing data, the above method can be personalized according to the habits and preferences of different users, thereby improving the adaptability and flexibility of the virtual instrument keyboard. Through automatic calibration, the system can promptly detect and correct deviations in the response time and playing time of the virtual instrument keyboard, thereby improving the stability and reliability of the system.

[0119] In one embodiment of the present invention, the pressing response time of the virtual musical instrument keyboard is used to obtain the pressing response time adjustment factor, including:

[0120] Step A1, retrieving the pressing response time data corresponding to each note contained in the verification audio;

[0121] Step A2: Obtain a first adjustment coefficient using the pressure response time data corresponding to each note; wherein the first adjustment coefficient is obtained by the following formula:

[0122]

[0123] Among them, K 01 represents the first adjustment coefficient; n represents the number of notes contained in the calibration audio; T i represents the pressing response time corresponding to the i-th note; T i-1represents the pressing response time corresponding to the i-1th note;

[0124] Step A3: Obtain a second adjustment coefficient using the press response time data and the press response time threshold corresponding to each note in the verification audio; wherein the second adjustment coefficient is obtained by the following formula:

[0125]

[0126] Among them, K 02 Represents the second adjustment coefficient; T y01 represents the threshold of the pressing response time; n represents the number of notes contained in the verification audio; T i represents the pressing response time corresponding to the i-th note;

[0127] Step A4: using the first adjustment coefficient and the second adjustment coefficient to obtain a press response time adjustment factor, wherein the press response time adjustment factor is obtained by the following formula:

[0128]

[0129] Where K represents the pressure response time adjustment factor, K 01 Represents the first adjustment coefficient; K 02 Represents the second adjustment factor.

[0130] The working principle of the above technical solution is as follows: First, the system retrieves the pressing response time data corresponding to each note in the verification audio from the database. The above data is a record of the pressing response time of the virtual instrument keyboard to each note when the user actually plays.

[0131] The system calculates the first adjustment coefficient based on the press response time data of each note. The above coefficient is used to evaluate the difference or change rate of the press response time between adjacent notes during the user's playing. By comparing the press response time of adjacent notes, the system can understand the stability of the user's press response when playing.

[0132] The system also calculates a second adjustment coefficient based on the press response time data of each note and the preset press response time threshold. The above coefficient is used to evaluate whether the user's press response time is within a reasonable range. If the press response time of a note exceeds the threshold, the second adjustment coefficient will be adjusted accordingly to reflect the above deviation.

[0133] Finally, the system combines the first adjustment coefficient and the second adjustment coefficient to obtain the press response time adjustment factor in the above manner. The above adjustment factor comprehensively considers the stability of the user's press response time during the playing process and the deviation from the threshold, and is used for subsequent virtual instrument keyboard sensitivity calibration.

[0134] The effect of the above technical solution is: by comprehensively considering the difference in the response time of adjacent note presses and the deviation from the threshold, the system can more accurately evaluate the press response performance of the virtual instrument keyboard and perform more precise calibration. The calibrated virtual instrument keyboard can provide a more stable and accurate press response, thereby enhancing the user's experience when playing. Especially in scenarios where precise control of note duration is required, the optimized virtual instrument keyboard can significantly improve the user's playing efficiency and satisfaction. Since the calibration process is based on the user's actual playing data, the method can be personalized according to the habits and preferences of different users. The above technical solution helps to enhance the adaptability and flexibility of the system, so that it can better meet the needs of different users. By automatically calibrating and adjusting the press response performance of the virtual instrument keyboard, the system can promptly detect and correct potential problems or deviations, thereby improving the stability and reliability of the system.

[0135] In one embodiment of the present invention, the sound playing response time of the virtual musical instrument keyboard is used to obtain a sound playing response time adjustment factor, including:

[0136] Step B1, retrieving the sound playing response time data corresponding to each note contained in the verification audio;

[0137] Step B2, retrieving the pressing response time data corresponding to each note contained in the verification audio;

[0138] Step B3: using the sound playing response time data and the pressing response time data corresponding to each note to obtain the sound playing response time adjustment factor, wherein the sound playing response time adjustment factor is obtained by the following formula:

[0139]

[0140] Where S represents the sound playback response time adjustment factor; n represents the number of notes contained in the calibration audio; T y02 Indicates the sound playback response time threshold; T si represents the sound playback response time corresponding to the i-th note; T i represents the pressing response time corresponding to the i-th note; S 01 and S 02 represent the third adjustment coefficient and the fourth adjustment coefficient respectively, and the third adjustment coefficient and the fourth adjustment coefficient are obtained by the following formula:

[0141]

[0142]

[0143] Among them, T y01represents the threshold of the pressing response time; n represents the number of notes contained in the verification audio; T i represents the pressing response time corresponding to the i-th note; T si represents the sound playback response time corresponding to the i-th note; T y02 Indicates the sound playback response time threshold.

[0144] The working principle of the above technical solution is as follows: First, the system retrieves the sound playing response time data corresponding to each note in the verification audio from the database. The above data reflects the time required from the user pressing the virtual instrument keyboard to the actual sound playing. At the same time, the system also retrieves the pressing response time data corresponding to each note. The above data reflects the response time of the user pressing the corresponding note key on the virtual instrument keyboard.

[0145] The third adjustment coefficient is calculated based on the press response time and the press response time threshold. The above coefficients are used to measure the deviation degree or stability of the press response time. The fourth adjustment coefficient is calculated based on the sound playback response time threshold. The above coefficients are used to measure the deviation degree or stability of the sound playback response time.

[0146] Combining the third adjustment coefficient, the fourth adjustment coefficient, the sound playing response time, the pressing response time and the corresponding threshold, the system obtains the sound playing response time adjustment factor. The adjustment factor combines the deviation degree between the pressing response time and the sound playing response time, and reflects the overall performance of the virtual musical instrument keyboard in terms of sound playing response.

[0147] The effect of the above technical solution is: by comprehensively considering the pressing response time and the sound playback response time, the technical solution can more comprehensively evaluate the performance of the virtual instrument keyboard and perform more accurate calibration accordingly. The calculation and application of the sound playback response time adjustment factor helps to optimize the sound playback performance of the virtual instrument keyboard, reduce problems such as sound delay or asynchrony, and thus enhance the user experience when playing. The technical solution can adjust the performance of the virtual instrument keyboard based on the actual playing data of different users, making it more adaptable to the needs and habits of different users. By automatically calibrating and adjusting the sound playback performance of the virtual instrument keyboard, the system can promptly detect and correct potential problems or deviations, thereby improving the stability and reliability of the system.

[0148] In one embodiment of the present invention, the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by using the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing in combination with the pressing response time adjustment factor and the sound playing response time adjustment factor, including:

[0149] Step C1, retrieving the pressing response time adjustment factor and the sound playing response time adjustment factor;

[0150] Step C2, retrieve the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing to obtain a duration offset parameter; wherein the duration offset parameter is obtained by the following formula:

[0151]

[0152] Among them, T p Indicates the duration offset parameter; T a and T b They respectively represent the pressing completion time of the verified audio playing and the audio playing completion time corresponding to the verified audio playing;

[0153] Step C3, using the duration offset parameter combined with the press response time adjustment factor to perform initial automatic calibration on the press response time of the virtual musical instrument keyboard, and obtaining the press response time after the initial automatic calibration; wherein the press response time after the initial automatic calibration is obtained by the following formula:

[0154]

[0155] Among them, T ac represents the press response time after the initial automatic calibration; T ae represents the average value of the press response time before calibration; K represents the press response time adjustment factor; T p Indicates the duration offset parameter;

[0156] Step C4, using the duration offset parameter in combination with the sound playback response time adjustment factor to obtain an initial automatic calibration of the sound playback response time of the virtual musical instrument keyboard, and obtaining the sound playback response time after the initial automatic calibration; wherein the sound playback response time after the initial automatic calibration is obtained by the following formula:

[0157]

[0158] Among them, T yc Indicates the sound playback response time after initial automatic calibration; T ye It represents the average sound playback response time before the initial automatic calibration; S represents the sound playback response time adjustment factor; T p Indicates the duration offset parameter.

[0159] The initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard.

[0160] The working principle of the above technical solution is: first, the system retrieves the previously calculated pressing response time adjustment factor and sound playing response time adjustment factor from the database.

[0161] Next, the system retrieves the completion time of pressing the key and the completion time of the audio playing, and calculates the duration offset parameter. The duration offset parameter is used to measure the difference between the completion time of pressing the key and the completion time of the audio playing, which reflects the mismatch between the response speed of the virtual instrument keyboard and the audio playing speed.

[0162] Using the duration offset parameter and the press response time adjustment factor, the system performs initial automatic calibration on the press response time of the virtual musical instrument keyboard. The press response time adjustment factor reflects the degree of deviation of the press response time, and the system corrects the original press response time through the adjustment factor to reduce the synchronization error with the audio playback. The press response time after the initial automatic calibration is calculated based on the average value of the press response time before calibration, the duration offset parameter and the adjustment factor. Similarly, the system performs initial automatic calibration on the sound playback response time of the virtual musical instrument keyboard using the duration offset parameter and the sound playback response time adjustment factor. The sound playback response time adjustment factor is used to reflect the degree of deviation of the sound playback response time, and the system adjusts the original sound playback response time accordingly. Among them, the sound playback response time after the initial automatic calibration is calculated based on the average value of the sound playback response time before the initial automatic calibration, the duration offset parameter and the adjustment factor.

[0163] In the above process, the adjustment of the virtual instrument keyboard's pressing response time and sound playback response time is actually the calibration of the virtual instrument keyboard's sensitivity. Because the sensitivity reflects the virtual instrument keyboard's response speed and accuracy to user input, by adjusting the pressing response time and sound playback response time, the system can improve the synchronization and accuracy between the virtual instrument keyboard and the user input, thereby optimizing the user's playing experience.

[0164] The effect of the above technical solution is: by automatically calibrating the pressing response time and sound playback response time of the virtual instrument keyboard, the system can significantly reduce the synchronization error between user input and audio playback, and improve the response speed and accuracy of the virtual instrument keyboard.

[0165] The calibrated virtual instrument keyboard can respond to the user's playing actions more accurately, reduce delays and errors, and provide users with a smoother and more natural playing experience. This technical solution can be personalized according to the playing habits and preferences of different users, improving the adaptability and flexibility of the system. By automatically calibrating and adjusting the performance parameters of the virtual instrument keyboard, the system can promptly detect and correct potential problems or deviations, thereby improving the stability and reliability of the system.

[0166] An embodiment of the present invention monitors real-time operation data information of a virtual musical instrument keyboard during a user's audio playing process, and uses the real-time operation data information of the virtual musical instrument keyboard in combination with a dynamic adjustment factor of a pressing response time and a dynamic adjustment factor of a sound playing response time to automatically calibrate the sensitivity of the virtual musical instrument keyboard in real time, including:

[0167] S301, collecting in real time the pressing response time and the sound playing response time corresponding to each audio playing of the user;

[0168] S302, using the pressing response time and the sound playing response time after the initial automatic calibration of the virtual musical instrument keyboard sensitivity as the initial pressing response time and the initial sound playing response time;

[0169] S303, using the pressing response time corresponding to each audio playing of the user and the initial pressing response time to obtain a pressing response time dynamic adjustment factor; wherein the pressing response time dynamic adjustment factor is obtained by the following formula:

[0170]

[0171] Among them, K d represents the dynamic adjustment factor of the pressing response time; m represents the number of notes contained in the audio playing; T j represents the pressing response time corresponding to the jth note; T ac Indicates the press response time after the initial automatic calibration;

[0172] S304, using the sound playing response time corresponding to each audio playing of the user and the initial sound playing response time to obtain a sound playing response time dynamic adjustment factor; wherein the sound playing response time dynamic adjustment factor is obtained by the following formula:

[0173]

[0174] Among them, S d represents the dynamic adjustment factor of the sound playback response time; m represents the number of notes contained in the audio playing; T sj represents the sound playback response time corresponding to the jth note; T yc Indicates the sound playback response time after initial automatic calibration; T j represents the pressing response time corresponding to the jth note;

[0175] S305, using the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration on the pressing response time and the sound playing response time of the virtual musical instrument keyboard;

[0176] Among them, the real-time dynamic automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard.

[0177] The working principle of the above technical solution is: when the user plays audio, the system will collect the corresponding pressing response time and sound playing response time of each playing in real time. The above data reflects the instant response of the virtual instrument keyboard to the user input. The system uses the pressing response time and sound playing response time of the virtual instrument keyboard after initial automatic calibration as the initial pressing response time and initial sound playing response time. The above initial values ​​serve as the benchmark for subsequent dynamic calibration.

[0178] The dynamic adjustment factor of the pressing response time is calculated by a specific formula using the pressing response time corresponding to each audio playing of the user and the initial pressing response time. The above factor reflects the difference or fluctuation between the actual pressing response time and the initial value. The dynamic adjustment factor of the sound playing response time is calculated by a specific formula using the sound playing response time corresponding to each audio playing of the user and the initial sound playing response time. The above factor reflects the difference or fluctuation between the actual sound playing response time and the initial value.

[0179] After obtaining the dynamic adjustment factor of the press response time and the dynamic adjustment factor of the sound playback response time, the system will perform real-time dynamic automatic calibration of the press response time and the sound playback response time of the virtual instrument keyboard. This means that the system will dynamically adjust the sensitivity of the virtual instrument keyboard according to the user's real-time playing data to better adapt to the user's playing habits and preferences. The real-time dynamic automatic calibration of the press response time and the sound playback response time of the virtual instrument keyboard is actually the real-time dynamic automatic calibration of the sensitivity of the virtual instrument keyboard. The above calibration method can ensure that the virtual instrument keyboard always maintains the best performance and response speed during the user's playing process.

[0180] The effect of the above technical solution is: through real-time dynamic automatic calibration, the system can ensure that the virtual instrument keyboard always maintains the best performance and response speed during the user's playing process, thereby significantly improving the user's playing experience. This technical solution can dynamically adjust the sensitivity of the virtual instrument keyboard according to the user's real-time playing data, so it has strong adaptability. No matter how the user's playing habits change, the system can respond quickly and make corresponding adjustments. Real-time dynamic automatic calibration can promptly detect and correct deviations or problems that may occur in the virtual instrument keyboard during operation, thereby ensuring the stability and reliability of the system. This technical solution allows the system to perform calibration adjustments according to the user's personalized needs, providing users with a playing experience that is more in line with their personal preferences.

[0181] In one embodiment of the present invention, the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time are used to perform real-time dynamic automatic calibration on the pressing response time and the sound playing response time of the virtual musical instrument keyboard, including:

[0182] S3051, retrieving the dynamic adjustment factor of the pressing response time;

[0183] S3052, using the dynamic adjustment factor of the press response time to perform real-time dynamic automatic calibration on the press response time of the virtual musical instrument keyboard, wherein the press response time after the real-time dynamic automatic calibration is obtained by the following formula:

[0184]

[0185]

[0186] Among them, T ad represents the pressing response time after real-time dynamic automatic calibration; k represents the first adjustment factor; m represents the number of notes contained in the audio playing; T ac represents the press response time after the initial automatic calibration; T j represents the pressing response time corresponding to the jth note; T j-1 represents the pressing response time corresponding to the j-1th note; K d Indicates the dynamic adjustment factor of the press response time;

[0187] S3053, retrieving the sound playing response time dynamic adjustment factor;

[0188] S3054, using the sound playing response time dynamic adjustment factor to perform real-time dynamic automatic calibration on the sound playing response time of the virtual musical instrument keyboard, wherein the sound playing response time after the real-time dynamic automatic calibration is obtained by the following formula:

[0189]

[0190]

[0191] Among them, T yd represents the sound playback response time after real-time dynamic automatic calibration; s represents the second adjustment factor; m represents the number of notes contained in the audio playing; T sj represents the sound playback response time corresponding to the jth note; T sj-1 S represents the sound playback response time corresponding to the j-1th note; d Indicates the dynamic adjustment factor of the sound playback response time; T yc Indicates the sound playback response time after the initial automatic calibration.

[0192] The working principle of the above technical solution is as follows: the system first retrieves the previously calculated dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time. These two factors are calculated based on the user's real-time playing data, reflecting the dynamic changes in the virtual instrument keyboard response time during the user's playing process.

[0193] After obtaining the dynamic adjustment factor of the press response time, the system will automatically calibrate the press response time of the virtual instrument keyboard in real time according to a specific formula. This formula not only takes into account the press response time after the initial automatic calibration, but also introduces the first adjustment factor, the number of notes, the press response time corresponding to each note, and the press response time of the previous note. By comprehensively considering these factors, the system can more accurately calculate the press response time after real-time dynamic automatic calibration.

[0194] Similarly, the system will also perform real-time dynamic automatic calibration of the sound playback response time of the virtual instrument keyboard according to the dynamic adjustment factor of the sound playback response time. The calibration process will also take into account the second adjustment factor, the number of notes, the sound playback response time corresponding to each note, and the sound playback response time of the previous note. The sound playback response time after real-time dynamic automatic calibration is obtained through the calculation system.

[0195] The effect of the above technical solution is: by introducing dynamic adjustment factors and real-time playing data, the technical solution can more accurately reflect the real-time performance of the virtual instrument keyboard during the user's playing process, thereby improving the accuracy of calibration. Real-time dynamic automatic calibration can ensure that the virtual instrument keyboard always maintains the best performance and response speed during the user's playing process, thereby bringing a smoother and more natural playing experience to the user. The technical solution can dynamically adjust the sensitivity of the virtual instrument keyboard according to the user's real-time playing data, so it has strong adaptability. No matter how the user's playing habits change, the system can respond quickly and make corresponding adjustments. Real-time dynamic automatic calibration can promptly detect and correct deviations or problems that may occur in the virtual instrument keyboard during operation, thereby ensuring the stability and reliability of the system. Through real-time dynamic automatic calibration, the system can perform calibration adjustments according to the user's personalized needs, providing the user with a playing experience that is more in line with personal preferences.

[0196] The embodiment of the present invention provides a virtual musical instrument keyboard sensitivity automatic calibration system, such as Figure 2 As shown, the virtual musical instrument keyboard sensitivity automatic calibration system includes: the virtual musical instrument keyboard sensitivity automatic calibration method includes:

[0197] An initialization module, used to initialize the virtual musical instrument keyboard to obtain the initialized virtual musical instrument keyboard; wherein the virtual musical instrument keyboard is used to imitate a piano keyboard;

[0198] An initial calibration module is used to collect in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user, and use the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard;

[0199] The real-time calibration module is used to monitor the real-time operation data information of the virtual musical instrument keyboard during the user's audio playing process, and use the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration on the sensitivity of the virtual musical instrument keyboard.

[0200] The working principle of the above technical solution is as follows: first, the system initializes the virtual instrument keyboard to ensure that the virtual instrument keyboard can normally imitate the basic characteristics of the piano keyboard in the initial state.

[0201] When the user plays a specific calibration audio, the system will collect the operation data information of the virtual instrument keyboard in real time. The above data includes the force, speed, duration of the user's key presses, etc., which are used to analyze the user's playing habits and the initial response state of the virtual instrument keyboard. Then, the system automatically calibrates the sensitivity of the virtual instrument keyboard based on the above data, so that the initial response state of the virtual instrument keyboard is closer to the response characteristics of a real piano keyboard.

[0202] While the user is playing audio, the system will continuously monitor the real-time operation data of the virtual instrument keyboard. The above data includes not only the strength, speed, and duration of the key press, but also the response time of the key press and the response time of the sound playback after the user presses the key. The system will automatically calibrate the sensitivity of the virtual instrument keyboard in real time and dynamically based on the above real-time data and two dynamic adjustment factors (dynamic adjustment factor for the key press response time and dynamic adjustment factor for the sound playback response time). These two dynamic adjustment factors can be dynamically adjusted according to the user's playing habits and needs to achieve precise control of the sensitivity of the virtual instrument keyboard.

[0203] The effect of the above technical solution is: through the automatic calibration of the sensitivity of the virtual instrument keyboard, the response characteristics of the virtual instrument keyboard are made closer to the real piano keyboard, thereby improving the user's comfort and sense of reality during the playing process. The system can monitor the user's playing process in real time, and dynamically adjust the sensitivity of the virtual instrument keyboard in real time according to the user's playing habits and real-time data. The above adjustment method enables the response characteristics of the virtual instrument keyboard to always be consistent with the user's playing needs, improving the adaptability and flexibility of the system. Users can personalize the sensitivity of the virtual instrument keyboard by adjusting the dynamic adjustment factor of the press response time and the dynamic adjustment factor of the sound playback response time according to their own playing habits and needs. The above personalized setting method enables the system to meet the personalized needs of different users and improves the customizability and usability of the system.

[0204] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if the above-mentioned modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include the above-mentioned modifications and variations.

Claims

1. A method for automatically calibrating the sensitivity of a virtual musical instrument keyboard, characterized in that: The virtual musical instrument keyboard sensitivity automatic calibration method comprises: Initialize the virtual musical instrument keyboard to obtain the initialized virtual musical instrument keyboard; Collecting in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after completing the verification, and using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after completing the verification to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; Real-time monitoring of real-time operation data information of a virtual musical instrument keyboard during the user's audio playing process, and real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard using the real-time operation data information of the virtual musical instrument keyboard in combination with a dynamic adjustment factor of a pressing response time and a dynamic adjustment factor of a sound playing response time; The initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user, including: Extracting the pressing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process; Extracting the sound playing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process; Obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard; Obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard; Initial automatic calibration of the sensitivity of the virtual musical instrument keyboard using the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing combined with the pressing response time adjustment factor and the sound playing response time adjustment factor; Obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard includes: Retrieving the pressing response time data corresponding to each note included in the verification audio; The first adjustment coefficient is obtained by using the pressure response time data corresponding to each note; wherein the first adjustment coefficient is obtained by the following formula: in, K 01 represents the first adjustment coefficient; n Indicates the number of notes contained in the calibration audio; T i Indicates i The pressing response time corresponding to each note; T i-1 Indicates i - The pressing response time corresponding to 1 note; The second adjustment coefficient is obtained by using the press response time data and the press response time threshold corresponding to each note in the verification audio; wherein the second adjustment coefficient is obtained by the following formula: in, K 02 represents the second adjustment factor; T y01 Indicates the press response time threshold; The first adjustment coefficient and the second adjustment coefficient are used to obtain a press response time adjustment factor, wherein the press response time adjustment factor is obtained by the following formula: in, K Indicates the compression response time adjustment factor; Obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard includes: Retrieving the sound playing response time data corresponding to each note included in the verification audio; Retrieving the pressing response time data corresponding to each note included in the verification audio; The sound playing response time adjustment factor is obtained by using the sound playing response time data and the pressing response time data corresponding to each note, wherein the sound playing response time adjustment factor is obtained by the following formula: in, S Indicates the sound playback response time adjustment factor; T y02 Indicates the sound playback response time threshold; T si Indicates i The sound playback response time corresponding to each note; S 01 and S 02 represent the third adjustment coefficient and the fourth adjustment coefficient respectively, and the third adjustment coefficient and the fourth adjustment coefficient are obtained by the following formula: 。 2. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard according to claim 1, characterized in that: Initializing the virtual musical instrument keyboard to obtain the initialized virtual musical instrument keyboard includes: Loading the virtual musical instrument keyboard; After the virtual musical instrument keyboard is loaded, the pitch corresponding to the keys included in the virtual musical instrument keyboard is initialized to obtain the virtual musical instrument keyboard after the pitch is initialized and adjusted; An initial threshold configuration is performed on the virtual musical instrument keyboard after the initial pitch adjustment, wherein the initial threshold includes a pressing response time threshold and a sound playing response time threshold.

3. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard according to claim 1, characterized in that: Collecting in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification is completed, and using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user after the verification is completed to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard, including: Retrieve verification audio from the database; Collecting in real time the operation data information of the virtual musical instrument keyboard during the playing of the verification audio; wherein the operation data information includes the pressing response time and the sound playing response time contained in the playing of the verification audio; The operation data information of the virtual musical instrument keyboard corresponding to the audio playing completed by the user is used to perform the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; wherein, the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is the initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard.

4. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard according to claim 1, characterized in that: The initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by using the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing in combination with the pressing response time adjustment factor and the sound playing response time adjustment factor, including: Retrieving the pressing response time adjustment factor and the sound playing response time adjustment factor; The pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing are retrieved to obtain the duration offset parameter; wherein, the duration offset parameter is obtained by the following formula: in, T p Indicates the duration offset parameter; T a and T b They respectively represent the pressing completion time of the verified audio playing and the audio playing completion time corresponding to the verified audio playing; The press response time of the virtual musical instrument keyboard is initially automatically calibrated using the duration offset parameter combined with the press response time adjustment factor to obtain the press response time after the initial automatic calibration; wherein the press response time after the initial automatic calibration is obtained by the following formula: in, T ac Indicates the press response time after the initial automatic calibration; T ae represents the average value of the press response time before calibration; The duration offset parameter is combined with the sound playing response time adjustment factor to obtain an initial automatic calibration of the sound playing response time of the virtual musical instrument keyboard, and the sound playing response time after the initial automatic calibration is obtained; wherein the sound playing response time after the initial automatic calibration is obtained by the following formula: in, T yc Indicates the sound playback response time after initial automatic calibration; T ye Indicates the average value of the sound playback response time before the initial automatic calibration; The initial automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the initial automatic calibration of the sensitivity of the virtual musical instrument keyboard.

5. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard according to claim 1, characterized in that: Real-time monitoring of real-time operation data information of a virtual musical instrument keyboard during the user's audio playing process, and real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard using the real-time operation data information of the virtual musical instrument keyboard combined with a dynamic adjustment factor of a pressing response time and a dynamic adjustment factor of a sound playing response time, including: Real-time collection of the user's corresponding pressing response time and sound playing response time for each audio playing; Using the pressing response time and the sound playing response time after the initial automatic calibration of the virtual musical instrument keyboard sensitivity as the initial pressing response time and the initial sound playing response time; The dynamic adjustment factor of the pressing response time is obtained by using the pressing response time corresponding to each audio playing of the user and the initial pressing response time; wherein the dynamic adjustment factor of the pressing response time is obtained by the following formula: in, K d Indicates the dynamic adjustment factor of the press response time; m Indicates the number of notes contained in the audio performance; T j Indicates j The pressing response time corresponding to each note; The sound playing response time corresponding to each audio playing of the user and the initial sound playing response time are used to obtain the sound playing response time dynamic adjustment factor; wherein the sound playing response time dynamic adjustment factor is obtained by the following formula: in, S d Indicates the dynamic adjustment factor of the sound playback response time; T sj Indicates j The sound playback response time corresponding to each note; Using the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to perform real-time dynamic automatic calibration on the pressing response time and the sound playing response time of the virtual musical instrument keyboard; Among them, the real-time dynamic automatic calibration of the pressing response time and the sound playing response time of the virtual musical instrument keyboard is the real-time dynamic automatic calibration of the sensitivity of the virtual musical instrument keyboard.

6. The method for automatically calibrating the sensitivity of a virtual musical instrument keyboard according to claim 5, characterized in that: The pressing response time and the sound playing response time of the virtual musical instrument keyboard are automatically and dynamically calibrated in real time by using the pressing response time dynamic adjustment factor and the sound playing response time dynamic adjustment factor, including: Retrieving the dynamic adjustment factor of the pressing response time; The press response time of the virtual musical instrument keyboard is automatically and dynamically calibrated in real time using the press response time dynamic adjustment factor, wherein the press response time after the real-time dynamic automatic calibration is obtained by the following formula: in, T ad Indicates the press response time after real-time dynamic automatic calibration; k represents the first adjustment factor; T j-1 Indicates j - The pressing response time corresponding to 1 note; Retrieve the sound playback response time dynamic adjustment factor; The sound playing response time dynamic adjustment factor is used to perform real-time dynamic automatic calibration on the sound playing response time of the virtual musical instrument keyboard, wherein the sound playing response time after the real-time dynamic automatic calibration is obtained by the following formula: in, T yd Indicates the sound playback response time after real-time dynamic automatic calibration; s represents the second regulatory factor; T sj-1 Indicates j -The sound playback response time corresponding to 1 note.

7. A virtual musical instrument keyboard sensitivity automatic calibration system, characterized in that: The virtual musical instrument keyboard sensitivity automatic calibration system comprises: An initialization module, used to initialize the virtual musical instrument keyboard to obtain an initialized virtual musical instrument keyboard; An initial calibration module is used to collect in real time the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user, and use the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user to perform initial automatic calibration of the sensitivity of the virtual musical instrument keyboard; A real-time calibration module is used to monitor the real-time operation data information of the virtual musical instrument keyboard during the user's audio playing process, and use the real-time operation data information of the virtual musical instrument keyboard in combination with the dynamic adjustment factor of the pressing response time and the dynamic adjustment factor of the sound playing response time to automatically calibrate the sensitivity of the virtual musical instrument keyboard in real time and dynamically; The initial automatic calibration of the sensitivity of the virtual musical instrument keyboard is performed by using the operation data information of the virtual musical instrument keyboard corresponding to the audio played by the user, including: Extracting the pressing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process; Extracting the sound playing response time of the virtual musical instrument keyboard corresponding to the verification audio during the playing process; Obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard; Obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard; Initial automatic calibration of the sensitivity of the virtual musical instrument keyboard using the pressing completion time of the verification audio playing and the audio playing completion time corresponding to the verification audio playing combined with the pressing response time adjustment factor and the sound playing response time adjustment factor; Obtaining a pressing response time adjustment factor using the pressing response time of the virtual musical instrument keyboard includes: Retrieving the pressing response time data corresponding to each note included in the verification audio; The first adjustment coefficient is obtained by using the pressure response time data corresponding to each note; wherein the first adjustment coefficient is obtained by the following formula: in, K 01 represents the first adjustment coefficient; n Indicates the number of notes contained in the calibration audio; T i Indicates i The pressing response time corresponding to each note; T i-1 Indicates i - The pressing response time corresponding to 1 note; The second adjustment coefficient is obtained by using the press response time data and the press response time threshold corresponding to each note in the verification audio; wherein the second adjustment coefficient is obtained by the following formula: in, K 02 represents the second adjustment factor; T y01 Indicates the press response time threshold; The first adjustment coefficient and the second adjustment coefficient are used to obtain a press response time adjustment factor, wherein the press response time adjustment factor is obtained by the following formula: in, K Indicates the compression response time adjustment factor; Obtaining a sound playing response time adjustment factor using the sound playing response time of the virtual musical instrument keyboard includes: Retrieving the sound playing response time data corresponding to each note included in the verification audio; Retrieving the pressing response time data corresponding to each note included in the verification audio; The sound playing response time adjustment factor is obtained by using the sound playing response time data and the pressing response time data corresponding to each note, wherein the sound playing response time adjustment factor is obtained by the following formula: in, S Indicates the sound playback response time adjustment factor; T y02 Indicates the sound playback response time threshold; T si Indicates i The sound playback response time corresponding to each note; S 01 and S 02 represent the third adjustment coefficient and the fourth adjustment coefficient respectively, and the third adjustment coefficient and the fourth adjustment coefficient are obtained by the following formula: 。

Images