Immersive system and keyboard correction method applied to immersive system

Abstract

A correction method is applied to a keyboard of an immersive system. The keyboard comprises a plurality of keys. The correction method comprises the following steps: receiving a set touch operation and a set pressing operation corresponding to each key; obtaining a plurality of light-pressing trigger values corresponding to the keys according to a set light-touch operation, and obtaining a plurality of pressing trigger values corresponding to the keys according to a set pressing operation; calculating to obtain a plurality of force difference values according to the light pressure trigger values and the pressing trigger values, and calculating to obtain a fault-tolerant range according to the force difference values; comparing at least one force difference value with a fault-tolerant range, and marking the force difference value outside the fault-tolerant range as a force abnormal value; and adjusting the force abnormal value to be within the fault-tolerant range.

Description

Technical Field

[0001] The invention relates to a calibration method, and in particular to a calibration method for a keyboard applied in an immersive system. Background Art

[0002] Virtual Reality (VR), Augmented Reality (AR) and / or Mixed Reality (MR) devices and systems can provide users with an immersive experience and can be referred to as immersive systems. Immersive systems usually use a head-mounted display (HMD) as a display device for stereoscopic images.

[0003] According to the current usage habits of computer devices, most users are still accustomed to using keyboards as input devices. However, when the user wears a head-mounted display, his field of vision will be obscured by the content displayed by the head-mounted display, making it difficult to confirm the position of the keys on the keyboard. Therefore, the keyboard used in the immersive system usually includes two-stage operation. The first stage of operation is to touch the key, and the head-mounted display can display the characters of the touched key (such as A, B, C, etc.) to guide the user. In other words, a lighter touch operation allows the user to confirm whether the touched key is the same as the key actually wanted to be pressed. The second stage of operation is to press the key, and a heavier press operation can generate an input signal accordingly.

[0004] However, because the touch and press force of different users is different, and even the touch and press force of different fingers of the same user is different, a single factory setting value often leads to misjudgment. For example, a press operation is misjudged as a touch operation, or a touch operation is misjudged as a press operation. The above situations will cause inconvenience to the user's operation, and there is a need for improvement. Summary of the invention

[0005] In view of the above problems, the main purpose of the present invention is to provide a calibration method and an immersive system, by calculating multiple force difference values ​​based on the light pressure trigger value and the press trigger value, and obtaining the fault tolerance range based on the force difference calculation, and then finding and adjusting the abnormal force value, so as to solve the problem that the keyboards used in the immersive system often have misjudgments and cause operational inconveniences.

[0006] To achieve the above-mentioned purpose, the present invention provides a calibration method for a keyboard of an immersive system. The keyboard includes a plurality of keys. The calibration method includes the following steps: obtaining a plurality of light pressure trigger values ​​corresponding to the keys according to a set light touch operation, and obtaining a plurality of press trigger values ​​corresponding to the keys according to a set press operation; receiving a set light touch operation and a set press operation corresponding to each key; calculating and obtaining a plurality of force difference values ​​according to the light pressure trigger values ​​and the press trigger values, and calculating and obtaining a tolerance range according to the force difference values; comparing at least one of the force difference values ​​with the tolerance range, marking the force difference value outside the tolerance range as a force abnormality value; and adjusting the force abnormality value to within the tolerance range.

[0007] To achieve the above-mentioned purpose, the present invention further provides an immersive system, which includes a keyboard and a processor. The keyboard includes a plurality of keys. The processor is electrically connected to the keyboard, and receives set light touch operations and set press operations corresponding to each key. In addition, the processor performs the following steps according to the calibration method: obtaining a plurality of light press trigger values ​​corresponding to the keys according to the set light touch operations, and obtaining a plurality of press trigger values ​​corresponding to the keys according to the set press operations; calculating and obtaining a plurality of force difference values ​​according to the light press trigger values ​​and the press trigger values, and calculating and obtaining a fault tolerance range according to the force difference values; comparing at least one of the force difference values ​​and the fault tolerance range, marking the force difference value outside the fault tolerance range as a force abnormality value; and adjusting the force abnormality value to within the fault tolerance range.

[0008] According to an embodiment of the present invention, the force difference values ​​are respectively the pressing trigger value corresponding to each key minus the light pressing trigger value.

[0009] According to an embodiment of the present invention, the abnormal value of the force is increased or decreased by a correction value to adjust it to within the error tolerance range.

[0010] According to an embodiment of the present invention, the error tolerance range is a range where the average value of the force differences increases by one standard deviation and decreases by one standard deviation.

[0011] According to an embodiment of the present invention, the standard deviation is less than or equal to a preset empirical value. When the standard deviation is greater than the preset empirical value, the preset empirical value is used to replace the standard deviation to obtain a tolerance range.

[0012] According to an embodiment of the present invention, the immersive system further includes a head-mounted display device. The calibration method further includes the following steps: receiving at least one initial tap operation from the keyboard; and when the key corresponding to the initial tap operation is different from the indication key information, the head-mounted display device displays at least one indication direction.

[0013] According to an embodiment of the present invention, the immersive system further includes a head-mounted display device electrically connected to the processor. The processor stores at least one indication key information. When the processor determines that the key corresponding to the initial tap operation is different from the indication key information, the head-mounted display device is controlled to display at least one indication direction.

[0014] According to an embodiment of the present invention, the indication direction is a direction from the key corresponding to the initial light touch operation toward the indication key.

[0015] According to an embodiment of the present invention, the indicated direction is an arrow symbol. The calibration method includes: adjusting the length of the arrow symbol according to the actual distance between the indicated key information and the key corresponding to the initial light touch operation.

[0016] According to an embodiment of the present invention, the indicating direction is an arrow symbol, and the processor adjusts the length of the arrow symbol according to the actual distance between the indicating key information and the key corresponding to the initial light touch operation.

[0017] According to one embodiment of the present invention, the immersive system further includes a user wearable device, a transmitter and a receiver. The transmitter is disposed on the user wearable device. Furthermore, the transmitter includes a plurality of transmitting units, and the transmitting units emit a plurality of distance sensing signals, and the frequencies of the distance sensing signals are different. The receiver is disposed on the keyboard and receives the distance sensing signals. The calibration method further includes: obtaining relative position information of the user wearable device and the keyboard according to the frequency and strength of the distance sensing signals.

[0018] According to an embodiment of the present invention, the receiver receives the distance sensing signals and transmits them to the processor, and the processor obtains the relative position information of the user's wearable device and the keyboard according to the frequency and strength of the distance sensing signals.

[0019] According to an embodiment of the present invention, the receiver includes a plurality of receiving units. The calibration method includes obtaining relative position information between the user's wearable device and the keyboard according to the frequencies and intensities of the distance sensing signals respectively received by the receiving units.

[0020] According to an embodiment of the present invention, the processor obtains the relative position information between the user's wearable device and the keyboard according to the frequencies and intensities of the distance sensing signals respectively received by the receiving units.

[0021] According to an embodiment of the present invention, the transmitting units are symmetrically arranged on the user wearable device, and the receiving units are symmetrically arranged on the keyboard.

[0022] As described above, according to the calibration method and immersive system of the present invention, the calibration method is applied to the keyboard of the immersive system. The calibration method includes calculating a force difference value based on a light pressure trigger value and a press trigger value, and obtaining a fault tolerance range based on the force difference value calculation. In addition, the force difference value outside the fault tolerance range is marked as a force abnormality value, so that the keys that are lightly touched and pressed with similar forces due to insufficient finger strength of the user can be found out first. Then, the force abnormality value is further adjusted to the fault tolerance range to avoid the situation where the processor cannot distinguish and misjudges, so as to achieve the correction effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 FIG. 4 is a schematic diagram of an immersive system according to an embodiment of the present invention.

[0024] Figure 2 FIG. 4 is a flow chart of a calibration method according to an embodiment of the present invention.

[0025] Figure 3 for Figure 1 The processor shown executes Figure 2 The schematic diagram of step S20 is shown.

[0026] Figure 4 for Figure 1 The processor shown executes Figure 2 The schematic diagram of step S30 is shown.

[0027] Figure 5 for Figure 2 Flow chart of the first steps of the calibration method shown.

[0028] Figure 6 for Figure 1 An enlarged schematic diagram of the keyboard and head-mounted display device is shown.

[0029] Figure 7 for Figure 1 Schematic diagram of the display screen of the head-mounted display device shown.

[0030] The following are the descriptions of the reference numerals:

[0031] 1 Immersive System

[0032] 10. Keyboard

[0033] 11 Buttons

[0034] 11a Indicator button

[0035] 20 Processors

[0036] 30 Head-mounted display device

[0037] 40 launchers

[0038] 41, 41a, 41b, 41c, 41d transmitting unit

[0039] 50 Receivers

[0040] 51, 51a, 51b, 51c, 51d, 51e, 51f, 51g, 51h receiving unit

[0041] I indicates direction

[0042] Steps S10 to S71

[0043] T Fault tolerance range

[0044] U User DETAILED DESCRIPTION

[0045] In order to better understand the technical content of the present invention, preferred specific embodiments are described below.

[0046] Figure 1 is a schematic diagram of an immersive system according to an embodiment of the present invention, Figure 2 This is a flow chart of a calibration method according to an embodiment of the present invention. Please refer to Figure 1 and Figure 2 As shown. First, the immersive system 1 of the present embodiment may include systems such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) that provide the user U with an immersive experience. In the present embodiment, the immersive system 1 includes a keyboard 10, a processor 20, and a head-mounted display device 30. Among them, the processor 20 is electrically connected to the keyboard 10 and the head-mounted display device 30 to receive and transmit relevant parameters, signals, or instructions and other data. In addition, the keyboard 10, the processor 20, and the head-mounted display device 30 can be electrically connected to each other by wire or wirelessly, and the present invention is not limited. For example, the keyboard 10 of the present embodiment includes a plurality of keys 11 for the user U to operate. The processor 20 can receive signals generated by the operation of each key 11 from the keyboard 10.

[0047] The keyboard 10 used in the immersive system 1 includes two-stage operation, the first stage operation is to touch the key 11, and the second stage operation is to press the key 11. In this embodiment, the keyboard 10 can use an analog keyboard with a multi-stage trigger function. The optical axis trigger range is analogous to the pressing action stroke (i.e., the stroke of being pressed down), and an output value corresponding to the operation key 11 is generated. It should be noted that the optical axis trigger can also be implemented in other types, and the present case is not limited to this. The processor 20 stores a relationship between the pressing action stroke and the output value, so after receiving the operation corresponding to each key 11 from the keyboard 10 (i.e., receiving the aforementioned output value), it can be judged as a light touch operation or a pressing operation. When the processor 20 determines that it is a touch operation, it can control the head-mounted display device 30 to display the character of the touched key 11, so that the user U can confirm the actual contact with the key 11. When the processor 20 determines that it is a pressing operation, it can generate a corresponding input signal. In order to avoid the situation where the processor 20 may make a wrong judgment due to different finger strengths of the user U, the present invention proposes the following Figure 2 In this embodiment, the processor 20 can store and execute the following correction method: Figure 2 The following is a further description of the actions between the various devices according to the steps of the calibration method.

[0048] Step S10 : receiving a set tap operation and a set press operation corresponding to each button 11 .

[0049] Specifically, before the user U starts to use the keyboard 10, he can first set the light touch operation or the pressing operation for each key 11. For example, the user U can lightly touch and press each key 11 according to his usual habits (i.e., the usual usage force). At this time, the keyboard 10 receives the set light touch operation and the set pressing operation corresponding to each key 11. In other words, the set light touch operation is the light touch operation of the user U on each key 11 during the setting stage. The set pressing operation is the pressing operation of the user U on each key 11 during the setting stage.

[0050] As mentioned above, the keyboard 10 of this embodiment is an analog keyboard with a multi-stage trigger function. When the key 11 is pressed, the optical axis trigger range can be analogized to the pressing stroke, and the corresponding output value is transmitted to the processor 20.

[0051] Step S20 : ​​obtaining a plurality of light-press trigger values ​​corresponding to the button 11 according to the set light-touch operation, and obtaining a plurality of press trigger values ​​corresponding to the button 11 according to the set press operation.

[0052] After receiving the output values ​​of the set light touch operation and the set press operation from the keyboard 10, the processor 20 can further obtain the light press trigger value and the press trigger value corresponding to each key 11. Specifically, the processor 20 can convert the received output values ​​into trigger forces, and the unit of force can be Newton (N). The processor 20 converts the output value obtained by setting the light touch operation into the light press trigger value, and converts the output value obtained by setting the press operation into the press trigger value, such as Figure 3 shown. Figure 3 for Figure 1 The processor shown executes Figure 2 FIG. 1 is a schematic diagram of step S20 shown in FIG. Figure 3 The light-press trigger values ​​and the pressed trigger values ​​of fifteen of the keys 11 are taken as examples.

[0053] In this embodiment, the processor 20 can generate a multi-activation graph according to the light pressure trigger value and the press trigger value. Figure 3 Specifically, the light-touch force curve is formed by connecting the light-touch trigger values ​​of the fifteen keys 11, and the pressing force curve is formed by connecting the pressing trigger values ​​of the fifteen keys 11. The light-touch force curve and the pressing force curve can together form the aforementioned multiple trigger force diagram.

[0054] In the subsequent step S30 , the fault tolerance range can be calculated based on the multiple trigger force diagram.

[0055] Step S30: Calculate and obtain a plurality of force difference values ​​according to the light pressure trigger values ​​and the press trigger values, and calculate and obtain a tolerance range T according to the force difference values.

[0056] First, the processor 20 can calculate and obtain a plurality of force difference values ​​according to the light pressure trigger value and the press trigger value, such as Figure 4 shown. Figure 4 for Figure 1 The processor shown executes Figure 2 Specifically, the processor 20 may subtract the light-press trigger value from the press trigger value of each key 11 to obtain the force difference value of each key 11. Figure 3 Taking the first button 11 as an example, its light press trigger value is about 0.25 Newton (N), and the press trigger value is about 0.6 Newton, so the force difference is about 0.35 Newton. Figure 4 Similarly, the light-press trigger value of the second button 11 is about 0.3 Newtons, and the press trigger value is about 0.625 Newtons, so the force difference is about 0.325 Newtons. And so on, to obtain the force difference of each button 11. In other words, each force difference is the value of the press trigger value corresponding to each button 11 minus the light-press trigger value.

[0057] Since the force applied by the user U during each tapping or pressing operation is not exactly the same, a tolerance range T needs to be set. In other words, the tolerance range T refers to the acceptable force range, or it can also refer to giving the user a similar touch feeling for each key. In this embodiment, the tolerance range is the range of the average value of the force difference values ​​plus one standard deviation and minus one standard deviation. The processor 20 of this embodiment can calculate the mean and variance of all force differences. Among them, Figure 4 The position of the average value is marked with a dotted line. Next, the standard deviation (SD) is obtained by converting the variance. Finally, the range of the average value plus one standard deviation and minus one standard deviation is taken as the fault tolerance range T of this embodiment. Figure 4 As shown, the average value of the force differences in this embodiment is approximately 0.4, and the standard deviation is approximately 0.1, so the tolerance range T is approximately within the range of 0.3 Newton to 0.5 Newton of force difference.

[0058] Preferably, the standard deviation is less than or equal to a preset empirical value. The preset empirical value is an empirical value of the standard deviation, for example, a common standard deviation obtained by referring to past manufacturing experience. Therefore, limiting the standard deviation of the calculated fault tolerance range T to be less than or equal to the preset empirical value can prevent an excessive standard deviation. In addition, when the standard deviation is greater than the preset empirical value, the preset empirical value can be directly used to replace the standard deviation to obtain the fault tolerance range T. In other words, in an embodiment where the standard deviation is greater than the preset empirical value, the fault tolerance range T can be a range that increases by one preset empirical value and decreases by one preset empirical value.

[0059] Step S40: Compare at least one of the force difference values ​​with the error tolerance range to determine whether there is a force difference value outside the error tolerance range.

[0060] Step S41: Mark the strength difference value outside the tolerance range as a strength abnormal value.

[0061] In step S40, the processor 20 may compare the force difference values ​​corresponding to each button 11 with the tolerance range to find out the force difference values ​​outside the tolerance range T. In other words, if there is a force difference value outside the tolerance range T, the processor 20 enters step S41 and marks the force difference value outside the tolerance range T as a force abnormal value. For example, Figure 4 The force difference value of the eleventh key 11 is outside the tolerance range T, and the processor 20 may mark the force difference value of the eleventh key 11 as a force abnormal value. Then, step S50 is performed to adjust the force abnormal value.

[0062] On the contrary, if no force difference value outside the tolerance range T is found in step S40, that is, there is no abnormal force value, there is no need for adjustment, and step S50 does not need to be executed, and the calibration method can be terminated.

[0063] In other embodiments, step S30 and step S40 may also be combined with artificial intelligence algorithms such as machine learning, deep learning, or neural network learning. Specifically, the force abnormal value (i.e., the return value) according to the method of step S30 and step S40 is marked on Figure 3 The multiple trigger force diagram shown. Preferably, the labeled multiple trigger force diagram can also be added with user U's customized labels to form a hybrid learning data set. Then, after the machine learning, deep learning or neural network learning process converges, the fault tolerance range T is found. In this embodiment, the user U can dynamically adjust the fault tolerance range T. In other words, the fault tolerance range T obtained by using the artificial intelligence algorithm includes a specific range customized by the user.

[0064] Step S50: Adjust the abnormal force value to within the tolerance range T.

[0065] In step S50, the processor 20 may adjust the abnormal force value marked in step S40. In this embodiment, the processor 20 may increase or decrease the correction value of the abnormal force value to adjust it to within the error tolerance range T. The correction value may be to adjust all abnormal force values ​​to values ​​within the error tolerance range T. Figure 4 For example, the force abnormal value is the force difference of the eleventh key 11, which is about 0.225 Newtons. The lower limit of the fault tolerance range T is about 0.3 Newtons, so the correction value can be a value greater than 0.075 Newtons. For example, the correction value of this embodiment can be 0.1 Newton. In other embodiments, if there are multiple force abnormal values, the force abnormal value with the largest difference from the upper limit or lower limit of the fault tolerance range T can be found first, and the correction value can be calculated based on it.

[0066] In this embodiment, the processor 20 increases the force abnormal value by the correction value to adjust it to within the error tolerance range T. For example, 0.225 Newtons (force abnormal value) plus 0.1 Newtons (correction value) is 0.325 Newtons, which is within the error tolerance range T of 0.3 Newtons to 0.5 Newtons. In other embodiments, if the force abnormal value is greater than the upper limit of the error tolerance range, the processor 20 may subtract the correction value from the force abnormal value to adjust it to within the error tolerance range T.

[0067] In this embodiment, the force difference is used to calculate the tolerance range T (such as step S30), and the force difference in the tolerance range T is marked as the force abnormal value (such as step S40), so that the key 11 that is touched and pressed with similar force due to insufficient finger strength of the user U can be found first. Subsequently, the force abnormal value is adjusted to the tolerance range T, so as to avoid the situation where the processor 20 cannot distinguish and misjudge, so as to achieve the correction effect.

[0068] Preferably, after step S50 is completed, the method can return to step S10 to repeatedly verify the light-press trigger value and the press trigger value of each key 11 until the force difference values ​​of all keys 11 are within the tolerance range T. In other words, until step S40 is determined that there is no force difference value outside the tolerance range, the calibration method can be terminated.

[0069] Figure 5 for Figure 2 The flowchart of the latter steps of the correction method shown in FIG. Figure 6 for Figure 1 For an enlarged schematic diagram of the keyboard and head mounted display device shown, please refer to Figure 1 , Figure 5 and Figure 6 After completing the setting of the touch operation and the press operation of the keys 11 of the keyboard 10 (i.e., step S10 to step S50), when the user U formally uses the keyboard 10 and the head-mounted display device 30, because the visual field will be blocked by the head-mounted display device 30, a method for assisting in finding the positions of the keyboard 10 and the keys 11 is also required. Preferably, the calibration method of this embodiment also includes steps S60 and S61 for finding the keyboard 10, and steps S70 and S71 for indicating the positions of the keys 11.

[0070] The immersive system 1 of the present embodiment may further include a user wearable device, a transmitter 40 and a receiver 50. Among them, the user wearable device of the present embodiment may be a head-mounted display device 30, so no additional number is given. In other embodiments, the user wearable device may also be a wearable device such as a smart watch, a smart bracelet, a smart necklace, a smart ring, etc. The transmitter 40 and the receiver 50 of the present embodiment are respectively a transmitter 40 and a receiver 50 that can transmit and receive distance sensing signals. Among them, the distance sensing signal may be, for example, but not limited to, ultrasonic waves, infrared rays, and lasers. The distance sensing signal of the present embodiment takes ultrasonic waves as an example, and correspondingly, the transmitter 40 and the receiver 50 are ultrasonic transmitters and ultrasonic receivers, respectively.

[0071] Furthermore, the transmitter 40 includes a plurality of transmitting units 41, and is disposed on the head mounted display device 30 (i.e., the user's wearable device). The transmitting units 41 are disposed at different positions of the head mounted display device 30 (i.e., the user's wearable device). Preferably, the transmitting units 41 are symmetrically disposed on the head mounted display device 30 (i.e., the user's wearable device). Figure 6 As shown, the transmitter 40 of the present embodiment includes four transmitting units 41, such as transmitting units 41a, 41b, 41c, and 41d. Preferably, the four transmitting units 41a, 41b, 41c, and 41d of the present embodiment are respectively disposed on the left side, right side, front side, and rear side of the head mounted display device 30. In other words, the transmitting units 41a, 41b, 41c, and 41d are 90 degrees apart and disposed on the left side, right side, front side, and rear side of the head mounted display device 30. Moreover, the frequencies of the distance sensing signals (such as ultrasonic waves) emitted by each transmitting unit 41a, 41b, 41c, and 41d are different from each other. In other words, a plurality of transmitting units 41 (i.e., transmitting units 41a, 41b, 41c, and 41d) can emit a plurality of distance sensing signals, and the frequencies of the distance sensing signals are different from each other. In addition, the receiver 50 is disposed on the keyboard 10 and can receive the distance sensing signals.

[0072] When the user U wears the head mounted display device 30, his / her field of vision will be blocked by the content displayed on the head mounted display device 30, and it is difficult to confirm the position of the keyboard 10. The transmitter 40 and the receiver 50 are respectively disposed on the head mounted display device 30 (i.e., the user's wearable device) and the keyboard 10, and the processor 20 executes step S60 to find the relative position of the keyboard 10 and the head mounted display device 30.

[0073] Step S60 : obtaining relative position information of the head mounted display device 30 (ie, the device worn by the user) and the keyboard 10 according to the frequency and strength of the distance sensing signal.

[0074] Specifically, the receiver 50 can receive the distance sensing signal sent by the transmitting unit 41 and transmit it to the processor 20. Since the transmitting units 41a, 41b, 41c, and 41d are disposed at different positions of the head mounted display device 30 and the frequencies of the distance sensing signals sent are different, the processor 20 can obtain the relative position information of the head mounted display device 30 (i.e., the user's wearable device) and the keyboard 10 according to the frequency and strength of the received distance sensing signal. Figure 6For example, the transmitting units 41a and 41c located on the left and front sides of the head mounted display device 30 are closer to the keyboard 10, so the strength of the received distance sensing signal is stronger, so the relative position of the head mounted display device 30 and the keyboard 10 can be known through the distance sensing signals of different frequencies. In addition, the distance sensing signal can also be used to detect the characteristics of the distance to calculate the distance between the transmitter 40 and the receiver 50. Therefore, the processor 20 can determine that the transmitting units 41a and 41c on the left and front sides are closer to the keyboard 10 through the frequency and strength of the received distance sensing signal, and then obtain the relative position information (such as distance and azimuth angle) of the head mounted display device 30 and the keyboard 10. At the same time, the relative position of the user U and the keyboard 10 can be known.

[0075] Preferably, the receiver 50 also includes a plurality of receiving units 51, and the receiving units 51 are disposed at different positions of the keyboard 10. Preferably, the receiving units 51 are symmetrically disposed on the keyboard 10, such as Figure 6 As shown. Each receiving unit 51 can receive the distance sensing signal sent by the transmitting unit 41 respectively. The processor 20 can obtain the relative position information of the head-mounted display device 30 (user wearable device) and the keyboard 10 more accurately according to the frequency and strength of the distance sensing signal received by each receiving unit 51. For example, the receiver 50 of this embodiment may include eight receiving units 51a, 51b, 51c, 51d, 51e, 51f, 51g, and 51h, which are arranged on the keyboard 10 at a distance of 45 degrees. The distance sensing signal strength received by the receiving units 51c and 51d from the transmitting units 41a and 41c is stronger, and it can be known that the left side and the front side of the head-mounted display device 30 are closer to the upper side and the right side of the receiver 50.

[0076] Since the transmitting unit 41 of this embodiment is symmetrically arranged on the head-mounted display device 30 (i.e., the user's wearable device), and the receiving unit 51 is symmetrically arranged on the keyboard 10, the processor 20 can accurately obtain the relative azimuth angle of the head-mounted display device 30 and the keyboard 10. Preferably, a neural network learning algorithm can be used in combination to generate a predicted guidance indication, that is, to predict the angle of the head-mounted display device 30 (i.e., the user's wearable device). Specifically, the receiving unit 51 is symmetrically arranged on the keyboard 10, so that the range of the receiver 50 receiving the distance sensing signal can reach 360 degrees. Therefore, each fixed degree (for example, 2 degrees or 3 degrees) can be made into a learning data set, which includes the position information of each transmitting unit 41 and its corresponding distance sensing signal strength. Among them, the received distance sensing signal strength value is the input element, and the angle is the learning target. After the data of the learning data set is normalized, it is learned and converged by neural network learning. Subsequently, the angle prediction module can accurately obtain the azimuth angle of the head-mounted display device 30 (i.e., the device worn by the user), or even the XY axis coordinates of the head-mounted display device 30.

[0077] Step S61: the head mounted display device 30 displays a keyboard position indication.

[0078] Next, the processor 20 may generate a keyboard position indication according to the relative position information obtained in step S60 , and control the head mounted display device 30 to display the keyboard position indication.

[0079] Preferably, the calibration method of this embodiment further includes steps S70 and S71 for indicating the position of the key 11. As mentioned above, when the user U wears the head mounted display device 30, his / her field of vision will be blocked by the content displayed by the head mounted display device 30, and thus he / she cannot confirm which key 11 is touched. Generally speaking, among the multiple keys 11 of the keyboard 10, two keys 11 have convex points, and the most common ones are the keys 11 of the characters F and G. In this embodiment, such a key 11 with a convex point is referred to as an indication key 11a, such as Figure 6 The indication key 11a is used for the user U to know the position of the indication key 11a by touching the convex point without looking down at the keyboard 10, and the user U can know the positions of other keys 11 through the operation experience. In this embodiment, the processor 20 executes steps S70 and S71 to guide the user U to the position of the indication key 11a.

[0080] Step S70 : receiving at least one initial tap operation from the keyboard 10 .

[0081] After the user U finds the location of the keyboard 10 (i.e., as directed by steps S60 and S61), he can touch any key 11 on the keyboard 10, which is referred to as the initial touch operation. The processor 20 of this embodiment stores at least one indication key information, which includes relevant information of the indication key 11a, such as the scan code corresponding to the indication key 11a. After receiving the initial touch operation, the keyboard 10 transmits a signal to the processor 20. In this embodiment, the keyboard 10 can receive multiple initial touch operations. For example, the user U touches two keys 11 with the index fingers of both hands respectively, and there are two initial touch operations.

[0082] Step S71: When the button 11 corresponding to the initial tap operation is different from the indication button information, the head mounted display device 30 displays at least one indication direction I.

[0083] The processor 20 receives a signal corresponding to the initial tap operation from the keyboard 10 (step S70), the signal including the scan code information corresponding to the operated key 11. Then, the processor 20 determines whether the scan code information of the signal is the same as the indicated key information.

[0084] When the processor 20 determines that the key 11 corresponding to the initial light touch operation is different from the indication key information, that is, when the scan code of the key 11 after the initial light touch operation is different from the scan code of the indication key 11a, the processor 20 can control the head mounted display device 30 to display at least one indication direction I, such as Figure 7 shown. Figure 7 for Figure 1 Schematic diagram of the display screen of the head mounted display device 30 shown in FIG. Specifically, the processor 20 can obtain the position of the lightly touched key 11 according to the signal of the initial light touch operation, and can further obtain the relative position of the lightly touched key 11 and the indication key 11a, and then generate the indication direction I from the key 11 to the indication key 11a. In other words, the indication direction I refers to the direction from the key 11 corresponding to the initial light touch operation to the indication key 11a. In this embodiment, two initial light touch operations are taken as an example, so the head mounted display device 30 displays two indication directions I, which respectively guide the moving directions of the index fingers of the user U.

[0085] Furthermore, the processor 20 may control the head mounted display device 30 to display a symbol indicating the direction I. In the present embodiment, the indicating direction I is an arrow symbol, and the arrow direction is toward the indicating button 11a, so as to guide the position of the indicating button 11a. In other embodiments, the indicating direction I may also be a triangle symbol, or other symbols with a sharp point or a convex portion, and the sharp point or the convex portion is toward the indicating button 11a, so as to achieve the same indicating effect. Therefore, after the user U sees the symbol indicating the direction I, he may move his finger according to the indicating direction I, and then find the position of the indicating button 11a. For example, the user U sees Figure 7 After the two indicating directions I are shown, the right index finger can be moved toward the upper right, and the left index finger can be moved toward the upper left.

[0086] Preferably, the processor 20 can also adjust the length of the arrow symbol (i.e., the indicating direction I) according to the actual distance between the indicating key information and the key 11 corresponding to the initial light touch operation. Specifically, after the processor 20 obtains the relative position of the lightly touched key 11 and the indicating key 11a, it can simultaneously know the actual distance between the lightly touched key 11 and the indicating key 11a, and can adjust the length of the arrow symbol according to the actual distance. For example, the width of a key 11 can be set to display a 1 cm arrow symbol. If the lightly touched key 11 and the indicating key 11a are two keys 11 apart, a 2 cm arrow symbol can be displayed. Therefore, after the user U sees the arrow symbol indicating the direction I, in addition to knowing in which direction the finger should move, he can also know the approximate moving distance. When the user U finds the position of the indicating key 11a, he can use his own operating experience to know the relative positions of other keys 11.

[0087] In summary, according to the calibration method and immersive system of the present invention, the calibration method is applied to the keyboard of the immersive system. The calibration method includes calculating a force difference value based on a light pressure trigger value and a press trigger value, and obtaining a fault tolerance range based on the force difference value calculation. In addition, the force difference value outside the fault tolerance range is marked as a force abnormality value, so that the keys that are lightly touched and pressed with similar forces due to insufficient finger strength of the user can be found out first. Then, the force abnormality value is further adjusted to the fault tolerance range to avoid the situation where the processor cannot distinguish and misjudges, so as to achieve the correction effect.

[0088] It should be noted that the above embodiments are examples for the convenience of description, and the scope of rights claimed by the present invention should be based on the claims, but not limited to the above embodiments.

Claims

1. A calibration method, characterized in that: A keyboard applied to an immersive system, the keyboard comprising a plurality of keys, the calibration method comprising the following steps: receiving a set light touch operation and a set press operation corresponding to each of the keys; Acquire multiple light-press trigger values ​​corresponding to the multiple buttons according to the set light-touch operation, and acquire multiple press trigger values ​​corresponding to the multiple buttons according to the set press operation; Calculating a plurality of force difference values ​​according to the plurality of light pressure trigger values ​​and the plurality of press trigger values, and calculating a tolerance range according to the plurality of force difference values; Compare at least one of the strength difference values ​​with the error tolerance range, and mark the strength difference value outside the error tolerance range as an abnormal strength value; and The force abnormal value is adjusted to be within the error tolerance range.

2. The calibration method according to claim 1, characterized in that: The plurality of force difference values ​​are respectively the pressing trigger value corresponding to each of the keys minus the light pressing trigger value.

3. The calibration method according to claim 1, characterized in that: The force abnormality value increases or decreases the correction value to adjust it to within the error tolerance range.

4. The calibration method according to claim 1, wherein: The tolerance range is a range where the average value of the plurality of force differences is increased by one standard deviation and decreased by one standard deviation.

5. The calibration method according to claim 4, characterized in that: The standard deviation is less than or equal to a preset empirical value. When the standard deviation is greater than the preset empirical value, the preset empirical value is used to replace the standard deviation to obtain the error tolerance range.

6. The calibration method according to claim 1, characterized in that: The immersive system further includes a head mounted display device, and the calibration method further includes the following steps: Receiving at least one initial tap operation from the keyboard; and When the button corresponding to the initial tap operation is different from the indication button information, the head mounted display device displays at least one indication direction.

7. The calibration method according to claim 6, characterized in that: The indication direction is a direction from the button corresponding to the initial light touch operation toward the indication button.

8. The calibration method according to claim 6, characterized in that: The indicated direction is an arrow symbol, and the correction method includes: adjusting the length of the arrow symbol according to the actual distance between the indicated key information and the key corresponding to the initial light touch operation.

9. The calibration method according to claim 1, characterized in that: The immersive system also includes a user wearable device, a transmitter and a receiver. The transmitter is arranged on the user wearable device, and the transmitter includes multiple transmitting units. The multiple transmitting units send out multiple distance sensing signals, and the frequencies of the multiple distance sensing signals are different. The receiver is arranged on the keyboard and receives the multiple distance sensing signals. The calibration method also includes: obtaining the relative position information of the user wearable device and the keyboard based on the frequencies and intensities of the multiple distance sensing signals.

10. The calibration method according to claim 9, characterized in that: The receiver includes a plurality of receiving units, and the calibration method includes: obtaining relative position information between the user's wearable device and the keyboard according to the frequencies and intensities of the plurality of distance sensing signals respectively received by the plurality of receiving units.

11. The calibration method according to claim 10, characterized in that: The multiple transmitting units are symmetrically arranged on the user wearable device, and the multiple receiving units are symmetrically arranged on the keyboard.

12. An immersive system, characterized in that: include: a keyboard, including a plurality of keys; as well as The processor is electrically connected to the keyboard, receives the set light touch operation and the set press operation corresponding to each of the keys, and performs the following steps according to the calibration method: Acquire multiple light-press trigger values ​​corresponding to the multiple buttons according to the set light-touch operation, and acquire multiple press trigger values ​​corresponding to the multiple buttons according to the set press operation; Calculating a plurality of force difference values ​​according to the plurality of light pressure trigger values ​​and the plurality of press trigger values, and calculating a tolerance range according to the plurality of force difference values; Compare at least one of the strength difference values ​​with the error tolerance range, and mark the strength difference value outside the error tolerance range as an abnormal strength value; and The force abnormal value is adjusted to be within the error tolerance range.

13. The immersive system according to claim 12, wherein: The plurality of force difference values ​​are respectively the pressing trigger value corresponding to each of the keys minus the light pressing trigger value.

14. The immersive system according to claim 12, wherein: The force abnormality value increases or decreases the correction value to adjust it to within the error tolerance range.

15. The immersive system according to claim 12, wherein: The tolerance range is a range where the average value of the plurality of force differences is increased by one standard deviation and decreased by one standard deviation.

16. The immersive system according to claim 15, characterized in that: The standard deviation is less than or equal to a preset empirical value. When the standard deviation is greater than the preset empirical value, the preset empirical value is used to replace the standard deviation.

17. The immersive system of claim 12, wherein: Also includes: A head-mounted display device is electrically connected to the processor, the processor stores at least one indication button information, the keyboard receives at least one starting light touch operation, and when the processor determines that the button corresponding to the starting light touch operation is different from the indication button information, the head-mounted display device is controlled to display at least one indication direction.

18. The immersive system of claim 17, wherein: The indication direction is a direction from the button corresponding to the initial light touch operation toward the indication button.

19. The immersive system of claim 17, wherein: The indication direction is an arrow symbol, and the processor adjusts the length of the arrow symbol according to the actual distance between the indication key information and the key corresponding to the initial light touch operation.

20. The immersive system of claim 12, wherein: Also includes: The user wears the device; A transmitter, disposed on the user wearable device, the transmitter comprising a plurality of transmitting units, the plurality of transmitting units transmitting a plurality of distance sensing signals, the frequencies of the plurality of distance sensing signals being different; and A receiver is disposed on the keyboard. The receiver receives the multiple distance sensing signals and transmits them to the processor. The processor obtains the relative position information of the user's wearable device and the keyboard according to the frequency and strength of the multiple distance sensing signals.

21. The immersive system of claim 20, wherein: The receiver includes a plurality of receiving units, and the processor obtains the relative position information of the user's wearable device and the keyboard according to the frequencies and intensities of the plurality of distance sensing signals respectively received by the plurality of receiving units.

22. The immersive system of claim 21, wherein: The multiple transmitting units are symmetrically arranged on the user wearable device, and the multiple receiving units are symmetrically arranged on the keyboard.

Images