Handle operation method and device, electronic equipment and storage medium

Abstract

The invention discloses a handle operation method and device, electronic equipment and a storage medium, and relates to the technical field of virtual reality, the handle operation method is applied to a VR handle, the VR handle comprises an operation module, and the operation module is provided with an operation sensor. The handle operation method comprises the following steps that at least one piece of first force test data is collected through the operation sensor; and determining an operation triggering range of the operation module according to the first force test data. The technical problem that the use performance of a VR handle in the prior art is poor is solved.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a handle operation method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of virtual reality technology, VR (Virtual Reality) products are being used more and more widely. VR devices usually include head-mounted display devices and control handles. When users experience VR devices, they wear head-mounted displays on their heads and hold control handles in their hands to operate. Conventional VR handles are designed according to the usage habits of young and middle-aged people. For children, users with small hands or less strength, when operating the handles, there may be situations where the user's operations cannot trigger the handle operation. For users who need to use VR devices for rehabilitation training, it may be difficult to complete the training in the early stages of recovery, and in the later stages of recovery, the training effect may be poor because the training movements are too easy to complete, resulting in reduced performance of the VR handles. Summary of the invention

[0003] The main purpose of this application is to provide a handle operation method, device, electronic device and storage medium, aiming to solve the technical problem of poor performance of VR handles in the prior art.

[0004] To achieve the above object, the present application provides a handle operation method, which is applied to a VR handle, wherein the VR handle includes an operation module, and an operation sensor is provided on the operation module. The handle operation method includes the following steps:

[0005] Collect at least one first force test data through the operation sensor;

[0006] An operation triggering range of the operation module is determined according to each of the first force test data.

[0007] The present application also provides a handle operating device, which is applied to a VR handle. The VR handle includes an operating module, and an operating sensor is provided on the operating module. The handle operating device includes:

[0008] A collection module, used for collecting at least one first force test data through the operation sensor;

[0009] A determination module is used to determine the operation trigger range of the operation module according to each of the first force test data.

[0010] The present application also provides an electronic device, which is a physical device, and includes: a memory, a processor, and a program of the handle operation method stored in the memory and executable on the processor. When the program of the handle operation method is executed by the processor, the steps of the handle operation method as described above can be implemented.

[0011] The present application also provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores a program for implementing a handle operation method. When the program of the handle operation method is executed by a processor, the steps of the handle operation method as described above are implemented.

[0012] The present application provides a handle operation method, device, electronic device and storage medium, the handle operation method is applied to a VR handle, the VR handle includes an operation module, the operation module is provided with an operation sensor, and at least one first force test data is collected by the operation sensor provided on the operation module of the VR handle, so as to realize the force test of the user operation based on the operation module, and then the operation trigger range of the operation module is determined according to each of the first force test data, so as to realize the adaptive adjustment of the operation trigger range of the operation module. In this way, the operation trigger range of the operation module can be adapted to the force that the user can apply to the operation module. When the force that the user can apply to the operation module is small, the operation trigger range of the operation module is reduced, so that the small force applied by the user to the operation module can also trigger the operation module, reducing the probability of the operation module missing triggering, so that when the user uses the VR handle, there is no need to deliberately increase the force to trigger the operation module, but to be more involved in the VR experience, thereby improving the use fluency of the VR handle and improving the user experience; and when the force that the user can apply to the operation module is large, the operation trigger range of the operation module is increased, so that the user needs to apply more force to the operation module to trigger the operation module, and in the later stage of recovery of rehabilitation training using VR equipment, better training effect can be achieved. Therefore, the technical defect that the design of conventional VR handles is designed according to the usage habits of young and middle-aged people is overcome. For children, users with small hands or less strength, when operating the handle, there may be a situation where the operation made by the user cannot trigger the handle operation. For users who need to use VR equipment for rehabilitation training, it may be difficult to complete the training in the early stage of recovery, and in the later stage of recovery, the training effect may be poor because it is too easy to complete the training, resulting in poor performance of the VR handle. This allows the VR handle to adapt to the needs of different scenes and different groups of people, thereby improving the performance of the VR handle. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0014] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0015] Figure 1 This is a flow chart of the first embodiment of the handle operation method in this application;

[0016] Figure 2 This is a schematic diagram of a possible implementation method of the VR handle in this application;

[0017] Figure 3 This is a flow chart of a second embodiment of the handle operation method in this application;

[0018] Figure 4 This is a flow chart of a third embodiment of the handle operation method in this application;

[0019] Figure 5 It is a structural schematic diagram of an embodiment of a handle operating device in the present application;

[0020] Figure 6 This is a schematic diagram of the device structure of the hardware operating environment involved in the handle operation method in the embodiment of the present application.

[0021] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0022] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0023] Embodiment 1

[0024] The present application provides a handle operation method. In the first embodiment of the handle operation method of the present application, refer to Figure 1 The handle operation method is applied to a VR handle, the VR handle includes an operation module, an operation sensor is provided on the operation module, and the handle operation method includes the following steps:

[0025] Step S10, collecting at least one first force test data through the operation sensor;

[0026] The execution subject of the method of this embodiment can be a handle operation device, or it can be a handle operation terminal device or server. This embodiment takes the handle operation device as an example. The handle operation device can be integrated into a terminal device such as a VR device with data processing function, a VR handle, a smart phone, a tablet computer, a computer, etc.

[0027] Since different people may have different hand strengths in different states, it is usually difficult to adapt to the actual needs of different groups of people and different scenarios by designing according to the usage habits of young and middle-aged people and determining a fixed operation trigger adjustment. For example, for users with smaller hands, when operating the handle, the operation module that is far away from the finger may just be able to be touched, and it may not be possible to apply as much force as the young and middle-aged people when applying force, resulting in the user operating the operation module, but this user operation cannot trigger the operation module to output the operation instruction because it cannot meet the trigger condition. For another example, for users who have injured their hands and use VR equipment for rehabilitation training, they have less strength in the early stage of recovery, and may experience overload training, or even cause the hand to be injured again. In the later stage of recovery, it may be easier to complete the training action, resulting in the failure to achieve the training effect. Therefore, in this embodiment, before using the VR handle for VR experience, a strength test can be performed to determine the operation trigger range of the operation module that matches the user's strength, so that the VR handle can adapt to the actual needs of different groups of people and different scenarios.

[0028] In this embodiment, it should be noted that the handle operation method is applied to a VR handle, which refers to a control handle of a VR device. The VR handle is provided with one or more operation modules, which refer to modules that accept user operations and convert user operations into corresponding control instructions, including buttons, joysticks, grips, etc. Each operation module may be provided with one or more operation sensors, which refer to detection devices that can sense the operation information acting on the operation module and can transform the sensed operation information into electrical signals or other required forms of information output according to certain rules to meet the requirements of information transmission, processing, storage, display, recording and control, including pressure sensors, inertial sensors, resistive strain sensors, etc.

[0029] The first force test data refers to the data of the force applied by the user to the operating module during the force test and collected by the operating sensor on the operating module, wherein the force test refers to the test process in which the user makes corresponding actions according to the force test instructions, and the force test instructions refer to the instructions for making one or more actions required during the force test. The force test instructions should enable the user to trigger each operating sensor of each operating module on the VR handle multiple times. It can be specifically designed according to actual needs. This embodiment is not limited to this. It can be in the form of text, pictures, videos, etc. For example, it can be multiple videos, and a video is played each time for the user to make corresponding actions following the video, and detect whether the user has completed the action. After the user completes the action of the currently playing video, the next video is played until the user completes all video actions. It is easy to understand that during the force test process, the user may apply force to the operating module multiple times. In this case, the force data generated by each force application can be used as the first force test data.

[0030] Illustratively, before using a VR controller for a VR experience, for example, when it is sensed that a user is holding the VR controller, when a user uses the VR controller to connect a VR device, when a user enters the VR game main page but has not yet started the game, etc., a strength test guide may be output through a head-mounted display device or other display device connected to the VR device to guide the user to perform corresponding actions according to the strength test guide. During the strength test process, one or more first strength test data may be collected through the operation sensor.

[0031] Optionally, the operation module includes a pressing operation module, and the operation sensor includes a second pressure sensor;

[0032] And / or, the operation module includes a joystick operation module, and the operation sensor includes a second inertial sensor.

[0033] In this embodiment, the operation module may include a pressing operation module and / or a rocker operation module. When the operation module is a pressing operation module, the operation sensor provided on the pressing operation module is a second pressure sensor, and the second pressure sensor can detect the pressure when the user presses the pressing operation module. In this case, the first force test data may be pressure test data; when the operation module is a rocker operation module, the operation sensor provided on the rocker operation module is a second inertial sensor, and the second inertial sensor can detect the acceleration of the rocker when the user moves the rocker operation module, and then the user's moving force can be calculated based on the acceleration. In this case, the first force test data may be acceleration test data or moving force test data.

[0034] In one practicable manner, the operation module may further include a handle operation module. When the operation module is a handle operation module, the operation sensor provided on the handle operation module is a first pressure sensor, and the first pressure sensor may detect the grip force of the user when holding the handle operation module.

[0035] In this embodiment, since the VR handle cannot be completely fixed to the user's hand, if the user performs a large-scale movement at a high speed while holding the VR handle, it is possible that the VR handle will be out of hand. For example, if the user holds the VR handle to play a table tennis game, if a ball needs to be drawn, the action of drawing the ball requires the user to quickly swing the VR handle. For users with weak grip or small hands, the VR handle is likely to be thrown out of the user's hand along with the action of drawing the ball. Therefore, a first pressure sensor can be set on the grip part of the VR handle to detect the user's grip, and the user's grip range can be further determined. After determining the user's grip range, the detected grip range can be sent to the VR game end, so that the VR game end can adaptively adjust the game rhythm based on the grip range; after determining the user's grip range, the operation instructions output by the VR handle can also be adjusted, so that when the user gently or slowly swings the VR handle, the VR handle can also output an operation instruction to swing the VR handle with greater force or faster speed. Thereby, the speed or strength of the user swinging the VR handle can be slowed down, thereby reducing the probability of the VR handle being out of hand.

[0036] Step S20: determining the operation triggering range of the operation module according to each of the first force test data.

[0037] In this embodiment, it should be noted that the operation trigger range refers to the range of the trigger operation module to output the operation instruction. Therefore, when multiple operation modules are arranged on the VR handle, the operation trigger range of each corresponding operation module should be adjusted according to the first force test data collected by the operation sensor on each operation module. For example, the VR handle includes an operation module M1 and an operation module M2, and the operation module M1 includes an operation sensor S1, and the operation module M2 includes an operation sensor S2. In this case, during the force test process, the first force test data N1 can be collected through S1, and the first force test data N2 can be collected through S2. Then, the operation trigger range of M1 can be adjusted according to N1, and the operation trigger range of M2 can be adjusted according to N2.

[0038] Exemplarily, by performing data analysis on each of the first force test data, the operation trigger range of the operation module is determined, wherein the lower limit of the operation trigger range is positively correlated with the minimum value of each of the first force test data, and the upper limit of the operation trigger range is positively correlated with the maximum value of each of the first force test data, that is, the greater the user's strength, the greater the value of the operation trigger range, and the smaller the user's strength, the smaller the value of the operation trigger range. Among them, the method of determining the operation trigger range of the operation module by performing data analysis on each of the first force test data can be to determine the minimum force value in the first force test data as the minimum value of the target operation trigger range, and the maximum force value in the first force test data can also be determined as the maximum value of the target operation trigger range, or each of the first force test data can be statistically analyzed, and according to the statistical analysis results, the error range is compensated or not compensated, and the target operation trigger range is obtained. For example, by removing the data with a large deviation in each of the first force test data through statistical analysis, the remaining data belongs to the range of A1~A2. Considering the operation error, 90%A1~110%A2 can be determined as the target operation trigger range.

[0039] Optionally, after the step of determining the operation trigger range of the operation module according to each of the first force test data, the method further includes:

[0040] Step S30, collecting force data through the operation sensor;

[0041] For example, after completing the strength test, when the user holds the VR handle to experience VR, if the user applies force to the operation module, the force data applied by the user to the operation module can be collected through the operation sensor set on the VR handle.

[0042] Step S40: when it is detected that the force data is within the operation triggering range, outputting an operation instruction through the operation module.

[0043] Exemplarily, after each force data is collected by the operation sensor, the force data is compared with the operation trigger range to determine whether the force data is within the operation trigger range. When it is detected that the force data is within the operation trigger range, the corresponding operation instruction is output through the operation module. When it is detected that the force data is not within the operation trigger range, it can be considered as a false touch, and therefore there is no need to output an operation instruction.

[0044] Optionally, the VR handle includes a fingerprint recognition module, and the handle operation method further includes:

[0045] Step A10, collecting first fingerprint information through the fingerprint recognition module;

[0046] In this embodiment, it should be noted that the VR handle can be used by multiple different people. For example, several friends can take turns holding the VR handle to play games, and different patients can use the same handle for rehabilitation training. Different people have different strengths. When people of different strengths use the same VR handle, different operation trigger ranges need to be matched for different people. Therefore, this embodiment adds a fingerprint recognition module to the VR handle, and can store and match different operation trigger ranges for different users by detecting the fingerprint of the user holding the VR handle.

[0047] Exemplarily, after the user holds the VR handle, before the strength test, during the strength test, or after the strength test, when the user touches the fingerprint recognition module intentionally or unintentionally, the first fingerprint information of the user performing the strength test can be collected through the fingerprint recognition module, or the user can be reminded to enter the fingerprint by outputting a prompt message, and then after outputting the prompt message, the first fingerprint information of the user performing the strength test can be collected through the fingerprint recognition module.

[0048] After the step of determining the operation trigger range of the operation module according to each of the first force test data, the method further includes:

[0049] Step A20: establishing a corresponding relationship between the operation trigger range and the first fingerprint information.

[0050] Exemplarily, after the operation trigger range of the operation module is determined through a strength test, a correspondence between the operation trigger range and the first fingerprint information is established, and the first fingerprint information of the user who performs the strength test is collected and associated with the operation trigger range determined by the strength test. The correspondence between the operation trigger range and the first fingerprint information can be further stored so that the user can call the corresponding operation trigger range according to the fingerprint information during the VR experience.

[0051] Optionally, the VR handle includes a fingerprint recognition module, and before the step of outputting an operation instruction through the operation module when the force data is detected to be within the operation trigger range, the step further includes:

[0052] Step A30, collecting second fingerprint information through the fingerprint recognition module;

[0053] For example, when a user holds a VR handle to experience VR, the second fingerprint information of the user who currently holds the VR handle to experience VR can be collected through the fingerprint recognition module to confirm the identity of the user.

[0054] The step of outputting an operation instruction through the operation module when it is detected that the force data is within the operation trigger range comprises:

[0055] Step A40, determining the operation trigger range corresponding to the second fingerprint information according to a preset mapping relationship between the fingerprint information and the operation trigger range;

[0056] Exemplarily, a mapping relationship between fingerprint information and an operation trigger range that has passed a strength test and is stored in advance is queried according to the second fingerprint information to determine the operation trigger range corresponding to the second fingerprint information.

[0057] Step A50: when it is detected that the force data is within the operation triggering range corresponding to the second fingerprint information, outputting an operation instruction through the operation module.

[0058] Exemplarily, after each force data is collected by the operation sensor, the force data is compared with the operation trigger range corresponding to the second fingerprint information to determine whether the force data is within the operation trigger range corresponding to the second fingerprint information. When it is detected that the force data is within the operation trigger range corresponding to the second fingerprint information, the corresponding operation instruction is output through the operation module. When it is detected that the force data is not within the operation trigger range corresponding to the second fingerprint information, it can be considered as a false touch, and therefore there is no need to output an operation instruction.

[0059] In one practicable manner, referring to Figure 2 The VR handle includes a pressing operation module, a joystick operation module, a grip operation module and a fingerprint recognition module, wherein the pressing operation module is provided with a second pressure sensor, the joystick operation module is provided with a second inertial sensor, and the grip operation module is provided with a first pressure sensor and a first inertial sensor.

[0060] In this embodiment, the handle operation method is applied to a VR handle, the VR handle includes an operation module, and the operation module is provided with an operation sensor. By collecting at least one first force test data by the operation sensor provided on the operation module of the VR handle, a force test of the user operation based on the operation module is realized, and then the operation trigger range of the operation module is determined according to each of the first force test data, so as to realize the adaptive adjustment of the operation trigger range of the operation module. In this way, the operation trigger range of the operation module can be adapted to the force that the user can apply to the operation module. When the force that the user can apply to the operation module is small, the operation trigger range of the operation module is reduced, so that the small force applied by the user to the operation module can also trigger the operation module, reducing the probability of the operation module missing triggering, so that when the user uses the VR handle, there is no need to deliberately increase the force to trigger the operation module, but to be more involved in the VR experience, thereby improving the use fluency of the VR handle and improving the user experience; and when the force that the user can apply to the operation module is large, the operation trigger range of the operation module is increased, so that the user needs to apply more force to the operation module to trigger the operation module, and in the later stage of recovery of rehabilitation training using VR equipment, better training effect can be achieved. Therefore, the technical defect that the design of conventional VR handles is designed according to the usage habits of young and middle-aged people is overcome. For children, users with small hands or less strength, when operating the handle, there may be a situation where the operation made by the user cannot trigger the handle operation. For users who need to use VR equipment for rehabilitation training, it may be difficult to complete the training in the early stage of recovery, and in the later stage of recovery, the training effect may be poor because it is too easy to complete the training, resulting in poor performance of the VR handle. This allows the VR handle to adapt to the needs of different scenes and different groups of people, thereby improving the performance of the VR handle.

[0061] Embodiment 2

[0062] Further, refer to Figure 3 Based on the above embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above embodiment can be referred to the above description, and will not be described in detail later. On this basis, the operation module includes a handle operation module, the operation sensor includes a first pressure sensor, and the handle operation module is also provided with a first inertial sensor. When the force data is detected to be within the operation trigger range, the step of outputting the operation instruction through the operation module includes:

[0063] Step S41, when it is detected that the force data is within the operation trigger range, determining the acceleration adjustment value according to the operation trigger range and a preset standard range;

[0064] In the present embodiment, it should be noted that, since the VR handle cannot be completely fixed to the user's hand, if the user performs large-scale movements with a high speed while holding the VR handle, it is possible that the VR handle will slip out of the hand. For example, if the user holds the VR handle to play a table tennis game and needs to hit the ball, the action of hitting the ball will require the user to swing the VR handle quickly. For users with weak grip strength or small hands, the VR handle may be thrown out of the user's hand as the ball is hit.

[0065] The handle operation module is arranged at the handle of the VR handle, and a first pressure sensor and a first inertial sensor are arranged on the handle operation module. The first pressure sensor is used to detect the user's grip force, and the first inertial sensor is used to detect the acceleration, tilt, impact, vibration, rotation, multi-degree-of-freedom motion and other motion data of the VR handle.

[0066] During the strength test process, at least one first strength test data may be collected by the first pressure sensor, and the operation triggering range of the handle operation module may be determined according to each first strength test data, wherein the first strength test data is grip strength test data.

[0067] Exemplarily, after the strength test, during the VR experience, the first pressure sensor is used to collect strength data, wherein the strength data is grip strength data. Further, after each time the strength data is collected by the first pressure sensor, the strength data is compared with the operation trigger range to determine whether the strength data is within the operation trigger range. When it is detected that the strength data is within the operation trigger range, the acceleration adjustment value is determined according to the size relationship between the operation trigger range and the preset standard range, wherein the size relationship between the operation trigger range and the preset standard range can be a proportional relationship, a difference relationship, a functional relationship, etc. For example, the ratio of the median of the operation trigger range to the median of the preset standard range can be determined as the acceleration adjustment value, or the difference between the minimum value of the operation trigger range and the minimum value of the preset standard range can be determined as the acceleration adjustment value, etc., which can be determined according to actual conditions, and this embodiment does not limit this; when it is detected that the strength data is not within the operation trigger range, it can be considered as a false touch, so there is no need to output an operation instruction.

[0068] Step S42, collecting the current acceleration of the handle operation module through the first inertial sensor, and adjusting the current acceleration according to the acceleration adjustment value to obtain a target acceleration;

[0069] Exemplarily, after determining the acceleration adjustment value, it is determined that the acceleration data collected by the inertial sensor on the handle operation module needs to be adjusted before outputting the corresponding operation instruction. Therefore, the current acceleration of the handle operation module is collected by the first inertial sensor, and the current acceleration is adjusted according to the acceleration adjustment value to obtain the target acceleration, wherein the magnitude of the target acceleration is negatively correlated with the magnitude of the value of the operation trigger range, and the value of the operation trigger range can be represented by the average value, median value, end value, etc. of the operation trigger range, which can be specifically determined according to actual conditions, and this embodiment does not limit this. That is, the greater the user's grip strength, the larger the value of the operation trigger range, and the smaller the target acceleration. The user can swing the handle faster or with greater force, and the experience is more realistic; and the smaller the user's grip strength, the smaller the value of the operation trigger range. In order to avoid throwing the VR handle out, the current acceleration can be increased and adjusted. The larger the target acceleration, the VR handle can also output a larger acceleration when the user swings the VR handle lightly or slowly, thereby slowing down the speed or force with which the user swings the VR handle, thereby reducing the probability of the VR handle falling out of the hand.

[0070] In one practicable manner, the step of adjusting the current acceleration according to the acceleration adjustment value includes: when the median value of the operation trigger range is smaller than the median value of the prediction standard range, increasing the current acceleration according to the acceleration adjustment value.

[0071] In one practicable manner, the step of adjusting the current acceleration according to the acceleration adjustment value includes: when the median value of the operation trigger range is greater than the median value of the prediction standard range, not adjusting the current acceleration or reducing the current acceleration according to the acceleration adjustment value.

[0072] Step S43: outputting an operation instruction corresponding to the target acceleration through the handle operation module.

[0073] Exemplarily, an operation instruction is generated based on the target acceleration, and the operation instruction after the acceleration information is adjusted is outputted through the handle operation module.

[0074] In this embodiment, by setting a first pressure sensor on the grip part of the VR handle, the grip data of the user can be detected, and the acceleration adjustment value for adjusting the output acceleration of the handle is determined according to the size relationship between the operation trigger range determined by the grip data and the preset standard range, and then the acceleration of the handle detected by the first inertial sensor is adjusted, and then the corresponding operation instruction is generated, so that the acceleration applied to the handle by the user can be adjusted to adapt to the user's grip, so that when the user gently or slowly swings the VR handle, the VR handle can also output an operation instruction to swing the VR handle with greater force or faster speed. In this way, the speed or force of the user swinging the VR handle can be slowed down, thereby reducing the probability of the VR handle falling out of the hand.

[0075] Embodiment 3

[0076] Further, refer to Figure 4 Based on the above embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above embodiment can be referred to the above introduction and will not be described in detail later. On this basis, the steps include:

[0077] Step B10, determining whether to adjust the operation trigger range according to the force data;

[0078] In this embodiment, it should be noted that the strength of the same person may be different in different physical and mental states, and the time of the strength test and the time of the actual VR experience may be continuous or discontinuous. For example, a strength test is performed when the VR handle is used for the first time, and the VR experience may be intermittent in the following days, months or even years. When the time interval between the VR experience and the strength test is long, the strength of the user during the VR experience may change. Therefore, in the process of the actual VR experience, the user's strength data and the triggering status of the operation module can be continuously monitored, and the operation trigger range can be adjusted to adapt to the different states of the user.

[0079] Exemplarily, during the VR experience, after force data is collected by the operation sensor, it can be determined whether to adjust the operation trigger range based on the size of one or more of the force data collected, wherein the method for determining whether to adjust the operation trigger range based on the size of one or more of the force data collected can be, for example, determining whether to adjust the operation trigger range based on whether there are more than a preset number of force data that are not within the operation trigger range, determining whether to adjust the operation trigger range based on whether the difference between the average value of each force data and the median value of the operation trigger range exceeds a preset deviation range, etc. The specific method can be determined based on actual conditions, and this embodiment is not limited to this.

[0080] Optionally, the step of determining whether to adjust the operation trigger range according to the force data includes:

[0081] Step B11, when it is detected that the force data is not within the operation trigger range, an abnormal count is increased;

[0082] Step B12: When it is determined that the abnormality count exceeds a preset abnormality count threshold, it is determined to adjust the operation trigger range.

[0083] Exemplarily, after each time force data is collected by the operation sensor, the force data is compared with the operation trigger range to determine whether the force data is within the operation trigger range. When it is detected that the force data is not within the operation trigger range, it can be considered that an abnormal situation exists. However, in order to avoid misjudgment, the abnormal situation can be counted first, that is, the abnormal count is increased, and then the updated abnormal count is compared with the preset abnormal count threshold. When it is determined that the abnormal count exceeds the preset abnormal count threshold, it means that the actual force applied by the user has deviated from the current operation trigger range many times, so it is determined that the operation trigger range needs to be adjusted. After adjusting the operation trigger range, the abnormal count can also be initialized to facilitate the next statistics of abnormal situations. When it is detected that the force data is within the operation trigger range, the abnormal count can be either not increased or decreased.

[0084] Step B20, when it is determined that the operation trigger range is to be adjusted, obtaining at least one second force test data;

[0085] Exemplarily, when it is determined that the operation trigger range needs to be adjusted, at least one second strength test data is obtained, wherein the second strength test data may be strength data collected and stored for a period of time before the current moment as the second strength test data, or may be strength data collected for a period of time starting from the current moment as the second strength test data.

[0086] Step B30: updating the operation trigger range of the operation module according to each of the second force test data.

[0087] Exemplarily, by performing data analysis on each of the second force test data, a target operation trigger range is determined, and the operation trigger range of the operation module is updated to the target operation trigger range, wherein the method of updating the operation trigger range of the operation module according to each of the second force test data may be the same as the method of determining the operation trigger range of the operation module according to each of the first force test data.

[0088] In this embodiment, by continuously monitoring the user's strength data and the triggering status of the operation module and adjusting the operation trigger range during the actual VR experience, the operation trigger range of the operation module can be adaptively adjusted as the user's state and strength change. This can reduce the tedious operation of performing strength testing and resetting the operation trigger range when the user realizes that the VR handle does not match his or her own strength, thereby improving the user experience.

[0089] Embodiment 4

[0090] Furthermore, the present application also provides a handle operating device, referring to Figure 5 The handle operation device is applied to a VR handle, the VR handle includes an operation module, the operation module is provided with an operation sensor, and the handle operation device includes:

[0091] A collection module, used for collecting at least one first force test data through the operation sensor;

[0092] A determination module is used to determine the operation trigger range of the operation module according to each of the first force test data.

[0093] Optionally, the handle operating device further includes an association module, and the association module is used to:

[0094] Collecting first fingerprint information through the fingerprint recognition module;

[0095] After the step of determining the operation trigger range of the operation module according to each of the first force test data, the method further includes:

[0096] A corresponding relationship between the operation trigger range and the first fingerprint information is established.

[0097] Optionally, the handle operating device further comprises an output module, and after the operation of determining the operation trigger range of the operating module according to each of the first force test data, the output module is used to:

[0098] Collecting force data through the operation sensor;

[0099] When it is detected that the force data is within the operation trigger range, an operation instruction is outputted through the operation module.

[0100] Optionally, the operation sensor includes a first pressure sensor, the handle operation module is further provided with a first inertial sensor, and the output module is used for:

[0101] When it is detected that the force data is within the operation trigger range, determining the acceleration adjustment value according to the operation trigger range and a preset standard range;

[0102] collecting the current acceleration of the handle operation module through the first inertial sensor, and adjusting the current acceleration according to the acceleration adjustment value to obtain a target acceleration;

[0103] The operation instruction corresponding to the target acceleration is outputted through the handle operation module.

[0104] Optionally, the VR handle includes a fingerprint recognition module, and before the operation of outputting an operation instruction through the operation module when the force data is detected to be within the operation trigger range, the output module is further used to:

[0105] The second fingerprint information is collected through the fingerprint recognition module.

[0106] Optionally, the output module is further used for:

[0107] Determine the operation trigger range corresponding to the second fingerprint information according to a preset mapping relationship between the fingerprint information and the operation trigger range;

[0108] When it is detected that the force data is within the operation triggering range corresponding to the second fingerprint information, an operation instruction is outputted through the operation module.

[0109] Optionally, after the operation of collecting force data through the operation sensor, the output module is further used to:

[0110] Determining whether to adjust the operation trigger range according to the force data;

[0111] In case it is determined that the operation trigger range is adjusted, obtaining at least one second force test data;

[0112] The operation triggering range of the operation module is updated according to each of the second force test data.

[0113] Optionally, the output module is further used for:

[0114] When it is detected that the force data is not within the operation trigger range, an abnormal count is increased;

[0115] When it is determined that the abnormality count exceeds a preset abnormality count threshold, it is determined to adjust the operation trigger range.

[0116] Optionally, the operation module includes a pressing operation module, and the operation sensor includes a second pressure sensor;

[0117] And / or, the operation module includes a joystick operation module, and the operation sensor includes a second inertial sensor.

[0118] The handle operation device provided by the present invention adopts the handle operation method in the above embodiment, which solves the technical problem of poor performance of the VR handle in the prior art. Compared with the prior art, the beneficial effects of the handle operation device provided by the embodiment of the present invention are the same as the beneficial effects of the handle operation method provided by the above embodiment, and other technical features in the handle operation device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0119] Embodiment 5

[0120] Furthermore, an embodiment of the present invention provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the handle operation method in the above embodiment.

[0121] Reference below Figure 6 , which shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as VR devices, VR handles, mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0122] like Figure 6As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and arrays required for the operation of the electronic device are also stored. The processing device, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0123] Typically, the following systems can be connected to the I / O interface: input devices including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices including, for example, a magnetic tape, a hard disk, etc.; and communication devices. The communication device can allow the electronic device to communicate with other devices wirelessly or by wire to exchange arrays. Although the electronic device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have instead.

[0124] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0125] The electronic device provided by the present invention adopts the handle operation method in the above embodiment to solve the technical problem of poor performance of the VR handle in the prior art. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present invention are the same as the beneficial effects of the handle operation method provided by the above embodiment, and other technical features in the electronic device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0126] It should be understood that the various parts of the present disclosure can be implemented with hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0127] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

[0128] Embodiment 6

[0129] Furthermore, this embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the handle operation method in the above embodiment.

[0130] The computer-readable storage medium provided in the embodiment of the present invention may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0131] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0132] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an electronic device, the electronic device: collects at least one first force test data through the operation sensor; and determines the operation trigger range of the operation module according to each first force test data.

[0133] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0134] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0135] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of the module does not limit the unit itself in some cases.

[0136] The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the above-mentioned handle operation method, which solves the technical problem of poor performance of the VR handle in the prior art. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the present invention are the same as the beneficial effects of the handle operation method provided by the above-mentioned embodiment, and will not be described in detail here.

[0137] Embodiment 7

[0138] Furthermore, the present application also provides a computer program product, including a computer program, which implements the steps of the handle operation method as described above when executed by a processor.

[0139] The computer program product provided by the present application solves the technical problem of poor performance of the VR handle in the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as the beneficial effects of the handle operation method provided by the above embodiment, which will not be described in detail here.

[0140] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. A handle operation method, characterized in that: The handle operation method is applied to a VR handle, the VR handle includes an operation module, an operation sensor is provided on the operation module, and the handle operation method includes the following steps: Collect at least one first force test data through the operation sensor; An operation triggering range of the operation module is determined according to each of the first force test data.

2. The handle operation method according to claim 1, characterized in that: The VR handle includes a fingerprint recognition module, and the handle operation method further includes: Collecting first fingerprint information through the fingerprint recognition module; After the step of determining the operation trigger range of the operation module according to each of the first force test data, the method further includes: A corresponding relationship between the operation trigger range and the first fingerprint information is established.

3. The handle operation method according to claim 1, characterized in that: After the step of determining the operation trigger range of the operation module according to each of the first force test data, the method further includes: Collecting force data through the operation sensor; When it is detected that the force data is within the operation trigger range, an operation instruction is outputted through the operation module.

4. The handle operation method as claimed in claim 3, characterized in that: The operation module includes a handle operation module, the operation sensor includes a first pressure sensor, and the handle operation module is also provided with a first inertial sensor. When the force data is detected to be within the operation trigger range, the step of outputting an operation instruction through the operation module includes: When it is detected that the force data is within the operation trigger range, determining the acceleration adjustment value according to the operation trigger range and a preset standard range; collecting the current acceleration of the handle operation module through the first inertial sensor, and adjusting the current acceleration according to the acceleration adjustment value to obtain a target acceleration; The operation instruction corresponding to the target acceleration is outputted through the handle operation module.

5. The handle operation method according to claim 3, characterized in that: The VR handle includes a fingerprint recognition module, and before the step of outputting an operation instruction through the operation module when the force data is detected to be within the operation trigger range, the step further includes: Collecting second fingerprint information through the fingerprint recognition module; The step of outputting an operation instruction through the operation module when it is detected that the force data is within the operation trigger range comprises: Determine the operation trigger range corresponding to the second fingerprint information according to a preset mapping relationship between the fingerprint information and the operation trigger range; When it is detected that the force data is within the operation triggering range corresponding to the second fingerprint information, an operation instruction is outputted through the operation module.

6. The handle operation method according to claim 3, characterized in that: After the step of collecting force data through the operation sensor, the method further includes: Determining whether to adjust the operation trigger range according to the force data; In case it is determined that the operation trigger range is adjusted, obtaining at least one second force test data; The operation triggering range of the operation module is updated according to each of the second force test data.

7. The handle operation method according to claim 6, characterized in that: The step of determining whether to adjust the operation trigger range according to the force data includes: When it is detected that the force data is not within the operation trigger range, an abnormal count is increased; When it is determined that the abnormality count exceeds a preset abnormality count threshold, it is determined to adjust the operation trigger range.

8. The handle operation method according to any one of claims 1 to 7, characterized in that: The operation module includes a pressing operation module, and the operation sensor includes a second pressure sensor; And / or, the operation module includes a joystick operation module, and the operation sensor includes a second inertial sensor.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the handle operation method according to any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which is stored a program for implementing the handle operation method. The program for implementing the handle operation method is executed by a processor to implement the steps of the handle operation method as described in any one of claims 1 to 8.

Images