Man-machine gesture interaction method and device, electronic equipment and storage medium

By tracking the parameters of the charging movement of user gestures in virtual reality devices and determining the throwing parameters, the problem of low accuracy of gesture interaction in virtual reality games is solved, and a more accurate user interaction experience is achieved.

CN118925212APending Publication Date: 2024-11-12NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411223423.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In virtual reality games, when users interact with virtual reality devices through gestures, they cannot accurately calculate the degree of power accumulation of gestures, resulting in low accuracy of gesture interaction.

Method used

The virtual reality device provides a graphical user interface, and picks up the target game props in response to the user's first gesture operation, and tracks its charging action changes parameters. These parameters are used to determine preset throw parameters to achieve more accurate throwing actions.

Benefits of technology

It improves the accuracy of gesture interaction, can more comprehensively reflect the user's throwing movements, and solves the problem of low accuracy of gesture interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118925212A_ABST
    Figure CN118925212A_ABST
Patent Text Reader

Abstract

The invention provides a man-machine gesture interaction method and device, electronic equipment and a storage medium, and relates to the technical field of virtual reality, a graphical user interface is provided through virtual reality equipment, at least part of a game scene of a game is presented on the graphical user interface, and the game scene comprises a target game prop. The method comprises the following steps: in response to a first gesture operation of a gesture object for a target game prop, picking up the target game prop from a game scene; after the target game prop is picked up, tracking a force storage action change parameter of the gesture object; in response to a second gesture operation of the gesture object for the target game prop, the target game prop is thrown in the game scene according to preset throwing parameters, and the preset throwing parameters are determined by the force storage action change parameters. By adopting the man-machine gesture interaction method and device, the electronic equipment and the storage medium, the problem that the accuracy of gesture interaction is low when man-machine interaction is carried out through virtual reality equipment is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a human-computer gesture interaction method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of virtual reality technology, virtual reality games have emerged, including virtual reality games (VR games), augmented reality games (AR games), and mixed reality games (MR games). Virtual reality games are usually run in head-mounted displays (HMDs). Head-mounted displays use their infinitely extendable space to provide users with the possibility of operating in a large visible space.

[0003] At present, in virtual reality games, users can interact with the virtual reality scene presented by the virtual reality device through various methods such as handles and eye tracking. For example, the virtual reality device can throw game props by tracking the user's gestures through lasers. However, when the user interacts with the virtual reality device through gestures to throw game props, the degree of force of the gesture cannot be accurately calculated, resulting in low accuracy of gesture interaction. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a human-computer gesture interaction method, device, electronic device and storage medium to solve the problem of low gesture interaction accuracy when a virtual reality device performs human-computer interaction.

[0005] In a first aspect, an embodiment of the present application provides a human-computer gesture interaction method, which provides a graphical user interface through a virtual reality device, and presents at least part of a game scene of a game on the graphical user interface, wherein the game scene includes a target game prop, and the method includes:

[0006] In response to a first gesture operation of the gesture object on the target game prop, picking up the target game prop from the game scene;

[0007] After the target game prop is picked up, track the change parameters of the gesture object's charging action;

[0008] In response to a second gesture operation of the gesture object on a target game prop, the target game prop is thrown in the game scene with preset throwing parameters, and the preset throwing parameters are determined by the charging action change parameters.

[0009] In a second aspect, an embodiment of the present application further provides a human-machine gesture interaction device, which provides a graphical user interface through a virtual reality device, and presents at least part of a game scene of a game on the graphical user interface, wherein the game scene includes a target game prop, and the device includes:

[0010] A prop picking module, configured to pick up a target game prop from a game scene in response to a first gesture operation of a gesture object on a target game prop;

[0011] A parameter tracking module is used to track the change parameters of the gesture object's charging action after the target game prop is picked up;

[0012] The prop throwing module is used to respond to the second gesture operation of the gesture object on the target game prop, and throw the target game prop with preset throwing parameters in the game scene, and the preset throwing parameters are determined by the charging action change parameters.

[0013] In a third aspect, an embodiment of the present application further provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the human-computer gesture interaction method as described above are performed.

[0014] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the human-computer gesture interaction method as described above are executed.

[0015] The embodiments of the present application bring the following beneficial effects:

[0016] A human-computer gesture interaction method, device, electronic device and storage medium provided in the embodiments of the present application can track the movement changes of a gesture object, and use the movement changes of the gesture object to determine the preset throwing parameters, so as to determine the degree of accumulated force through the movement changes of the gesture object, thereby being able to more accurately and comprehensively reflect the user's throwing movement and improve the accuracy of gesture interaction. Compared with the human-computer gesture interaction method in the prior art, the problem of low gesture interaction accuracy when performing human-computer interaction through virtual reality equipment is solved.

[0017] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A flow chart of a human-computer gesture interaction method provided in an embodiment of the present application is shown;

[0020] Figure 2 A schematic diagram of a target projection plane provided in an embodiment of the present application is shown;

[0021] Figure 3 A schematic diagram showing the moving distance provided by an embodiment of the present application is shown;

[0022] Figure 4 A schematic diagram of the structure of a human-machine gesture interaction device provided in an embodiment of the present application is shown;

[0023] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0024] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0025] It is worth noting that before the present application was proposed, with the rapid development of virtual reality technology, virtual reality games came into being, including virtual reality games (Virtual reality game, VR game), augmented reality games (Augmented Reality game, AR game), mixed reality games (Mixed Reality game, MR game). Virtual reality games are usually run in head-mounted display devices (i.e. head-mounted displays), which use the characteristics of their infinitely extendable space to provide users with the possibility of operating in a large visible space. At present, in virtual reality games, users can interact with virtual reality scenes presented by virtual reality devices through a variety of methods such as handles and eye tracking. For example, virtual reality devices can throw game props by tracking user gestures through lasers. However, when users interact with virtual reality devices through gestures to throw game props, it is impossible to accurately calculate the degree of power accumulation of gestures, and there is a problem of low accuracy of gesture interaction.

[0026] For example: After the virtual reality device tracks the user's gestures, it will calculate parameters such as the throwing speed and direction of the game props to determine the movement trajectory of the thrown game props. However, parameters such as the throwing speed and direction cannot reflect the user's degree of accumulated strength. It is inaccurate to determine the movement trajectory of the thrown game props only by the throwing speed and direction.

[0027] Based on this, an embodiment of the present application provides a human-computer gesture interaction method to improve the low accuracy of gesture interaction when human-computer interaction is performed through a virtual reality device.

[0028] The human-computer gesture interaction method can be run on a virtual reality device, which can be an electronic device configured with augmented reality AR, virtual reality VR, mixed reality MR, etc., which can simulate a virtual reality scene through a provided graphical user interface and can interact through user gestures.

[0029] Among them, the virtual reality scene is a scene displayed (or provided) on the graphical user interface when the application is running on the virtual reality device. Optionally, the virtual reality scene is a simulation environment of the real world, or a semi-simulation and semi-fictitious virtual environment, or a purely fictitious virtual environment, or a fictitious virtual environment presented on an existing scene by presenting virtual scene information, or a semi-real and semi-virtual virtual environment. The virtual scene is a three-dimensional virtual scene, and the virtual environment can be the sky, land, ocean, etc., wherein the land includes environmental elements such as deserts and cities. Among them, the virtual scene is a scene of complete game logic of controlled virtual objects such as user control. For example, in a sandbox 3D shooting game, the virtual scene is a 3D game world for players to control controlled virtual objects to fight. An exemplary virtual scene may include: at least one element of mountains, plains, rivers, lakes, oceans, deserts, skies, plants, buildings, and vehicles. In addition to being a game scene, the virtual reality scene can also be a scene requested by the virtual reality device according to other actual needs of the user, such as a live broadcast scene, a movie viewing scene, etc.

[0030] Correspondingly, at least one game interface for user operation is also displayed in the virtual reality scene. For example, when the virtual reality scene is a game scene, the game scene may include a game interface and a three-dimensional game screen for user players to interact. In an optional embodiment, the game interface may include game controls (such as skill controls, movement controls, function controls, etc.), indicators (such as direction indicators, role indicators, etc.), information display areas (such as the number of kills, game time, etc.), or game setting controls (such as system settings, stores, gold coins, etc.). In an optional embodiment, the game screen is a display screen corresponding to the virtual scene displayed by the terminal device, and the three-dimensional game screen may include controlled virtual objects such as game characters, NPC characters, and AI characters that execute game logic in the virtual reality scene.

[0031] Here, the controlled virtual object refers to a dynamic object that can be controlled in a virtual reality scene. Optionally, the dynamic object can be a virtual character, a virtual animal, an animated character, etc. The controlled virtual object is a character controlled by a player through an input device, or an artificial intelligence (AI) set in a virtual environment battle through training, or a non-player character (NPC) set in a virtual reality scene battle. Optionally, the controlled virtual object is a virtual character competing in a virtual reality scene. Optionally, the number of controlled virtual objects in the virtual reality scene battle is preset, or dynamically determined according to the number of clients joining the battle, and the disclosed embodiment does not limit this. In a possible implementation, the user can control the controlled virtual object to move in the virtual reality scene, for example, control the controlled virtual object to run, jump, crawl, etc., and can also control the controlled virtual object to use the skills, game props, etc. provided by the application to fight with other controlled virtual objects.

[0032] See also Figure 1 , Figure 1 This is a flow chart of a human-machine gesture interaction method provided by an embodiment of the present application. Figure 1 As shown, the human-computer gesture interaction method provided in the embodiment of the present application provides a graphical user interface through a virtual reality device, and presents at least part of the game scene of the game on the graphical user interface, and the game scene includes a target game prop. The method includes:

[0033] Step S101, in response to a first gesture operation of a gesture object on a target game prop, picking up a target game prop from a game scene;

[0034] Step S102, after the target game prop is picked up, tracking the change parameters of the power accumulation action of the gesture object;

[0035] Step S103, in response to a second gesture operation of the gesture object on the target game prop, throwing the target game prop in the game scene with preset throwing parameters.

[0036] The present application can track the movement changes of gesture objects, and use the movement changes of gesture objects to determine the preset throwing parameters, so as to determine the degree of accumulated force through the movement changes of gesture objects, thereby being able to more accurately and comprehensively reflect the user's throwing movements, improve the accuracy of gesture interaction, and solve the problem of low gesture interaction accuracy when conducting human-computer interaction through virtual reality devices.

[0037] Below Figure 1 Each step is described in detail.

[0038] In step S101, in response to a first gesture operation of a gesture object on a target game prop, a target game prop is picked up from a game scene.

[0039] Here, the gesture object may refer to an object whose hand posture can be recognized. Exemplarily, the gesture object includes the palm and / or arm of the user, and may also be the palm and / or arm of a controlled virtual character in the game.

[0040] The first gesture operation may refer to an operation of picking up a game prop. For example, the first gesture operation may be a grabbing operation or an arm sliding operation. The virtual reality device detects the posture of the gesture object in real time. If it is detected that the posture of the gesture object matches the preset posture corresponding to the grabbing operation, it is determined that the gesture object has performed the first gesture operation at this time.

[0041] In the embodiment of the present application, different methods can be used to pick up the target game props from the game scene, for example: control the target game props to move according to the motion trajectory of the gesture object, at this time, the target game props will follow the motion trajectory of the gesture object to move in real time. Or, when a preset event is triggered, control the target game props to move to the target position that triggers the preset event. Here, the preset event can be that the gesture object completes a certain action or reaches a certain specified position. For example: the preset event is that the gesture object draws a circle in the air. When the gesture object completes the action, the target game prop will move to the position where the gesture object completes the action.

[0042] It should be noted that the graphical user interface is an interface provided by the virtual reality device for the target game. Virtual reality scenes or augmented reality scenes (for example, game scenes of the target game, game candidate scenes, etc.) can be presented in the graphical user interface. Specifically, when the player user selects the target game Z, the game interface of the target game Z can be displayed in the graphical user interface in response to the player user's selection operation for the target game Z.

[0043] Taking AR games as an example, through the game interface in the virtual reality device, the player user can observe the gesture object, for example: observe his own palm and / or arm. When the player user makes a grabbing action for the target game prop, the virtual reality device can recognize the action and use it as the first gesture operation to pick up the target game prop from the game scene, for example: picking up a spear from the game scene.

[0044] In step S102, after the target game prop is picked up, the charging action change parameter of the gesture object is tracked. The charging action change parameter refers to the change parameter of the charging stage when throwing the target game prop, and the charging action change parameter includes at least one of the following items: the projection area of ​​the gesture object on the target projection plane, and the movement distance of the gesture object.

[0045] Here, the target projection plane is a plane perpendicular to the throwing direction, and the throwing direction is the direction indicated when the second gesture operation is triggered.

[0046] The second gesture operation is an operation of throwing out the target game prop. For example, if the first gesture operation is to clench the palm, the second gesture operation may be to open the palm. The moving distance is the moving distance in the throwing direction during the charging stage.

[0047] It should be noted that the entire process from picking up the target game prop to throwing the target game prop can be divided into two stages, namely the power accumulation stage and the throwing stage. Here, the current stage can be determined according to the moving direction of the first gesture operation. Taking the throwing of the target game prop in the direction in which the current user is facing as an example, the entire process is: the arm first moves backward and then moves forward, that is, first moves in the opposite direction of the facing direction, and then moves in the facing direction. Therefore, the process of the arm moving backward can be regarded as the power accumulation stage, and the process of the arm moving backward and then moving forward can be regarded as the throwing stage. The position where the arm stops after moving backward in the whole process is the dividing point of the two stages.

[0048] Refer to the following Figure 2 Let's introduce the target projection plane.

[0049] Figure 2 A schematic diagram of a target projection plane provided in an embodiment of the present application is shown. Figure 2 As shown, the second gesture operation is the palm opening operation. When the palm is opened, the direction indicated by the palm is the throwing direction. At this time, the positive direction of the Z axis is the throwing direction, and the target projection plane is the plane 210 perpendicular to the throwing direction, that is, the plane formed by the X axis and the Y axis.

[0050] Refer to the following Figure 3 Let's introduce how to determine the moving distance.

[0051] Figure 3 A schematic diagram showing the moving distance provided by the embodiment of the present application is shown in FIG. Figure 3 As shown, the positive direction of the Z axis is the throwing direction, the initial position of the first gesture operation is position 310, the stop position of the first gesture operation after moving backward is position 320, and the moving distance is the distance 330 between position 310 and position 320 in the Z axis direction. The initial position refers to the position when the target game prop is first picked up, and the stop position is the position at the end of the charging stage.

[0052] In an embodiment of the present application, after the user picks up the target game prop through the first gesture operation, the virtual reality device will track the change parameters of the gesture object's force accumulation action on the preset projection plane in real time. If the change parameter of the force accumulation action is the projection area, the projection area of ​​the gesture object on the preset projection plane is obtained in real time, and when the second gesture operation is triggered, the projection area of ​​the preset projection plane at different times is converted into the projection area of ​​the target projection plane according to the spatial conversion relationship, and then the swing amplitude is calculated using the projection area of ​​the target projection plane.

[0053] If the change parameter of the charging action is the moving distance, the spatial moving trajectory of the gesture object is determined according to the position of the gesture object tracked in real time, and when the second gesture operation is triggered, the spatial moving trajectory is converted into the moving distance relative to the target projection plane, that is, the moving distance in the throwing direction, according to the spatial conversion relationship, and then the swing amplitude is calculated using the moving distance.

[0054] The preset projection plane is the current observation plane of the virtual reality device, and the preset projection plane changes with the observation angle of the virtual reality device. For example, when the user looks down at the ground, the preset projection plane is a horizontal plane parallel to the ground; when the user looks straight ahead, the preset projection plane is a vertical plane perpendicular to the ground.

[0055] After tracking the change parameters of the power-accumulating action of the gesture object, the current swing amplitude of the gesture object can be determined according to the change parameters of the power-accumulating action, so as to determine the preset throwing parameters according to the current swing amplitude. Here, if the change parameter of the power-accumulating action is the projection area, a projection area curve is constructed according to the change of the projection area, and then the current swing amplitude of the gesture object is determined according to the projection area curve. If the change parameter of the power-accumulating action is the moving distance, the current swing amplitude of the gesture object is determined according to the corresponding relationship between the moving distance and the swing amplitude.

[0056] Specifically, if the parameter of the charging action change is the projection area, multiple target projection areas are selected according to the change of the projection area, and curve fitting is performed on the multiple target projection areas to construct a projection area curve. Among them, the target projection area refers to the projection area on the target projection plane whose projection area is greater than the set area threshold. In order to avoid calculation errors and the influence of light, the projection area needs to be screened to accurately construct the projection area curve. The projection area curve is a curve with time as the horizontal axis and the projection area value as the vertical axis. After constructing the projection area curve, it can be determined whether the projection area curve is monotonic. Whether it is monotonic indicates the complexity of the charging stage. If it is monotonic, it means that the swing process is relatively simple, and the projection area only changes in an increasing or decreasing manner; if it is not monotonic, it means that the swing process is relatively complex, and the projection area changes in a mixed manner of increasing and decreasing. If the projection area curve is monotonic, for example, it changes in an increasing or decreasing manner, the current swing amplitude can be directly determined according to the positive value of the projection area in the projection area curve; if the projection area curve is not monotonic, for example, it changes in a manner of first increasing and then decreasing or first decreasing and then increasing, the projection area curve can be divided into multiple monotonic intervals, and then the current swing amplitude is determined according to the positive values ​​of the projection area in all monotonic intervals in the projection area curve. Among them, the positive values ​​of the projection area include the maximum projection area and the minimum projection area in the monotonic interval.

[0057] When the projection area curve is monotonic, the difference between the maximum projection area and the minimum projection area can be determined, and the difference is called the first area difference. Then, the current swing amplitude of the gesture object is determined according to the first area difference. The first area difference is proportional to the current swing amplitude. The larger the first area difference, the larger the current swing amplitude; the smaller the first area difference, the smaller the current swing amplitude.

[0058] When the projected area curve is not monotonic, the difference between the maximum projected area and the minimum projected area in each monotonic interval can be determined, and the difference is called the second area difference. Then, the current swing amplitude of the gesture object can be determined based on the multiple second area differences corresponding to all monotonic intervals. For example, the current swing amplitude of the gesture object can be determined based on the weighted sum of the multiple second area differences. Assume that there are three monotonic intervals, and the maximum projected areas of the three monotonic intervals are S max1 , S max2 , S max3 , the minimum projected areas of the three monotone intervals are S min1 , S min2 , S min3 , then we can get three second area difference values ​​S diffe1 , S diffe2 , S diffe3 Among them, Sdiffe1 =S max1 -S min1 , S diffe2 =S max2 -S min2 , S diffe3 =S max3 -S min3 . diffe1 The corresponding weight coefficients are K1, S diffe2 The corresponding weight coefficients are K2, S diffe3 The corresponding weight coefficient is K3, then according to K1×S diffe1 +K2×S diffe2 +K3×S diffe3 The result determines the current swing amplitude.

[0059] Here, the current swing amplitude can be determined according to the corresponding relationship between the area difference and the swing amplitude. The corresponding relationship between the area difference and the swing amplitude is established in advance and can be represented by a data table or a curve, which will not be described here.

[0060] In step S103, in response to the second gesture operation of the gesture object on the target game prop, the target game prop is thrown in the game scene with preset throwing parameters, wherein the preset throwing parameters are determined by the charging action variation parameters.

[0061] After determining the current swing amplitude, it is necessary to further convert the current swing amplitude into a preset throwing parameter. The throwing parameter determines the motion trajectory of the target game prop, and the preset throwing parameter is a throwing parameter affected by the degree of power accumulation. Here, the preset throwing parameter can be determined by the current swing amplitude.

[0062] In an optional embodiment, in order to more clearly show the power level to the user, a power level indicator may be displayed in the graphical user interface in response to the first gesture operation. The power level indicator may be an indicator of any shape such as a strip, a circle, a triangle, etc., and the power level indicator is used to show the current power level.

[0063] The level of power can be indicated by the display state of the power level indicator, which is determined by the current swing strength, that is, the display state of the power level indicator corresponds to the current swing strength. For example: if the display state is indicated by different colors, the greater the current swing strength, the darker the color of the power level indicator; if the display state is indicated by the filling degree of the power level indicator, the greater the current swing strength, the greater the filling degree of the power level indicator.

[0064] In one example, the preset throwing parameter can be determined by the current swing amplitude. Here, the swing amplitude is positively correlated with the preset throwing parameter, that is, the larger the swing amplitude, the greater the degree of power accumulation, and the larger the preset throwing parameter reflecting the degree of power accumulation; the smaller the swing amplitude, the smaller the degree of power accumulation, and the smaller the preset throwing parameter reflecting the degree of power accumulation.

[0065] In another example, the preset throwing parameters can be determined by the swing intensity. To this end, the current swing intensity can be calculated based on the current swing amplitude, and then the preset throwing parameters can be determined based on the current swing intensity. Specifically, the current swing intensity can be determined based on the current swing amplitude and the current swing duration, and then the preset throwing parameters corresponding to the current swing intensity can be determined based on the corresponding relationship between the swing intensity and the throwing parameters. For example, the current swing intensity can be determined based on the ratio of the current swing amplitude to the current swing duration, and the current swing amplitude is recorded as: L amp , the current swing duration is recorded as: T amp , the current swing intensity is recorded as: L str , then: L str =L amp / T amp , and then determine the current swing intensity L by querying the data table or calculating the formula str The value of the corresponding preset throwing parameter.

[0066] In an embodiment of the present application, the preset throwing parameters include the parabola angle, and the current swing strength will directly determine the parabola angle. For example, the current swing strength is proportional to the parabola angle. The greater the current swing strength, the greater the degree of accumulated force, and the greater the parabola angle of the motion trajectory of the thrown target game prop.

[0067] In this way, by tracking the changing parameters of the gesture object's charging action, the current swing amplitude can be calculated. The current swing amplitude determines the degree of charging of the thrown object, and different degrees of charging will affect the motion trajectory of the thrown target game props, so that the present application can more accurately and comprehensively reflect the actual situation of gesture interaction.

[0068] Based on the same inventive concept, the embodiment of the present application also provides a human-computer gesture interaction device corresponding to the human-computer gesture interaction method. Since the principle of solving the problem by the device in the embodiment of the present application is similar to the above-mentioned human-computer gesture interaction method in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0069] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of a human-machine gesture interaction device provided in an embodiment of the present application. Figure 4As shown in , a graphical user interface is provided by a virtual reality device, and at least part of the game scene of the game is presented on the graphical user interface. The game scene includes target game props. The human-computer gesture interaction device 400 includes:

[0070] The prop picking module 401 is used to pick up the target game prop from the game scene in response to the gesture object operation of the gesture object on the target game prop;

[0071] The parameter tracking module 402 is used to track the change parameters of the power accumulation action of the gesture object after the target game prop is picked up;

[0072] The prop throwing module 403 is used to respond to the second gesture operation of the gesture object on the target game prop, and throw the target game prop with preset throwing parameters in the game scene, and the preset throwing parameters are determined by the charging action change parameters.

[0073] In a feasible implementation scheme of the present application, the change parameter of the power storage action includes at least one of the following items: the projection area of ​​the gesture object on the target projection plane, and the movement distance of the gesture object.

[0074] In a feasible implementation scheme of the present application, the human-computer gesture interaction device 400 also includes an amplitude calculation module, which is used to determine the current swing amplitude of the gesture object according to the change parameters of the power storage action, so as to determine the preset throwing parameters according to the current swing amplitude.

[0075] In a feasible implementation scheme of the present application, the changing parameter of the power storage action is the projection area, and the amplitude calculation module includes a curve construction module and a swing amplitude determination module. The curve construction module is used to construct a projection area curve according to the change of the projection area; the swing amplitude determination module is used to determine the current swing amplitude of the gesture object according to the projection area curve.

[0076] In a feasible implementation scheme of the present application, the change parameter of the force storage action is the moving distance, and the amplitude calculation module is specifically used to determine the current swing amplitude of the gesture object according to the corresponding relationship between the moving distance and the swing amplitude.

[0077] In a feasible implementation scheme of the present application, the swing amplitude determination module includes a monotonicity determination module, a first swing amplitude determination module and a second swing amplitude determination module. The monotonicity determination module is used to determine whether the projection area curve is monotonic; the first swing amplitude determination module is used to determine the current swing amplitude according to the positive value of the projection area in the projection area curve if the projection area curve is monotonic, and the positive value of the projection area includes the maximum projection area and the minimum projection area; the second swing amplitude determination module is used to determine the current swing amplitude according to the positive value of the projection area in all monotonic intervals in the projection area curve if the projection area curve is not monotonic.

[0078] In a feasible implementation scheme of the present application, the human-computer gesture interaction device 400 also includes a swing intensity calculation module and a throwing parameter calculation module. The swing intensity calculation module is used to determine the current swing intensity based on the current swing amplitude and the current swing duration; the throwing parameter calculation module is used to determine the preset throwing parameters corresponding to the current swing intensity based on the correspondence between the swing intensity and the throwing parameters.

[0079] In a feasible implementation scheme of the present application, the first swing amplitude determination module is specifically used to: determine a first area difference corresponding to the maximum projection area and the minimum projection area; and determine the current swing amplitude of the gesture object according to the first area difference.

[0080] In a feasible implementation scheme of the present application, the second swing amplitude determination module includes a second difference calculation module and a second swing amplitude determination sub-module. The second difference calculation module is used to determine, for each monotonic interval, the second area difference corresponding to the maximum projected area and the minimum projected area within the monotonic interval; the second swing amplitude determination sub-module is used to determine the current swing amplitude of the gesture object based on multiple second area differences corresponding to all monotonic intervals.

[0081] In a feasible implementation scheme of the present application, the swing intensity calculation module is specifically used to determine the current swing intensity according to the ratio of the current swing amplitude to the current swing duration.

[0082] In a feasible implementation scheme of the present application, the human-computer gesture interaction device 400 also includes a force indication display module, which is used to display a force degree indication in a graphical user interface in response to a first gesture operation, and the display state of the force degree indication corresponds to the current swing intensity.

[0083] In a feasible implementation of the present application, the second swing amplitude determination submodule is specifically used to determine the current swing amplitude of the gesture object according to the weighted sum of the multiple second area differences.

[0084] In a feasible implementation scheme of the present application, the prop picking module 401 is specifically used to: control the target game prop to move according to the motion trajectory of the gesture object, or, when a preset event is triggered, control the target game prop to move to the target position that triggers the preset event.

[0085] In a feasible implementation scheme of the present application, the preset throwing parameters include the parabola angle, and the current swing intensity is proportional to the parabola angle.

[0086] Through the above method, the present application can track the movement changes of the gesture object, and use the movement changes of the gesture object to determine the preset throwing parameters, so as to determine the degree of force accumulation through the movement changes of the gesture object, thereby being able to more accurately and comprehensively reflect the user's throwing movements, improve the accuracy of gesture interaction, and solve the problem of low gesture interaction accuracy when conducting human-computer interaction through virtual reality devices.

[0087] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown in , the electronic device 500 includes a processor 510 , a memory 520 and a bus 530 .

[0088] The memory 520 stores machine-readable instructions executable by the processor 510. When the electronic device 500 is running, the processor 510 communicates with the memory 520 via the bus 530. When the machine-readable instructions are executed by the processor 510, the following steps are performed:

[0089] Providing a graphical user interface through a virtual reality device, presenting at least a portion of a game scene of the game on the graphical user interface, the game scene including a target game prop;

[0090] In response to the gesture object operation of the gesture object on the target game prop, picking up the target game prop from the game scene;

[0091] After the target game prop is picked up, track the change parameters of the gesture object's charging action;

[0092] In response to a second gesture operation of the gesture object on a target game prop, the target game prop is thrown in the game scene with preset throwing parameters, and the preset throwing parameters are determined by the charging action change parameters.

[0093] In a feasible implementation scheme of the present application, the change parameter of the power storage action includes at least one of the following items: the projection area of ​​the gesture object on the target projection plane, and the movement distance of the gesture object.

[0094] In a feasible implementation scheme of the present application, after executing the force accumulation action change parameters of the tracking gesture object, the processor 510 is also used to: determine the current swing amplitude of the gesture object according to the force accumulation action change parameters, so as to determine the preset throwing parameters according to the current swing amplitude.

[0095] In a feasible implementation scheme of the present application, the change parameter of the force storage action is the projection area. When the processor 510 determines the current swing amplitude of the gesture object according to the change parameter of the force storage action, it is specifically used to: construct a projection area curve according to the change of the projection area; and determine the current swing amplitude of the gesture object according to the projection area curve.

[0096] In a feasible implementation scheme of the present application, the change parameter of the force storage action is the moving distance. When the processor 510 determines the current swing amplitude of the gesture object according to the change parameter of the force storage action, it is specifically used to: determine the current swing amplitude of the gesture object according to the correspondence between the moving distance and the swing amplitude.

[0097] In a feasible implementation scheme of the present application, when the processor 510 determines the current swing amplitude of the gesture object based on the projection area curve, it is specifically used to: determine whether the projection area curve is monotonic; if the projection area curve is monotonic, determine the current swing amplitude based on the positive value of the projection area in the projection area curve, and the positive value of the projection area includes the maximum projection area and the minimum projection area; if the projection area curve is not monotonic, determine the current swing amplitude based on the positive value of the projection area in all monotonic intervals in the projection area curve.

[0098] In a feasible implementation scheme of the present application, when the processor 510 determines the preset throwing parameters according to the current swing amplitude, it is specifically used to: determine the current swing intensity according to the current swing amplitude and the current swing duration; determine the preset throwing parameters corresponding to the current swing intensity according to the corresponding relationship between the swing intensity and the throwing parameters.

[0099] In a feasible implementation scheme of the present application, when the projection area curve is monotonic, the processor 510, when determining the current swing amplitude, is specifically used to: determine a first area difference corresponding to the maximum projection area and the minimum projection area; and determine the current swing amplitude of the gesture object based on the first area difference.

[0100] In a feasible implementation scheme of the present application, when the projection area curve is not monotonic, the processor 510, when determining the current swing amplitude, is specifically used to: determine, for each monotonic interval, a second area difference corresponding to the maximum projection area and the minimum projection area within the monotonic interval; and determine the current swing amplitude of the gesture object based on multiple second area differences corresponding to all monotonic intervals.

[0101] In a feasible implementation scheme of the present application, when the processor 510 determines the current swing intensity according to the current swing amplitude and the current swing duration, it is specifically used to: determine the current swing intensity according to the ratio of the current swing amplitude to the current swing duration.

[0102] In a feasible implementation scheme of the present application, the processor 510 is further used to: in response to the first gesture operation, display a power level indicator in the graphical user interface, and the display state of the power level indicator corresponds to the current swing intensity.

[0103] In a feasible implementation scheme of the present application, when the processor 510 determines the current swing amplitude of the gesture object according to multiple second area difference values ​​corresponding to all monotonic intervals, it is specifically used to: determine the current swing amplitude of the gesture object according to the sum of the weights of the multiple second area difference values.

[0104] In a feasible implementation scheme of the present application, when executing the picking up of the target game prop from the game scene, the processor 510 is specifically used to: control the target game prop to move according to the motion trajectory of the gesture object, or, when a preset event is triggered, control the target game prop to move to the target position that triggers the preset event.

[0105] In a feasible implementation scheme of the present application, the preset throwing parameters include the parabola angle, and the current swing intensity is proportional to the parabola angle.

[0106] Through the above method, the present application can track the movement changes of the gesture object, and use the movement changes of the gesture object to determine the preset throwing parameters, so as to determine the degree of force accumulation through the movement changes of the gesture object, thereby being able to more accurately and comprehensively reflect the user's throwing movements, improve the accuracy of gesture interaction, and solve the problem of low gesture interaction accuracy when conducting human-computer interaction through virtual reality devices.

[0107] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the following steps can be performed:

[0108] Providing a graphical user interface through a virtual reality device, presenting at least a portion of a game scene of the game on the graphical user interface, the game scene including a target game prop;

[0109] In response to the gesture object operation of the gesture object on the target game prop, picking up the target game prop from the game scene;

[0110] After the target game prop is picked up, track the change parameters of the gesture object's charging action;

[0111] In response to a second gesture operation of the gesture object on a target game prop, the target game prop is thrown in the game scene with preset throwing parameters, and the preset throwing parameters are determined by the charging action change parameters.

[0112] In a feasible implementation scheme of the present application, the change parameter of the power storage action includes at least one of the following items: the projection area of ​​the gesture object on the target projection plane, and the movement distance of the gesture object.

[0113] In a feasible implementation scheme of the present application, after executing the tracking gesture object's force storage action change parameters, the processor is also used to: determine the current swing amplitude of the gesture object according to the force storage action change parameters, so as to determine the preset throwing parameters according to the current swing amplitude.

[0114] In a feasible implementation scheme of the present application, the change parameter of the force storage action is the projection area. When the processor determines the current swing amplitude of the gesture object according to the change parameter of the force storage action, it is specifically used to: construct a projection area curve according to the change of the projection area; and determine the current swing amplitude of the gesture object according to the projection area curve.

[0115] In a feasible implementation scheme of the present application, the change parameter of the force storage action is the moving distance. When the processor determines the current swing amplitude of the gesture object according to the change parameter of the force storage action, it is specifically used to: determine the current swing amplitude of the gesture object according to the corresponding relationship between the moving distance and the swing amplitude.

[0116] In a feasible implementation scheme of the present application, when the processor determines the current swing amplitude of the gesture object according to the projection area curve, it is specifically used to: determine whether the projection area curve is monotonic; if the projection area curve is monotonic, determine the current swing amplitude according to the positive value of the projection area in the projection area curve, and the positive value of the projection area includes the maximum projection area and the minimum projection area; if the projection area curve is not monotonic, determine the current swing amplitude according to the positive value of the projection area in all monotonic intervals in the projection area curve.

[0117] In a feasible implementation scheme of the present application, when the processor determines the preset throwing parameters according to the current swing amplitude, it is specifically used to: determine the current swing intensity according to the current swing amplitude and the current swing duration; determine the preset throwing parameters corresponding to the current swing intensity according to the corresponding relationship between the swing intensity and the throwing parameters.

[0118] In a feasible implementation scheme of the present application, when the projection area curve is monotonic, the processor, when determining the current swing amplitude, is specifically used to: determine a first area difference corresponding to the maximum projection area and the minimum projection area; and determine the current swing amplitude of the gesture object based on the first area difference.

[0119] In a feasible implementation scheme of the present application, when the projection area curve is not monotonic, the processor, when determining the current swing amplitude, is specifically used to: determine, for each monotonic interval, a second area difference corresponding to the maximum projection area and the minimum projection area within the monotonic interval; and determine the current swing amplitude of the gesture object based on multiple second area differences corresponding to all monotonic intervals.

[0120] In a feasible implementation scheme of the present application, when the processor determines the current swing intensity according to the current swing amplitude and the current swing duration, it is specifically used to: determine the current swing intensity according to the ratio of the current swing amplitude to the current swing duration.

[0121] In a feasible implementation scheme of the present application, the processor is also used to: in response to the first gesture operation, display a power level indicator in the graphical user interface, and the display state of the power level indicator corresponds to the current swing intensity.

[0122] In a feasible implementation scheme of the present application, when the processor determines the current swing amplitude of the gesture object according to multiple second area differences corresponding to all monotonic intervals, it is specifically used to: determine the current swing amplitude of the gesture object according to the sum of the weights of the multiple second area differences.

[0123] In a feasible implementation scheme of the present application, when executing the picking up of the target game prop from the game scene, the processor is specifically used to: control the target game prop to move according to the motion trajectory of the gesture object, or, when a preset event is triggered, control the target game prop to move to the target position that triggers the preset event.

[0124] In a feasible implementation scheme of the present application, the preset throwing parameters include the parabola angle, and the current swing intensity is proportional to the parabola angle.

[0125] Through the above method, the present application can track the movement changes of the gesture object, and use the movement changes of the gesture object to determine the preset throwing parameters, so as to determine the degree of force accumulation through the movement changes of the gesture object, thereby being able to more accurately and comprehensively reflect the user's throwing movements, improve the accuracy of gesture interaction, and solve the problem of low gesture interaction accuracy when conducting human-computer interaction through virtual reality devices.

[0126] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0127] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0130] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0131] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A human-computer gesture interaction method, characterized in that: A graphical user interface is provided through a virtual reality device, and at least a part of a game scene of a game is presented on the graphical user interface, wherein the game scene includes a target game prop, and the method includes: In response to a first gesture operation of a gesture object on the target game prop, picking up the target game prop from the game scene; After the target game prop is picked up, tracking the change parameters of the power storage action of the gesture object; In response to a second gesture operation of the gesture object on the target game prop, the target game prop is thrown in the game scene with preset throwing parameters, and the preset throwing parameters are determined by the charging action change parameters.

2. The method according to claim 1, characterized in that: The power storage action change parameter includes at least one of the following items: The projection area of ​​the gesture object on the target projection plane, and the moving distance of the gesture object.

3. The method according to claim 2, characterized in that After tracking the change parameters of the power storage action of the gesture object, the method further includes: According to the change parameter of the power storage action, the current swing amplitude of the gesture object is determined, so as to determine the preset throwing parameter according to the current swing amplitude.

4. The method according to claim 3, characterized in that The force storage action change parameter is a projection area, and determining the current swing amplitude of the gesture object according to the force storage action change parameter includes: Constructing a projection area curve according to the change of the projection area; The current swing amplitude of the gesture object is determined according to the projection area curve.

5. The method according to claim 3, characterized in that: The force storage action change parameter is a moving distance, and determining the current swing amplitude of the gesture object according to the force storage action change parameter includes: The current swing amplitude of the gesture object is determined according to the corresponding relationship between the moving distance and the swing amplitude.

6. The method according to claim 4, characterized in that The determining, according to the projection area curve, a current swing amplitude of the gesture object includes: Determining whether the projected area curve is monotonic; If the projection area curve is monotonic, determining the current swing amplitude according to the projection area positive value in the projection area curve, wherein the projection area positive value includes a maximum projection area and a minimum projection area; If the projected area curve is not monotonic, the current swing amplitude is determined according to the positive values ​​of the projected area in all monotonic intervals of the projected area curve.

7. The method according to claim 3, characterized in that The preset throwing parameters are determined according to the current swing amplitude in the following manner: Determining a current swing intensity according to the current swing amplitude and the current swing duration; According to the corresponding relationship between the swing intensity and the throwing parameter, the preset throwing parameter corresponding to the current swing intensity is determined.

8. The method according to claim 6, characterized in that When the projected area curve is monotonic, the current swing amplitude is determined by: Determine a first area difference between the maximum projected area and the minimum projected area; A current swing amplitude of the gesture object is determined according to the first area difference.

9. The method according to claim 4, characterized in that When the projected area curve is not monotonic, the current swing amplitude is determined by: For each monotonic interval, determining a second area difference value corresponding to a maximum projected area and a minimum projected area in the monotonic interval; The current swing amplitude of the gesture object is determined according to the multiple second area difference values ​​corresponding to all the monotonic intervals.

10. The method according to claim 7, characterized in that The determining the current swing intensity according to the current swing amplitude and the current swing duration includes: The current swing intensity is determined according to the ratio of the current swing amplitude to the current swing duration.

11. The method according to claim 7, characterized in that The method further comprises: In response to the first gesture operation, a power level indicator is displayed in the graphical user interface, and a display state of the power level indicator corresponds to the current swing intensity.

12. The method according to claim 9, characterized in that The determining the current swing amplitude of the gesture object according to the multiple second area differences corresponding to all monotonic intervals includes: The current swing amplitude of the gesture object is determined according to the sum of the weights of the multiple second area differences.

13. The method according to claim 1, characterized in that The step of picking up the target game prop from the game scene comprises: The target game prop is controlled to move along the motion track of the gesture object, or, when a preset event is triggered, the target game prop is controlled to move to a target position that triggers the preset event.

14. The method according to claim 7, characterized in that The preset throwing parameters include a parabola angle, and the current swing intensity is proportional to the parabola angle.

15. A human-machine gesture interaction device, characterized in that: A graphical user interface is provided through a virtual reality device, and at least a part of a game scene of a game is presented on the graphical user interface, wherein the game scene includes a target game prop, and the apparatus includes: A prop picking module, configured to pick up the target game prop from the game scene in response to a first gesture operation of a gesture object on the target game prop; A parameter tracking module, used for tracking the change parameters of the power storage action of the gesture object after the target game prop is picked up; The prop throwing module is used to respond to the second gesture operation of the gesture object on the target game prop, and throw the target game prop with preset throwing parameters in the game scene, and the preset throwing parameters are determined by the charging action change parameters.

16. An electronic device, characterized in that: include: A processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the storage medium communicate through the bus, and the processor executes the machine-readable instructions to perform the steps of the human-computer gesture interaction method as described in any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the human-computer gesture interaction method according to any one of claims 1 to 14 are executed.