Data processing method, device, equipment and medium

Abstract

[0009] The embodiments of the present disclosure relate to a data processing method, an apparatus, a device, and a medium. The data processing method includes: determining an action position based on a first action signal (S101); determining a second action posture based on a second action signal (S102); and executing an operation command according to the action position and the second action posture (S103). Another data processing method includes: determining a first action time and a first action posture based on a received action signal (S701); determining a target object whose object information matches the first action time and the first action posture (S702); and playing a first processing effect corresponding to the target object (S703). Another data processing method includes displaying a trigger device and a target object in a virtual reality scene (S1401), determining an action position based on an action signal (S1402), determining a trigger time according to the action position and the position of the trigger device (S1403), determining a target object whose object information matches the trigger time and the position of the trigger device (S1404), and playing an effect corresponding to the target object (S1405). Another data processing method includes determining an action position and an action speed direction based on the action signal (S2001), determining a target object whose object information including the object direction and the object position matches the action position (S2002), and playing an effect corresponding to the target object according to the action speed direction and the direction of the target object (S2003).

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application is based on and claims priority from the Chinese application having application number 202211129259.7 and filing date September 16, 2022, the Chinese application having application number 202211157713.X and filing date September 22, 2022, the Chinese application having application number 202211157841.4 and filing date September 22, 2022, and the Chinese application having application number 202211165882.8 and filing date September 23, 2022, the entire disclosures of which are incorporated herein by reference.

[0002] The present disclosure relates to the field of data processing technology, and more particularly to a number of data processing methods, devices, equipment and media. [Background technology]

[0003] As virtual reality (VR) technology develops, interactions and games based on VR technology can bring users a sense of reality and participation.

[0004] In related technologies, a gamepad is generally used as an input device to perform processing, and the method for determining the processing results is complicated, the processing efficiency is relatively low, and the processing operations are not sufficiently rich, which cannot meet the usage needs of users.

[0005] In the related art, a gamepad is generally used as an input device to hit an object, and the method for determining the hitting result is complicated, the processing efficiency is relatively low, and the gamepad operations are not sufficiently rich, which cannot meet the usage needs of users.

[0006] In the related art, it is difficult to know at what position and / or at what time an object is to be processed in a virtual reality space, and the processing effect is relatively poor.

[0007] In the related art, the judgment method for the interaction result of the virtual reality scene leads to poor accuracy of the judgment result and poor accuracy of the presentation of the subsequent interaction effect, so that the user cannot prepare to understand the actual interaction situation. Summary of the Invention

[0008] To solve or at least partially solve the above technical problems, the present disclosure provides a number of data processing methods, devices, apparatuses and media.

[0009] An embodiment of the present disclosure includes: determining an actuation position based on the first actuation signal; determining a second movement posture based on the second movement signal; A data processing method is provided, which includes executing an operation command according to the motion position and the second motion posture.

[0010] An embodiment of the present disclosure includes: a first determination module for determining an operating position based on the first operating signal; a second determination module for determining a second movement posture based on the second movement signal; A data processing device is further provided, including a processing module for executing an operation command according to the operating position and the second operating attitude.

[0011] An embodiment of the present disclosure includes: determining a first movement time and a first movement posture based on the received movement signal; determining a target object whose object information matches the first motion time and the first motion posture; and reproducing a first processing effect corresponding to the target object.

[0012] An embodiment of the present disclosure includes: a first determination module for determining a first motion time and a first motion posture based on the received motion signal; a second determination module for determining a target object whose object information matches the first motion time and the first motion posture; and a reproduction module for reproducing the first processing effect corresponding to the target object.

[0013] An embodiment of the present disclosure includes: Displaying the trigger device and the target object in a virtual reality scene; determining an actuation position based on the actuation signal; determining a trigger time in response to the operating position and the position of the trigger device; determining a target object whose object information matches the trigger time and the position of the trigger device; and playing an effect corresponding to the target object.

[0014] An embodiment of the present disclosure includes: a display module for displaying the trigger device and the target object in a virtual reality scene; a first determination module for determining an operating position based on the operating signal; a second determination module for determining a trigger time according to the operating position and the position of the trigger device; a third determination module for determining a target object whose object information matches the trigger time and the position of the trigger device; and a playback module for playing an effect corresponding to the target object.

[0015] An embodiment of the present disclosure further provides an electronic device including a processor and a memory for storing instructions executable by the processor, the processor being configured to read the executable instructions from the memory and execute the instructions to realize a data processing method according to an embodiment of the present disclosure.

[0016] An embodiment of the present disclosure further provides a computer-readable storage medium having stored thereon a computer program for performing a data processing method according to an embodiment of the present disclosure.

[0017] An embodiment of the present disclosure includes: determining a motion position and a motion speed direction based on the motion signal; determining a target object whose object information including an object direction and an object position matches the operating position; and playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object.

[0018] An embodiment of the present disclosure includes: a first determination module for determining a motion position and a motion speed direction based on the motion signal; a second determination module for determining a target object whose object information including an object direction and an object position matches the operating position; and a playback module for playing an effect corresponding to the target object according to the motion speed direction and a direction of the target object. An embodiment of the present disclosure further provides an electronic device including a processor and a memory for storing instructions executable by the processor, the processor being configured to read the executable instructions from the memory and execute the instructions to realize a data processing method according to any one of the embodiments of the present disclosure.

[0019] An embodiment of the present disclosure further provides a computer-readable storage medium having stored thereon a computer program for performing the data processing method according to any one of the embodiments of the present disclosure.

[0020] An embodiment of the present disclosure further provides a computer program product comprising instructions that, when executed by a processor, cause the processor to perform a data processing method according to any one of the embodiments of the present disclosure.

[0021] An embodiment of the present disclosure further provides a computer program comprising instructions that, when executed by a processor, cause the processor to perform a data processing method according to any one of the embodiments of the present disclosure. [Brief explanation of the drawings]

[0022] These and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the drawings in which the same or similar elements are designated by the same or similar reference numerals throughout the drawings. It should be understood that the drawings are schematic and that the materials and elements are not necessarily drawn to scale. [Figure 1] 1 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure. [Figure 2] 10 is a schematic diagram illustrating the flow of another data processing method according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is a schematic diagram of an operation scene according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is a schematic diagram of another operation scene according to an embodiment of the present disclosure. [Figure 5] 1 is a schematic diagram illustrating the configuration of a data processing device according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a schematic diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure. [Figure 7] 1 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure. [Figure 8] 10 is a schematic diagram illustrating the flow of another data processing method according to an embodiment of the present disclosure. [Figure 9] 1 is a schematic diagram of a real scene and a virtual reality scene according to an embodiment of the present disclosure. [Figure 10a] FIG. 1 is a schematic diagram of a stepping scene according to an embodiment of the present disclosure. [Figure 10b] FIG. 10 is a schematic diagram of another stepping scene according to an embodiment of the present disclosure. [Figure 10c] FIG. 10 is a schematic diagram of yet another stepping scene according to an embodiment of the present disclosure. [Figure 10d]FIG. 10 is a schematic diagram of yet another stepping scene according to an embodiment of the present disclosure. [Figure 10e] FIG. 10 is a schematic diagram of yet another stepping scene according to an embodiment of the present disclosure. [Figure 11] FIG. 2 is a schematic diagram of a track area according to an embodiment of the present disclosure. [Figure 12a] FIG. 10 is a schematic diagram of a short note step according to an embodiment of the present disclosure. [Figure 12b] FIG. 10 is a schematic diagram of another short note step according to an embodiment of the present disclosure. [Figure 12c] FIG. 1 is a schematic diagram of a long note step according to an embodiment of the present disclosure. [Figure 13] 1 is a schematic diagram illustrating the configuration of a data processing device according to an embodiment of the present disclosure. [Figure 14] 1 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure. [Figure 15] 10 is a schematic diagram illustrating the flow of another data processing method according to an embodiment of the present disclosure. [Figure 16a] 1 is a schematic diagram of a trigger device and a target object displayed according to an embodiment of the present disclosure; [Figure 16b] 10 is a schematic diagram of another trigger device and target object display according to an embodiment of the present disclosure; [Figure 17] FIG. 1 is a schematic diagram of acting on a target object according to an embodiment of the present disclosure. [Figure 18] 1 is a schematic diagram of a trigger device according to an embodiment of the present disclosure. [Figure 19] 1 is a schematic diagram illustrating the configuration of a data processing device according to an embodiment of the present disclosure. [Figure 20] 1 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure. [Figure 21] 10 is a schematic diagram illustrating the flow of another data processing method according to an embodiment of the present disclosure. [Figure 22a] FIG. 1 is a schematic diagram of a trigger scene according to an embodiment of the present disclosure. [Figure 22b] FIG. 10 is a schematic diagram of another trigger scene according to an embodiment of the present disclosure. [Figure 23] 1 is a schematic diagram illustrating the configuration of a data processing device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0023] The following describes in more detail the embodiments of the present disclosure with reference to the drawings. Although the drawings illustrate several embodiments of the present disclosure, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely illustrative and do not limit the scope of protection of the present disclosure.

[0024] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in a different order and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit performing steps as shown. The scope of the present disclosure is not limited in this respect.

[0025] As used herein, the term "comprises" and variations thereof are open-ended, meaning "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below.

[0026] It should be noted that the concepts of "first," "second," etc. described in this disclosure are merely intended to distinguish between different devices, modules, or units, and are not intended to limit the order or interdependence of functions performed by these devices, modules, or units.

[0027] It should be noted that the modifications of "one" and "plurality" described in the present disclosure are illustrative and not limiting. Unless otherwise specified, it is obvious to those skilled in the art that they should be understood as "one or plural."

[0028] The names of messages or information exchanged between devices in the embodiments of the present disclosure are merely descriptive and do not limit the scope of these messages or information.

[0029] 1 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure, which may be performed by a data processing device, which may be implemented in software and / or hardware and may generally be integrated into electronic equipment.

[0030] The technical solution according to the embodiment of the present disclosure has the following advantages over the related art: The data processing solution according to the embodiment of the present disclosure determines an operating position based on a first operating signal, determines a second operating posture based on a second operating signal, and executes an operation command according to the operating position and the second operating posture. By adopting the above technical solution, data processing is performed using different combinations of operating signals, making the data processing method more diverse and interesting. Furthermore, different data processing can be performed based on more user actions, meeting users' needs for more diverse data processing and further improving data processing efficiency.

[0031] The data processing method according to the embodiments of the present disclosure can be applied to many application scenarios, for example, virtual reality scenarios, where virtual reality includes at least visual sensing, and may further include auditory sensing, tactile sensing, motion sensing, and even taste sensing, olfactory sensing, etc., to realize the integrated, interactive three-dimensional dynamic vision and simulation of real actions in the virtual environment, immerse the user in the simulated virtual reality environment, and realize various applications in virtual environments such as maps, games, videos, etc.

[0032] Furthermore, the device for realizing the virtual reality effect may generally be a device such as glasses, a head-mounted display, or contact lenses to realize visual or other forms of sensing. Of course, the virtual reality device is not limited to these and may be designed to be smaller or larger as needed.

[0033] As shown in FIG. 1, the method includes the following steps:

[0034] Step 101: Determine an operating position based on a first operating signal.

[0035] Here, the first motion signal is, for example, a six-degree-of-freedom signal (movement degrees of freedom along three orthogonal coordinate axes, x, y, and z, and rotation degrees of freedom around these three coordinate axes). For example, the first motion signal is a motion signal including the position and orientation of a gamepad transmitted by a user controlling an external device, such as a gamepad. The first motion signal may be the position and orientation of the user and / or an external device calculated by image recognition from images of the environment collected by the user and / or images of another external device (e.g., a gamepad) collected by the external device (e.g., a head-mounted display device). The motion position may refer to a corresponding position of the external device in a virtual reality scene, and the motion orientation may refer to a corresponding orientation of the external device in the virtual reality scene. For example, the gamepad is mapped as a virtual hand in virtual reality, and the position of the hand is the motion position. Alternatively, a ray corresponding to the position and orientation of the gamepad may be displayed in virtual reality according to the position and orientation of the gamepad, and a corresponding command may be executed according to the direction of the ray. Alternatively, the head display device may be mapped as a virtual camera that collects and displays virtual reality content in virtual reality, determines a gaze point according to the position and posture of the virtual camera, and executes corresponding commands according to the end point of the gaze point.

[0036] In the embodiments of the present disclosure, there are many ways to determine the operating position based on the first operating signal, and in some embodiments, the position of the external device is obtained based on the first operating signal, and the operating position in virtual reality is determined according to the position of the external device. In other embodiments, the position and orientation of the external device are obtained based on the first operating signal, and the operating position in virtual reality is determined according to the position and orientation of the external device.

[0037] The above two methods are merely examples of determining the operating position based on the first operating signal, and the embodiments of the present disclosure do not impose any specific limitations on the implementation form of determining the operating position based on the first operating signal.

[0038] It should be noted that one or more first operating signals may be obtained according to the needs of the application scenario, and the number of operating positions is the same as the number of the first operating signals.

[0039] Step 102: Determine a second movement posture based on the second movement signal.

[0040] Here, the second motion signal refers to a motion signal generated when a user wears a motion tracking device and performs a motion, such as a three-degree-of-freedom signal (three degrees of freedom refers to degrees of freedom having three rotation angles). In an embodiment of the present disclosure, the motion tracking device may be a thigh tracking device, and for example, thigh tracking devices may be worn on both the left and right thighs of the user. A data processing device (e.g., a virtual reality device) is connected to the thigh tracking device and receives the second motion signal transmitted by the thigh tracking device in real time. The motion tracking device may be a head tracking device, a waist tracking device, a hand tracking device, etc., and may be selected and configured according to specific application scenarios, and the embodiment of the present disclosure does not impose any specific limitations.

[0041] Furthermore, a second movement posture is determined based on the second movement signal. Here, the second movement may be a stepping movement, a kicking movement, etc., and may be specifically set according to the application scene. For example, the second movement is a stepping movement, and the second movement posture is a posture of the stepping movement. Here, the second movement posture refers to the body movement posture of the user, such as a stepping movement posture, a kicking movement posture, etc. Depending on the tracking device, the movement posture may be a nod, a head shake, a hip rotation (a posture of rotating the hips), a jump, etc.

[0042] In the embodiments of the present disclosure, there are many ways to determine the second movement posture based on the second movement signal, and in some embodiments, the second movement signal includes a timestamp, an acceleration signal, and an angular velocity signal, and the second movement posture is determined based on the timestamp, the acceleration signal, and the angular velocity signal.

[0043] In some other embodiments, the motion signal includes a timestamp, an acceleration signal, an angular velocity signal, and a magnetometer signal, and the second motion attitude is determined based on the timestamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0044] The above two methods are merely examples of determining the second movement posture based on the second movement signal, and the embodiments of the present disclosure do not impose any limitations on the specific implementation form of determining the second movement posture based on the second movement signal.

[0045] It should be noted that one or more second movement signals may be acquired according to the needs of the application scenario, and the number of second movement postures is the same as the number of second movement signals.

[0046] Note that the above-described steps 101 and 102 may be steps independent of each other, and the present disclosure does not impose any restrictions on the order thereof.

[0047] Step 103: Execute the operation command according to the operating position and the second operating posture.

[0048] The operation commands in the present disclosure may be various interaction or non-interaction commands, such as control commands, setting commands, display commands, etc., including, but not limited to, commands to enable a virtual object (e.g., strike a musical note, make a virtual user dance, etc.), select a virtual object (e.g., select a picture, text content, etc.), edit a virtual object (e.g., edit a picture, video and text content, etc.), display virtual content (e.g., display a picture, text content, etc.), or control various external devices (e.g., gamepads, head-mounted displays, etc.) to turn on / off, calibrate, vibrate, make sounds, etc.

[0049] In the embodiments of the present disclosure, there are many ways to execute an operation command according to a motion position and a second motion posture. In some embodiments, a first operation command is executed according to a motion position, and a second operation command is executed according to a second motion posture. That is, a first operation command is executed according to a motion position determined based on a first motion signal, and a second operation command is executed according to a second motion posture determined based on a second motion signal. The first operation command and the second operation command are independent of each other. The first operation command may be executed first and then the second operation command, or the second operation command may be executed first and then the first operation command, or the first operation command and the second operation command may be executed simultaneously. For example, the first operation command and the second operation command may be discrete in time (first striking the first note and then the second note, or first striking the second note and then the first note), or the first operation command and the second operation command may be executed at the same time (first striking the first note and then the second note simultaneously).

[0050] In some other embodiments, an operation command corresponding to the operating position and the second operating posture is executed, that is, the operating position and the position corresponding to the second operating posture jointly determine one operation command, for example, according to the operating position, an operation control, for example, a page turning control, is determined, and a second operating posture, for example, a posture of stomping one's feet to check, is determined, and the final operation command is a command to turn multiple pages (for example, turn two pages).

[0051] The above two methods are merely examples of executing an operation command according to the operating position and the second operating posture, and the embodiments of the present disclosure do not impose any limitations on the specific implementation form of executing an operation command according to the operating position and the second operating posture.

[0052] The data processing solution according to the embodiment of the present disclosure determines an operating position based on a first operating signal, determines a second operating posture based on a second operating signal, and executes an operation command according to the operating position and the second operating posture. By adopting the above technical solution, data processing is performed based on different combinations of operating signals, making the data processing method more diverse and interesting. Furthermore, different data processing can be performed based on more user actions, meeting users' needs for more diverse data processing and further improving data processing efficiency.

[0053] In some embodiments, the method further includes determining a first movement posture based on the first movement signal, and executing the operation command according to the movement position and the second movement posture includes executing the operation command according to the movement position, the first movement posture, and the second movement posture.

[0054] In an embodiment of the present disclosure, the first movement signal may be, for example, a six-degree-of-freedom signal, such as a movement signal including the position and orientation of a gamepad transmitted by a user controlling an external device, for example, by operating a gamepad. The first movement signal may be the position and orientation of the user and / or an external device calculated by image recognition from images of the environment collected by the user and / or images of another external device (e.g., a gamepad) collected by the external device (e.g., a head-mounted display device). The movement position may refer to the corresponding position of the external device in a virtual reality scene, and the movement orientation may refer to the corresponding orientation of the external device in the virtual reality scene. Therefore, the corresponding movement position and the first movement orientation can be recognized based on the first movement signal.

[0055] In an embodiment of the present disclosure, in order to further enhance the accuracy and diversity of data processing, an operation command is executed according to an operating position, a first operating posture, and a second operating posture, for example, a first operating command is executed according to a first operating position and a first operating posture, a second operating command is executed according to a second operating posture, and also, for example, an operation command corresponding to an operating position, a first operating posture, and a second operating posture is executed.

[0056] In the above solution, a first motion posture is further obtained, and an operation command is executed according to the motion position, the first motion posture, and the second motion posture, thereby further enhancing the diversity and accuracy of data processing and meeting the user's usage needs.

[0057] In some embodiments, the method further includes determining a first operating signal in response to the operational data of the first device and determining a second operating signal in response to the operational data of the second device.

[0058] In an embodiment of the present disclosure, the first movement signal and the second movement signal are each from different devices, and for example, the first movement signal determined according to the movement data of the first device may be a movement signal including the position and posture of an external device, such as a gamepad, that the user can transmit using the external device, or the first movement signal may be the position and posture of the user and / or an external device calculated by image recognition from images of the environment collected by the user and / or images of other external devices (e.g., gamepads) collected by the external device (e.g., a head display device).

[0059] Further, for example, the second motion signal is generated by wearing a motion tracking device and performing a motion. Here, the motion tracking device may be a thigh tracking device, a waist tracking device, a hand tracking device, etc., and may be selected and configured according to specific application scenarios; the embodiments of the present disclosure do not impose specific limitations. The second motion signal is determined according to motion data of the second device, for example, according to one or more motion data generated by an inertial sensor of the second device, such as a timestamp, an acceleration signal, an angular velocity signal, and a magnetometer signal. Since the second device can provide only a three-degree-of-freedom signal or only a motion posture, it can be realized using a conventional inertial sensor, reducing hardware requirements and costs.

[0060] In the above solution, the first operating signal and the second operating signal are respectively determined according to the operating data of different devices, and data processing is performed by at least two devices, thereby enriching the variety of processing operations and processing scenes, and meeting the usage needs of users.

[0061] In some embodiments, executing the operational command according to the operating position and the second operating posture includes executing a first operational command according to the operating position and executing a second operational command according to the second operating posture.

[0062] Specifically, a first operation command is executed according to an operation position determined based on a first operation signal, and a second operation command is executed according to a second operation posture determined based on a second operation signal. The first operation command and the second operation command are mutually independent operation commands, and the first operation command may be executed first and then the second operation command, or the first operation command and the second operation command may be executed simultaneously.

[0063] In one possible implementation, the first operation command corresponds to a first display content of the display device, and the first display content is determined depending on the position and attitude of the display device, and the second operation command corresponds to a second display content of the display device, and the second display content is determined depending on the attitude of the display device, or the second display content is display content at a predetermined position.

[0064] In an embodiment of the present disclosure, the display device may be a head-mounted display device. The display device executes a first operation command according to a movement position determined based on a first movement signal. Here, the first movement signal is a six-degree-of-freedom signal. As can be understood, as the wearable display device moves in real space, the position and orientation of the display device constantly change, and the first display content of the display device corresponding to the first operation command also changes accordingly. For example, as the wearable display device moves forward in real space (e.g., an indoor room space, a car interior space), the first display content (virtual space) is also updated and displayed according to the position and orientation of the display device after the movement.

[0065] In an embodiment of the present disclosure, a second operation command is executed according to a second movement posture determined based on the second movement signal. Here, the second movement signal is a three-degree-of-freedom signal. As can be understood, the position and posture of the display device constantly change as the wearable display device moves in real space. The second display content of the display device corresponding to the second operation command may change according to changes in the posture of the display device, while its spatial position or relative horizontal position with respect to the display device does not change. For example, the second display content, such as a virtual trajectory or operation control, can move in virtual space along with the wearable display device (i.e., the user's first viewing angle), and its display state can change according to changes in the posture of the display device, such as a bowing posture. The virtual trajectory can change its display color, deformation, and / or display position to create a three-dimensional effect. The second display content may be preset content, such as a predetermined virtual object, and may be displayed at a fixed position on the display device in a predetermined form without changing according to changes in the position and posture of the display device.

[0066] As a result, when an operation command corresponds to display content of a display device, the display content may be controlled to be updated and displayed according to the position and / or attitude of the display device, or the display content may be controlled to be fixed, depending on the needs of the application scenario. As can be understood, using the same display interface, some display content (first display content) may be controlled to be updated and displayed according to the position and attitude of the display device, while some display content (second display content) may be controlled to be fixed. Also, as can be understood, using the same display interface, some display content (first display content) may be controlled to be updated and displayed according to the position and attitude of the display device, while some display content (second display content) may be controlled to be updated and displayed according to the attitude of the display device. This satisfies flexible control of the display content of the display device, further meets user needs, and improves the user experience.

[0067] In another possible implementation, when the action position matches the first operation position of the first target object, an effect corresponding to the first target object is played; a second action time is determined based on the second action signal; when the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object, an effect corresponding to the second target object is played.

[0068] Here, the second movement time refers to the time point of the movement, and more specifically, the target position can be determined depending on the movement posture, and the time point at the target position of the movement is recorded as the second movement time.

[0069] In the embodiments of the present disclosure, there are many ways to determine the second operating time based on the second operating signal, and in some embodiments, the operating signal includes a timestamp, an acceleration signal, and an angular velocity signal, and the second operating time is determined based on the timestamp, the acceleration signal, and the angular velocity signal.

[0070] In the embodiments of the present disclosure, different operation positions (such as a first operation position and a second operation position) correspond to different application scenes. For example, in a music game scene, the operation position refers to a musical note position. Also, for example, in an interface operation scene, the operation position refers to a control button position or a control icon position.

[0071] Specifically, when the action position matches the first operation position of the first target object, an effect corresponding to the first target object may be played, such as displaying text information corresponding to the operation result and an operation score, and / or switching the display state of the first target object, such as to a crushing state.

[0072] Specifically, when the second action time matches the operation valid time and the action posture matches the second operation position, an effect corresponding to the second target object is played, such as displaying text information corresponding to the operation result and an operation score, and / or switching the display state of the first target object, such as to a crushing state.

[0073] As an example, in a virtual reality game scene, by directly or indirectly interacting with a first target object A at an action position recognized by a first action signal, the first target object A is triggered to display a score 1 and is controlled to enter a disintegrated state. By directly or indirectly interacting with a second target object B at a position corresponding to an action posture recognized by a second action signal, the second target object B is triggered to display a score 2 and is controlled to enter a disintegrated state.

[0074] Thus, different action signals act on different target objects, thereby increasing the richness of actions and the diversity of processing, meeting the needs of users and improving the user experience.

[0075] In another possible implementation, if the action position matches the action trajectory within the valid action time, a first action effect is played, and if the second action posture satisfies a predetermined condition within the valid action time, a second action effect is played.

[0076] In the embodiment of the present disclosure, the operation hint indicator is displayed within the operation valid time.

[0077] Specifically, an operation hint indicator, for example, an arrow indicator, is displayed within the operation valid time to give the user a hint on the direction of the operation, that is, a hint on how to control an item or the like and move it according to the operation hint indicator.

[0078] In an embodiment of the present disclosure, a position indicator associated with the operating position is displayed.

[0079] Specifically, a position indicator associated with the action position, such as an item icon, is displayed to give the user a hint as to the specific movement status of the action position.

[0080] For example, if the movement time is within the effective operation time and the movement position trajectory matches the movement trajectory, for example, two up and down movements, a first operation effect is played, for example, an operation score is displayed, and sound effects are played. If the second movement posture meets a predetermined condition, for example, the right foot is moved to the right, a second operation effect is played, for example, an operation score is displayed, and sound effects are played.

[0081] As can be understood, the first operating signal and the second operating signal may be acquired alternately and discretely. Therefore, the operating position and the second operating posture may be matched alternately and discretely. As a result, the first operating effect and the second operating effect appear alternately and discretely. The first operating signal and the second operating signal may be acquired simultaneously. Therefore, the operating position and the second operating posture may be matched simultaneously. As a result, the first operating effect and the second operating effect appear simultaneously. Specific selection and setting are made according to the application scenario.

[0082] In the above solution, different operation signals are used to provide different operation experiences, thereby improving the processing accuracy, meeting the user's usage needs, and improving the user's usage experience.

[0083] In some embodiments, executing the manipulation command in response to the second motion posture and the motion position includes executing the manipulation command corresponding to the motion position and the second motion posture.

[0084] Specifically, the operating position and the position corresponding to the second operating posture jointly determine one operation command, that is, the operating position and the second operating posture jointly control the operation result.

[0085] In one possible implementation, if the second motion posture satisfies a predetermined condition, an operation command corresponding to the motion position is executed, or if the second motion posture satisfies a predetermined condition, an operation command corresponding to the motion position and a position corresponding to the second motion posture is executed.

[0086] As an example, a target position, such as a picture, a page-turning control, or a menu-back control, is determined according to the motion position, and if the second motion posture satisfies a predetermined condition, such as stepping on the spot or stomping to the left, an operation command corresponding to the motion position, such as a picture enlargement or page-turning operation, is executed. Here, the predetermined condition may be set as needed, for example, by stepping or stomping, and the predetermined condition is satisfied only when the position corresponding to the second motion posture corresponds to a predetermined position, for example, stepping to the right. For example, if a right page-turning control is determined according to the motion position, and if the position corresponding to the second motion posture corresponds to a predetermined second motion trajectory to the right, an operation to turn two pages to the right is executed.

[0087] In another possible implementation form, determining a first movement posture based on the first movement signal and executing an operation command corresponding to the movement position and the second movement posture includes executing an operation command corresponding to the first movement posture and the movement position if the second movement posture satisfies a predetermined condition.

[0088] As an example, for example, the aiming posture is determined according to the first movement posture, the target position is determined to be X according to the movement position, and if the second movement posture satisfies a predetermined condition, for example, when stepping on the spot and stomping to the left, an operation command corresponding to the first movement posture and movement position is executed, and for example, a shot is fired at the target position X.

[0089] In yet another possible implementation form, executing the operation command corresponding to the operation position and the second operation posture includes executing the operation command corresponding to the operation position, displaying the real-time execution result, and obtaining the execution result at the current time if the second operation posture satisfies a predetermined condition.

[0090] As an example, a target position, for example, an operation such as picture rotation or enlargement, is determined according to the movement position, and the picture rotation and enlargement results are displayed in real time, and when the second movement posture satisfies a predetermined condition, for example, when stepping on the spot and stomping to the left, the picture rotation and enlargement results at the current time are obtained.

[0091] An operation command associated with a position corresponding to the second movement posture may be preset. For example, a stepping posture with the left thigh to the left corresponds to a page back / previous command, a stepping posture with the right thigh to the right corresponds to a page forward / continue command, a position in which both thighs lean to the left simultaneously corresponds to a command to rotate the lens / picture clockwise, a position in which both thighs lean to the right simultaneously corresponds to a command to rotate the lens / picture counterclockwise, and a position in which both thighs jump up and down corresponds to a command to call up a shortcut menu. This allows the position corresponding to the second movement posture to quickly display the interface operation results, further improving data processing efficiency and significantly improving the user's experience of operating using any movement.

[0092] In the above solution, the operating position recognized by the first operating signal and the position corresponding to the operating posture recognized by the second operating signal jointly achieve the operating purpose, thereby reducing the related settings and further improving the convenience of operation.

[0093] 2 is a schematic diagram showing the flow of another data processing method according to an embodiment of the present disclosure. This embodiment further optimizes the above data processing method based on the above embodiment. As shown in FIG. 2, the method includes the following steps:

[0094] Step 201: Determine an operating position based on a first operating signal, and determine a second operating posture based on a second operating signal.

[0095] Step 201 is the same as steps 101 and 102, and therefore, the description of steps 101 and 102 may be referred to specifically, and no further detailed description will be given here.

[0096] In addition to step 201, at least one of step 202, step 203, step 204, step 205, and step 206 may be performed, and FIG. 2 is merely an example.

[0097] In an embodiment of the present disclosure, a first operation command may be executed according to the motion position, and a second operation command may be executed according to the second motion posture.

[0098] In an embodiment of the present disclosure, the first operation command corresponds to a first display content of the display device, and the first display content is determined according to the position and attitude of the display device; the second operation command corresponds to a second display content of the display device, and the second display content is determined according to the attitude of the display device; or the second display content is a display content at a predetermined position.

[0099] As can be understood, the display device may be a head-mounted display device, and the same virtual reality interface may display first display content and / or second display content, and the first display content may be a virtual environment space, for example, a conference room space, a playground space, etc., and as the display device moves in the real space, the real-time position and real-time attitude of the display device are obtained, and the first display content (virtual environment space) is updated and displayed according to the real-time position and real-time attitude of the display device.

[0100] The second display content may be a virtual object at a predetermined position, such as a virtual orbit, a control button, or other content, and as the display device moves in real space, the second display content such as the virtual orbit, the control button, etc., remains unchanged at a predetermined position. To further enhance the interaction experience, the second display content may be controlled to change depending on the posture of the display device, for example, by raising the head, and controlling the deformation of the virtual orbit, etc.

[0101] Step 202: If the action position matches the first operation position of the first target object, play an effect corresponding to the first target object; determine a second action time based on the second action signal; if the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object, play an effect corresponding to the second target object.

[0102] As can be understood, two sets of operation objects may be provided for the user to operate, and the two sets of operation objects require the user to control a first device (e.g., a 6-DOF device) and a second device (e.g., a 3-DOF device) in the real world, respectively, and transmit operation signals to control associated control devices (e.g., items) to operate the respective operation objects, thereby obtaining operation results (e.g., operation scores, switching of the display state of the operation objects, etc.). Here, there are no specific restrictions on the time order in which the first device and the second device transmit operation signals, and the order may be selected and set according to the application scenario.

[0103] Note that the setting is not limited to two sets of control objects, but three or more sets of control objects may be set depending on the application scenario, and the corresponding operation signals may be set to perform the operation. For example, two sets of control objects may be operated by two different six-degree-of-freedom devices (e.g., a head display device and a game pad), and one set of control objects may be operated by a three-degree-of-freedom device (e.g., a thigh motion tracking device).

[0104] As an example, a virtual reality game scene has two sets of target objects: a first target object, e.g., a hand object X1, with which a first device can interact, and a second target object, e.g., a foot region object X2, with which a second device can interact. A user moves the first device, e.g., a gamepad, to send a first action signal to control a control device, e.g., an item M, in the virtual reality game scene, and directly or indirectly interacts with the hand object X1, causing it to disappear.

[0105] The user sends a second motion signal by moving the motion tracking device, such as the thigh / foot / waist, of the second device to control a control device, such as item N, in the virtual reality game scene, and directly or indirectly interacts with the foot area object X2, causing the foot area object X2 to disappear.

[0106] It should be noted that item M does not have any logical interaction with the foot region object X2, and item N does not have any logical interaction with the hand region object X1.

[0107] Step 203: If the action position matches the action trajectory within the effective action time, a first action effect is played; if the second action posture satisfies a predetermined condition, a second action effect is played.

[0108] In the embodiment of the present disclosure, the operation hint indicator is displayed within the operation valid time.

[0109] In an embodiment of the present disclosure, a position indicator associated with the operating position is displayed.

[0110] Specifically, areas A1 and A2 are set up in a virtual reality scene. The user controls a six-degree-of-freedom device to transmit an operation signal to control an item in the virtual reality scene, a virtual user's hand model, or the like, to move in the virtual space. The user must control the item or the virtual user's hand model, etc., to complete a predetermined operation in area A1 within the operation valid time. Then, a first operation effect is played. Here, the operation may be considered completed if the item or the virtual user's hand model, etc., is held in area A1, or the item or the virtual user's hand model, etc., must complete movement in a specific direction in A1.

[0111] In addition, the user controls the 3-DOF motion tracking device for the thighs, feet, waist, etc. to control the item or the virtual user's foot model to complete a corresponding movement within the effective operation time, thereby playing a second operation effect. Here, the second movement posture may be determined from data such as acceleration and angular velocity at each timestamp of the 3-DOF device, and may be a second movement posture such as stepping, lifting, or moving.

[0112] As an example, in area A1, the item or virtual user's hand model needs to move up and down twice, and in the process of completing the action, the position of the item or virtual user's hand model needs to be in area A1 all the time, and a similarity comparison is made between the movement trajectory of the item or virtual user's hand model and the set movement trajectory, and within the operation validity time when a right foot movement hint is shown in area A2, the right foot needs to be raised and stepped to complete the action, or if a hint to move to the right is given, the right foot is controlled to move to the right, etc. Action determination in area A2 does not require the item to be in area A2.

[0113] 3 is a schematic diagram of an operation scene according to an embodiment of the present disclosure. As shown in FIG. 3, the operation scene includes an area A1, i.e., a 6-DOF operation area, and an area A2, i.e., a 3-DOF operation area. The operation hint indicator displayed in the area A1 is an upward arrow, which instructs the user to control the 6-DOF device to move upward while the operation hint is being given. The position indicator associated with the operation position displayed in the area A1 is a circular indicator, which indicates the item controlled by the 6-DOF device and indicates the current position, and needs to be held in the area A1 to complete the operation of moving upward.

[0114] 3, the area A2, i.e., the 3-DOF operation area, is further included, and the operation hint indicator displayed in the area A2 is a downward arrow, which instructs the user to control the 3-DOF device and step while the operation hint is being given. If the user's stepping posture at any position is recognized, the operation can be completed.

[0115] Step 204: If the second operating position satisfies a predetermined condition, execute the operation command corresponding to the operating position.

[0116] Step 205: Determine a first motion posture according to the first motion signal, and if the second motion posture satisfies a predetermined condition, execute an operation command corresponding to the first motion posture and motion position.

[0117] Step 206: Execute the operation command corresponding to the operating position, display the real-time execution result, and obtain the execution result at the current time if the second operating posture satisfies the predetermined condition.

[0118] Specifically, a combination of a first operating signal (six-degree-of-freedom signal) and a second operating signal (three-degree-of-freedom signal) is used, and these two operating signals are used together to realize operation.

[0119] For example, FIG. 4 is a schematic diagram of another operation scene according to an embodiment of the present disclosure, which enables turning multiple pages at once, eliminating the need to design buttons for turning multiple pages and requiring users to tap them, further enhancing the convenience of operation.

[0120] Specifically, as shown in FIG. 4, the control object is a ">" and the displayed control indicator is an arrow. The action position recognized in response to the first action signal acts on the control indicator. At the same time, if the position corresponding to the action posture recognized based on the second action signal (e.g., a stepping posture on the spot) meets a predetermined condition, for example, if the stepping position is the origin or a target position, such as the second trajectory on the right, the control command is executed to turn multiple pages (e.g., turn two pages). It is easy to understand that if the radiation emitted from the gamepad is directed toward a single control, especially a very small control, and the control is triggered using a key on the gamepad, the position and posture of the gamepad may change, causing it to no longer be directed toward the control. In this case, by holding the gamepad stationary, the second action signal from another device can be used to precisely trigger the control. A similar situation also occurs in shooting-like scenarios.

[0121] This allows two different operation signals (e.g., a six-degree-of-freedom signal and a three-degree-of-freedom signal) to operate two sets of operation objects respectively, or a combination of two different operation signals to operate one operation object, or one operation signal (e.g., a three-degree-of-freedom signal) to operate alone, improving operation convenience.

[0122] A data processing scheme according to an embodiment of the present disclosure includes: determining an action position based on a first action signal; determining a second action posture based on a second action signal; if the action position matches a first operation position of a first target object, playing an effect corresponding to the first target object; determining a second action time based on the second action signal; if the second action time matches an operation effective time of the second target object and the action posture matches a second operation position of the second target object, playing an effect corresponding to the second target object; if the action position matches an operation trajectory within the operation effective time, playing a first operation effect; if the second action posture satisfies a predetermined condition, playing a second operation effect; if the second action posture satisfies the predetermined condition, executing an operation command corresponding to the action position; determining a first action posture based on the first action signal; if the second action posture satisfies the predetermined condition, executing an operation command corresponding to the first action posture and action position; executing the operation command corresponding to the action position, displaying the real-time execution result; if the second action posture satisfies the predetermined condition, obtaining the execution result at the current time. By adopting the above solution, the operation purpose is realized by combining the operation position recognized by the first operation signal with the position corresponding to the operation posture recognized by the second operation signal, thereby reducing the related settings and further improving the convenience of operation; and by having different operation signals act on different target objects, the richness of operations and the diversity of operations can be increased, or by having different operation signals act on the same target object, the accuracy of operation can be improved; and by using the position corresponding to the operation posture, the interface operation results can be quickly displayed, which further improves data processing efficiency and greatly improves the user's experience of operating using any operation.

[0123] 5 is a schematic diagram of a data processing device according to an embodiment of the present disclosure. The device may be implemented in software and / or hardware, and may generally be integrated into electronic equipment. As shown in FIG. 5, the device includes: a first determination module 301 for determining an operating position based on the first operating signal; a second determination module 302 for determining a second movement posture based on the second movement signal; and a processing module 303 for executing an operation command according to the operating position and the second operating attitude.

[0124] In some embodiments, the first movement signal is a six degree of freedom movement signal and / or the second movement signal is a three degree of freedom movement signal.

[0125] In some embodiments, the device comprises: a third determination module for determining a first motion posture based on the first motion signal; Specifically, the processing module 303: The control unit is used to execute an operation command according to the operating position, the first operating posture, and the second operating posture.

[0126] In some embodiments, the device comprises: a fourth determination module for determining the first operating signal in response to operational data of the first device; and a fifth determination module for determining the second operating signal in response to operational data of the second device.

[0127] In some embodiments, the processing module 303: a first execution unit for executing a first operation command according to an operation position; and a second execution unit for executing a second operation command in accordance with the second motion posture.

[0128] In some embodiments, the first operation command corresponds to a first display content of a display device, the first display content being determined in response to a position and an orientation of the display device;

[0129] The second operation command corresponds to a second display content of the display device, and the second display content is determined depending on the attitude of the display device, or the second display content is a display content at a predetermined position.

[0130] In some embodiments, the first execution unit specifically: When the operation position matches a first operation position of a first target object, an effect corresponding to the first target object is played; The device comprises: a sixth determination module for determining a second operation time based on the second operation signal; Specifically, the second execution unit: When the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object, it is used to play an effect corresponding to the second target object.

[0131] In some embodiments, the first execution unit is specifically used to play a first operation effect when the action position matches an operation trajectory within an operation effective time; Specifically, the second execution unit is used to reproduce a second operation effect when the second motion posture satisfies a predetermined condition within the operation valid time.

[0132] In some embodiments, the device comprises: The device further includes a first display module for displaying an operation hint indicator within the operation valid time.

[0133] In some embodiments, the device comprises: Further included is a second display module for displaying a position indicator associated with the operating position.

[0134] In some embodiments, the processing module 303: The robot further includes a third execution unit for executing an operation command corresponding to the motion position and the second motion posture.

[0135] In some embodiments, the third execution unit specifically: When the second operating position satisfies a predetermined condition, the second operating position is used to execute an operation command corresponding to the operating position; or The device comprises: a seventh determination module for determining a first motion posture based on the first motion signal; Specifically, the third execution unit further When the second motion posture satisfies a predetermined condition, it is used to execute an operation command corresponding to the first motion posture and the motion position.

[0136] In some embodiments, the third execution unit specifically further includes: Executing an operation command corresponding to the operation position and displaying a real-time execution result; When the second motion posture satisfies a predetermined condition, the execution result at the current time is obtained.

[0137] The above modules may be implemented as software components running on one or more general-purpose processors, or as hardware for performing certain functions, such as programmable logic devices and / or application-specific integrated circuits. In some embodiments, the modules may be embodied in the form of a software product, which may be stored on a non-volatile storage medium. These non-volatile storage media may include a computer device (e.g., a personal computer, a server, a network device, a mobile device, etc.) that executes the methods described in the embodiments of the present disclosure. In some embodiments, the above modules may be implemented on a single device or distributed across multiple devices. The functions of the modules may be integrated with each other or further divided into multiple sub-modules.

[0138] In actual applications, a gamepad is used as an input device to hit an object, and the hitting result is determined from 6-DOF data. This places relatively high demands on tracking the gamepad's position and posture, and often requires a combination of inertial signals and image recognition. The hitting result determination process is also relatively complex, and both spatial position and posture must meet the requirements. In addition, the movement experience is not rich enough, which limits the user's interaction and prevents the movement needs of many users from being met.

[0139] To address the above-mentioned problems, an embodiment of the present disclosure proposes a data processing method for determining a first motion time and a first motion posture based on a received motion signal, determining a target object whose object information matches the first motion time and the first motion posture, and playing a first processing effect corresponding to the target object. This recognizes a motion posture based on the received motion signal, determines a target object according to a position corresponding to the motion posture, and plays a corresponding processing effect, thereby realizing the rapid recognition of a position corresponding to a motion posture and the determination of a target object based only on a simple motion signal, further improving data processing efficiency, and significantly improving the user's interaction experience using arbitrary motions.

[0140] 7 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure. The method may be executed by a data processing device, which may be implemented in software and / or hardware, and may generally be integrated into electronic equipment. As shown in FIG. 7, the method includes the following steps:

[0141] Step 701: Determine a first motion time and a first motion posture based on the received motion signal.

[0142] Here, the motion signal refers to a signal generated when a user wears a motion tracking device and performs a motion, such as a three-degree-of-freedom signal (three degrees of freedom refers to degrees of freedom having three rotation angles). In an embodiment of the present disclosure, the motion tracking device may be a thigh tracking device, for example, a thigh tracking device may be worn on both the left and right thighs of the user. A data processing device (e.g., a virtual reality device) is connected to the thigh tracking device and receives the motion signal transmitted by the thigh tracking device in real time. The motion tracking device may be a waist tracking device, a hand tracking device, a head tracking device, etc., and may be selected and configured according to specific application scenarios, and the embodiment of the present disclosure does not impose any specific limitations.

[0143] Furthermore, a first movement time and a first movement posture are determined based on the movement signal. Here, the first movement may be a stepping movement, a kicking movement, etc., and may be specifically set according to the application scene. For example, the first movement is a stepping movement, and the first movement posture is a posture of the stepping movement. Here, the first movement posture refers to the user's body movement posture, such as a stepping movement posture, a kicking movement posture, etc., and the first movement time refers to the time point of the movement. More specifically, a target position can be determined according to the movement posture, and the time point at the target position of the movement is recorded as the movement time.

[0144] In the embodiments of the present disclosure, there are many ways to determine the first motion time and the first motion posture based on the received motion signal, and in some embodiments, the motion signal includes a timestamp, an acceleration signal, and an angular velocity signal, and the first motion time and the first motion posture are determined based on the timestamp, the acceleration signal, and the angular velocity signal.

[0145] In some other embodiments, the motion signal includes a timestamp, an acceleration signal, an angular velocity signal, and a magnetometer signal, and the first motion time and the first motion attitude are determined based on the timestamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0146] The above two methods are merely examples of determining the first operation time and the first operation posture based on the received operation signal, and the embodiments of the present disclosure do not impose any limitations on the specific implementation form of determining the first operation time and the first operation posture based on the received operation signal.

[0147] Step 702: Determine a target object whose object information matches the first motion time and the first motion posture.

[0148] Here, if the object information of an object matches the first motion time and the first motion posture, the object is a target object. The target object may have different shapes, such as a musical note or a circle, and may be specifically selected and set according to the application scenario, and the embodiments of the present disclosure do not impose specific limitations. The object information includes the object position, the effective motion time, etc., and specific object information is set according to the object.

[0149] In the embodiments of the present disclosure, there are many ways to determine a target object, and in some embodiments, the object information includes a first effective action time and an object position, and if the first action time matches the first effective action time and the first action posture matches the object position, the object is determined to be a target object.

[0150] In some other embodiments, the object information includes a first effective action time, a second effective action time, and an object position, and if the first action time matches the first effective action time and the first action posture matches the object position, and a second action time and a second action posture are determined based on the action signal received again, and if the second action time matches the second effective action time and the second action posture matches the object position, the object is determined to be a target object.

[0151] The above two methods are merely examples of determining a target object, and the embodiments of the present disclosure do not impose any specific limitations on the method of determining a target object.

[0152] Step 703: Play a first processing effect corresponding to the target object.

[0153] In the embodiment of the present disclosure, the first processing effect may be custom-configured according to the needs of the application scenario, further meeting the usage needs of the user.

[0154] In some embodiments of the present disclosure, the first processing effect corresponding to the target object may be played in various ways. In some embodiments, the first processing effect may be played by playing a sound effect corresponding to the target object and / or switching the display state of the target object, for example, playing a sound effect corresponding to the target object and simultaneously switching the object shape of the target object to a disintegrated state. In other embodiments, the first processing effect may be played by playing a sound effect corresponding to the target object and / or displaying a predetermined lighting effect, for example, playing a sound effect corresponding to the target object and simultaneously displaying a bloom effect.

[0155] The above two methods are merely examples of reproducing a first processing effect corresponding to a target object, and the embodiments of the present disclosure do not impose any restrictions on the specific implementation form of reproducing a first processing effect corresponding to a target object.

[0156] The data processing solution according to the embodiment of the present disclosure determines a first motion time and a first motion posture based on the received motion signal, determines a target object whose object information matches the first motion time and the first motion posture, and plays a first processing effect corresponding to the target object. By adopting the above technical solution to recognize the motion posture based on the received motion signal, determine the target object according to the position corresponding to the motion posture, and play the corresponding processing effect, it is possible to quickly recognize the position corresponding to the motion posture and determine the target object based on only a simple motion signal, further improving data processing efficiency and greatly improving the user's experience of interacting using arbitrary motions.

[0157] In some embodiments, the data processing method is applied to a head-mounted display device and further includes displaying a target object in a virtual reality scene, wherein a ground plane of the virtual reality scene is aligned with a ground plane of the real scene.

[0158] Here, the head-mounted display device may be, for example, virtual reality glasses, and the virtual reality scene may be any virtual reality scene related to movement rhythm, such as a music game or an object-stepping game. The ground of the virtual reality scene and the ground of the real scene are aligned, and after wearing the body tracking device and performing a movement on the ground of the real scene, feedback can be generated in the virtual reality scene, and movement height information in the virtual reality scene remains consistent with the ground of the real scene. The target object is a virtual object in the virtual reality scene, and may be a different virtual object, such as a musical note or a circle.

[0159] In the embodiments of the present disclosure, there are various ways to display target objects in a virtual reality scene. For example, the virtual reality scene may include an object flow region, which may include multiple object trajectories, such as four object trajectories. Different object trajectories may include one or more objects. The object types of the objects may be various and are specifically determined according to the objects. For example, if the object is a musical note, it may be a short note or a long note. As can be understood, different virtual reality scenes may correspond to different motion rhythms. Therefore, the object trajectories in the object flow region, as well as the object types, number of objects, occurrence times, and movement speeds corresponding to each object trajectory, are pre-set according to the motion rhythms of different virtual reality scenes.

[0160] In the above solution, the action acts on the target object in the virtual reality scene, thereby realizing the goal of human-computer interaction in the virtual reality scene, and greatly improving the experience of the user playing games using any action in the virtual reality scene.

[0161] In some embodiments, the virtual reality scene includes a virtual object, and the method further includes controlling a display of the virtual object based on the movement signal.

[0162] In some embodiments, motion signals transmitted by motion tracking devices are received.

[0163] Here, the number of virtual objects is consistent with the number of real users, and the specific features of the virtual objects, such as their characters, may be 3D scanned and reconstructed in real time by the user, selected by the user when the virtual reality scene starts, randomly assigned by the virtual reality device, or specifically set according to different application scenes.

[0164] For example, in a real-world scene, a user wears a motion tracking device, and a motion (e.g., stepping) made on the ground is converted into a body (e.g., left and right feet) motion signal by a wireless communication system, which is then transmitted to a virtual reality device for processing. The virtual reality device processes the motion signal and controls a virtual object in the virtual reality scene to complete the body (e.g., left and right feet) motion. The motion of the virtual object hits a target object in the virtual reality scene, completing the game experience.

[0165] Specifically, the user controls the motion tracking device by moving, lifting, dropping, etc. their feet to generate motion signals, and performs motions on the ground in the game, matching them with target objects to complete the game experience.

[0166] Specifically, the motion position can be determined according to the first motion posture, for example, any object trajectory that is in the motion area during the first motion time is the motion position, that is, the motion posture corresponds to a position in the virtual reality scene, and the motion angle can be obtained based on the motion posture, and the motion position can be further determined, thereby obtaining the position change situation of the motion tracking device relative to the initial position based on the motion posture, and further improving the accuracy of the action results of the subsequent target object.

[0167] Specifically, a motion angle can be determined according to the first motion posture, where the motion angle refers to the relative angle between the pre-motion position and the post-motion position, thereby obtaining the angle change situation of the motion tracking device relative to the initial position, and further improving the accuracy of the subsequent action results of the target object.

[0168] In an embodiment of the present disclosure, an associated object of an object is displayed on the ground of the virtual reality scene, and the associated object is associated with the object position.

[0169] In an embodiment of the present disclosure, the display state of the related object at the position corresponding to the first motion posture is switched.

[0170] Specifically, a corresponding related object is set according to the object, and the related object is associated with the object position (e.g., the object trajectory to which the object position belongs). For example, if it is determined that the action is in a first object trajectory, the display state of the first object trajectory is set to a first color (a different color may be set depending on the scene, e.g., yellow), and if it is determined that the action is in a second object trajectory, the display state of the second object trajectory is set to a second color (a different color may be set depending on the scene, e.g., blue).

[0171] In the above solution, the virtual reality scene simultaneously displays actions that match the real user's, further enhancing the user's sense of participation and improving the user experience of using the virtual reality scene; and the display state of related objects is switched in real time according to the position corresponding to the movement posture to give the user hints, further improving the user experience of controlling the virtual reality scene.

[0172] In some examples, the motion signal includes a timestamp, an acceleration signal, and an angular velocity signal, and determining the first motion time and the first motion posture based on the received motion signal includes determining the first motion time and the first motion posture based on the timestamp, the acceleration signal, and the angular velocity signal.

[0173] In some embodiments, the motion signal further includes a magnetometer signal, and the method further includes determining a first motion time and a first motion attitude based on the timestamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0174] In an embodiment of the present disclosure, user posture data is collected in real time by one or more inertial sensors attached to the motion tracking device, for example, the inertial sensors include a gyroscope and an accelerometer, or the inertial sensors include a gyroscope, an accelerometer, and a magnetometer.

[0175] Specifically, two or three types of inertial sensors are employed to collect posture data, and the first operating time and the first operating posture are fusion-calculated from the data. For example, the inertial sensor includes a gyroscope and an accelerometer, collects acceleration signals and angular velocity signals at each timestamp, and performs fusion calculations on the acceleration signals and angular velocity signals at each timestamp to obtain the first operating time and the first operating posture.

[0176] As another example, the inertial sensor includes a gyroscope, an accelerometer, and a magnetometer, collects acceleration signals, angular velocity signals, and magnetometer signals at each time stamp, and performs fusion calculations on the acceleration signals, angular velocity signals, and magnetometer signals at each time stamp to obtain a first motion time and a first motion attitude.

[0177] In the above solution, two or three types of inertial sensors are selected to collect corresponding motion posture data, thereby improving the accuracy of motion posture capture and further improving the user's interaction experience in the virtual reality scene.

[0178] In some embodiments, the object information includes a first effective action time and an object position, and determining the target object includes determining that the object is the target object if the first effective action time matches the first effective action time and the first action posture matches the object position.

[0179] In an embodiment of the present disclosure, the object information further includes a second effective action time, and the method further includes determining a second action time and a second action posture based on the received action signal, and playing a second processing effect corresponding to the target object when the second action time matches the second effective action time and the second action posture matches the object position.

[0180] Specifically, in the object flow region, no feedback is provided to the action signal when the object moves within the region. As can be understood, different object types contain different corresponding object information. Therefore, the determination methods for valid actions based on different physical information may be different.

[0181] Specifically, when the object information includes a first effective action time and an object position, if the first action time matches the first effective action time and the first action posture matches the object position, the object is determined to be a target object.

[0182] In an embodiment of the present disclosure, a target object is displayed at a first effective time and object position.

[0183] Specifically, a first object trajectory is determined based on the object position, and a first trigger area is displayed on the first object trajectory within a first effective action time. The first trigger area refers to an effective trigger area displayed on the first object trajectory after the action, i.e., after determining the target object according to the first action time and the first action posture (i.e., the position corresponding to the first action posture), the first trigger area is displayed while the target object is exactly within the first trigger area.

[0184] Specifically, when the first trigger area is displayed, whether the object is exactly within the first trigger area may be determined based on whether the first trigger area is within a first effective action time range, e.g., -200 ms to +200 ms. If the first action time is within the first effective action time range, the object can be confirmed as a target object. Here, the specific size of the first trigger area may be set according to the application scenario, i.e., the first effective action time range may also be set according to the specific application scenario, thereby meeting the usage needs of different users. Therefore, after determining the target object based on the action time and action posture (i.e., the position corresponding to the action posture), the trigger area is displayed, and the target object is confirmed to be exactly within the trigger area, thereby further enhancing the subsequent object playback effect.

[0185] Specifically, when the object information further includes a second effective action time, a second action time and a second action posture are determined based on the received action signal, and if the second action time matches the second effective action time and the second action posture matches the object position, a second processing effect corresponding to the target object is played.

[0186] Specifically, after a user makes a motion, the user must remain motionless for a predetermined period of time before moving again, so that the motion position can be considered to be effectively matched with the object only when it continuously contacts the object. For example, the object is a long note, which includes an initial note (the initial position of the note), a note band (the note band for which the motion tracking device performs position matching), and a final note (the final note for determining whether the user has completed the note). That is, if a first motion posture matches the initial note within a first motion effective time range, it can be determined as an initial hit, and the user must continue to complete the note band and the final note. That is, after a motion, the motion tracking device can strike the object band by remaining motionless within a predetermined period of time, and then obtain a second motion posture. If the second motion posture matches the final note within the second motion effective time range, it can be determined as a final hit. Thus, the object is determined to be a target object through the two motion postures, and a second processing effect corresponding to the target object is played, further enhancing the object playback effect.

[0187] In the embodiment of the present disclosure, the motion signal is a three-degree-of-freedom signal, and the motion posture can be recognized according to the received motion signal, and the target object can be determined according to the position corresponding to the motion posture. The calculation requirements for the motion tracking device and the head-mounted display device are relatively low, and the correspondence between the motion posture and the position is introduced, so that the target object can be determined according to the position corresponding to the motion posture using only three-degree-of-freedom data. While ensuring data processing accuracy, data processing efficiency is reduced, and the user experience is ensured.

[0188] In the embodiment of the present disclosure, the action score of the target object is determined and displayed based on the first action time and the first action effective time.

[0189] Here, the first action valid time of the target object is, for example, within the valid time range when the target object appears in the trigger area, e.g., -200 ms to +200 ms, and immediately after the target object reaches the trigger area is, for example, -200 ms, and the first action time is just after the target object reaches the trigger area, so the action score of the target object is determined to be 60 points. Also, for example, the valid time when the target object appears in the trigger area is -200 ms to +200 ms, and when the target object completely overlaps the trigger area is, for example, 0 ms, and the first action time is just after the target object reaches the trigger area, so the action score of the target object is determined to be 100 points.

[0190] In the above solution, the action score of the target object is determined and displayed based on the first action time and the first action effective time, and the action result is provided more intuitively, so that the user can continue to perform the action while maintaining the rhythm or can be given hints to adjust the action rhythm in real time, thereby improving the action effect and the user's usage experience.

[0191] In some embodiments, playing an object effect corresponding to the target object includes playing an audio effect corresponding to the target object and / or toggling a display state of the target object.

[0192] Here, the audio effect refers to the audio corresponding to the target object, i.e., playing the corresponding object rhythm and / or changing the display state of the target object, for example, switching the target object to an object crushing state, etc., and may be specifically set according to the application scene.

[0193] In the above solution, by playing audio effects corresponding to the target object and / or switching the display state of the target object, the user can understand the operation results in real time, which further improves the user experience.

[0194] 8 is a schematic diagram showing the flow of another data processing method according to an embodiment of the present disclosure. This embodiment further optimizes the above data processing method based on the above embodiment. As shown in FIG. 8, the method is applied to a head-mounted display device and includes the following steps:

[0195] Step 801: The ground plane of the virtual reality scene is aligned with the ground plane of the real scene, and an object is displayed in the virtual reality scene.

[0196] Step 802: Receive the motion signal sent by the motion tracking device, control the display of the virtual object based on the motion signal, and display an associated object of the object on the ground of the virtual reality scene, where the associated object is associated with the object position.

[0197] Step 803: The motion signal includes a timestamp, an acceleration signal, an angular velocity signal, and a magnetometer signal, and a first motion time and a first motion posture are determined based on the timestamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0198] 9 is a schematic diagram of a real scene and a virtual reality scene according to an embodiment of the present disclosure. As shown in FIG. 9, in the real scene, a user wearing a VR device and a motion tracking device stands on a real ground. In the virtual reality scene, a virtual object stands in a motion area. When the user is stationary and there is no change in the motion tracking device, the position of the virtual object in the virtual reality scene does not change. The same height parameter as in the real scene is transmitted to the virtual reality scene.

[0199] 10a is a schematic diagram of a stepping scene according to an embodiment of the present disclosure. When a user stands normally, if the thigh tracking device can obtain that the thigh tracking device remains unchanged according to the timestamps, acceleration signals, angular velocity signals, and magnetometer signals collected by the thigh tracking device, the virtual object will maintain the posture of the stepping motion in a standing state in the virtual scene.

[0200] 10b is a schematic diagram of another stepping scene according to an embodiment of the present disclosure. The thigh tracking device worn by the user can recognize the user's motion posture and motion time according to the timestamp, acceleration signal, angular velocity signal, and magnetometer signal collected by the thigh tracking device. That is, after recognizing the user's motion according to the angular velocity and acceleration, the motion time is determined. For example, the thigh tracking device may detect a sudden change in the angular velocity and acceleration collected by the thigh tracking device. According to the angular velocity and acceleration, the user's foot may be recognized as lifted. At the same time, the virtual object in the virtual reality scene performs a foot-lifting motion. That is, the posture of the virtual object's stepping motion is that the foot is lifted but not yet stepped.

[0201] 10c is a schematic diagram of another stepping scene according to an embodiment of the present disclosure. The thigh tracking device worn by the user can recognize the user's motion posture and motion time according to the timestamp, acceleration signal, angular velocity signal, and magnetometer signal collected by the thigh tracking device. For example, if the thigh tracking device detects changes in both angular velocity and acceleration in the real scene and recognizes that the position of the user's thigh has shifted to the left according to the angular velocity and acceleration change results, the stepping posture of the virtual object in the virtual reality scene is a posture in which the foot is biased toward the leftmost object trajectory. The display state of the related object (object trajectory) at a position corresponding to the stepping posture may be switched, and the color of the object trajectory may change from the previous object trajectory to the new object trajectory.

[0202] For example, Figure 10d is a schematic diagram of another stepping scene according to an embodiment of the present disclosure. The thigh tracking device worn by the user can recognize the user's movement posture and movement time according to the timestamp, acceleration signal, angular velocity signal, and magnetometer signal collected by the thigh tracking device. For example, the thigh tracking device can detect changes in both angular velocity and acceleration, and recognize changes in the user's thigh movement according to the resulting angular velocity and acceleration changes, for example, stepping on the spot. As shown in Figure 10e, the stepping posture of the virtual object in the VR scene matches the stepping posture of the user's thigh in the real scene. After recognizing the user's stepping motion according to the angular velocity and acceleration, the stepping motion duration is determined. As a result, when the user steps on the ground, a corresponding state change (e.g., color change) occurs in the stepping area, i.e., the floor, and the step is completed.

[0203] It should be noted that the above magnetometer signal may be used to calibrate angular velocity and acceleration data, further improving the accuracy of motion posture and motion time recognition, thereby enhancing the subsequent user experience.

[0204] Furthermore, when the thigh tracker finishes stepping on the floor, the thigh tracker will realign and clearly obtain a new origin, as shown in Figure 10d, so that the next step can be determined.

[0205] In one example of a scene, the virtual reality scene includes four object trajectories, and the user's thighs are positioned midway between the four object trajectories. For example, the user's right thigh steps vertically downward, and the corresponding object trajectory is determined to be the third object trajectory depending on the movement posture. Also, for example, if the user's right thigh steps diagonally to the right, the corresponding object trajectory is determined to be the fourth object trajectory depending on the movement posture. Note that the movement posture corresponds to the object trajectory, and if the stepping is determined to be the third object trajectory depending on the position corresponding to the movement posture, even if the user's thigh moves parallel to the right and then steps vertically, the fourth object trajectory will not be stepped on. This allows the object trajectory to be uniquely determined depending on the position corresponding to the movement posture, further improving the accuracy of movement result determination and further enhancing the user's usage experience.

[0206] Step 804: The object information includes a first action effective time and an object position, and if the first action time matches the first action effective time and the first action posture matches the object position, it is determined that the object is a target object.

[0207] Step 805: The object information further includes a second action effective time, and based on the received action signal, a second action time and a second action posture are determined, and if the second action time matches the second action effective time and the second action posture matches the object position, a second processing effect corresponding to the target object is played.

[0208] In an embodiment of the present disclosure, a target object is displayed at a first effective time and object position.

[0209] 11 is a schematic diagram of a track area according to an embodiment of the present disclosure, taking the case where the action is a stepping action and the object is a musical note as an example. The figure shows a schematic diagram of one track area, in which the track area includes a note flow area A and a stepping area B, and there are four note trajectories, divided into two on the left (note trajectory 1 and note trajectory 2) and two on the right (note trajectory 3 and note trajectory 4). After determining that a step has been made in a stepping area, a hint is triggered and a "stay effect" display is provided, for example, the left thigh is displayed in yellow and the right thigh is displayed in blue, giving the user a hint to step in the stepping area and also hinting at different note trajectories.

[0210] Specifically, notes appear far away in the note flow area and move to the step area according to the tempo. If a virtual object is present, the virtual object moves to an area where both feet can reach. Therefore, it is necessary to set a track distance, such as the track distance L shown in Figure 11, which is usually set to a value greater than 1 meter, such as 1.1 meters, and can be dynamically adjusted according to different users to further satisfy the user's stepping experience.

[0211] 11, note trajectory 1 in the note flow area includes a long note a1 and a long note a2, note trajectory 2 includes a short note b1 and a short note b2, note trajectory 3 includes a short note b3 and a short note b4, and note trajectory 4 includes a long note a3 and a long note a4. Here, the short notes are notes that are stepped on to hit, and the long notes need to be held still after being stepped on by the user, so that the foot touches consecutive notes in succession and then is raised again to complete the step on the long note.

[0212] As can be seen, the number of notes at the note generation point may be four. The note generation point is the same as the generation points of other notes, but it needs to be close to the ground and move along a parallel trajectory. The speed of the note movement may be set according to the application scenario. The note has a relatively small area when generated and grows larger as it moves into the step area. For example, when a note is generated, it shrinks by 50% of its target size, and when it moves into the step area, its size becomes 100%. In other words, the note generation position shifts from a position close to approximately 20% of the center of the trajectory (on the XY plane) and moves to the final position (X, Y) when it moves into the step area.

[0213] Specifically, the user steps on the ground in reality, activates a trigger area in the virtual reality scene after stepping, and hits a musical note in the trigger area.

[0214] For example, Figure 12a is a schematic diagram of a short note step according to an embodiment of the present disclosure. As shown in Figure 12a, when the left foot steps on note trajectory 2, a trigger area is displayed, but the note does not reach the trigger area, and the note is not hit after the left foot step ends. Figure 12a also displays a feedback display after the step, indicating that the note is not hit at this time. Figure 12a further indicates that the step width L2 is 110 cm, and note trajectory 2 includes a left-foot short note, while note trajectories 3 and 4 both include a right-foot short note, a "miss," and a "perfect hit."

[0215] When the note has not yet reached the trigger area, the step time at which the left foot steps on the ground, the note enters the trigger area, and the note is completely struck is T=0. If the note is hit within the effective step time range, for example, T=[200,-200] milliseconds, it can be determined to be an initial hit.

[0216] For example, Figure 12b is a schematic diagram of another short note step according to an embodiment of the present disclosure. As shown in Figure 12b, when the right foot steps on note trajectory 4, a trigger area is displayed. When the right foot steps, the note is hit when the right foot steps. When the note reaches the trigger area, the right foot steps on the ground. The right foot short note is within the trigger area, and the note is hit. The step time for the note to be completely struck is T = 0. If the note is determined to be hit within a valid step time range, for example, T = [200, -200] milliseconds, an initial hit can be determined. Figure 12b further shows that the step width L2 is 110 cm. Note trajectory 2 includes a left foot short note, and note trajectories 3 and 4 both include a right foot short note, a "miss," and a "perfect hit."

[0217] For example, Figure 12c is a schematic diagram of a long note step according to an embodiment of the present disclosure. As shown in Figure 12c, when the initial note reaches the trigger area, the right foot steps on the ground, and the right foot short note is within the trigger area. The note is hit and the step time for the note to be fully struck is T = 0. If the note is determined to be hit within a valid step time range, for example, T = [200, -200] milliseconds, it can be determined to be an initial hit, and the user must continue to complete the note band and the final note. The user must perform a stepping motion to step on the initial note. Figure 12c further shows that the step width L2 is 110 cm. Note trajectory 2 includes a left foot short note, note trajectory 3 includes a right foot short note, and note trajectory 4 includes a right foot long note, a "miss," and a "perfect hit."

[0218] Specifically, if the user maintains the foot position after stepping, the note band can be struck. The user's foot tracking device must be held on the same side as the trajectory, and if the consecutive positions are correct, the notes are determined to be consecutive and correct. Whether the user's foot position is continuously maintained is determined according to the tempo, and if not, the strike is determined to be unsuccessful. If the user's foot tracking device is maintained on the same trajectory and reaches the final note, the note determination for that round is determined to be complete; otherwise, the hit is unsuccessful.

[0219] Step 806: Play an audio effect corresponding to the target object and / or switch the display state of the target object.

[0220] Step 807: Determine and display a motion score of the target object based on the first motion time and the first motion effective time.

[0221] Specifically, the virtual object may be controlled to perform an action on a target object based on the action signal, matched to the target object, displayed, and then feedback after matching to the target object may be displayed. For example, after triggering the target object, a "trigger effect" called blooming may appear, and the target object may be broken up. After the action, the object's trajectory may be highlighted. After the action is successful, the striking evaluation result may appear in the virtual reality scene. Here, for example, in the case of a long note, the evaluation is not displayed when the initial note is stepped on, but is displayed after the final note is stepped on.

[0222] After wearing the VR device and the motion tracking device, the user can perform actions such as stepping on the trajectory area in the VR game and hit objects in the game. The motion tracking device achieves the goal of human-computer interaction in the VR system, and the VR device makes real-time adjustments to the virtual reality scene according to the motion signals, and by applying posture tracking, spatial alignment, etc., it realizes interaction between the person and the virtual reality scene.

[0223] A data processing scheme according to an embodiment of the present disclosure includes: a ground plane of a virtual reality scene and a ground plane of a real scene are aligned; an object is displayed in the virtual reality scene; a motion signal transmitted by a motion tracking device is received; a display of the virtual object is controlled based on the motion signal; an associated object of the object is displayed on the ground plane of the virtual reality scene; the associated object is associated with an object position; the motion signal includes a timestamp, an acceleration signal, an angular velocity signal, and a magnetometer signal; a first motion time and a first motion attitude are determined based on the timestamp, the acceleration signal, the angular velocity signal, and the magnetometer signal; the object information includes a first motion effective time and an object position; and determining a second action time and a second action posture based on the received action signal, and if the second action time matches the second action valid time and the second action posture matches the object position, playing a second processing effect corresponding to the target object, playing a sound effect corresponding to the target object, and / or switching the display state of the target object, and determining and displaying an action score of the target object based on the first action time and the first action valid time. By adopting the above technical solution, an action such as hitting an object in a virtual scene can be performed by an action such as stepping on a thigh, and at the same time, related action result information is displayed in real time, allowing the user to understand the action result in a timely manner, increasing the user's action enjoyment, and greatly improving the user's experience of playing games using actions such as foot movements in a virtual reality scene.

[0224] 13 is a schematic diagram of a data processing device according to an embodiment of the present disclosure. The device may be implemented in software and / or hardware, and may generally be integrated into electronic equipment. As shown in FIG. 13, the device includes: a first determination module 1301 for determining a first motion time and a first motion posture according to the received motion signal; a second determination module 1302 for determining a target object whose object information matches the first motion time and the first motion posture; and a replay module 1303 for replaying a first processing effect corresponding to the target object.

[0225] In some embodiments, the data processing device is applied to a head-mounted display device, the device comprising: The system further includes a first display module for displaying the target object in a virtual reality scene, wherein a ground plane of the virtual reality scene is aligned with a ground plane of a real scene.

[0226] In some embodiments, the virtual reality scene includes a virtual object, and the device comprises:

[0227] The device further includes a control module for controlling the display of the virtual object based on the motion signal.

[0228] In some embodiments, the motion signal includes a timestamp, an acceleration signal, and an angular velocity signal, and the first determination module 1301 specifically: The first motion time and the first motion posture are determined based on the time stamp, the acceleration signal, and the angular velocity signal.

[0229] In some embodiments, the operating signal further comprises a magnetometer signal, and the first determining module 1301 specifically further comprises: The first motion time and the first motion posture are determined based on the time stamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0230] In some embodiments, the object information includes a first action effective time and an object position, and the second determination module 1302 specifically: If the first motion time matches the first motion effective time and the first motion posture matches the object position, the object is used to determine that it is a target object.

[0231] In some embodiments, the object information further includes a second effective time for operation, and the device: a third determination module for determining a second motion time and a second motion posture based on the received motion signal; The playback module 1303 is further used for playing a second processing effect corresponding to the target object when the second action time matches the second action effective time and the second action posture matches the object position.

[0232] In some embodiments, the device comprises: The virtual reality scene further includes a second display module for displaying an associated object of the object on a ground surface of the virtual reality scene, the associated object being associated with the object position.

[0233] In some embodiments, the device comprises: The device further includes a switching module for switching a display state of a related object at a position corresponding to the first motion posture.

[0234] In some embodiments, the device comprises: The device further includes a third display module for displaying the target object at the first effective operating time and the object position.

[0235] In some embodiments, the playback module 1303 specifically: It is used to play a sound effect corresponding to the target object and / or to switch the display state of the target object.

[0236] In some embodiments, the device comprises: The device further includes a determination and display module for determining and displaying an action score of the target object based on the first action time and the first action effective time.

[0237] In some embodiments, the first motion is a stepping motion, and the first motion posture is a posture of the stepping motion.

[0238] In some embodiments, the movement signal is a three degree of freedom signal.

[0239] The above modules may be implemented as software components running on one or more general-purpose processors, or as hardware for performing certain functions, such as programmable logic devices and / or application-specific integrated circuits. In some embodiments, the modules may be embodied in the form of a software product, which may be stored on a non-volatile storage medium. These non-volatile storage media may include a computer device (e.g., a personal computer, a server, a network device, a mobile terminal, etc.) that executes the methods described in the embodiments of the present disclosure. In some embodiments, the above modules may be implemented on a single device or distributed across multiple devices. The functions of the modules may be integrated with each other or further divided into multiple sub-modules.

[0240] 14 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure, which may be performed by a data processing device, which may be implemented in software and / or hardware and may generally be integrated into electronic equipment.

[0241] The technical solution according to the embodiment of the present disclosure has the following advantages over the related art: the data processing solution according to the embodiment of the present disclosure displays a trigger device and a target object in a virtual reality scene, determines an operating position based on an operating signal, determines a trigger time according to the operating position and the position of the trigger device, determines a target object whose object information matches the trigger time and the position of the trigger device, and plays an effect corresponding to the target object. By adopting the above technical solution, an accurate operating signal can be obtained based on the displayed trigger device, and the trigger device can be accurately acted on to determine the target object and play an effect corresponding to the target object, thereby improving the accuracy of data processing and greatly improving the user's experience in the virtual reality scene.

[0242] As shown in FIG. 14, the method includes the following steps:

[0243] Step 1401: Display a trigger device and a target object in a virtual reality scene.

[0244] Here, the virtual reality scene may be any one of virtual reality scenes, such as a scene from a music game or a musical note action game, or an interface interaction scene. The trigger device refers to a device that can generate a trigger effect (such as a sound wave, an electromagnetic wave, a spark, or an arc) after receiving a trigger operation. The shape of the trigger device may be selected and set according to the application scene, such as an oval disk or a disc. The trigger device and the trigger effect may be selected and set according to the application scene, and the embodiments of the present disclosure do not impose any specific limitations. The target object refers to an object that can be triggered in the virtual reality scene, such as a musical note or a display interface. The shape of the target object may be selected and set according to the application scene, and the embodiments of the present disclosure do not impose any specific limitations.

[0245] Here, the trigger device and the target object may be displayed, and the positional relationship between the trigger device and the target object, i.e., the relative positions of the trigger device and the target object, may be acquired in real time. As can be understood, the position of the target object corresponding to each time point in the virtual reality scene may be preset. For example, in a virtual music rhythm game scene, the position of the musical note (target object) corresponding to each time point may be preset according to the music rhythm. Furthermore, for example, in a predetermined virtual browsing interaction scene, the position of the page corresponding to each time point may be preset according to text information.

[0246] Specifically, in a virtual reality scene, the trigger device generally remains stationary, while the target object's position is updated over time. Therefore, by displaying the trigger device and the target object in real time, the user can intuitively see the relative positions of the target object and the trigger device. When the target object and the trigger device overlap, an operation signal is sent to trigger the trigger device. Displaying the trigger device and the target object in real time provides the user with hints for controlling the operating position and operating time of the trigger device, further improving the accuracy of the processing effect.

[0247] Step 1402: Determine an operating position based on the operating signal.

[0248] Here, the motion signal is, for example, a six-degree-of-freedom signal (movement degrees of freedom along three orthogonal coordinate axes, x, y, and z, and rotation degrees of freedom around these three coordinate axes), and may be a motion signal including the position and orientation of a gamepad transmitted by a user controlling an external device, for example, by operating a gamepad, or the motion signal may be the position and orientation of an external device calculated by image recognition from an image of the user's own orientation and the external device (for example, a gamepad) collected by a data processing device (for example, a head display device). The motion position may refer to the position of the external device, or may be the position of a control device in a virtual reality scene controlled by the external device.

[0249] As can be appreciated, the operating signal may act directly on the trigger device, or may act on the trigger device via the control device by displaying the control device in a virtual reality scene and the operating signal acting on the control device.

[0250] In some embodiments, the position and orientation of an external device are acquired based on the motion signal, and the motion position is determined according to the position and orientation of the external device. In other embodiments, the position and orientation of a control device in a virtual reality scene are acquired based on the motion signal, and the motion position is determined according to the position and orientation of the control device.

[0251] The above two methods are merely examples of determining the operating position based on the operating signal, and the embodiments of the present disclosure do not impose any specific limitations on the implementation of determining the operating position based on the operating signal.

[0252] Step 1403: Determine the trigger time according to the operating position and the position of the trigger device.

[0253] Here, the trigger time refers to the time when the trigger device is triggered, that is, the time when the operating position and the position of the trigger device come into contact with each other.

[0254] In the embodiments of the present disclosure, there are many ways to determine the trigger time according to the operating position and the position of the trigger device, and in some embodiments, the trigger time is determined as the time point recorded when the operating position and the position of the trigger device overlap according to the operating position and the position of the trigger device. In other embodiments, the speed of the operation signal is determined according to the operating signal, and if the speed of the operation is greater than a predetermined speed threshold, the trigger time is determined as the time point recorded when the operating position and the position of the trigger device overlap.

[0255] The above two methods are merely examples of determining the trigger time depending on the operating position and the position of the trigger device, and the embodiments of the present disclosure do not impose any specific limitations on the implementation form of determining the trigger time depending on the operating position and the position of the trigger device.

[0256] Step 1404: Determine a target object whose object information matches the trigger time and the position of the trigger device.

[0257] Here, if the object information of an object matches the trigger time and the position of the trigger device, the object is a target object. The target object may have different shapes, such as a musical note, a circle, etc., and may be specifically selected and set according to the application scenario, and the embodiments of the present disclosure do not impose specific limitations. The object information includes object time, object position, etc., and specific object information is set according to the object.

[0258] In the embodiments of the present disclosure, there are many ways to determine a target object. In some embodiments, the object information includes an object time and an object position. If the object position matches the position of the trigger device, i.e., the object position and the position of the trigger device correspond to the same direction or position area, and the value of the time difference between the object time and the trigger time meets a predetermined time range, the object is determined to be a target object.

[0259] In some other embodiments, the object information includes object time and object position, and if the value of the position distance difference between the object position and the position of the trigger device satisfies a predetermined distance range and the value of the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be a target object.

[0260] The above two methods are merely examples of determining a target object, and the embodiments of the present disclosure do not impose any specific limitations on the implementation of determining the target object.

[0261] Step 1405: An effect corresponding to the target object is played.

[0262] Here, the effect may be selected and set depending on the application scene, for example, updating the display state of the shape, color, etc. of the target object.

[0263] In the embodiments of the present disclosure, there are many ways to play an effect corresponding to the target object, and in some embodiments, the text information corresponding to the trigger result and the trigger score are displayed simultaneously, and the display state of the target object is switched. In other embodiments, a trigger level corresponding to the trigger result is obtained, the trigger level is displayed, and the display state of the target object is switched.

[0264] The above two methods are merely examples of playing an effect corresponding to a target object, and the embodiments of the present disclosure do not impose any specific limitations on the implementation form of playing an effect corresponding to a target object.

[0265] The data processing solution according to the embodiment of the present disclosure displays a trigger device and a target object in a virtual reality scene, determines an operating position based on an operating signal, determines a trigger time according to the operating position and the position of the trigger device, determines a target object whose object information matches the trigger time and the position of the trigger device, and plays an effect corresponding to the target object. By adopting the above technical solution, an accurate operating signal can be obtained based on the displayed trigger device, and the trigger device can be accurately acted on to determine the target object and play an effect corresponding to the target object, thereby improving the accuracy of data processing and greatly improving the user's experience in the virtual reality scene.

[0266] In some embodiments, the method further comprises playing a trigger effect at the trigger time at the location of the trigger device.

[0267] Here, the trigger effect refers to an effect that is displayed when the trigger device is acted upon, and the trigger effect may be one or more of a sound wave effect, an electromagnetic wave effect, a spark effect, and an arc effect.

[0268] In an embodiment of the present disclosure, the trigger device includes a plurality of trigger segments, and playing a trigger effect at a position of the trigger device includes determining a target trigger segment from the plurality of trigger segments according to the position of the trigger device, and triggering an effect at the position of the target trigger segment.

[0269] In an embodiment of the present disclosure, the trigger device may be divided into multiple trigger segments, and the trigger device may be controlled to trigger an effect only at the position (e.g., the center position) of the target trigger segment to which the trigger device belongs, and the target trigger segment may be controlled to vibrate, thereby providing hints to the user and further enhancing the user's interaction experience.

[0270] As can be understood, the object information includes object time and object position, and if the object position matches the position of the trigger device, i.e., the object position matches the position of the target trigger segment, i.e., the object position and the position of the target trigger segment correspond to the same direction or position area, and the value of the time difference between the object time and the trigger time meets a predetermined time range, the object is determined to be a target object.

[0271] In the above solution, a trigger effect is played by a trigger device to enhance the richness of interaction in the virtual reality scene; the trigger device is divided into multiple trigger segments, and the target trigger segment to which the position of the trigger device belongs can be controlled to vibrate to trigger an effect, which further enhances the interest of the display and interaction in the virtual reality scene, meets more of the user's usage needs, and improves the user's usage experience.

[0272] In some embodiments, the actuation speed is determined in response to the actuation signal, and if the actuation speed is greater than a predetermined speed threshold, the trigger time is determined in response to the actuation position and the position of the trigger device.

[0273] In an embodiment of the present disclosure, a data processing device (e.g., a head display device) collects images of an externally connected device (e.g., a gamepad), obtains the motion speed through an image recognition algorithm, and determines the trigger time according to the motion position and the position of the trigger device if the motion speed is greater than a predetermined speed threshold, where the speed threshold may be set according to the application scenario.

[0274] When the motion speed is equal to or less than a predetermined speed threshold, even if it is determined that the motion position and the position of the trigger device overlap, the trigger time is not determined.

[0275] In the above solution, the trigger time is determined according to the operating position and the position of the trigger device only when the operating speed is greater than the speed threshold, thereby avoiding false triggering, further improving the accuracy of data processing, and improving the user experience.

[0276] In some embodiments, the object information includes an object time and an object position, and determining the target object includes determining that the object is the target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range.

[0277] In the embodiments of the present disclosure, the trigger effect generated by the trigger device can act on the target object to obtain a trigger result, which can be set according to the application scenario, and can be a successful trigger or a failed trigger, or a perfect trigger, a good trigger, a moderate trigger, a failed trigger, etc.

[0278] Specifically, the time when the trigger device is triggered may be acquired as the trigger time. As can be understood, the position of the target object is constantly updated over time, i.e., the positional relationship between the target object and the trigger device is constantly updated, and at the object time, the target object is displayed at the object position. For example, the overlap between the target object and the trigger device can be regarded as the overlap between the target object and any one of the trigger segments in the trigger device.

[0279] Furthermore, a time difference value is determined based on the trigger time and the object time, i.e., the time difference value between the trigger time and the object time. As can be understood, the smaller the time difference value, the higher the accuracy of the trigger time and the better the trigger effect. Therefore, the trigger result can be determined based on the time difference value and the predetermined time range.

[0280] In the embodiments of the present disclosure, there are many ways to determine a trigger result based on the time difference value and the predetermined time range. In some embodiments, the time range includes a first time sub-range, a second time sub-range, and a third time sub-range, where the first time sub-range is lower than the second time sub-range, and the method further includes: determining a first trigger result if the time difference value is within the first time sub-range; determining a second trigger result if the time difference value is within the second time sub-range; determining a third trigger result if the time difference value is within the third time sub-range; and determining a fourth trigger result if the time difference value is beyond the third time sub-range.

[0281] Specifically, the time range is divided into different time subranges, and the corresponding trigger result within each time subrange is determined according to the time difference value. For example, the first time subrange is 0 to 50 ms, the second time subrange is 50 to 120 ms, and the third time subrange is 120 to 200 ms. For example, if the time difference value is 10 ms, it is within the first time subrange of 0 to 50 ms, and the first trigger result is determined to be a perfect trigger. For example, if the time difference value is 210 ms, it is outside the third time subrange of 120 to 200 ms, and the fourth trigger result is determined to be a no-hit.

[0282] In some other embodiments, a time sub-range to which the time difference value belongs is determined, and a score calculation formula corresponding to the time sub-range is obtained and calculated for the time difference value, and the trigger score is obtained as the trigger result.

[0283] In an embodiment of the present disclosure, a score range corresponding to each time subrange is obtained, and a calculation is performed based on each time subrange, each score range, and the time difference value to obtain a trigger score for each trigger result.

[0284] As an example, a first time sub-range is 0 to 50 ms, the corresponding score range is 100 to 120, and the time difference value is 10 ms. First, subtract 100 from 120 to get a difference value of 20, then divide the time difference value of 10 ms by 50 ms and multiply by the difference value 20 to get 4. Next, subtract 4 from 120 to get the trigger score 116.

[0285] In the above solution, the trigger result is determined according to the time difference between the trigger time and the object time, thereby improving the accuracy of the trigger result, and further dividing the trigger result into smaller parts according to the time difference and the predetermined time range, and calculating the trigger score for each trigger result to provide to the user, so as to let the user understand more specific trigger results, meet the user's usage needs, and improve the user's usage experience.

[0286] In some embodiments, the trigger score and text information corresponding to the trigger result are displayed, and / or the display state of the target object is toggled.

[0287] For example, if the trigger result is successful, text information corresponding to the trigger result and the trigger score are displayed, and the display state of the target object is switched to, for example, a crushed state. If the trigger result is unsuccessful, text information corresponding to the trigger result and the trigger score are displayed.

[0288] Here, different trigger results correspond to different text information and trigger scores. The display state of the target object can be preset according to application needs, such as displaying different shapes, colors, etc.

[0289] In an embodiment of the present disclosure, if the trigger result is successful, text information corresponding to the trigger result and a trigger score may be displayed, and / or the display of the target object may be switched to, for example, a disintegrated state, thereby further enhancing the display of the trigger effect in the virtual reality scene and improving the user's operating experience.

[0290] 15 is a schematic diagram showing the flow of another data processing method according to an embodiment of the present disclosure. This embodiment further optimizes the above data processing method based on the above embodiment. As shown in FIG. 15, the method includes the following steps:

[0291] Step 1501: Display a trigger device and a target object in a virtual reality scene.

[0292] 16a is a schematic diagram illustrating a virtual reality scene in which a trigger device and a target object are displayed according to an embodiment of the present disclosure. The diagram illustrates a virtual reality scene including a trigger device 11 and a target object 12, the trigger device 11 being configured in an oval shape, and a user may trigger the trigger device 11 by transmitting an operation signal.

[0293] As can be seen, for example, as shown in FIG. 16b, the trigger device 11 and the target object 12 are updated in real time. Compared with FIG. 16a, the displayed positional relationship between the trigger device 11 and the target object 12 is updated and displayed in real time. This allows the user to intuitively see the positional relationship between them. As a result, the trigger device 11 and the target object 12 control external devices to trigger the trigger device. In other words, by displaying the positional relationship between the trigger device 11 and the target object 12 in real time in the virtual reality scene, the user can be given a hint about the operation time and operation position of the trigger device 11, thereby ensuring the operation effect and improving the user's operation experience.

[0294] Step 1502: Determine an action position and an action speed based on the action signal; if the action speed is greater than a predetermined speed threshold, determine a trigger time according to the action position and the position of the trigger device; and play a trigger effect at the position of the trigger device at the trigger time.

[0295] In an embodiment of the present disclosure, the trigger device includes a plurality of trigger segments, and playing a trigger effect at a position of the trigger device includes determining a target trigger segment from the plurality of trigger segments according to the position of the trigger device, and triggering an effect at the position of the target trigger segment.

[0296] Here, the object time and object position of each target object may be set in advance. For example, if the target objects are musical notes, the object time and object position at which each note will be displayed are set in advance according to the musical rhythm. In this way, the notes can be controlled to be displayed at the corresponding object time and object position according to the preset object time and object position.

[0297] Furthermore, based on the positional relationship between the trigger device and the target object displayed in real time, for example, the user controls an external device to send an operation signal to the virtual reality device, whereby the virtual reality device controls the control device to trigger the trigger device in response to the operation signal, obtains the operation position, and plays (e.g., fires) a trigger effect at the position of the trigger device.

[0298] 17 is a schematic diagram of an embodiment of the present disclosure for acting on a target object. As shown in FIG. 17, a control device 13 performs an action on a trigger device 11, which in turn triggers an effect 14 to perform an action on a target object 12.

[0299] In an embodiment of the present disclosure, the trigger device may further include multiple trigger segments, each corresponding to a different target object, and may be configured to obtain a target trigger segment to which the trigger position belongs and control the device to trigger an effect at the position of the target trigger segment.

[0300] 18 is a schematic diagram of a trigger device according to an embodiment of the present disclosure. As shown in FIG. 18, the trigger device 11 includes trigger segments 110-119, which include center positions A0-A9, respectively.

[0301] 18 further shows that the target object 12 and the trigger segment 110 are about to overlap. Therefore, after receiving the operation signal, the trigger segment 110 may be triggered to trigger the effect at the center position A0.

[0302] Step 1503: The object information includes object time and object position, and if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time meets a predetermined time range, it is determined that the object is a target object.

[0303] Step 1504: Obtain a score range corresponding to each time subrange, and perform calculations based on each time subrange, each score range, and the time difference value to obtain a trigger score for each trigger result.

[0304] In an embodiment of the present disclosure, the time range includes a first time subrange, a second time subrange, and a third time subrange, the first time subrange being lower than the second time subrange, and the second time subrange being lower than the third time subrange. Determining a trigger result based on the time difference value and the predetermined time range includes determining a first trigger result if the time difference value is within the first time subrange, determining a second trigger result if the time difference value is within the second time subrange, determining a third trigger result if the time difference value is within the third time subrange, and determining a fourth trigger result if the time difference value exceeds the third time subrange. Here, the trigger result and the trigger score may be set according to application scenarios.

[0305] For example, the first time subrange is determined to be 0 to 50 ms, the second time subrange is determined to be 50 to 120 ms, and the third time subrange is determined to be 120 to 200 ms. For example, if the time difference value is within the first time subrange, the first trigger result is determined to be a perfect trigger. The score range corresponding to the first time subrange is 100 to 120. The score difference value between the minimum and maximum scores in the score range is obtained as 20, and the time difference value is divided by the maximum time in the first time subrange and multiplied by the score difference value to obtain an initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 10 ms, the trigger score is calculated to be 116.

[0306] For example, if the time difference value is within the second time subrange, the second trigger result is determined to be an excellent trigger. The score range corresponding to the second time subrange is 80 to 100. The score difference value, 20, between the minimum and maximum scores in the score range is obtained, and the maximum time in the first time subrange is subtracted from the time difference value to obtain the first difference value. The maximum time in the second time subrange is subtracted from the maximum time in the first time subrange to obtain the second difference value. The score difference value, 20, between the minimum and maximum scores in the score range is obtained, and the first difference value is divided by the second difference value and multiplied by 20 to obtain the initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 85 ms, the first difference value, 35, is obtained by subtracting 50 from 85, and the second difference value, 70, is obtained by subtracting 35 from 70 and multiplying by 20 to obtain the initial value, and the trigger score is obtained by subtracting 20 from 100.

[0307] Furthermore, for example, if the time difference value is within a third time subrange, the third trigger result is determined to be an accurate trigger. The score range corresponding to the third time subrange is 40 to 80. The score difference value between the minimum and maximum scores in the score range, 40, is obtained, and the maximum time in the second time subrange is subtracted from the time difference value to obtain the third difference value. The maximum time in the third time subrange is subtracted from the maximum time in the second time subrange to obtain the fourth difference value. The score difference value between the minimum and maximum scores in the score range, 40, is obtained, and the third difference value is divided by the fourth difference value and multiplied by 40 to obtain the initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 160 ms, the third difference value, 40, is obtained by subtracting 120 from 160, and the fourth difference value, 80, is obtained by subtracting 120 from 200, and the fourth difference value, 80, is obtained by dividing 40 by 80 and multiplying by 40 to obtain the initial value, and 20 is obtained by subtracting 20 from 80.

[0308] Also, if the time difference value exceeds the third time sub-range, the fourth trigger result is determined to be no hit, and the trigger score is 0.

[0309] Step 1505: Display the text information corresponding to the trigger result and the trigger score, and / or switch the display state of the target object.

[0310] Specifically, in a virtual reality scene, for example, a virtual reality game, target objects are continuously generated and fly toward a user from a distance. A trigger device is installed in the virtual reality game. When a target object overlaps with a trigger segment of the trigger device, the user transmits an operation signal via an external device to control the control device and operate the trigger device. Vibration occurs in the trigger device, triggering an effect (e.g., emitting a shock wave, arc, etc.) to disintegrate the target object, and the trigger result and trigger score are displayed.

[0311] A data processing solution according to an embodiment of the present disclosure displays a trigger device and a target object in a virtual reality scene, determines a motion position and a motion speed based on the motion signal, and if the motion speed is greater than a predetermined speed threshold, determines a trigger time according to the motion position and the position of the trigger device, and plays a trigger effect at the trigger time at the position of the trigger device. The object information includes an object time and an object position. If the object position matches the position of the trigger device and the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be a target object, obtains a score range corresponding to each time subrange, performs calculations based on each time subrange, each score range, and the time difference value to obtain a trigger score for each trigger result, and displays text information and the trigger score corresponding to the trigger result, and / or switches the display state of the target object. By adopting the above technical solution, a trigger device is installed in the virtual reality scene, and under user control, the trigger device triggers an effect to perform an action on the target object and plays an effect corresponding to the trigger result, greatly improving the user's experience in the virtual reality scene.

[0312] 19 is a schematic diagram of a data processing device according to an embodiment of the present disclosure. The device may be implemented in software and / or hardware, and may generally be integrated into electronic equipment. As shown in FIG. 19, the device includes: a display module 1901 for displaying the trigger device and the target object in a virtual reality scene; a first determination module 1902 for determining an operating position based on the operating signal; a second determination module 1903 for determining a trigger time according to the operating position and the position of the trigger device; a third determination module 1904 for determining a target object whose object information matches the trigger time and the position of the trigger device; a playback module 1905 for playing an effect corresponding to the target object.

[0313] In some embodiments, the device comprises: It further includes a trigger module for playing a trigger effect at the trigger time at the location of the trigger device.

[0314] In some embodiments, the trigger device includes a plurality of trigger segments, and the trigger module specifically includes: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; and triggering an effect at the location of the target trigger segment.

[0315] In some embodiments, the device comprises: further comprising a fourth determination module for determining a motion speed in response to the motion signal; The second determination module 1903 is further used for determining the trigger time according to the motion position and the position of the trigger device when the motion speed is greater than a predetermined speed threshold.

[0316] In some embodiments, the object information includes an object time and an object position, and the third determining module 1904 specifically determines: If the object position matches the position of the trigger device and the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be the target object.

[0317] In some embodiments, the time range includes a first time sub-range, a second time sub-range, and a third time sub-range, the first time sub-range being lower than the second time sub-range, and the device: determining a first trigger result if the time difference value is within the first time sub-range; determining a second trigger result if the time difference value is within the second time sub-range; determining a third trigger result if the time difference value is within the third time sub-range; and determining a fourth trigger result if the time difference value exceeds the third time sub-range.

[0318] In some embodiments, the device comprises: an acquisition module for acquiring a score range corresponding to each time subrange; The method further includes a calculation module for performing calculations based on each of the time sub-ranges, each of the score ranges, and the time difference value to obtain a trigger score for each trigger result.

[0319] In some embodiments, the playback module 1905 specifically: It is used to display text information and a trigger score corresponding to the trigger result, and / or to switch the display state of the target object.

[0320] The above modules may be implemented as software components running on one or more general-purpose processors, or as hardware for performing certain functions, such as programmable logic devices and / or application-specific integrated circuits. In some embodiments, the modules may be embodied in the form of a software product, which may be stored on a non-volatile storage medium. These non-volatile storage media may include a computer device (e.g., a personal computer, a server, a network device, a mobile terminal, etc.) that executes the methods described in the embodiments of the present disclosure. In some embodiments, the above modules may be implemented on a single device or distributed across multiple devices. The functions of the modules may be integrated with each other or further divided into multiple sub-modules.

[0321] 20 is a schematic diagram illustrating the flow of a data processing method according to an embodiment of the present disclosure, which may be performed by a data processing device, which may be implemented in software and / or hardware and may generally be integrated into electronic equipment.

[0322] The technical solution according to the embodiment of the present disclosure has the following advantages over the related art: the data processing solution according to the embodiment of the present disclosure determines the motion position and motion speed direction based on the motion signal, determines a target object that matches the motion position based on object information including the object direction and object position, and plays an effect corresponding to the target object according to the motion speed direction and the direction of the target object. By adopting the above technical solution, the target object can be accurately determined according to the motion position, and an effect corresponding to the target object can be played according to the motion speed direction and the direction of the target object, further improving the accuracy of data processing and greatly improving the user's interaction experience.

[0323] As shown in FIG. 20, the method includes the following steps:

[0324] Step 2001: The motion position and motion speed direction are determined based on the motion signal.

[0325] Here, the movement signal is, for example, a six-degree-of-freedom signal (movement freedom along three orthogonal coordinate axes, x, y, and z, and rotation freedom around these three coordinate axes), and may be a movement signal including the position and orientation of a gamepad transmitted by a user controlling an external device, for example, by operating a gamepad, or the movement signal may be the position and orientation of an external device (for example, a gamepad) calculated by image recognition from the user's own orientation and images of the external device collected by a data processing device (for example, a head display device).

[0326] Here, the motion position may refer to the position of an external device or the position of a control device in a virtual reality scene controlled by the external device. The motion speed direction refers to a motion vector, i.e., a motion motion vector, such as a vector pointing from a pre-motion gamepad position to a post-motion gamepad position.

[0327] In some embodiments, the position and orientation of an external device are acquired based on the motion signal, and the motion position and motion speed direction are determined according to the position and orientation of the external device. In other embodiments, the position and orientation of a control device in a virtual reality scene are acquired based on the motion signal, and the motion position and motion speed direction are determined according to the position and orientation of the control device.

[0328] The above two methods are merely examples of determining the motion position and motion speed direction based on the motion signal, and the embodiments of the present disclosure do not impose any specific restrictions on the implementation form of determining the motion position and motion speed direction based on the motion signal.

[0329] Step 2002: Determine a target object whose object information including object direction and object position matches the action position.

[0330] Here, the target object may be selected and set according to the application scene, and may be, for example, an object that can be acted upon by a motion in a virtual reality scene, a musical note, a display interface, etc. The shape of the target object may be selected and set according to the application scene, and the embodiments of the present disclosure do not impose any specific limitations.

[0331] Here, if the object information of an object matches the motion position, the object is a target object. The target object may have different shapes, such as a musical note or a circle, and may be specifically selected and set according to the application scenario, and the embodiments of the present disclosure do not impose specific limitations. The object information includes object time, object position, object direction, etc., and specific object information is set according to the object.

[0332] In the embodiments of the present disclosure, there are many ways to determine a target object, and in some embodiments, the object information includes an object position, and if the object position matches the operating position, the object is determined to be a target object. In other embodiments, the object information includes an object time and an object position, and a trigger time is determined according to the operating position and the position of the trigger device, and if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be a target object.

[0333] The above two methods are merely examples of determining a target object, and the embodiments of the present disclosure do not impose any specific limitations on the implementation of determining the target object.

[0334] Step 2003: An effect corresponding to the target object is played back according to the direction of the movement speed and the direction of the target object.

[0335] Here, the direction of the object is related to the object position. That is, when the object is in a different position, the direction of the object is different. Therefore, the direction of the target object can be determined according to the position of the target object. Here, the effect corresponding to the target object can be selected and set according to the application scene, such as updating the display state of the shape, color, etc. of the target object.

[0336] In some embodiments, the absolute value of the included angle is determined based on the normal to the motion speed direction and the target object direction, and the effect corresponding to the target object is determined and played based on the absolute value of the included angle. In other embodiments, if the included angle between the two vectors is determined to be smaller than a predetermined included angle distance based on the motion speed direction and the target object direction, text information corresponding to the trigger result and a trigger score are displayed, and the display state of the target object is switched.

[0337] The above two methods are merely examples of playing an effect corresponding to a target object according to the direction of the movement speed and the direction of the target object, and the embodiments of the present disclosure do not impose any restrictions on the specific implementation form of playing an effect corresponding to a target object according to the direction of the movement speed and the direction of the target object.

[0338] The data processing solution according to the embodiment of the present disclosure determines the motion position and motion speed direction based on the motion signal, determines a target object that matches the motion position based on object information including the object direction and object position, and plays an effect corresponding to the target object according to the motion speed direction and the direction of the target object. By adopting the above technical solution, the target object can be accurately determined according to the motion position, and the effect corresponding to the target object can be played according to the motion speed direction and the direction of the target object, which further improves the accuracy of data processing and greatly improves the user's interaction experience.

[0339] In some embodiments, the object information further includes an object time, and the method further includes determining a trigger time according to the operating position and the position of the trigger device, and determining the target object includes determining that the object is a target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range.

[0340] The data processing method of the present disclosure may be applied to a virtual reality scene, and the virtual reality scene may be any virtual reality scene, for example, a scene of a music game, a note action game, etc., or an interface interaction scene.

[0341] In some embodiments, a trigger device and a target object may be displayed in real time in a virtual reality scene, and the positional relationship between the trigger device and the target object, i.e., the relative positions of the trigger device and the target object, may be acquired in real time. As can be understood, the position of the target object corresponding to each time point in the virtual reality scene may be preset. For example, in a virtual music rhythm game scene, the position of a musical note (target object) corresponding to each time point may be preset according to the music rhythm. Also, for example, in a predetermined virtual browsing interaction scene, the position of a page corresponding to each time point may be preset according to text information.

[0342] Specifically, in a virtual reality scene, the trigger device generally remains stationary, while the target object's position is updated over time. Therefore, by displaying the trigger device and the target object in real time, the user can intuitively see the relative positions of the target object and the trigger device. When the target object and the trigger device overlap, an operation signal is sent to trigger the trigger device. Displaying the trigger device and the target object in real time provides the user with hints for controlling the operating position and operating time of the trigger device, further improving the accuracy of the processing effect.

[0343] As can be appreciated, the operating signal may act directly on the trigger device, or may act on the trigger device via the control device by displaying the control device in a virtual reality scene and the operating signal acting on the control device.

[0344] Here, the trigger time refers to the time when the trigger device is triggered, that is, the time when the operating position and the position of the trigger device come into contact with each other.

[0345] In the embodiments of the present disclosure, there are many ways to determine the trigger time according to the operating position and the position of the trigger device, and in some embodiments, the trigger time is determined as the time point recorded when the operating position and the position of the trigger device overlap according to the operating position and the position of the trigger device. In other embodiments, the speed of the operation signal is determined according to the operating signal, and if the speed of the operation is greater than a predetermined speed threshold, the trigger time is determined as the time point recorded when the operating position and the position of the trigger device overlap.

[0346] The above two methods are merely examples of determining the trigger time depending on the operating position and the position of the trigger device, and the embodiments of the present disclosure do not impose any specific limitations on the implementation form of determining the trigger time depending on the operating position and the position of the trigger device.

[0347] In the embodiments of the present disclosure, there are many ways to determine a target object. In some embodiments, the object information includes an object time and an object position. If the object position matches the position of the trigger device, i.e., the object position and the position of the trigger device correspond to the same direction or position area, and the value of the time difference between the object time and the trigger time meets a predetermined time range, the object is determined to be a target object.

[0348] In some other embodiments, the object information includes object time and object position, and if the value of the position distance difference between the object position and the position of the trigger device satisfies a predetermined distance range and the value of the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be a target object.

[0349] The above two methods are merely examples of determining a target object, and the embodiments of the present disclosure do not impose any specific limitations on the implementation of determining the target object.

[0350] In the above solution, based on the displayed trigger device, an accurate operating signal can be obtained, and the trigger device can be precisely acted upon to determine the target object and play an effect corresponding to the target object, thereby improving the accuracy of data processing and greatly improving the user's experience in the virtual reality scene.

[0351] In some embodiments, the trigger device includes a plurality of trigger segments, and the method further includes determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device, and playing a trigger effect at the position of the target trigger segment.

[0352] Here, the trigger effect refers to an effect displayed when the trigger device is acted upon, and the trigger effect may be one or more of a sound wave effect, an electromagnetic wave effect, a spark effect, and an arc effect.

[0353] In an embodiment of the present disclosure, the trigger device may be divided into multiple trigger segments, and the trigger device may be controlled to trigger an effect only at the position (e.g., the center position) of the target trigger segment to which the trigger device belongs, and the target trigger segment may be controlled to vibrate, thereby providing hints to the user and further enhancing the user's interaction experience.

[0354] As can be understood, the object information includes object time and object position, and if the object position matches the position of the trigger device, i.e., the object position matches the position of the target trigger segment, i.e., the object position and the position of the target trigger segment correspond to the same direction or position area, and the value of the time difference between the object time and the trigger time meets a predetermined time range, the object is determined to be a target object.

[0355] In an embodiment of the present disclosure, a trigger score is determined according to the time difference value and a predetermined time range.

[0356] Specifically, the time when the trigger device is triggered may be acquired as the trigger time. As can be understood, the position of the target object is constantly updated over time, i.e., the positional relationship between the target object and the trigger device is constantly updated, and at the object time, the target object is displayed at the object position. For example, the overlap between the target object and the trigger device can be regarded as the overlap between the target object and any one of the trigger segments in the trigger device.

[0357] Furthermore, a time difference value is determined based on the trigger time and the object time, i.e., the time difference value between the trigger time and the object time. As can be understood, the smaller the time difference value, the higher the accuracy of the trigger time and the better the trigger effect. Therefore, a trigger score can be determined based on the time difference value and a predetermined time range.

[0358] In the embodiment of the present disclosure, the time range includes multiple time subranges, and a score range corresponding to each time subrange is obtained. A trigger score is obtained by calculation based on each time subrange, each score range, and the time difference value. The trigger score is determined according to the time difference value between the trigger time and the object time and provided to the user, so that the user can understand more specific trigger results, meet the user's usage needs, and improve the user's usage experience.

[0359] In the above solution, a trigger effect is played by a trigger device to enhance the richness of interaction in the virtual reality scene; the trigger device is divided into multiple trigger segments, and the target trigger segment to which the position of the trigger device belongs can be controlled to vibrate to trigger an effect, which further enhances the interest of the display and interaction in the virtual reality scene, meets more of the user's usage needs, and improves the user's usage experience.

[0360] In some embodiments, the trigger device includes a plurality of trigger segments, and the method further includes determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device, obtaining a center position of the target trigger segment, calculating a distance difference value between the position of the trigger device and the center position, and determining a trigger score based on the distance difference value and a predetermined distance range.

[0361] As can be seen, when acting on a trigger device, the closer the center position of the target trigger segment corresponding to the trigger device is to the position of the trigger device, the greater the trigger effect strength will be, and the higher the trigger score will be after acting on the target object.

[0362] Specifically, the distance range is divided into different distance subranges, the distance subrange to which the distance difference value belongs is determined, a score range corresponding to each distance subrange is obtained, and a calculation is performed based on each distance subrange, each score range, and the distance difference value to obtain a trigger score.

[0363] As an example, a first distance sub-range is 0.5 or less, a corresponding second score range is 20 to 40, and the distance difference value is 0.2. First, 0.2 is divided by 0.5 and multiplied by 20 to calculate a value of 8, and then 8 is subtracted from 40 to get a trigger score of 32.

[0364] In the above solution, a trigger score is determined according to the position of the trigger device and the center position of the target trigger segment, and provided to the user, so as to further allow the user to understand the specific operation results, meet the user's usage needs, and improve the user's usage experience.

[0365] In some embodiments, playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object includes determining an absolute value of the included angle based on a normal to the motion speed direction and the direction of the target object, and determining and playing an effect corresponding to the target object according to the absolute value of the included angle.

[0366] In an embodiment of the present disclosure, determining and playing an effect corresponding to a target object according to the absolute value of the angle includes, when the absolute value of the angle is smaller than a predetermined angle threshold, displaying text information corresponding to a trigger result and a trigger score, and / or switching the display state of the target object.

[0367] If the absolute value of the included angle is equal to or greater than the included angle threshold, the effect corresponding to the target object is not played back.

[0368] In an embodiment of the present disclosure, the motion speed direction may be the motion direction corresponding to the motion vector when the control device acts on the trigger device.

[0369] As can be understood, the smaller the angle between the direction of the motion speed and the normal to the direction of the target object, the stronger the trigger effect strength of the trigger device, and the higher the trigger score after acting on the target object.

[0370] Specifically, the angle range is divided into different angle subranges, the time subrange to which the angle absolute value belongs is determined, a score range corresponding to each angle subrange is obtained, and a calculation is performed based on each angle subrange, each score range, and the angle absolute value to obtain a second trigger score.

[0371] As an example, a first angle sub-range is 25 or less, a corresponding first score range is 20 to 40, and the absolute angle value is 5. First, 5 is divided by 25 and multiplied by 20 to calculate a value of 4, and then 4 is subtracted from 40 to obtain a trigger score of 36.

[0372] Specifically, a threshold value for the angle may be preset, and when the absolute value of the angle is smaller than the threshold value, text information and a trigger score corresponding to the trigger result are displayed, and / or the display state of the target object is switched, with different trigger results corresponding to different text information and trigger scores. The display state of the target object may be preset according to application needs, for example, by displaying different shapes, colors, etc.

[0373] The above solution determines the absolute value of the included angle and a predetermined included angle threshold based on the direction of the motion speed and the normal to the direction of the target object, and plays an effect corresponding to the target object, so that the user can visually understand the specific motion result, meet the user's usage needs, and improve the user experience.

[0374] 21 is a schematic diagram showing the flow of another data processing method according to an embodiment of the present disclosure. This embodiment further optimizes the above data processing method based on the above embodiment. As shown in FIG. 21, the method includes the following steps:

[0375] Step 2101: Determine the operating position and operating speed direction based on the operating signal, and determine the trigger time according to the operating position and the position of the trigger device.

[0376] Step 2102: If the object position matches the position of the trigger device, and the value of the time difference between the object time and the trigger time satisfies a predetermined time range, determine that the object is a target object.

[0377] After step 2102, at least one of step 2103, step 2104, and step 2105 may be performed, and FIG. 21 is merely an example.

[0378] Step 2103: The trigger device includes a plurality of trigger segments, and a target trigger segment is determined from the plurality of trigger segments according to the position of the trigger device, and a trigger effect is played at the position of the target trigger segment.

[0379] Here, each target object may be set in advance to be displayed at the object position at the object time. For example, if the target object is a musical note, the note time and note position of each note are set in advance according to the musical rhythm, and the note is controlled to be displayed at the note position at the corresponding note time.

[0380] Furthermore, based on the positional relationship between the trigger device and the target object displayed in real time, the user controls an external device to send an operation signal to the virtual reality device, which then controls the control device in the virtual reality scene to perform an operation on the trigger device in response to the operation signal, obtains the operation position and operation speed direction, and controls the trigger device to trigger an effect.

[0381] 17 is a schematic diagram of an embodiment of the present disclosure for acting on a target object. As shown in FIG. 17, a control device 13 performs an action on a trigger device 11, which in turn triggers an effect 14 to perform an action on a target object 12.

[0382] In an embodiment of the present disclosure, a firing device may include multiple trigger segments, each corresponding to a different target object, and each trigger segment may include a center position, and the firing device may be configured to obtain a target trigger segment to which the position of the trigger device belongs, and control the firing device to trigger an effect at the position of the target trigger segment, where the trigger effect may be one or more of a sonic effect, an electromagnetic effect, a spark effect, and an arc effect.

[0383] 18 is a schematic diagram of a trigger device according to an embodiment of the present disclosure. As shown in FIG. 18, the trigger device 11 includes trigger segments 110-119, which include positions A0-A9, respectively.

[0384] 18 further shows that the target object 12 and the trigger segment 110 are about to overlap. Therefore, after receiving the action signal, an action may be performed on the trigger segment 110 to trigger an effect at position A0.

[0385] Here, the direction of the target object 12 is associated with the object position of the target object 12. For example, if the target object appears in the trigger area 110, the direction of the target object 12 is associated with the trigger area 110. That is, the direction of the trigger area 110 is the direction of the target object 12. Also, for example, if the target object appears in the trigger area 111, the direction of the target object 12 is associated with the trigger area 111. That is, the direction of the trigger area 111 is the direction of the target object 12. Thus, the user can determine the direction of interaction according to the position of the trigger area, and the interaction direction coincides with the direction indicated by the object position of the object, providing clearer instructions to the user, meeting the user's usage needs, and improving the user's interaction experience.

[0386] Step 2104: Determine a trigger score according to the time difference value and the predetermined time range.

[0387] Specifically, if the trigger device is acted upon within a predetermined time before or after the target object and the trigger device overlap, an effect can be triggered to act upon the target object, and a trigger score may be set and determined according to the specific application scenario.

[0388] Specifically, the time range includes a first time subrange, a second time subrange, and a third time subrange, and the first time subrange is lower than the second time subrange. The time subrange to which the time difference value belongs is determined, and a score calculation formula corresponding to the time subrange is obtained and calculated for the time difference value to obtain a trigger score.

[0389] As an example, the first time subrange is determined to be 0 to 50 ms, the second time subrange is determined to be 50 to 120 ms, and the third time subrange is determined to be 120 to 200 ms. For example, the score range corresponding to the first time subrange is determined to be 100 to 120. The score difference value between the minimum and maximum scores in the score range is obtained as 20, and the time difference value is divided by the maximum time in the first time subrange and multiplied by the score difference value to obtain an initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 10 ms, the trigger score is calculated to be 116.

[0390] For example, if the time difference value is within the second time subrange, the score range corresponding to the second time subrange is 80 to 100. The score difference value between the minimum and maximum scores in the score range, 20, is obtained, and the maximum time in the first time subrange is subtracted from the time difference value to obtain the first difference value. The maximum time in the second time subrange is subtracted from the maximum time in the first time subrange to obtain the second difference value. The score difference value between the minimum and maximum scores in the score range, 20, is obtained, and the first difference value is divided by the second difference value and multiplied by 20 to obtain the initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 85 ms, the first difference value is 35 by subtracting 50 from 85, and the second difference value is 70 by subtracting 35 from 70 and multiplying by 20 to obtain the initial value 10. The trigger score is then calculated by subtracting 20 from 100.

[0391] Furthermore, for example, if the time difference value is within a third time subrange, the score range corresponding to the third time subrange is 40 to 80. The score difference value between the minimum and maximum scores in the score range, 40, is obtained, and the maximum time in the second time subrange is subtracted from the time difference value to obtain the third difference value. The maximum time in the third time subrange is subtracted from the maximum time in the second time subrange to obtain the fourth difference value. The score difference value between the minimum and maximum scores in the score range, 40, is obtained, and the third difference value is divided by the fourth difference value and multiplied by 40 to obtain the initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the time difference value is 160 ms, the third difference value, 40, is obtained by subtracting 120 from 160, and the fourth difference value, 80, is obtained by subtracting 120 from 200, and the fourth difference value, 80, is obtained by dividing 40 by 80 and multiplying by 40 to obtain the initial value, and 20 is subtracted from 80 to obtain the trigger score, 60.

[0392] Also, if the time difference value exceeds the third time sub-range, the trigger score is 0.

[0393] Step 2105: The trigger device includes a plurality of trigger segments, and according to the position of the trigger device, a target trigger segment is determined from the plurality of trigger segments, a center position of the target trigger segment is obtained, a distance difference value between the position of the trigger device and the center position is calculated, and a trigger score is determined based on the distance difference value and a predetermined distance range.

[0394] In an embodiment of the present disclosure, the trigger device includes a plurality of trigger segments, determines a distance difference value based on the position of the trigger device and the center position of the target trigger segment, determines a score range based on the distance range, and determines a trigger score based on the distance difference value, the distance range, and the score range.

[0395] For example, a first distance subrange within the distance range is equal to or less than 0.5, a second distance subrange is greater than 0.5 and equal to or less than 0.8, and a third distance subrange is greater than 0.8. For example, if the score range corresponding to the first distance subrange is 20 to 40, the score difference value between the minimum and maximum scores in the score range, 20, is obtained, and the distance difference value is divided by the maximum distance in the first distance subrange and multiplied by the score difference value to obtain an initial value. Finally, the initial value is subtracted from the maximum score to obtain the trigger score. If the distance difference value is 0.2, the trigger score is calculated to be 32.

[0396] Also, for example, if the distance difference value is within a second distance sub-range, the score range corresponding to the second distance sub-range is 10 to 20, and the score difference value between the minimum score and the maximum score in the score range is obtained as 10, and the maximum distance in the first distance sub-range is subtracted from the distance difference value to obtain a first difference value. The maximum distance in the first distance sub-range is subtracted from the maximum distance in the second distance sub-range to obtain a second difference value. The score difference value between the minimum score and the maximum score in the score range is obtained as 10, and the first difference value is divided by the second difference value and multiplied by 10 to obtain an initial value. Finally, the initial value is subtracted from the maximum score of 20 to obtain a trigger score.

[0397] Furthermore, for example, if the distance difference value is within a third distance sub-range, the score range corresponding to the third distance sub-range is 5 to 10, and the score difference value between the minimum score and the maximum score in the score range is obtained as 5, and the maximum distance in the second distance sub-range is subtracted from the distance difference value to obtain the third difference value. The maximum distance in the third distance sub-range is subtracted from the maximum distance in the second distance sub-range to obtain the fourth difference value. The score difference value between the minimum score and the maximum score in the score range is obtained as 5, and the third difference value is divided by the fourth difference value and multiplied by 5 to obtain the initial value. Finally, the initial value is subtracted from the maximum score of 10 to obtain the trigger score.

[0398] 22a is a schematic diagram of a trigger scene according to an embodiment of the present disclosure. As shown in FIG. 22a, a segment from a segment start point to a segment end point is defined as one trigger segment. The control device, for example, determines the center position of the target trigger segment, and determines the distance between the hit point of the held item and the center position, for example, distance X shown in FIG. 22a, as the distance difference value.

[0399] Step 2106: Determine the absolute value of the included angle based on the normal to the motion speed direction and the direction of the target object, and determine and play an effect corresponding to the target object according to the absolute value of the included angle.

[0400] In an embodiment of the present disclosure, if the absolute value of the included angle is smaller than a predetermined included angle threshold, text information corresponding to the trigger result and a trigger score are displayed, and / or the display state of the target object is switched.

[0401] In an embodiment of the present disclosure, the trigger device includes a plurality of trigger segments, determines an absolute value of an included angle based on the direction of the motion speed and a normal to the direction of the target object, and determines and plays an effect corresponding to the target object based on the absolute value of the included angle.

[0402] For example, the first angle subrange is determined to be 25 or less, the second angle subrange is greater than 25 but less than 45, and the third angle subrange is greater than 45 but less than 60. For example, if the score range corresponding to the first angle subrange is 20 to 40, the score difference between the minimum and maximum scores in the score range is obtained (20), the absolute value of the angle is divided by the maximum angle in the first angle subrange, and multiplied by the score difference to obtain an initial value. Finally, the initial value is subtracted from the maximum score to obtain a trigger score. If the absolute value of the angle is 5, the trigger score is calculated to be 36, and a corresponding effect is selected and played according to the trigger score.

[0403] For example, if the absolute angle value is within a second angle sub-range, the score range corresponding to the second angle sub-range is 10 to 20. The score difference value, 10, between the minimum and maximum scores in the score range is obtained, and the maximum angle in the first angle sub-range is subtracted from the absolute angle value to obtain a first difference value. The maximum angle in the first angle sub-range is subtracted from the maximum angle in the second angle sub-range to obtain a second difference value. The score difference value, 10, between the minimum and maximum scores in the score range is obtained, and the first difference value is divided by the second difference value and multiplied by 10 to obtain an initial value. Finally, the initial value is subtracted from the maximum score of 20 to obtain a trigger score. A corresponding effect is selected and played depending on the trigger score.

[0404] Furthermore, for example, if the absolute angle value is within a third angle sub-range, the score range corresponding to the third angle sub-range is 5 to 10. The score difference value (5) between the minimum and maximum scores in the score range is obtained, and the maximum angle in the second angle sub-range is subtracted from the absolute angle value to obtain a third difference value. The maximum angle in the second angle sub-range is subtracted from the maximum angle in the third angle sub-range to obtain a fourth difference value. The score difference value (5) between the minimum and maximum scores in the score range is obtained, and the third difference value is divided by the fourth difference value and multiplied by 5 to obtain an initial value. Finally, the initial value is subtracted from the maximum score of 10 to obtain a trigger score. A corresponding effect is selected and played depending on the trigger score.

[0405] Additionally, if the absolute included angle value exceeds the third included angle sub-range, the trigger score is 0.

[0406] 22b is a schematic diagram of another trigger scene according to an embodiment of the present disclosure. As shown in FIG. 22b, there is a straight line A in the direction of the motion speed, the direction of the straight line A is the motion speed direction, a normal line B is a normal line to the direction of the target object, and the included angle between the straight line A and the normal line B is the included angle absolute value.

[0407] Specifically, in a virtual reality scene, for example, in a virtual reality game, target objects are continuously generated and fly toward the user from a distance. A trigger device is installed in the virtual reality game. When the target object overlaps with a trigger segment of the trigger device, the user transmits an operation signal via an external device to control the control device and strike the trigger device. Vibration occurs in the trigger device, triggering an effect (such as a shock wave or arc) to break up the target object, and the trigger result and trigger score are displayed.

[0408] A data processing scheme according to an embodiment of the present disclosure determines an action position and an action speed direction based on the action signal, determines a trigger time according to the action position and the position of a trigger device, determines the object to be a target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range, the trigger device includes multiple trigger segments, determines a target trigger segment from the multiple trigger segments according to the position of the trigger device, plays a trigger effect at the position of the target trigger segment, determines a trigger score according to the value of the time difference and the predetermined time range, the trigger device includes multiple trigger segments, determines a target trigger segment from the multiple trigger segments according to the position of the trigger device, obtains the center position of the target trigger segment, calculates a distance difference value between the position of the trigger device and the center position, determines a trigger score according to the value of the distance difference and the predetermined distance range, determines an absolute value of the included angle according to the action speed direction and a normal to the direction of the target object, and determines and plays an effect corresponding to the target object according to the absolute value of the included angle. By adopting the above technical solution, a trigger device is installed in the virtual reality scene, and according to the user's control, the trigger device triggers an effect to act on the target object, and also determines the action result according to the trigger time and the action position, improving the accuracy of the action result, and playing an effect corresponding to the target object according to the action speed direction and the direction of the target object, thereby greatly improving the user's experience in the virtual reality scene.

[0409] 23 is a schematic diagram of a data processing device according to an embodiment of the present disclosure. The device may be implemented in software and / or hardware, and may generally be integrated into electronic equipment. As shown in FIG. 23, the device includes: a first determination module 2301 for determining a motion position and a motion speed direction based on the motion signal; a second determination module 2302 for determining a target object whose object information including an object direction and an object position matches the operation position; and a playback module 2303 for playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object.

[0410] In some embodiments, the object orientation is related to the object position.

[0411] In some embodiments, the object information further includes an object time, and the method further comprises: determining a trigger time according to the operating position and a position of a trigger device; Specifically, the second determination module 2302: If the object position matches the position of the trigger device and the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be the target object.

[0412] In some embodiments, the trigger device includes a plurality of trigger segments, the device comprising: a third determination module for determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device; and a trigger module for playing a trigger effect at the location of the target trigger segment.

[0413] In some embodiments, the trigger device includes a plurality of trigger segments, the device comprising: a fourth determination module for determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device and obtaining a center position of the target trigger segment; a calculation module for calculating a distance difference value between the position of the trigger device and the center position; and a fifth determination module for determining a trigger score based on the distance difference value and a predetermined distance range.

[0414] In some embodiments, the device comprises: The sixth determination module further includes a trigger score for determining a trigger score according to the time difference value and a predetermined time range.

[0415] In some embodiments, the playback module 2303: a determination unit for determining an absolute value of an included angle based on the motion velocity direction and a normal to the direction of the target object; and a reproduction unit for determining and reproducing an effect corresponding to the target object according to the absolute value of the included angle.

[0416] In some embodiments, the playback unit specifically includes: If the absolute angle is smaller than a predetermined threshold, the trigger score and text information corresponding to the trigger result are displayed, and / or the display state of the target object is switched.

[0417] The above modules may be implemented as software components running on one or more general-purpose processors, or as hardware for performing certain functions, such as programmable logic devices and / or application-specific integrated circuits. In some embodiments, the modules may be embodied in the form of a software product, which may be stored on a non-volatile storage medium. These non-volatile storage media may include a computer device (e.g., a personal computer, a server, a network device, a mobile terminal, etc.) that executes the methods described in the embodiments of the present disclosure. In some embodiments, the above modules may be implemented on a single device or distributed across multiple devices. The functions of the modules may be integrated with each other or further divided into multiple sub-modules.

[0418] The data processing device according to the embodiments of the present disclosure can execute the data processing method according to any embodiment of the present disclosure, and has beneficial effects with functional modules corresponding to the execution of the method.

[0419] An embodiment of the present disclosure further provides a computer program product including a computer program or instructions that, when executed by a processor, implements a data processing method according to any embodiment of the present disclosure.

[0420] FIG. 6 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. The following specifically refers to FIG. 6 , which illustrates a schematic diagram of an electronic device 400 suitable for implementing an embodiment of the present disclosure. The electronic device 400 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device illustrated in FIG. 6 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0421] 6, electronic device 400 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 401, which can perform various appropriate operations and processes according to programs stored in read-only memory (ROM) 402 or programs loaded from storage device 408 into random access memory (RAM) 403. RAM 403 stores various programs and data necessary for the operation of electronic device 400. Processing unit 401, ROM 402, and RAM 403 are interconnected via bus 404. Input / output (I / O) interface 405 is also connected to bus 404.

[0422] Typically, input devices 406, including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 407, including, for example, a liquid crystal display (LCD), speaker, oscillator, etc.; storage devices 408, including, for example, a magnetic tape, hard disk, etc.; and communication devices 409 may be connected to the I / O interface 405. The communication devices 409 enable the electronic device 400 to communicate wirelessly or via wires with other devices to exchange data. While FIG. 6 illustrates the electronic device 400 with various devices, it should be understood that it is not intended to require the implementation or inclusion of all of the devices shown. More or fewer devices may alternatively be implemented or included.

[0423] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product, which includes a computer program embodied in a non-transitory computer-readable medium, including program code for performing the methods illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, it performs the functions defined above in the data processing methods of the embodiments of the present disclosure.

[0424] It should be noted that the computer-readable medium in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program can be used in or in combination with an instruction execution system, apparatus, or device. In this disclosure, the computer-readable signal medium may include a data signal propagated in baseband or a data signal propagated in part on a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), or the like, or any suitable combination thereof.

[0425] In some embodiments, clients and servers may communicate using any now known or later developed network protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any now known or later developed network.

[0426] The computer-readable medium may be included in the electronic device, or may be a standalone medium not mounted in the electronic device.

[0427] The computer-readable medium has one or more programs stored therein, which, when executed by the electronic device, cause the electronic device to determine an operating position based on a first operating signal, determine a second operating posture based on a second operating signal, and execute an operation command according to the operating position and the second operating posture.

[0428] The computer-readable medium includes one or more programs that, when executed by the electronic device, cause the electronic device to determine a first motion time and a first motion posture based on the received motion signal, determine a target object whose object information matches the first motion time and the first motion posture, and play a first processing effect corresponding to the target object.

[0429] The computer-readable medium is equipped with one or more programs, which, when executed by the electronic device, cause the electronic device to display a trigger device and a target object in a virtual reality scene, determine an operation position based on an operation signal, determine a trigger time according to the operation position and the position of the trigger device, determine a target object whose object information matches the trigger time and the position of the trigger device, and play an effect corresponding to the target object.

[0430] The computer-readable medium has one or more programs stored therein, which, when executed by the electronic device, cause the electronic device to determine an action position and an action speed direction based on an action signal, determine a target object whose object information including the object direction and object position matches the action position, and play an effect corresponding to the target object according to the action speed direction and the direction of the target object.

[0431] Computer program code for carrying out the operations of the present disclosure can be written using one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as general procedural programming languages ​​such as "C" or similar programming languages. The program code can execute entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0432] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a specified logical function. Note that in some alternative implementations, the functions depicted in the blocks may be implemented in a different order than depicted in the figures. For example, two successively shown blocks may be executed substantially simultaneously, or, depending on the functionality, they may be executed in the reverse order. Note that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or operation, or by a combination of dedicated hardware and computer instructions.

[0433] The units according to the embodiments of the present disclosure may be realized in software or hardware, and the names of the units may not necessarily limit the units themselves.

[0434] The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, exemplary hardware logic components that may be used include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0435] In this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program used by or in combination with an instruction execution system, device, or apparatus. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0436] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: determining an actuation position based on the first actuation signal; determining a second movement posture based on the second movement signal; A data processing method is provided, which includes executing an operation command according to the motion position and the second motion posture.

[0437] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the first movement signal is a six-degree-of-freedom movement signal; and / or The second actuation signal is a three-degree-of-freedom actuation signal.

[0438] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: determining a first motion posture based on the first motion signal; Executing the operation command in accordance with the operation position and the second operation posture as described above includes: Executing an operation command according to the operating position, the first operating posture, and the second operating posture.

[0439] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: determining the first operating signal in response to operational data of a first device; and determining the second operating signal in response to operational data of a second device.

[0440] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing an operation command according to the motion position and the second motion posture as described above includes: Executing a first operation command according to the operating position; and executing a second operation command in accordance with the second operating posture.

[0441] According to one or more embodiments of the present disclosure, a data processing method according to the present disclosure, comprising: the first operation command corresponds to a first display content of a display device, and the first display content is determined according to a position and an attitude of the display device; The second operation command corresponds to a second display content of the display device, and the second display content is determined depending on the attitude of the display device, or the second display content is a display content at a predetermined position.

[0442] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing the first operation command according to the operation position as described above may include: If the operating position matches a first manipulation position of a first target object, playing an effect corresponding to the first target object; The method comprises: determining a second operating time based on the second operating signal; Executing the second operation command in accordance with the second operating posture as described above includes: When the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object, an effect corresponding to the second target object is played.

[0443] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing the first operation command according to the operation position as described above may include: and playing a first operation effect when the motion position matches the operation trajectory within an operation effective time; Executing the second operation command in accordance with the second operating posture as described above includes: If the second motion posture satisfies a predetermined condition within the effective operation time, a second operation effect is reproduced.

[0444] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes displaying an operation hint indicator within the operation valid time.

[0445] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes displaying a position indicator associated with the operating position.

[0446] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing an operation command according to the second motion posture and the motion position as described above includes: Executing an operation command corresponding to the operating position and the second operating posture.

[0447] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing the operation command corresponding to the operation position and the second operation posture as described above includes: If the second operating position satisfies a predetermined condition, executing an operation command corresponding to the operating position; or The method comprises: determining a first motion posture based on the first motion signal; Executing the operation command corresponding to the operation position and the second operation posture as described above includes: When the second motion posture satisfies a predetermined condition, an operation command corresponding to the first motion posture and the motion position is executed.

[0448] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, executing the operation command corresponding to the operation position and the second operation posture as described above includes: Executing an operation command corresponding to the operation position and displaying a real-time execution result; If the second movement posture satisfies a predetermined condition, the execution result at the current time is obtained.

[0449] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: a first determination module for determining an operating position based on the first operating signal; a second determination module for determining a second movement posture based on the second movement signal; a processing module for executing an operation command according to the operating position and the second operating attitude.

[0450] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the first movement signal is a six-degree-of-freedom movement signal, and / or the second movement signal is a three-degree-of-freedom movement signal.

[0451] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: a third determination module for determining a first motion posture based on the first motion signal; Specifically, the processing module includes: The control unit is used to execute an operation command according to the operating position, the first operating posture, and the second operating posture.

[0452] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: a fourth determination module for determining the first operating signal in response to operational data of the first device; and a fifth determination module for determining the second operating signal in response to operational data of the second device.

[0453] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the processing module comprises: a first execution unit for executing a first operation command according to an operation position; and a second execution unit for executing a second operation command in accordance with the second motion posture.

[0454] According to one or more embodiments of the present disclosure, a data processing device according to the present disclosure, comprising: the first operation command corresponds to a first display content of a display device, and the first display content is determined according to a position and an attitude of the display device; The second operation command corresponds to a second display content of the display device, and the second display content is determined depending on the attitude of the display device, or the second display content is a display content at a predetermined position.

[0455] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the first execution unit specifically: When the operation position matches a first operation position of a first target object, an effect corresponding to the first target object is played; The device comprises: a sixth determination module for determining a second operation time based on the second operation signal; Specifically, the second execution unit: When the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object, it is used to play an effect corresponding to the second target object.

[0456] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the first execution unit is specifically used for playing a first operation effect when the action position matches an operation trajectory within an operation effective time; Specifically, the second execution unit is used to reproduce a second operation effect when the second motion posture satisfies a predetermined condition within the operation valid time.

[0457] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The device further includes a first display module for displaying an operation hint indicator within the operation valid time.

[0458] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: Further included is a second display module for displaying a position indicator associated with the operating position.

[0459] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the processing module comprises: The robot further includes a third execution unit for executing an operation command corresponding to the motion position and the second motion posture.

[0460] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the third execution unit specifically: When the second operating position satisfies a predetermined condition, the second operating position is used to execute an operation command corresponding to the operating position; or The device comprises: a seventh determination module for determining a first motion posture based on the first motion signal; Specifically, the third execution unit further When the second motion posture satisfies a predetermined condition, it is used to execute an operation command corresponding to the first motion posture and the motion position.

[0461] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the third execution unit specifically further comprises: Executing an operation command corresponding to the operation position and displaying a real-time execution result; When the second motion posture satisfies a predetermined condition, the execution result at the current time is obtained.

[0462] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: determining a first movement time and a first movement posture based on the received movement signal; determining a target object whose object information matches the first motion time and the first motion posture; and reproducing a first processing effect corresponding to the target object.

[0463] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the data processing method being applied to a head-mounted display device, The method further includes displaying the target object in a virtual reality scene, wherein a ground plane of the virtual reality scene is aligned with a ground plane of a real scene.

[0464] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the virtual reality scene includes a virtual object, the method comprising: The method further includes controlling a display of the virtual object based on the action signal.

[0465] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the motion signal includes a timestamp, an acceleration signal, and an angular velocity signal, and determining a first motion time and a first motion posture based on the received motion signal as described above includes: The method includes determining the first motion time and the first motion posture based on the time stamp, the acceleration signal, and the angular velocity signal.

[0466] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the operating signal further includes a magnetometer signal, the method comprising: The method further includes determining the first motion time and the first motion attitude based on the time stamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0467] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: Further comprising receiving the motion signal transmitted by the motion tracking device.

[0468] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the object information includes a first effective operation time and an object position, and determining the target object as described above includes: determining that the object is a target object if the first motion time matches the first motion effective time and the first motion posture matches the object position.

[0469] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the object information further includes a second effective operation time, and the method includes: determining a second movement time and a second movement posture based on the received movement signal; The method further includes playing a second processing effect corresponding to the target object when the second action time matches the second action effective time and the second action posture matches the object position.

[0470] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes displaying an associated object of the object on a ground surface of the virtual reality scene, the associated object being associated with the object position.

[0471] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes switching a display state of a related object at a position corresponding to the first motion posture.

[0472] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes displaying the target object at the first effective time and at the object position.

[0473] According to one or more embodiments of the present disclosure, in the data processing method of the present disclosure, the aforementioned reproducing the first processing effect corresponding to the target object may include: The method includes playing an audio effect corresponding to the target object and / or switching a display state of the target object.

[0474] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes determining and displaying an action score of the target object based on the first action time and the first action effective time.

[0475] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the first motion is a stepping motion, and the first motion posture is a posture of the stepping motion.

[0476] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the movement signal is a three-degree-of-freedom signal.

[0477] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: a first determination module for determining a first motion time and a first motion posture based on the received motion signal; a second determination module for determining a target object whose object information matches the first motion time and the first motion posture; and a reproduction module for reproducing a first processing effect corresponding to the target object.

[0478] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The system further includes a first display module for displaying the target object in a virtual reality scene, wherein a ground plane of the virtual reality scene is aligned with a ground plane of a real scene.

[0479] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The device further includes a control module for controlling the display of the virtual object based on the motion signal.

[0480] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the operation signal includes a timestamp, an acceleration signal, and an angular velocity signal, and the first determination module specifically: The first motion time and the first motion posture are determined based on the time stamp, the acceleration signal, and the angular velocity signal.

[0481] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the operating signal further includes a magnetometer signal, and the first determining module specifically further comprises: The first motion time and the first motion posture are determined based on the time stamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

[0482] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the object information includes a first action effective time and an object position, and the second determination module specifically: If the first motion time matches the first motion effective time and the first motion posture matches the object position, the object is used to determine that it is a target object.

[0483] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the object information further includes a second effective operation time, and the device: a third determination module for determining a second motion time and a second motion posture based on the received motion signal; The playback module is further used for playing a second processing effect corresponding to the target object when the second action time matches the second action effective time and the second action posture matches the object position.

[0484] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The device further includes a switching module for switching a display state of a related object at a position corresponding to the first motion posture.

[0485] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The device further includes a third display module for displaying the target object at the first effective operating time and the object position.

[0486] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the playback module specifically comprises: It is used to play a sound effect corresponding to the target object and / or to switch the display state of the target object.

[0487] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The device further includes a determination and display module for determining and displaying an action score of the target object based on the first action time and the first action effective time.

[0488] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the first motion is a stepping motion, and the first motion posture is a posture of the stepping motion.

[0489] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the movement signal is a three-degree-of-freedom signal.

[0490] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: Displaying the trigger device and the target object in a virtual reality scene; determining an actuation position based on the actuation signal; determining a trigger time in response to the operating position and the position of the trigger device; determining a target object whose object information matches the trigger time and the position of the trigger device; and playing an effect corresponding to the target object.

[0491] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes playing a trigger effect at the trigger time at the location of the trigger device.

[0492] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the trigger device includes a plurality of trigger segments, and the aforementioned playing of the trigger effect at the position of the trigger device includes: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; and triggering an effect at the location of the target trigger segment.

[0493] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: determining an operating speed in response to the operating signal; If the movement speed is greater than a predetermined speed threshold, determining the trigger time according to the movement position and the position of the trigger device.

[0494] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the object information includes an object time and an object position, and the aforementioned determining the target object includes: determining that the object is the target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range;

[0495] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the time range includes a first time sub-range, a second time sub-range, and a third time sub-range, and the first time sub-range is lower than the second time sub-range, and the method includes: determining a first trigger result if the time difference value is within the first time sub-range; determining a second trigger result if the time difference value is within the second time sub-range; determining a third trigger result if the time difference value is within the third time sub-range; and determining a fourth trigger result if the time difference value exceeds the third time sub-range. obtaining a score range corresponding to each time subrange; The method further includes performing a calculation based on each of the time sub-ranges, each of the score ranges, and the time difference value to obtain a trigger score for each trigger result.

[0496] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the aforementioned playing of an effect corresponding to the target object includes: The method includes displaying text information corresponding to the trigger result and a trigger score, and / or switching the display state of the target object.

[0497] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: a display module for displaying the trigger device and the target object in a virtual reality scene; a first determination module for determining an operating position based on the operating signal; a second determination module for determining a trigger time according to the operating position and the position of the trigger device; a third determination module for determining a target object whose object information matches the trigger time and the position of the trigger device; a playback module for playing an effect corresponding to the target object.

[0498] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: It further includes a trigger module for playing a trigger effect at the trigger time at the location of the trigger device.

[0499] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the trigger device includes a plurality of trigger segments, and the trigger module specifically comprises: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; and triggering an effect at the location of the target trigger segment.

[0500] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: further comprising a fourth determination module for determining a motion speed in response to the motion signal; The second determination module is further used for determining the trigger time according to the motion position and the position of the trigger device when the motion speed is greater than a predetermined speed threshold.

[0501] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the object information includes an object time and an object position, and the third determination module specifically comprises: If the object position matches the position of the trigger device and the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be the target object.

[0502] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the time range includes a first time sub-range, a second time sub-range, and a third time sub-range, the first time sub-range being lower than the second time sub-range, and the second time sub-range being lower than the third time sub-range, and the device is configured to: determining a first trigger result if the time difference value is within the first time sub-range; determining a second trigger result if the time difference value is within the second time sub-range; determining a third trigger result if the time difference value is within the third time sub-range; and determining a fourth trigger result if the time difference value exceeds the third time sub-range.

[0503] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: an acquisition module for acquiring a score range corresponding to each time subrange; The method further includes a calculation module for performing calculations based on each of the time sub-ranges, each of the score ranges, and the time difference value to obtain a trigger score for each trigger result.

[0504] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the playback module specifically comprises: It is used to display text information and a trigger score corresponding to the trigger result, and / or to switch the display state of the target object.

[0505] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: determining a motion position and a motion speed direction based on the motion signal; determining a target object whose object information including an object direction and an object position matches the operating position; and playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object.

[0506] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the object orientation is associated with the object position.

[0507] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the object information further includes an object time, and the method includes: determining a trigger time according to the operating position and a position of a trigger device; As mentioned above, determining the target object is determining that the object is the target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range;

[0508] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the trigger device includes a plurality of trigger segments, and the method includes: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; and playing a trigger effect at the location of the target trigger segment.

[0509] According to one or more embodiments of the present disclosure, in a data processing method according to the present disclosure, the trigger device includes a plurality of trigger segments, and the method includes: determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device, and obtaining a center position of the target trigger segment; calculating a value of a distance difference between the position of the trigger device and the center position; and determining a trigger score based on the distance difference value and a predetermined distance range.

[0510] According to one or more embodiments of the present disclosure, there is provided a data processing method according to the present disclosure, the method comprising: The method further includes determining a trigger score according to the time difference value and a predetermined time range.

[0511] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, the aforementioned playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object includes: determining an absolute value of an included angle based on the motion velocity direction and a normal to the target object direction; and determining and playing an effect corresponding to the target object according to the absolute value of the included angle.

[0512] According to one or more embodiments of the present disclosure, in the data processing method according to the present disclosure, determining and playing an effect corresponding to the target object according to the absolute value of the included angle as described above may include: If the absolute value of the included angle is smaller than a predetermined included angle threshold, displaying text information corresponding to the trigger result and a trigger score, and / or switching a display state of the target object.

[0513] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: a first determination module for determining a motion position and a motion speed direction based on the motion signal; a second determination module for determining a target object whose object information including an object direction and an object position matches the operating position; a playback module for playing an effect corresponding to the target object according to the motion speed direction and a direction of the target object.

[0514] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the object orientation is associated with the object position.

[0515] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the object information further includes object time, and the method further comprises: determining a trigger time according to the operating position and a position of a trigger device; Specifically, the second determination module: If the object position matches the position of the trigger device and the time difference between the object time and the trigger time satisfies a predetermined time range, the object is determined to be the target object.

[0516] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the trigger device includes a plurality of trigger segments, the device comprising: a third determination module for determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device; and a trigger module for playing a trigger effect at the location of the target trigger segment.

[0517] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the trigger device includes a plurality of trigger segments, the device comprising: a fourth determination module for determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device and obtaining a center position of the target trigger segment; a calculation module for calculating a distance difference value between the position of the trigger device and the center position; and a fifth determination module for determining a trigger score based on the distance difference value and a predetermined distance range.

[0518] According to one or more embodiments of the present disclosure, there is provided a data processing device according to the present disclosure, the device comprising: The sixth determination module further includes a trigger score for determining a trigger score according to the time difference value and a predetermined time range.

[0519] According to one or more embodiments of the present disclosure, in a data processing device according to the present disclosure, the playback module comprises: a determination unit for determining an absolute value of an included angle based on the motion velocity direction and a normal to the direction of the target object; and a reproduction unit for determining and reproducing an effect corresponding to the target object according to the absolute value of the included angle.

[0520] According to one or more embodiments of the present disclosure, in the data processing device according to the present disclosure, the playback unit specifically: If the absolute angle is smaller than a predetermined threshold, the trigger score and text information corresponding to the trigger result are displayed, and / or the display state of the target object is switched.

[0521] According to one or more embodiments of the present disclosure, the present disclosure provides a method for manufacturing a semiconductor device, comprising: a processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the instructions to implement any one of the data processing methods disclosed herein.

[0522] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having stored thereon a computer program for performing any one of the data processing methods according to the present disclosure.

[0523] According to one or more embodiments of the present disclosure, the present disclosure provides a computer program product including instructions that, when executed by a processor, cause the processor to perform any one of the data processing methods according to the present disclosure.

[0524] According to one or more embodiments of the present disclosure, the present disclosure provides a computer program comprising instructions that, when executed by a processor, cause the processor to perform any one of the data processing methods according to the present disclosure.

[0525] The above is merely a description of preferred embodiments and the technical principles applied in the present disclosure. It is obvious to those skilled in the art that the scope of the present disclosure is not limited to the technical solution based on a specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or equivalent features without departing from the concept of the above disclosure. For example, it also includes technical solutions formed by mutually replacing the above features with technical features having similar functions disclosed in the present disclosure (but not limited to those).

[0526] Also, although operations are described in a particular order, this should not be understood as requiring such operations to be performed in the particular order shown, or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above description, they should not be construed as limiting the scope of the present disclosure. Certain features described in the context of a single embodiment may also be implemented in combination in a single embodiment. Rather, various features described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable subcombination.

[0527] Although the present subject matter has been described in language specific to structural features and / or methodological operations, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. determining an actuation position based on the first actuation signal; determining a second movement posture based on the second movement signal; A data processing method comprising: executing an operation command according to the motion position and the second motion posture.

2. the first actuation signal is a six degree of freedom actuation signal; and / or 2. The data processing method according to claim 1, wherein the second movement signal is a three-degree-of-freedom movement signal.

3. The method comprises: determining a first motion posture based on the first motion signal; Executing an operation command in accordance with the operation position and the second operation posture includes:

3. The data processing method according to claim 1, further comprising: executing an operation command in accordance with the motion position, the first motion posture, and the second motion posture.

4. The method comprises: determining the first operating signal in response to operational data of a first device; The data processing method according to any one of claims 1 to 3, further comprising: determining the second operation signal in response to operation data of a second device.

5. Executing an operation command in accordance with the operation position and the second operation posture includes: Executing a first operation command according to the operation position; 5. The data processing method according to claim 1, further comprising: executing a second operation command in accordance with the second operating posture.

6. the first operation command corresponds to a first display content of a display device, and the first display content is determined according to a position and an attitude of the display device; 6. The data processing method of claim 5, wherein the second operation command corresponds to second display content of a display device, and the second display content is determined depending on the attitude of the display device, or the second display content is display content at a predetermined position.

7. Executing a first operation command in accordance with the operation position includes: If the operating position matches a first manipulation position of a first target object, playing an effect corresponding to the first target object; The method comprises: determining a second operation time based on the second operation signal; Executing a second operation command in accordance with the second motion posture includes:

7. The data processing method according to claim 5 or 6, further comprising: playing an effect corresponding to the second target object when the second action time matches the operation effective time of the second target object and the action posture matches the second operation position of the second target object.

8. Executing a first operation command in accordance with the operation position includes: If the operation position matches the operation trajectory within an operation valid time, a first operation effect is played; Executing a second operation command in accordance with the second motion posture includes:

7. The data processing method according to claim 5, further comprising: reproducing a second operation effect when the second motion posture satisfies a predetermined condition within the effective operation time.

9. The method comprises: The data processing method according to claim 8 , further comprising: displaying an operation hint indicator within the operation valid time.

10. The method comprises:

10. The data processing method of claim 8 or 9, further comprising displaying a position indicator associated with the operating position.

11. Executing an operation command in accordance with the second movement posture and the movement position includes: The data processing method according to any one of claims 1 to 10, further comprising: executing an operation command corresponding to the operation position and the second operation posture.

12. Executing an operation command corresponding to the operation position and the second operation posture includes: Executing an operation command corresponding to the operation position when the second operation posture satisfies a predetermined condition; or The method comprises: determining a first motion posture based on the first motion signal; Executing an operation command corresponding to the operation position and the second operation posture includes:

12. The data processing method according to claim 1, further comprising: executing an operation command corresponding to the first movement posture and the movement position when the second movement posture satisfies a predetermined condition.

13. Executing an operation command corresponding to the operation position and the second operation posture includes: Executing an operation command corresponding to the operation position and displaying a real-time execution result; The data processing method according to claim 1 , further comprising: acquiring an execution result at a current time when the second motion posture satisfies a predetermined condition.

14. a first determination module for determining an operating position based on the first operating signal; a second determination module for determining a second motion posture based on the second motion signal; a processing module for executing an operation command according to the operating position and the second operating attitude.

15. determining a first motion time and a first motion posture based on the received motion signal; determining a target object whose object information matches the first motion time and the first motion posture; and reproducing a first processing effect corresponding to the target object.

16. The data processing method is applied to a head-mounted display device, 16. The data processing method of claim 15, further comprising displaying the target object in a virtual reality scene, wherein a ground plane of the virtual reality scene is aligned with a ground plane of a real scene.

17. The virtual reality scene includes a virtual object, and the method further comprises: The data processing method of claim 16 , further comprising controlling a display of the virtual object based on the action signal.

18. The motion signal includes a time stamp, an acceleration signal, and an angular velocity signal, and determining a first motion time and a first motion posture based on the received motion signal includes:

18. The data processing method according to claim 15, further comprising determining the first movement time and the first movement posture based on the time stamp, the acceleration signal, and the angular velocity signal.

19. The operating signal further comprises a magnetometer signal, and the method further comprises:

20. The data processing method of claim 18, further comprising determining the first motion time and the first motion attitude based on the time stamp, the acceleration signal, the angular velocity signal, and the magnetometer signal.

20. The method comprises: The data processing method of any one of claims 15 to 19, further comprising receiving the motion signal transmitted by a motion tracking device.

21. The object information includes a first effective time of operation and an object position, and determining the target object includes:

21. The data processing method according to claim 15, further comprising: determining that the object is a target object if the first action time matches the first action effective time and the first action posture matches the object position.

22. The object information further includes a second effective operation time, and the method further comprises: determining a second movement time and a second movement posture based on the received movement signal; 22. The data processing method of claim 21, further comprising: playing a second processing effect corresponding to the target object when the second action time matches the second action effective time and the second action posture matches the object position.

23. The method comprises: The data processing method of claim 16 , further comprising displaying an associated object of the object on a ground surface of the virtual reality scene, the associated object being associated with an object position.

24. The method comprises: The data processing method according to claim 23 , further comprising: switching a display state of an associated object at a position corresponding to the first motion posture.

25. The method comprises:

23. The data processing method according to claim 21 or 22, further comprising displaying the target object at the first effective time of operation and at the object position.

26. Reproducing a first processing effect corresponding to the target object includes: The data processing method according to any one of claims 15 to 25, further comprising: playing an audio effect corresponding to the target object and / or switching a display state of the target object.

27. The method comprises:

23. The data processing method according to claim 21 or 22, further comprising determining and displaying an action score of the target object based on the first action time and the first action effective time.

28. The data processing method according to any one of claims 15 to 27, wherein the first motion is a stepping motion, and the first motion posture is a posture of the stepping motion.

29. The data processing method according to any one of claims 15 to 28, wherein the operation signal is a three-degree-of-freedom signal.

30. a first determination module for determining a first motion time and a first motion posture based on the received motion signal; a second determination module for determining a target object whose object information matches the first motion time and the first motion posture; a reproduction module for reproducing a first processing effect corresponding to the target object.

31. Displaying the trigger device and the target object in a virtual reality scene; determining an actuation position based on the actuation signal; determining a trigger time in response to the operating position and the position of the trigger device; determining a target object whose object information matches the trigger time and the position of the trigger device; and playing an effect corresponding to said target object.

32. The method comprises:

32. The data processing method of claim 31, further comprising playing a trigger effect at the trigger time at the location of the trigger device.

33. The trigger device includes a plurality of trigger segments, and playing a trigger effect at the location of the trigger device includes: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; and triggering an effect at the location of the target trigger segment.

34. The method comprises: determining an operating speed in response to the operating signal; 34. The data processing method according to claim 31, further comprising: if the movement speed is greater than a predetermined speed threshold, determining the trigger time according to the movement position and a position of the trigger device.

35. The object information includes an object time and an object position, and determining the target object includes:

35. The data processing method of claim 31, further comprising: determining that an object is the target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range.

36. The time range includes a first time sub-range, a second time sub-range, and a third time sub-range, the first time sub-range being lower than the second time sub-range, and the method includes: determining a first trigger result if the time difference value is within the first time sub-range; determining a second trigger result if the time difference value is within the second time sub-range; determining a third trigger result if the time difference value is within the third time sub-range; 36. The data processing method of claim 35, further comprising: determining a fourth trigger result if the time difference value exceeds the third time sub-range.

37. The method comprises: obtaining a score range corresponding to each time subrange; 37. The data processing method of claim 36, further comprising: performing a calculation based on each of the time sub-ranges, each of the score ranges, and the time difference value to obtain a trigger score for each trigger result.

38. Playing an effect corresponding to the target object includes: The data processing method according to any one of claims 31 to 37, comprising displaying text information corresponding to the trigger result and a trigger score, and / or switching a display state of the target object.

39. a display module for displaying the trigger device and the target object in a virtual reality scene; a first determination module for determining an operating position based on the operating signal; a second determination module for determining a trigger time according to the operating position and the position of the trigger device; a third determination module for determining a target object whose object information matches the trigger time and the position of the trigger device; a playback module for playing an effect corresponding to said target object.

40. determining a motion position and a motion speed direction based on the motion signal; determining a target object whose object information including an object direction and an object position matches the operating position; and playing an effect corresponding to the target object according to the direction of the motion speed and the direction of the target object.

41. 41. A data processing method according to claim 40, wherein the object orientation is associated with the object position.

42. The object information further includes object time, and the method further comprises: determining a trigger time according to the operating position and a position of a trigger device; determining the target object 42. A data processing method according to claim 40 or 41, comprising determining that an object is the target object if the object position matches the position of the trigger device and the value of the time difference between the object time and the trigger time satisfies a predetermined time range.

43. The trigger device includes a plurality of trigger segments, and the method includes: determining a target trigger segment from the plurality of trigger segments in response to a position of the trigger device; 43. The data processing method of claim 42, further comprising: playing a trigger effect at the location of the target trigger segment.

44. The trigger device includes a plurality of trigger segments, and the method includes: determining a target trigger segment from the plurality of trigger segments according to a position of the trigger device, and obtaining a center position of the target trigger segment; calculating a value of a distance difference between the position of the trigger device and the center position; 44. A data processing method according to claim 42 or 43, further comprising determining a trigger score based on the distance difference value and a predetermined distance range.

45. The method comprises:

44. The data processing method of claim 43, further comprising determining a trigger score in response to the time difference value and a predetermined time range.

46. Reproducing an effect corresponding to the target object according to the motion speed direction and the direction of the target object includes: determining an absolute value of an included angle based on the motion velocity direction and a normal to the target object direction; The data processing method according to any one of claims 40 to 45, further comprising determining and playing an effect corresponding to the target object in accordance with the absolute value of the included angle.

47. Determining and playing an effect corresponding to a target object according to the absolute value of the included angle 47. The data processing method of claim 46, further comprising: displaying text information corresponding to a trigger result and a trigger score, and / or switching a display state of the target object, when the absolute included angle value is smaller than a predetermined included angle threshold.

48. a first determination module for determining a motion position and a motion speed direction based on the motion signal; a second determination module for determining a target object whose object information including an object direction and an object position matches the operating position; a playback module for playing an effect corresponding to the target object according to the motion speed direction and the direction of the target object.

49. a processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the instructions to realize the data processing method described in any one of claims 1 to 13, 15 to 29, 31 to 38, and 40 to 48.

50. A computer-readable storage medium storing a computer program for executing the data processing method according to any one of claims 1 to 13, 15 to 29, 31 to 38, and 40 to 48.

51. A computer program product comprising instructions which, when executed by a processor, cause the processor to implement a data processing method according to any one of claims 1 to 13, 15 to 29, 31 to 38, 40 to 48.

52. A computer program comprising instructions which, when executed by a processor, cause the processor to implement a data processing method according to any one of claims 1 to 13, 15 to 29, 31 to 38, 40 to 48.

Images