Interactive input data processing method and device, equipment and storage medium

Abstract

The invention relates to the technical field of XR, and provides an interactive input data processing method and device, equipment and a storage medium, and the method comprises the steps: detecting the interactive input of a user; when the interactive input meets a first preset condition, entering an accumulation input mode; recording tracks of interactive input position change and / or rotation change of the user during the accumulation input mode, and accumulating the tracks to obtain an accumulation result; when the interactive input in the accumulative input mode meets a second preset condition, stopping recording the interactive input of the user during the accumulative input mode; generating an interaction instruction corresponding to the accumulation result; triggering an event corresponding to the interaction instruction; and exiting the accumulation input mode. According to the embodiment of the invention, the operation range of interactive input can be expanded and the operation continuity can be improved.

Description

Technical Field

[0001] The present specification relates to the field of extended reality (XR) technology, and in particular to an interactive input data processing method, device, equipment and storage medium. Background Art

[0002] In XR space, users can obtain information and experience by interacting with virtual content. However, since virtual content is generally not limited by the size of physical space, it sometimes exceeds the user's physical reach or the accessible area of ​​the physical space to gain experience advantages. This design leads to a significant technical challenge: when virtual content is outside the user's operational range, it may be difficult for the user to interact with it, thereby limiting the user's operational range and operational continuity in the XR space.

[0003] For interactive objects that are beyond the operable range, a feasible method is to amplify the interaction of the input source by a fixed ratio, and then map the amplified mobile interaction to the interactive object. For example, taking the magnification ratio as 4 times, the user's hand movement range is about 0.5 meters. When the user drags the interactive object by moving the hand, the interactive object can be moved to a distance of about 2 meters at most. However, it is still difficult to move the interactive object to a position farther than 2 meters. It can be seen that this method still limits the user's operating range and operation continuity in the XR space. Summary of the invention

[0004] The purpose of the embodiments of this specification is to provide an interactive input data processing method, device, equipment and storage medium to expand the operation scope of interactive input and improve operation consistency.

[0005] To achieve the above objectives, on the one hand, an embodiment of the present specification provides an interactive input data processing method, including:

[0006] Detect user interaction input;

[0007] When the interactive input meets the first preset condition, entering the cumulative input mode;

[0008] Recording a trajectory of a user's interactive input position change and / or rotation change during the accumulation input mode, and accumulating the trajectory to obtain an accumulation result;

[0009] When the interactive input in the cumulative input mode meets a second preset condition, stop recording the interactive input of the user during the cumulative input mode;

[0010] Generate an interactive instruction corresponding to the accumulated result;

[0011] Triggering an event corresponding to the interaction instruction;

[0012] Exit the accumulation input mode.

[0013] In the interactive input data processing method of the embodiment of this specification, the first preset condition includes:

[0014] The position change and / or rotation change of the interactive input meets the first feature; and / or,

[0015] The interactive input mode generates a first specific operation.

[0016] In the interactive input data processing method of the embodiment of this specification, the first feature includes:

[0017] a change in the position and / or rotation of the interactive input relative to the interactive target; and / or,

[0018] The change in the position and / or rotation of the interactive input is relative to the change characteristics of the user's interactive operation habits.

[0019] In the interactive input data processing method of the embodiment of this specification, the first specific operation includes:

[0020] a first specific operation caused by a human body part; or,

[0021] The specified first input device interaction action.

[0022] In the interactive input data processing method of the embodiment of this specification, the second preset condition includes any one or more of the following:

[0023] The position change and / or rotation change of the interactive input meets the second feature;

[0024] Interactive input triggers the UI’s functionality;

[0025] The interactive input mode generates a second specific operation.

[0026] In the interactive input data processing method of the embodiment of this specification, the second feature includes:

[0027] a change in the position and / or rotation of the interactive input relative to the interactive target; and / or,

[0028] The change in the position and / or rotation of the interactive input is relative to the change characteristics of the user's interactive operation habits.

[0029] In the interactive input data processing method of the embodiment of this specification, the second specific operation includes:

[0030] a second specific operation produced by a human body part; or,

[0031] A specific second input device interaction action.

[0032] In the interactive input data processing method of the embodiment of this specification, recording the trajectory of the user's interactive input position change and / or rotation change during the cumulative input mode includes:

[0033] The position change information and the rotation change information corresponding to the interactive input during the cumulative input mode are recorded.

[0034] In the interactive input data processing method of the embodiment of this specification, the accumulating the trajectory includes:

[0035] The displacements of the interaction inputs in the direction most similar to the user's interaction intention direction during the accumulation input mode are accumulated, and the rotation information of the interaction inputs in the direction most similar to the user's interaction intention direction during the accumulation input mode is accumulated.

[0036] In the interactive input data processing method of the embodiment of this specification, when the interactive instruction is an interactive instruction for moving the pointing position of the interactive input, the event corresponding to the triggering of the interactive instruction includes:

[0037] The three-dimensional position pointed to by the interactive input in the XR space is moved from the position before entering the cumulative input mode to the position specified by the interactive instruction.

[0038] In the interactive input data processing method of the embodiment of this specification, when the interactive instruction is an interactive instruction for activating a UI component function, the event corresponding to the triggering interactive instruction includes:

[0039] Activates the functionality of UI components in XR space.

[0040] In the interactive input data processing method of the embodiment of this specification, when the interactive instruction is an interactive instruction for switching UI or UI components, the event corresponding to the triggering of the interactive instruction includes:

[0041] Switch the object pointed to by the interactive input in the XR space from the current UI or UI component to another UI or UI component in the XR space.

[0042] In the interactive input data processing method of the embodiment of this specification, the other UI or UI component includes:

[0043] The UI or UI component in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple UIs or UI components in the direction most similar to the user's interaction intention direction, the other UI or UI component is the one that is closest to the object pointed to by the interaction input.

[0044] In the interactive input data processing method of the embodiment of this specification, when the interactive instruction is an interactive instruction to enter the XR scene, the event corresponding to the triggering of the interactive instruction includes:

[0045] Load the corresponding XR scene from the user's current XR space position.

[0046] In the interactive input data processing method of the embodiment of this specification, the corresponding XR scene includes:

[0047] The XR scene in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple XR scenes in the direction most similar to the user's interaction intention direction, the corresponding XR scene is the XR scene that is closest to the current scene.

[0048] In the interactive input data processing method of the embodiment of this specification, when the interactive instruction is an interactive instruction for switching the XR scene, the event corresponding to the triggering of the interactive instruction includes:

[0049] Switch the XR space from the current XR scene to another XR scene in the XR space.

[0050] In the interactive input data processing method of the embodiment of this specification, the other XR scene includes:

[0051] The XR scene in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple XR scenes in the direction most similar to the user's interaction intention direction, the other XR scene is the XR scene that is closest to the current scene.

[0052] In the interactive input data processing method of the embodiment of this specification, the UI includes a two-dimensional UI and / or a three-dimensional UI.

[0053] In the interactive input data processing method of the embodiment of this specification, the UI component includes a two-dimensional UI component and / or a three-dimensional UI component.

[0054] On the other hand, the embodiment of this specification also provides an interactive input data processing device, including:

[0055] A detection module, used to detect user interaction input;

[0056] An entry module, configured to enter an accumulation input mode when the interactive input satisfies a first preset condition;

[0057] An accumulation module, used to record the trajectory of the user's interactive input position change and / or rotation change during the accumulation input mode, and accumulate the trajectory to obtain an accumulation result;

[0058] A stopping module, configured to stop recording the user's interactive input during the cumulative input mode when the interactive input in the cumulative input mode meets a second preset condition;

[0059] A generating module, used for generating an interactive instruction corresponding to the accumulated result;

[0060] A trigger module, used to trigger an event corresponding to the interaction instruction;

[0061] An exit module is used to exit the accumulation input mode.

[0062] On the other hand, an embodiment of the present specification further provides a computer device, including a memory, a processor, and a computer program stored in the memory, wherein when the computer program is executed by the processor, the instructions of the above method are executed.

[0063] On the other hand, an embodiment of the present specification further provides a computer storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer device, the instructions of the above method are executed.

[0064] On the other hand, an embodiment of the present specification further provides a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor of a computer device, the computer program executes instructions of the above method.

[0065] It can be seen from the technical solutions provided by the above embodiments of this specification that when the user's interactive input in the XR space meets the first preset condition, it will trigger the entry into the cumulative input mode; in the cumulative input mode, the trajectory of the user's interactive input position change and / or rotation change in the XR space during the cumulative input mode will be recorded, and the trajectory will be accumulated to obtain the cumulative result; when the interactive input in the cumulative input mode meets the second preset condition, the cumulative input mode will be exited, and the interactive instruction corresponding to the cumulative result will be generated, and then the event corresponding to the interactive instruction will be triggered. Because the user's input actions in the cumulative input mode are accumulated and processed by the system; by accumulating these inputs, the system can generate instructions that exceed the user's physical input limits; and as long as the interactive input in the cumulative input mode does not meet the second preset condition, the trajectory will continue to be accumulated, thereby greatly expanding the scope of operation in the XR space and improving the continuity of operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the technical solutions in the embodiments of this specification or the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art description. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. In the drawings:

[0067] Figure 1 A schematic diagram of an environment for interactive input data processing in some embodiments of this specification is shown;

[0068] Figure 2 A flowchart of a method for processing interactive input data in some embodiments of this specification is shown;

[0069] Figure 3a-3c A schematic diagram showing a method of changing a position corresponding to an interactive input in a three-dimensional space in an exemplary embodiment of the present specification is shown;

[0070] Figure 4a-4b A schematic diagram of a zoom UI in an exemplary embodiment of the present specification is shown;

[0071] Figure 5a-Figure 5b A schematic diagram showing a switching UI in an exemplary embodiment of the present specification is shown;

[0072] Figure 6a-Figure 6b A schematic diagram of entering an XR scene in an exemplary embodiment of this specification is shown;

[0073] Figure 6c-6d A schematic diagram showing switching of XR scenes in an exemplary embodiment of this specification is shown;

[0074] Figure 7 A structural block diagram of an interactive input data processing device in some embodiments of this specification is shown;

[0075] Figure 8 The structure block diagram of the computer device in some embodiments of the present specification is shown.

[0076] [Description of Reference Numerals]

[0077] 10. XR devices;

[0078] 20. XR space;

[0079] 30. User;

[0080] 71. Detection module;

[0081] 72. Enter the module;

[0082] 73. Accumulation module;

[0083] 74. Stop module;

[0084] 75. Generate module;

[0085] 76. Trigger module;

[0086] 77. Exit module;

[0087] 802. Computer equipment;

[0088] 804, processor;

[0089] 806. Memory;

[0090] 808, driving mechanism;

[0091] 810, input / output interface;

[0092] 812. Input device;

[0093] 814. Output device;

[0094] 816. Presentation equipment;

[0095] 818. Graphical user interface;

[0096] 820, network interface;

[0097] 822, communication link;

[0098] 824. Communication bus. DETAILED DESCRIPTION

[0099] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.

[0100] The embodiments of this specification relate to interactive input data processing technology to expand the operation range of interactive input and improve the consistency of operation; it can be applied to interactive input data processing in XR space, and can also be applied to interactive input data processing in non-XR space (for example, interactive input data processing in non-XR space in electronic devices such as desktop computers, tablet computers, laptops, and smart phones). Therefore, the embodiments of interactive input data processing in XR space in the following description are only used as illustrative descriptions and should not be understood as the sole limitation of this specification. Figure 1A schematic diagram of the environment for interactive input data processing in some embodiments of this specification is shown in the figure; the environment includes an XR device 10, which can display an XR space 20 (i.e., an XR scene) to a user 30; multiple applications (including three-dimensional applications and / or two-dimensional applications, etc.) or other visual objects can be presented in the XR space 20. Among them, the XR device 10 can be a wearable device (such as VR glasses, AR glasses, etc.) configured with an XR system. The XR system can include a virtual reality (VR) system, an augmented reality (AR) system, and a mixed reality (MR) system. Therefore, the XR device 10 in the embodiments of this specification can be any one of a VR device, an AR device, or an MR device. In some embodiments of the present specification, the XR device 10 is used to detect the interactive input of the user 30 in the XR space 20 (i.e., the interactive input of the user 30 to the XR space 20); when the interactive input meets the first preset condition, enter the cumulative input mode; record the trajectory of the interactive input position change and / or rotation change of the user 30 in the XR space 20 during the cumulative input mode, and accumulate the trajectory to obtain the cumulative result; when the interactive input in the cumulative input mode meets the second preset condition, stop recording the interactive input of the user 30 during the cumulative input mode; generate an interactive instruction corresponding to the cumulative result; trigger an event corresponding to the interactive instruction; and exit the cumulative input mode. Through the embodiments of the present specification, the operation range in the XR space can be expanded and the operation consistency can be improved.

[0101] In the embodiments of this specification, the input source corresponding to the interactive input may be an input device and / or a human body part. For example, in some embodiments of this specification, the input source may be an input device such as a handle or a mouse, or may be a human body part such as a human hand, a human eye, or a human head; a handle may generate a handle interactive input, a human hand may generate a gesture interactive input, a human eye may generate an eye interactive input, a human head may generate a head interactive input, etc.

[0102] The embodiments of this specification provide an interactive input data processing, which can be applied to the XR system of the above-mentioned XR device, referring to Figure 2 As shown, in some embodiments of the present specification, interactive input data processing may include the following steps:

[0103] Step 201: Detect the user's interactive input in the XR space.

[0104] Step 202: When the interactive input meets a first preset condition, enter an accumulation input mode.

[0105] Step 203: Record the trajectory of the user's interactive input position change and / or rotation change in the XR space during the accumulation input mode, and accumulate the trajectory to obtain an accumulation result.

[0106] Step 204: When the interactive input in the cumulative input mode satisfies a second preset condition, stop recording the interactive input of the user in the XR space during the cumulative input mode.

[0107] Step 205: Generate an interactive instruction corresponding to the accumulation result.

[0108] Step 206: trigger an event corresponding to the interaction instruction.

[0109] Step 207: exit the accumulation input mode.

[0110] In the embodiments of this specification, when the user's interactive input in the XR space meets the first preset condition, it will trigger the entry into the cumulative input mode; in the cumulative input mode, the trajectory of the user's interactive input position change and / or rotation change in the XR space during the cumulative input mode will be recorded, and the trajectory will be accumulated to obtain the accumulated result; when the interactive input in the cumulative input mode meets the second preset condition, the cumulative input mode will be exited, and the interactive instruction corresponding to the accumulated result will be generated, and then the event corresponding to the interactive instruction will be triggered. Because the user's input actions in the cumulative input mode are accumulated and processed by the system; by accumulating these inputs, the system can generate instructions that exceed the user's physical input limit; and as long as the interactive input in the cumulative input mode does not meet the second preset condition, the trajectory will continue to be accumulated, thereby greatly expanding the operation range in the XR space and improving the operation continuity.

[0111] In some embodiments of the present specification, detecting the user's interactive input in the XR space refers to: detecting the user's interactive input to the XR space. This interactive input can be an interactive input without a target object (i.e., a non-directional operation) or an interactive input with a target object (i.e., a directional operation), which can be determined by the user according to needs. For example, when a user snaps his fingers, a virtual butterfly will fly towards the user in the XR space. Since the user does not point to a specific object when snapping his fingers (i.e., there is no target object), this snapping operation is a non-directional operation. For another example, when a user uses gesture interactive input to point to a button in the XR space and then clicks the button, since this button-clicking operation is only effective for the button being pointed to, this button-clicking operation is a directional operation.

[0112] In some embodiments of this specification, the first preset condition is used to determine whether the user's interactive input in the XR space will trigger the entry into the cumulative input mode. The XR system can detect the user's interactive input in the XR space in real time by retrieving data generated by the input source (such as the handle input interface, camera, 3D motion sensor data, etc.), and determine in real time whether the interactive input meets the first preset condition; when the interactive input does not meet the first preset condition, the detection can continue; when the interactive input meets the first preset condition, it triggers the entry into the cumulative input mode. Among them, the first preset condition can be a preset condition defined by the user or set by the system.

[0113] In some embodiments of the present specification, the first preset condition may include, but is not limited to, part or all of the following:

[0114] (1) The position change and / or rotation change of the interactive input meets the first feature; wherein the first feature may include: the change characteristics of the position and / or rotation of the interactive input relative to the interactive target (i.e., the user's interactive target); and / or the change characteristics of the position and / or rotation of the interactive input relative to the user's interactive operation habits.

[0115] (2) The interactive input method generates a first specific operation; wherein the first specific operation may include: a first specific operation generated by a part of the human body; or a specific first input device interactive action, and the first specific operation and the first input device interactive action can both be set as needed.

[0116] In some embodiments of the present specification, the position change and / or rotation change of the above-mentioned interactive input meets the change feature of the position and / or rotation of the interactive input relative to the interactive target in the first feature, for example, may include but is not limited to part or all of the following:

[0117] (1) The data generated by the input source stops updating for a first preset time period.

[0118] The time when the data generated by the input source stops updating reaches the first preset time length means that after the user stops interactive input, the time when the position change information and rotation change information generated by the input source (such as an input device, etc.) no longer exceeds a certain threshold (that is, the position change or rotation change that does not exceed the certain threshold can be regarded as invalid input) reaches the first preset time length. The first preset time length can be set as needed (that is, the first preset time length can be customized as needed).

[0119] (2) The data generated by the input source stops updating for a second preset time period, and the rotation data generated by the input source deviates from the user-related angle by a first angle threshold.

[0120] The angle of rotation data generated by the input source deviating from the user is the angle between the central axis of the input source representing the interactive input and the central axis of the user's torso or body part. Figure 3a The vertical dashed line in the middle is the central axis of the user's torso, the inclined dashed line is the central axis of the arm, and the angle formed by the two dashed lines is the angle at which the rotation data generated by the input source deviates from the user. Figure 3a For example, when a user swings his right hand to the right, there is a swing limit (the user swings his right hand to the right); different users may have different operating limits for the same input source. Therefore, the first angle threshold can be set as needed. For example, the operating limit of an individual user when using an input source can be collected and recorded in advance, and used as the first angle threshold of the interactive input of the individual user corresponding to the input source. In addition, according to actual needs, the second preset time length can be set as needed.

[0121] (3) The input speed of the interactive input reaches a first speed threshold.

[0122] The input speed of the interactive input may refer to: an average speed of the interactive input, or a maximum speed of the interactive input, etc. The first speed threshold may be set as required. For example, the interactive input speed may be reflected by the size of the difference in position change information and / or rotation information of n adjacent frames of input sources; the larger the difference, the faster the speed, and vice versa.

[0123] (4) The three-dimensional position in the XR space pointed to by the interactive input changes to the boundary range of the UI and / or UI component, and the three-dimensional position changes within the boundary range and does not exceed the boundary range for a third preset time period.

[0124] After the three-dimensional position in the XR space of the user's interactive input (i.e., the pointing position of the interactive input) changes to the boundary range of the UI and / or UI component, if the user still wants the pointing position of the interactive input to continue to change toward the boundary direction, based on the interaction habits during the interaction between people and the system and the superposition effect of the jitter generated by the input source position, the pointing position of the interactive input will generally change repeatedly within the boundary range in a short time (for example, repeatedly changes or jitters within the boundary range within 0.5 seconds); therefore, "the three-dimensional position in the XR space pointed by the interactive input changes to the boundary range of the UI and / or UI component, the three-dimensional position changes within the boundary range, and the maintenance time without exceeding the boundary range reaches a third preset time length" can be used as one of the first preset conditions.

[0125] The boundary range and the third preset duration can be defined as needed. For example, in one embodiment of this specification, the range of x centimeters from the boundary of the UI or UI component can be called the boundary range. In some embodiments of this specification, the UI may include a two-dimensional UI and / or a three-dimensional UI; in some embodiments of this specification, the UI component includes a two-dimensional UI component and / or a three-dimensional UI component.

[0126] (5) The user moves to the physical boundary range of the physical space, and the user's position changes within the physical boundary range, and the time within which the position does not exceed the physical boundary range reaches a fourth preset time length. The fourth preset time length can be set as needed.

[0127] When the user realizes interactive input in the XR space by moving in the physical space, in order to avoid physical collision or injury caused by collision between the user and the physical boundary (such as a wall) when the user moves in the physical space, "the user moves to the physical boundary range of the physical space, the user's position changes within the physical boundary range, and the maintenance time within the physical boundary range reaches a fourth preset time length" can be used as a judgment condition for entering the cumulative input mode. The physical boundary range can be set as needed.

[0128] (6) The user moves to the physical boundary of the physical space.

[0129] In some embodiments of the present specification, the position change and / or rotation change of the above-mentioned interactive input conforms to the first feature, and the change characteristics of the position and / or rotation of the interactive input relative to the user's interactive operation habits, for example, may include but are not limited to: the change trajectory of the position and / or rotation of the interactive input relative to the interactive target conforms to the first preset feature.

[0130] In some embodiments of the present specification, the changing trend or direction of the trajectory of the interactive input position change and / or rotation change can be predicted based on an artificial intelligence model (such as a pre-trained deep learning model, etc.); when the changing trend of the trajectory of the interactive input position change and / or rotation change is predicted to be consistent with the preset changing trend feature, it can be considered that the changing trajectory of the position and / or rotation of the interactive input relative to the interactive target meets the first preset feature. Among them, the first preset feature can be set as needed, that is, the preset changing trend can be defined as needed. For example, the trajectory feature that changes back and forth in a certain direction and its opposite direction in the XR space is the first preset feature.

[0131] In some embodiments of the present specification, the first specific operation generated by a human body part includes but is not limited to any one of the following:

[0132] (1) A specific first gesture interaction action; the specific gesture operation allows the user to start the cumulative input mode with high flexibility and precise control; for example, the user can trigger the cumulative input mode through specific gestures such as pinching two fingers or waving the wrist quickly.

[0133] (2) A specific first eye interaction action; for example, a user can trigger the entry into the cumulative input mode by staring at a point for a certain period of time (eye lock).

[0134] (3) A specific first head interaction action; for example, a user can trigger entering the cumulative input mode by shaking his head in a specific direction.

[0135] (4) A specific first shoulder interaction action; for example, a user can trigger entering the cumulative input mode by shrugging once.

[0136] (5) Specific first posture interaction actions; for example, the user can trigger entering the cumulative input mode by leaning back.

[0137] In some embodiments of the present specification, the specific first input device interaction action refers to a specific action input by the user through a specific input device. For example, the user can trigger the cumulative input mode by pressing the left joystick and the right joystick of the handle at the same time.

[0138] In some embodiments of this specification, the second preset condition is used to determine whether the user's interactive input to the XR space in the cumulative input mode will trigger the exit from the cumulative input mode. The XR system can retrieve the data generated by the input source to detect the user's interactive input to the XR space in the cumulative input mode in real time, and determine in real time whether the interactive input meets the second preset condition; when the interactive input does not meet the second preset condition, the detection continues; when the interactive input meets the second preset condition, the exit from the cumulative input mode is triggered. The second preset condition can also be a preset condition defined by the user or set by the system.

[0139] In some embodiments of the present specification, the second preset condition may include, but is not limited to, part or all of the following:

[0140] (1) The position change and / or rotation change of the interactive input meets the second feature; wherein the second feature may include: the change characteristics of the position and / or rotation of the interactive input relative to the interactive target; and / or the change characteristics of the position and / or rotation of the interactive input relative to the user's interactive operation habits.

[0141] (2) The interactive input triggers the UI function; for example, the interactive input triggers the UI component's interface zooming, hidden menu display, and other functions.

[0142] (3) The interactive input method generates a second specific operation; wherein the second specific operation may include: a second specific operation generated by a part of the human body; or a specific second input device interactive action, and the second specific operation and the second input device interactive action can both be set as needed.

[0143] In some embodiments of the present specification, the position change and / or rotation change of the above-mentioned interactive input meets the second feature, that is, the change feature of the position and / or rotation of the interactive input relative to the interactive target, for example, may include but is not limited to part or all of the following:

[0144] (1) The data generated by the input source stops updating for a fifth preset time period.

[0145] (2) The time for which the data generated by the input source stops updating reaches a sixth preset time length, and the angle of the rotation data generated by the input source deviates from the user-related angle reaches a second angle threshold.

[0146] (3) The input speed of the interactive input reaches a second speed threshold.

[0147] (4) The position change and / or rotation change in the accumulated result reaches a corresponding preset threshold value. For example, the displacement in the accumulated result reaches a distance threshold value, and / or the rotation change in the accumulated result reaches an angle threshold value.

[0148] In some embodiments of the present specification, the position change and / or rotation change of the above-mentioned interactive input conforms to the second feature, and the change characteristics of the position and / or rotation of the interactive input relative to the user's interactive operation habits, for example, may include but are not limited to: the change trajectory of the position and / or rotation of the interactive input relative to the interactive target conforms to the second preset feature.

[0149] In some embodiments of the present specification, the second specific operation generated by the human body part may include but is not limited to any one of the following:

[0150] (1) A specific second gesture interaction action; for example, the user can trigger the exit of the cumulative input mode by pinching two fingers together and then separating them.

[0151] (2) Specific second eye interaction actions; for example, the user can stare at a point for a certain period of time (eye lock) to trigger the exit and entry into the cumulative input mode.

[0152] (3) A specific second head interaction action; for example, the user can trigger the exit of the cumulative input mode by shaking his head in a specific direction.

[0153] (4) A specific second shoulder interaction action; for example, a user can exit the cumulative input mode by shrugging once.

[0154] (5) Specific second posture interaction actions; for example, the user can exit the cumulative input mode by bending over.

[0155] In some embodiments of the present specification, a specific second input device interaction action refers to a specific action input by a user through a specific input device (such as a handle, etc.).

[0156] The preset duration, speed threshold, second preset characteristics of the change trend, second specific operation, etc. in the above-mentioned second preset condition can all be set as needed, and since these parameters are similar to the parameters of the above-mentioned first preset condition, please refer to the explanation of the corresponding parameters in the above-mentioned first preset condition for details, and no further details will be given.

[0157] The first preset condition and the second preset condition mentioned above are exemplary examples. In other embodiments of the present specification, the first preset condition and the second preset condition may also be any other suitable preset conditions as needed, and the present specification does not limit this.

[0158] Furthermore, in some embodiments of the present specification, the first preset condition and the second preset condition may correspond to each other, so that it can be easier to implement. For example, when the first preset condition includes a specific first head interaction action (such as the user shaking his head in a specific direction), the second preset condition may include a specific second head interaction action (such as the user shaking his head in another specific direction). In some other embodiments of the present specification, the first preset condition and the second preset condition may also be non-corresponding to meet the needs of the user's interaction preferences, etc.; for example, the first preset condition includes a specific first gesture interaction action (such as the user pinching the index finger and thumb), while the second preset condition does not include a specific second gesture interaction action (that is, the second preset condition does not include a gesture interaction action).

[0159] In some embodiments of the present specification, after entering the cumulative input mode, the trajectory of the user's interactive input position change and / or rotation change in the XR space during the cumulative input mode can be recorded in real time, and it can be determined in real time whether the interactive input in the cumulative input mode meets the second preset condition. It should be noted that in the embodiments of the present specification, real-time recording of the trajectory of the interactive input position change and / or rotation change input in the XR space during the cumulative input mode means: real-time recording of the trajectory of the user's interactive input position change and / or rotation change in the XR space during this cumulative input mode.

[0160] In some embodiments of the present specification, recording the trajectory of the user's interactive input position change and / or rotation change in the XR space during the cumulative input mode may include: recording the position change information and rotation change information corresponding to the interactive input during the cumulative input mode. The position change information corresponding to the interactive input may include: the change of the three-dimensional position information of the input source in the XR space; the rotation change information corresponding to the interactive input may include: the change of the three-dimensional rotation information of the input source in the XR space.

[0161] In some embodiments of the present specification, the accumulation of the trajectory may include: accumulating the displacement of the interaction input corresponding to the direction most similar to the user's interaction intention direction during the accumulation input mode, and accumulating the rotation information of the interaction input corresponding to the direction most similar to the user's interaction intention direction during the accumulation input mode. In other words, the displacement that is inconsistent with the user's interaction intention direction during the accumulation input mode will not be accumulated, and the rotation that is inconsistent with the user's interaction intention direction during the accumulation input mode will not be accumulated; this is conducive to improving the accuracy of the accumulation result.

[0162] In some embodiments of this specification, the user interaction behavior corresponding to the result generated by the cumulative input mode may include: relocation, switching, selection, triggering, loading, and creating. In some embodiments of this specification, some events corresponding to the interaction instructions triggered in the user interaction behavior are exemplarily listed. In other embodiments of this specification, the user interaction behavior corresponding to the result generated by the cumulative input mode may also be other user interaction behaviors as needed.

[0163] In some embodiments of the present specification, when the interaction instruction is an interaction instruction for moving the pointing position of the interaction input, the event corresponding to the triggering of the interaction instruction may include: moving the three-dimensional position pointed to by the interaction input in the XR space from the position before entering the cumulative input mode to the position specified by the interaction instruction.

[0164] For example, in Figure 3a-3c In the exemplary embodiment shown in FIG. 1 , when the user extends his right hand and starts to move right, the three-dimensional position in the XR space pointed by the gesture interaction input (eg, Figure 3aThe white dot shown) will also move to the right synchronously. When the gesture interaction input triggers the first preset condition, the cumulative input mode is triggered; during the cumulative input mode, the system will record in real time the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode (since the user's intended interaction direction in this scenario is to the right, only the displacement in the right direction can be accumulated during accumulation), and determine in real time whether the gesture interaction input meets the second preset condition. During this cumulative input mode, the user can repeatedly move his right hand to the left and right. As long as the gesture interaction input does not meet the second preset condition, the system will continue to record in real time the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode, thereby achieving unlimited movement of the pointing position of the interactive input to the right (i.e., without limiting the range of hand movement). Figure 3a-3c ), thereby extending the operating range.

[0165] In other embodiments of the present specification, when the interaction instruction is an interaction instruction to activate a UI component function, the event corresponding to the triggering of the interaction instruction may include: activating the function of the UI component in the XR space. The functions of the UI component may include, but are not limited to, scaling the UI, opening the UI, closing the UI, displaying hidden menus, etc., which are not limited in the embodiments of the present specification.

[0166] For example, in Figure 4a-4b In the exemplary embodiment shown in the figure, taking the gesture interaction input as an example, when the user extends his right hand and starts to move it upward to the right, the three-dimensional position in the XR space pointed by the gesture interaction input will also move to the right synchronously. In this process, when the gesture interaction input satisfies the first preset condition (for example, the three-dimensional position in the XR space pointed by the gesture interaction input ( Figure 4a ) reaches the boundary range of the UI), the cumulative input mode is triggered; during the cumulative input mode, the system will record in real time the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode (since the user's interaction intention direction in this scenario is to the upper right, only the displacement in the upper right direction can be accumulated during accumulation), and judge in real time whether the gesture interaction input meets the second preset condition. When the gesture interaction input meets the second preset condition (for example, the time when the data generated by the input source stops updating reaches a preset duration), the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode will be stopped from being recorded, the judgment of whether the gesture interaction input meets the second preset condition will be stopped, and the cumulative input mode will be exited; then, based on the accumulation result of this cumulative input mode, the function of the UI component can be activated, that is, an interaction instruction for enlarging the UI can be generated; then, based on the interaction instruction, a UI enlargement event is triggered (for example Figure 4bAfter that, the system may continue to detect whether the user's gesture interaction input in the XR space meets the first preset condition.

[0167] In other embodiments of the present specification, when the interaction instruction is an interaction instruction for switching UI or UI components, the event corresponding to the triggering of the interaction instruction may include: switching the object pointed to by the interaction input in the XR space from the current UI or UI component to another UI or UI component in the XR space.

[0168] Among them, the other UI or UI component may include: a UI or UI component in a direction in the XR space that is most similar to the direction of the user's interaction intention; when there are multiple UIs or UI components in a direction that is most similar to the direction of the user's interaction intention, the other UI or UI component is the one that is closest to the object pointed to by the interaction input.

[0169] For example, in Figure 5a-Figure 5b In the exemplary embodiment shown in the figure, taking the gesture interaction input as an example, when the user extends his right hand and starts to move rightward, when the gesture interaction input satisfies the first preset condition (for example, the three-dimensional position in the XR space pointed to by the gesture interaction input ( Figure 5a ) reaches the boundary range of UI1), the cumulative input mode is triggered; during the cumulative input mode, the system will record in real time the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode (since the user's interaction intention direction in this scenario is to the right, only the displacement in the right direction can be accumulated during accumulation), and judge in real time whether the gesture interaction input meets the second preset condition. When the gesture interaction input meets the second preset condition (for example, the time when the data generated by the input source stops updating reaches a preset duration), the position change information and rotation change information corresponding to the gesture interaction input in the cumulative input mode will be stopped from being recorded, the judgment of whether the gesture interaction input meets the second preset condition will be stopped, and the cumulative input mode will be exited; then, based on the accumulation result of this cumulative input mode, an interaction instruction for switching UI can be generated; then, based on the interaction instruction, the object pointed to by the interaction input in the XR space is switched from UI1 to UI2 (such as Figure 5b shown).

[0170] In other embodiments of the present specification, when the interaction instruction is an interaction instruction for entering an XR scene, the event corresponding to the triggering of the interaction instruction may include: loading the corresponding XR scene from the user's current XR spatial position.

[0171] Among them, the corresponding XR scene may include: an XR scene in a direction in the XR space that is most similar to the direction of the user's interaction intention; when there are multiple XR scenes in a direction that is most similar to the direction of the user's interaction intention, the corresponding XR scene is the one that is closest to the current scene.

[0172] For example, in Figure 6a-Figure 6b In the exemplary embodiment shown, the distance between the XR scenes is greater than the physical distance of the physical space. When the user's body moves to the left in the physical space, when the user's body moves to the left and reaches the physical boundary range of the physical space (such as Figure 6a ), triggers entry into the accumulation mode. During the accumulation input mode, the system will record in real time the position change information and rotation change information corresponding to the user in the accumulation input mode (since the user's interaction intention direction in this scenario is to the left, the displacement of the user's body returning to the right to the center area of ​​the physical space will not be accumulated, while the displacement of the user's body returning to the safe direction in the physical space and then moving to the left again can be accumulated), and judge in real time whether the user's interaction input meets the second preset condition. When the user's interaction input meets the second preset condition (for example, the user has made a specific action), the recording of the position change information and rotation change information corresponding to the user in the accumulation input mode will stop, and the judgment of whether the user's interaction input meets the second preset condition will stop, and the accumulation input mode will be exited; then, based on the accumulation result of this accumulation input mode, an interaction instruction to enter the XR scene can be generated; then, based on the interaction instruction, the following is loaded from the user's current XR space position. Figure 6b XR scene two is shown (i.e. entering XR scene two).

[0173] In other embodiments of the present specification, when the interaction instruction is an interaction instruction for switching the XR scene, the event corresponding to the triggering of the interaction instruction may include: switching the XR space from the current XR scene to another XR scene in the XR space.

[0174] Among them, the other XR scene includes: an XR scene in a direction in the XR space that is most similar to the direction of the user's interaction intention; when there are multiple XR scenes in a direction that is most similar to the direction of the user's interaction intention, the other XR scene is the one that is closest to the current scene.

[0175] For example, in Figure 6c-6d In the exemplary embodiment shown, when the user's body moves to the left in the physical space, when the user reaches the virtual boundary range of the XR scene in which the user is located (such as Figure 6cAs shown), the accumulation mode is triggered; during the accumulation input mode, the system will record in real time the position change information and rotation change information corresponding to the interactive input in the accumulation input mode, and judge in real time whether the body interaction input meets the second preset condition. When the body interaction input meets the second preset condition (for example, the dwell time after the body interaction input stops reaches the preset duration), the recording of the position change information and rotation change information corresponding to the body interaction input in the accumulation input mode will stop, and the judgment of whether the body interaction input meets the second preset condition will stop, and the accumulation input mode will be exited; then, based on the accumulation result of this accumulation input mode, an interaction instruction for switching the XR scene can be generated; then, based on the interaction instruction, the XR space is switched from the current XR scene one to XR scene two (as shown in the figure). Figure 6d shown).

[0176] In the embodiments of the specification, the above-mentioned XR scene may be a two-dimensional application scene and / or a three-dimensional application scene predefined by the system or the user.

[0177] Corresponding to the above-mentioned interactive input data processing, the embodiment of this specification also provides an interactive input data processing device, which can be configured on the above-mentioned XR system, referring to Figure 7 As shown, in some embodiments of this specification, the interactive input data processing device may include:

[0178] A detection module 71, used to detect the user's interactive input in the XR space;

[0179] An entry module 72, configured to enter an accumulation input mode when the interactive input satisfies a first preset condition;

[0180] An accumulation module 73, configured to record a trajectory of a position change and / or a rotation change of an interactive input of the user in the XR space during the accumulation input mode, and accumulate the trajectory to obtain an accumulation result;

[0181] A stopping module 74, configured to stop recording the user's interactive input in the XR space during the cumulative input mode when the interactive input in the cumulative input mode meets a second preset condition;

[0182] A generating module 75, used to generate an interactive instruction corresponding to the accumulated result;

[0183] A trigger module 76, used to trigger an event corresponding to the interaction instruction;

[0184] The exit module 77 is used to exit the accumulation input mode.

[0185] Although the process flows described above include multiple operations that occur in a particular order, it should be clearly understood that the processes may include more or fewer operations, which may be performed sequentially or in parallel (eg, using parallel processors or a multi-threaded environment).

[0186] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0187] It should be noted that in the embodiments of this specification, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user and fully authorized by all parties, that is, the acquisition, transmission, storage, use, and processing of data in the technical solution of this application comply with the relevant provisions of national laws and regulations.

[0188] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0189] The embodiments of this specification also provide a computer device. Figure 8As shown, in some embodiments of the present specification, the computer device 802 may include one or more processors 804, such as one or more central processing units (CPUs) or graphics processing units (GPUs), and each processing unit may implement one or more hardware threads. The computer device 802 may also include any memory 806, which is used to store any kind of information such as code, settings, data, etc. In a specific embodiment, the computer program on the memory 806 and can be run on the processor 804, when the computer program is run by the processor 804, can execute the instructions for interactive input data processing described in any of the above embodiments. Non-limiting, for example, the memory 806 may include any one or more combinations of the following: any type of RAM, any type of ROM, flash memory device, hard disk, optical disk, etc. More generally, any memory can use any technology to store information. Further, any memory can provide volatile or non-volatile retention of information. Further, any memory can represent a fixed or removable component of the computer device 802. In one case, when the processor 804 executes an associated instruction stored in any memory or a combination of memories, the computer device 802 can perform any operation of the associated instruction. The computer device 802 also includes one or more drive mechanisms 808 for interacting with any storage, such as a hard disk drive mechanism, an optical disk drive mechanism, etc.

[0190] The computer device 802 may also include an input / output interface 810 (I / O) for receiving various inputs (via input devices 812) and for providing various outputs (via output devices 814). A specific output mechanism may include a presentation device 816 and an associated graphical user interface 818 (GUI). In other embodiments, the input / output interface 810 (I / O), input device 812, and output device 814 may not be included, and the computer device 802 may be used as a computer device in a network. The computer device 802 may also include one or more network interfaces 820 for exchanging data with other devices via one or more communication links 822. One or more communication buses 824 couple the components described above together.

[0191] The communication link 822 may be implemented in any manner, for example, through a local area network, a wide area network (e.g., the Internet), a point-to-point connection, etc., or any combination thereof. The communication link 822 may include any combination of hardwired links, wireless links, routers, gateway functions, name servers, etc. governed by any protocol or combination of protocols.

[0192] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), computer-readable storage media, and computer program products of some embodiments of the present specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processor to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processor generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0193] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processor to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0194] These computer program instructions can also be loaded onto a computer or other programmable data processor so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0195] In a typical configuration, a computer device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0196] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0197] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computer device. As defined in this specification, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0198] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, the embodiments of this specification may take the form of complete hardware embodiments, complete software embodiments or embodiments combining software and hardware. Moreover, the embodiments of this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0199] The present specification embodiments may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present specification embodiments may also be practiced in distributed computing environments where tasks are performed by remote processors connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0200] It should also be understood that in the embodiments of this specification, the term "and / or" is only a description of the association relationship of the associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0201] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0202] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the embodiments of this specification. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0203] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. An interactive input data processing method, characterized in that: include: Detect user interaction input; When the interactive input meets the first preset condition, entering the cumulative input mode; Recording a trajectory of a user's interactive input position change and / or rotation change during the accumulation input mode, and accumulating the trajectory to obtain an accumulation result; When the interactive input in the cumulative input mode meets a second preset condition, stop recording the interactive input of the user during the cumulative input mode; Generate an interactive instruction corresponding to the accumulated result; Triggering an event corresponding to the interaction instruction; Exit the accumulation input mode.

2. The interactive input data processing method according to claim 1, characterized in that: The first preset condition includes: The position change and / or rotation change of the interactive input meets the first feature; and / or, The interactive input mode generates a first specific operation.

3. The interactive input data processing method according to claim 2, characterized in that: The first feature includes: a change in the position and / or rotation of the interactive input relative to the interactive target; and / or, The change in the position and / or rotation of the interactive input is relative to the change characteristics of the user's interactive operation habits.

4. The interactive input data processing method according to claim 2, characterized in that: The first specific operation includes: a first specific operation caused by a human body part; or, The specified first input device interaction action.

5. The interactive input data processing method according to claim 1, characterized in that: The second preset condition includes any one or more of the following: The position change and / or rotation change of the interactive input meets the second feature; Interactive input triggers the UI’s functionality; The interactive input mode generates a second specific operation.

6. The interactive input data processing method according to claim 5, characterized in that: The second feature includes: a change in the position and / or rotation of the interactive input relative to the interactive target; and / or, The change in the position and / or rotation of the interactive input is relative to the change characteristics of the user's interactive operation habits.

7. The interactive input data processing method according to claim 5, characterized in that: The second specific operation includes: a second specific operation produced by a human body part; or, A specific second input device interaction action.

8. The interactive input data processing method according to claim 1, characterized in that: The recording of the trajectory of the user's interactive input position change and / or rotation change during the cumulative input mode includes: The position change information and the rotation change information corresponding to the interactive input during the cumulative input mode are recorded.

9. The interactive input data processing method according to claim 1, characterized in that: The accumulating the trajectory includes: The displacements of the interaction inputs in the direction most similar to the user's interaction intention direction during the accumulation input mode are accumulated, and the rotation information of the interaction inputs in the direction most similar to the user's interaction intention direction during the accumulation input mode is accumulated.

10. The interactive input data processing method according to claim 1, characterized in that: When the interaction instruction is an interaction instruction for moving the pointing position of the interaction input, the event corresponding to the triggering of the interaction instruction includes: The three-dimensional position pointed to by the interactive input in the XR space is moved from the position before entering the cumulative input mode to the position specified by the interactive instruction.

11. The interactive input data processing method according to claim 1, characterized in that: When the interaction instruction is an interaction instruction for activating a UI component function, the event corresponding to the triggering interaction instruction includes: Activates the functionality of UI components in XR space.

12. The interactive input data processing method according to claim 1, characterized in that: When the interaction instruction is an interaction instruction for switching UI or UI components, the event corresponding to the triggering interaction instruction includes: Switch the object pointed to by the interactive input in the XR space from the current UI or UI component to another UI or UI component in the XR space.

13. The interactive input data processing method according to claim 12, characterized in that: The other UI or UI component comprises: The UI or UI component in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple UIs or UI components in the direction most similar to the user's interaction intention direction, the other UI or UI component is the one that is closest to the object pointed to by the interaction input.

14. The interactive input data processing method according to claim 1, characterized in that: When the interaction instruction is an interaction instruction for entering an XR scene, the event corresponding to the triggering interaction instruction includes: Load the corresponding XR scene from the user's current XR space position.

15. The interactive input data processing method according to claim 1, characterized in that: The corresponding XR scenarios include: The XR scene in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple XR scenes in the direction most similar to the user's interaction intention direction, the corresponding XR scene is the XR scene that is closest to the current scene.

16. The interactive input data processing method according to claim 1, characterized in that: When the interaction instruction is an interaction instruction for switching the XR scene, the event corresponding to the triggering of the interaction instruction includes: Switch the XR space from the current XR scene to another XR scene in the XR space.

17. The interactive input data processing method according to claim 16, characterized in that: The other XR scenario includes: The XR scene in the direction most similar to the user's interaction intention direction in the XR space; when there are multiple XR scenes in the direction most similar to the user's interaction intention direction, the other XR scene is the XR scene that is closest to the current scene.

18. The interactive input data processing method according to any one of claims 5, 12-13, characterized in that: The UI includes a two-dimensional UI and / or a three-dimensional UI.

19. The interactive input data processing method according to any one of claims 11 to 13, characterized in that: The UI components include two-dimensional UI components and / or three-dimensional UI components.

20. An interactive input data processing device, characterized in that: include: A detection module, used to detect user interaction input; An entry module, configured to enter an accumulation input mode when the interactive input satisfies a first preset condition; An accumulation module, used to record the trajectory of the user's interactive input position change and / or rotation change during the accumulation input mode, and accumulate the trajectory to obtain an accumulation result; A stopping module, configured to stop recording the user's interactive input during the cumulative input mode when the interactive input in the cumulative input mode meets a second preset condition; A generating module, used for generating an interactive instruction corresponding to the accumulated result; A trigger module, used to trigger an event corresponding to the interaction instruction; An exit module is used to exit the accumulation input mode.

21. A computer device comprising a memory, a processor, and a computer program stored in the memory, characterized in that: When the computer program is executed by the processor, the computer program executes the instructions of the method according to any one of claims 1 to 19.

22. A computer storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor of a computer device, the computer program executes instructions of the method according to any one of claims 1 to 19.

23. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor of a computer device, the computer program executes instructions of the method according to any one of claims 1 to 19.

Images