A virtual reality interaction system based on spatial perception
Through the interactive state capture and adjustment module based on spatial perception, the problem of limited interaction methods in virtual reality is solved, and a more efficient user interaction experience is achieved.
Patent Information
- Application Number
- CN202211488334.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-22
- Publication Date
- 2025-07-22
- Estimated Expiration
- 2042-11-22
AI Technical Summary
The limited user interaction methods in existing virtual reality technology lead to poor experience.
The interactive state capture module based on space perception locks the interactive objects in the virtual reality scene, and combines the interactive surface adjustment module and the action interaction module to realize interactive functions in different states, including interface interaction and pose interaction.
Improve the effectiveness and user experience of virtual reality interaction.
Smart Images

Figure CN115826747B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of virtual reality interaction, and particularly relates to a virtual reality interaction system based on spatial perception. Background Art
[0002] Virtual Reality (VR) technology is a new and digital human-machine interface technology. In VR technology, an optical structure, a display system, a virtual reality engine, etc. can jointly provide a user with a virtual reality scene mainly based on visual perception, including comprehensive perceptions such as hearing and touch. Moreover, the user can not only perceive the virtual reality scene through multiple sensory channels such as vision, hearing, touch, and acceleration, but also interact with the virtual reality scene through ways such as a handle, a remote control, voice, movements, expressions, gestures, and line of sight, thereby generating an immersive experience.
[0003] When the user is in a virtual reality scene, a three-dimensional scene will be shown to the user. However, during the display process, there are only a limited number of buttons for the user to select to achieve interaction in the virtual reality scene, greatly reducing the user experience effect.
[0004] Therefore, the present invention proposes a virtual reality interaction system based on spatial perception. Summary of the Invention
[0005] The present invention provides a virtual reality interaction system based on spatial perception, which is used to achieve interaction functions in a virtual reality scene in different states by locking an object and capturing the interaction state of the object, ensuring the effectiveness of the interaction, and further improving the user experience effect.
[0006] The present invention provides a virtual reality interaction system based on spatial perception, including:
[0007] An interaction state capture module, configured to lock a first interaction object in a virtual reality scene, capture and analyze the interaction state of the first interaction object;
[0008] An interaction surface adjustment module, configured to, when the interaction state is interface interaction, perform interaction adjustment of direction and distance on the interaction surface according to the first position relationship between the interface to be interacted and the virtual reality environment and in accordance with the object interaction intention;
[0009] An action interaction module, configured to, when the interaction state is gesture interaction, obtain the virtual action of the first interaction object and perform action dissection and separation, determine an interaction trigger point, and execute corresponding interaction functions according to the second position relationship between the interaction trigger point and the virtual reality environment and in combination with the gesture trajectory of the interaction trigger point.
[0010] Preferably, the interaction state capture module includes:
[0011] A scene construction unit for constructing a virtual reality scene based on a selected preset scene model and scene devices matching the preset scene model;
[0012] A scene scanning unit for globally scanning the virtual reality scene to lock the first interaction object;
[0013] A log capture unit for capturing the execution log of the first interaction object in the virtual reality scene from a virtual reality record database;
[0014] A log analysis unit for analyzing the execution log to obtain the execution input instruction of the first interaction object based on an operation device, and obtaining the interaction state of the first interaction object.
[0015] Preferably, the interaction surface adjustment module includes:
[0016] A range determination unit for capturing the interaction focus point of the first interaction object, determining the focus type of the interaction focus point, and at the same time, determining the first interaction surface at the current position of the first interaction object in the virtual reality environment, the adjustable direction range of the first interaction surface based on the virtual reality environment, and the adjustable length range of each adjustable direction;
[0017] An information acquisition unit for obtaining the first interaction information between the first interaction object and the first virtual interaction object when the focus type is related to the first virtual interaction object corresponding to a third-party actual person in the virtual reality environment;
[0018] An information parsing unit for parsing the first interaction information and determining the first interaction intention of the first interaction object and the second interaction intention of the first virtual interaction object;
[0019] A first determination unit for making a first determination on the current adjustment direction of the adjustable direction of the first interaction surface and the current adjustment length of the adjustable length based on the first interaction intention;
[0020] A second determination unit for making a second determination on the current adjustment direction and the current adjustment length of the second interaction surface of the first virtual interaction object according to the second interaction intention;
[0021] A first interaction adjustment unit for determining the interaction duration between the first interaction surface and the second interaction surface according to the first interaction intention and the second interaction intention, and combining the first determination result and the second determination result to determine an adjustment process to implement the interaction adjustment between the first interaction surface and the second interaction surface.
[0022] Preferably, the interaction surface adjustment module further includes:
[0023] A process generation unit, configured to obtain an interaction array according to a third interaction intention of the first interaction object when the focus type is related to a second virtual interaction object of the virtual reality environment itself, and generate an interaction surface adjustment process based on the interaction array;
[0024] A second interaction adjustment unit, configured to perform interaction adjustment on the first interaction surface according to the generation result.
[0025] Preferably, the first determination unit includes:
[0026] A first building block, configured to construct a position relationship function R1(Y1, r02, r03, r04) between a first position of a first interaction object and a position of a first interaction surface, where Y1 represents the first position, r02 represents a first center bias, r03 represents a first display width, and r04 represents a first display height;
[0027] A second building block, configured to construct an intention function R(r11, r12, r13) according to the first interaction intention, where r11 represents a bias factor after interaction determined based on the first interaction intention; r12 represents a width factor after interaction determined based on the first interaction intention; r13 represents a height factor after interaction determined based on the first interaction intention;
[0028] A third building block, configured to construct a function to be compared R2(Y1, x1, x2, x3) according to the position relationship function R1 and the intention function R, where x1 represents a height to be adjusted; x2 represents a width to be adjusted; x3 represents a bias to be adjusted;
[0029] x1 = r04 r13 + a1
[0030] x2 = r03 r12 + a2
[0031] x3 = r02 r11 + a3
[0032] A comparison block, configured to compare the function to be compared R2 with a standard function R3(f01, f02), where f01 represents an adjustable direction range, and f02 represents an adjustable length range for each adjustable direction; a1, a2, and a3 represent constants related to the corresponding factors;
[0033] A fourth building block, configured to construct a new function R4(Y1, x01, x02, x03) according to the comparison result, where x01 represents a height to be adjusted; x22 represents a width after current adjustment; x03 represents a bias after current adjustment;
[0034] A result determination block for obtaining a first determination result based on the new function R4.
[0035] Preferably, the first interaction adjustment unit includes:
[0036] A time period extraction unit for extracting a first interaction time period in the first interaction intention and a second interaction time period in the second interaction intention, and obtaining an intersection time period;
[0037] A duration analysis unit for analyzing a first duration of the left time period and a second duration of the left time period in the non-intersection time period;
[0038] A duration adjustment unit for adjusting the intersection time period based on the first duration and the second duration to obtain an interaction duration;
[0039] An array determination unit for determining a first distance array in the first determination result and determining a second distance array in the second determination result;
[0040] Meanwhile, extracting the same elements in the first determination result and the second determination result to obtain a third distance array;
[0041] A judgment unit for analyzing whether there is an overlapping position where the first interaction surface and the second interaction surface are interspersed during the interaction adjustment according to the first distance array, the second distance data, and the third distance data;
[0042] If it exists, determining the overlapping position based on the overlapping trajectory of the virtual reality scene;
[0043] A trajectory analysis unit for, when the overlapping trajectory is a straight line, obtaining the center point of the overlapping trajectory, and controlling the first interaction surface and the second interaction surface to shrink the surface at the center point, and expand the surface after passing through the center point, and taking it as the first interaction method;
[0044] When the overlapping trajectory is not a straight line, locking multiple specific curve points, and spatially cutting the first interaction surface and the second interaction surface according to adjacent specific curve points, and shrinking the cutting surface at the center point of the adjacent specific curve points, and expanding and splicing after passing through, and taking it as the second interaction method;
[0045] If it does not exist, performing parallel transmission of the first interaction surface and the second interaction surface in a specified direction and a specified position, and taking it as the third interaction method;
[0046] A duration optimization unit for optimizing the interaction duration based on the last interaction method, and controlling the first interaction surface and the second interaction surface to perform an interaction with the corresponding interaction duration.
[0047] Preferably, the optimized interaction duration includes the initial interaction duration and the increased duration caused by different interaction methods.
[0048] Preferably, the action interaction module includes:
[0049] A point acquisition unit, configured to, when in the action posture state, determine the interaction orientation of the first interaction object, the continuous orientation points and the separate orientation points in the interaction orientation through the action dissection and separation result of the virtual object, and at the same time, acquire the time sensing points of the interaction orientation;
[0050] A behavior setting unit, configured to input the time sensing points, the continuous orientation points and the separate orientation points into a behavior analysis model and output a self-logical behavior;
[0051] A line extraction unit, configured to perform global line extraction and local line extraction on the self-logical behavior;
[0052] A vector line acquisition unit, configured to acquire a first line vector line within the interaction range and a second line vector line outside the interaction range according to the extraction result;
[0053] A representable unit, configured to determine the representable interaction behavior of the first line vector line according to the line ratio of the first line vector line and the second line vector line, and obtain a number of interaction trigger points;
[0054] According to the posture trajectory of the interaction trigger points, retrieve the interaction operation method from the trajectory-function database and execute the corresponding interaction function.
[0055] Other features and advantages of the present invention will be described in the subsequent specification, and, in part, will be obvious from the specification, or will be understood by implementing the present invention. The objectives and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in the written specification, claims, and drawings.
[0056] The technical solutions of the present invention will be further described in detail below through the accompanying drawings and embodiments. Description of the Drawings
[0057] The drawings are used to provide further understanding of the present invention, and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention. In the drawings:
[0058] Figure 1 is a structural diagram of a virtual reality interaction system based on spatial perception in an embodiment of the present invention;
[0059] Figure 2 is a structural diagram of a vector line in an embodiment of the present invention. Specific Embodiments
[0060] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not intended to limit the present invention.
[0061] The present invention provides a virtual reality interaction system based on spatial perception, as Figure 1 shown, including:
[0062] An interaction state capture module, configured to lock a first interaction object in a virtual reality scene, capture and analyze the interaction state of the first interaction object;
[0063] An interaction surface adjustment module, configured to, when the interaction state is an interface interaction, perform interaction adjustments on the direction and distance of the interaction surface according to the first positional relationship between the interface to be interacted with and the virtual reality environment, and in accordance with the object interaction intention;
[0064] An action interaction module, configured to, when the interaction state is a gesture interaction, obtain the virtual action of the first interaction object and perform action dissection and separation, determine the interaction trigger point, and execute corresponding interaction functions according to the second positional relationship between the interaction trigger point and the virtual reality environment, and in combination with the gesture trajectory of the interaction trigger point.
[0065] In this embodiment, the virtual reality scene is a 3D scene, and the display of different scenes is realized according to the pre-set information scenes.
[0066] In this embodiment, the first interaction object refers to a user who enters the virtual reality scene by wearing a virtual reality device.
[0067] In this embodiment, the interaction state includes two states: interaction with the interface and gesture-based interaction. The former is to satisfy the visual interaction experience, and the latter is to satisfy the interaction experience of feedback behavior gestures.
[0068] In this embodiment, the interface to be interacted with refers to the interface with which the first interaction object and the other interacting user interact. In the virtual reality scene, the interface to be interacted with is a two-dimensional picture.
[0069] In this embodiment, the first positional relationship refers to the current position coordinates of the interface to be interacted with in the virtual reality environment, and the object interaction intention refers to the operation that the first interaction object wants to perform on the interface to be interacted with. For example, swapping positions with other interaction interfaces, or transmitting the interface to be interacted with to other positions for display.
[0070] In this embodiment, the interaction surface refers to the interaction interface involved in the object interaction intention, and definitely includes the interface to be interacted with.
[0071] In this embodiment, the action interaction gesture refers to determining the interaction instruction of the object itself by capturing the action gesture of the object itself. Before determining the interaction instruction, it is necessary to anatomically separate the virtual action (the captured action gesture) of the first interaction object to determine the trigger point, which mainly refers to the point where interaction can be performed based on the action.
[0072] In this embodiment, the second positional relationship refers to the position coordinates of the trigger point corresponding to the trigger action in the virtual reality environment.
[0073] In this embodiment, the gesture trajectory of the trigger point refers to the interaction process instruction, and then the interaction function is executed.
[0074] In this embodiment, during the process of capturing the interaction state, information collection is obtained based on different laser devices and various types of sensors (position, inertia, etc.).
[0075] The beneficial effects of the above technical solution are: by locking the object and capturing the interaction state of the object, the interaction function in the real virtual scene in different states is realized, the effectiveness of the interaction is guaranteed, and the user experience effect is further improved.
[0076] The present invention provides a virtual reality interaction system based on spatial perception. The interaction state capture module includes:
[0077] A scene construction unit for constructing a virtual reality scene based on a selected preset scene model and scene devices matching the preset scene model;
[0078] A scene scanning unit for globally scanning the virtual reality scene to lock the first interaction object;
[0079] A log capture unit for capturing the execution log of the first interaction object in the virtual reality scene from the virtual reality record database;
[0080] A log analysis unit for analyzing the execution log to obtain the execution input instruction of the first interaction object based on the operation device and obtaining the interaction state of the first interaction object.
[0081] In this embodiment, the preset scene models are all pre-constructed three-dimensional scenes, and different construction devices are used for the construction of different three-dimensional scenes. Therefore, a virtual reality scene can be constructed.
[0082] In this embodiment, the virtual reality scene is a virtual 3D scene built, so the scene can be scanned in all directions (global scanning), and the interaction object can be effectively locked. During this process, a human contour will be constructed according to the scanning results, and then the interaction object will be effectively locked.
[0083] In this embodiment, the virtual reality record database includes interaction information generated under different interaction scenes and different interaction instructions, mainly to facilitate the subsequent retrieval of the execution logs of the object, and the execution logs are also interaction operations, interaction instructions, etc.
[0084] In this embodiment, an input instruction is executed, such as interface interaction input or gesture interaction. Among them, the operating device can be a vr helmet, a vr handle, etc., which are devices that can receive input instructions.
[0085] The beneficial effects of the above technical solution are: By building a virtual reality scene and retrieving the execution logs of the object, it is convenient to effectively determine the interaction state, providing a basis for subsequent effective interaction in the virtual reality scene.
[0086] The present invention provides a virtual reality interaction system based on spatial perception. The interaction surface adjustment module includes:
[0087] A range determination unit for capturing the interaction focus point of the first interaction object, determining the focus type of the interaction focus point, and at the same time, determining the first interaction surface of the current position of the first interaction object in the virtual reality environment, the adjustable direction range of the first interaction surface based on the virtual reality environment, and the adjustable length range of each adjustable direction;
[0088] An information acquisition unit for, when the focus type is related to a first virtual interaction object corresponding to a third-party actual person in the virtual reality environment, acquiring the first interaction information between the first interaction object and the first virtual interaction object;
[0089] An information analysis unit for analyzing the first interaction information and determining the first interaction intention of the first interaction object and the second interaction intention of the first virtual interaction object;
[0090] A first determination unit for making a first determination on the current adjustment direction of the adjustable direction of the first interaction surface and the current adjustment length of the adjustable length based on the first interaction intention;
[0091] A second determination unit for making a second determination on the current adjustment direction and the current adjustment length of the second interaction surface of the first virtual interaction object according to the second interaction intention;
[0092] The first interaction adjustment unit is configured to determine the interaction duration between the first interaction surface and the second interaction surface according to the first interaction intention and the second interaction intention, and determine an adjustment process in combination with the first determination result and the second determination result, so as to realize the interaction adjustment between the first interaction surface and the second interaction surface.
[0093] In this embodiment, the interaction focus refers to the interaction object that the user focuses on, that is, whether the user focuses on the interaction with the virtual human set in the virtual reality scene itself or focuses on the interaction with the real interaction object in the same virtual reality scene. The focus point refers to the interaction focus situation corresponding to the interaction object.
[0094] In this embodiment, the focus type refers to different interaction objects.
[0095] In this embodiment, the first interaction surface refers to the current interaction surface of the first interaction object, and the current interaction surface can exist alone or in parallel.
[0096] In this embodiment, the adjustable direction range and the adjustable length range are both preset. For example, if the virtual length corresponding to the virtual reality scene is 1m and the corresponding virtual direction is 360 degrees, then the adjustable direction range is [0°, 360°], and the adjustable length range is [0, 1m].
[0097] In this embodiment, the first interaction information refers to the interaction intention between the two. For example, the first intention of the first interaction object is to swap the positions of the first interaction surface and the second interaction surface, and the second intention is to swap the positions of the second interaction surface and the first interaction surface.
[0098] In this embodiment, the adjustable direction, the adjustable length, and the adjustment duration are all determined according to the intention.
[0099] For example, the first intention and the second intention are to swap the positions of the first interaction surface and the second interaction surface, the swapping duration during the swapping process of the first interaction surface and the second interaction surface is 1s, the display duration of the second interaction surface on the first interaction surface is 2s, and the display duration of the first interaction surface on the second interaction surface is 3s.
[0100] In this embodiment, the adjustment process is position swapping (1s) - display after the interaction surface swapping (2s, 3s).
[0101] The beneficial effects of the above technical solution are: By determining the interaction intention between different objects, it is convenient to reasonably determine the interaction direction, interaction distance, and interaction duration between the first interaction surface and the second interaction surface, which is convenient to realize the effective interaction of the interface and improve the user experience effect.
[0102] The present invention provides a virtual reality interaction system based on spatial perception. The interaction surface adjustment module further includes:
[0103] A process generation unit, configured to obtain an interaction array according to a third interaction intention of the first interaction object when the focus type is related to a second virtual interaction object of the virtual reality environment itself, and generate an interaction surface adjustment process based on the interaction array;
[0104] A second interaction adjustment unit, configured to perform interaction adjustment on the first interaction surface according to the generation result.
[0105] In this embodiment, the second virtual interaction object refers to the virtual human set by the virtual reality environment itself.
[0106] In this embodiment, the third interaction intention refers to the interface interaction situation with the second virtual interaction object, and the interaction array also includes an interaction direction, an interaction distance, and an interaction duration.
[0107] The beneficial effect of the above technical solution is that by obtaining the interaction intention to construct an interaction array, the adjustment of the interaction surface is realized, and the experience effect is improved.
[0108] The present invention provides a virtual reality interaction system based on spatial perception. The first determination unit includes:
[0109] A first construction block, configured to construct a position relationship function R1(Y1, r02, r03, r04) between the first position of the first interaction object and the position of the first interaction surface, where Y1 represents the first position, r02 represents the first center deviation, r03 represents the first display width, and r04 represents the first display height;
[0110] A second construction block, configured to construct an intention function R(r11, r12, r13) according to the first interaction intention, where r11 represents a deviation factor after interaction determined based on the first interaction intention; r12 represents a width factor after interaction determined based on the first interaction intention; r13 represents a height factor after interaction determined based on the first interaction intention;
[0111] A third construction block, configured to construct a function to be compared R2(Y1, x1, x2, x3) according to the position relationship function R1 and the intention function R, where x1 represents the height to be adjusted; x2 represents the width to be adjusted; x3 represents the deviation to be adjusted;
[0112] x1 = r04 r13 + a1
[0113] x2 = r03 r12 + a2
[0114] x3 = r02r11 +a3
[0115] A comparison block for comparing the function R2 to be compared with the standard function R3(f01, f02), where f01 represents the adjustable direction range and f02 represents the adjustable length range for each adjustable direction; a1, a2, and a3 represent constants related to the corresponding factors.
[0116] A fourth construction block for constructing a new function R4(Y1, x01, x02, x03) based on the comparison result, where x01 represents the height to be adjusted; x22 represents the width after the current adjustment; x03 represents the bias after the current adjustment.
[0117] A result determination block for obtaining a first determination result based on the new function R4.
[0118] In this embodiment, the first position is a three-dimensional coordinate, and the first i-performance bias refers to the center point coordinates of the first interaction surface.
[0119] In this embodiment, the first interaction intention is obtained by including how to adjust the corresponding interaction surface. Therefore, different factors existing in this interaction intention are obtained, and then the function to be compared is constructed.
[0120] In this embodiment, the purpose of constructing the new function is that since the virtual reality scene is limited by length, width, and angle ranges, the existence of the standard function R3 is to further limit R2 so that while satisfying the interaction intention as much as possible, it can also meet the reasonable display in the virtual reality scene.
[0121] In this embodiment, a1, a2, and a3 represent constants, and the value range is [0, 0.1].
[0122] The beneficial effect of the above technical solution is that by constructing a position relationship function, adjusting based on the intention function, obtaining the function to be compared, and comparing it with the standard function, a new function can be effectively obtained to meet the interaction intention and can also be reasonably displayed in the virtual reality scene.
[0123] The present invention provides a virtual reality interaction system based on spatial perception. The first interaction adjustment unit includes:
[0124] A time period extraction unit for extracting the first interaction time period in the first interaction intention and the second interaction time period in the second interaction intention, and obtaining an intersection time period.
[0125] A duration analysis unit for analyzing the first duration of the left time period and the second duration of the left time period in the non-intersection time period.
[0126] A duration adjustment unit for adjusting the intersection time period based on the first duration and the second duration to obtain an interaction duration;
[0127] An array determination unit for determining a first distance array in the first determination result and determining a second distance array in the second determination result;
[0128] Meanwhile, extracting the same elements in the first determination result and the second determination result to obtain a third distance array;
[0129] A judgment unit for analyzing whether there is an overlapping position of interpenetration between the first interaction surface and the second interaction surface during the interaction adjustment according to the first distance array, the second distance data, and the third distance data;
[0130] If there is, determining the overlapping track of the overlapping position based on the virtual reality scene;
[0131] A track analysis unit for, when the overlapping track is a straight line, obtaining the center point of the overlapping track and controlling the first interaction surface and the second interaction surface to shrink the surface at the center point, and expanding the surface after passing through the center point, and taking it as the first interaction method;
[0132] When the overlapping track is not a straight line, locking a plurality of specific curve points, and spatially cutting the first interaction surface and the second interaction surface according to adjacent specific curve points, and shrinking the cutting surface at the center point of the adjacent specific curve points, and expanding and splicing after passing through, and taking it as the second interaction method;
[0133] If not, performing parallel transmission of the first interaction surface and the second interaction surface in a specified direction and at a specified position, and taking it as the third interaction method;
[0134] A duration optimization unit for optimizing the interaction duration based on the last interaction method, and controlling the first interaction surface and the second interaction surface to perform interactions with corresponding interaction durations.
[0135] Preferably, the optimized interaction duration includes the initial interaction duration and the increased duration caused by adopting different interaction methods.
[0136] In this embodiment, the first interaction time period is [b1, b3], the second interaction time period is [b2, b4], b1 < b2 < b3 < b4. At this time, the intersection time period is [b2, b3], the left time period is [b1, b2], and the right time period is [b3, b4].
[0137] In this embodiment, the calculation formula of the interaction duration is as follows:
[0138]
[0139]
[0140] Among them, b20 represents the adjusted left boundary time; b30 represents the adjusted right boundary time.
[0141] In this embodiment, the distance array is [position before adjustment, position after adjustment, direction before adjustment, direction after adjustment].
[0142] In this embodiment, the extraction of the same elements refers to the extraction of the same type of position and the extraction of the same type of direction.
[0143] If there is an overlap during the position movement in the adjustment process between the first interaction surface and the second interaction surface, it is regarded as having an interpenetrating overlap position. If they do not interfere with each other, it is regarded as not having an interpenetrating overlap position. That is, since the interaction surface 1 and the interaction surface 2 may be in a parallel state during the adjustment process, there will be no intersection in terms of position between them. When there is an intersection in terms of position, it is regarded as having an interpenetrating overlap position.
[0144] In this embodiment, when the overlapping trajectory is a straight line, that is, the position overlap of the two interaction surfaces during the adjustment process is a straight line. At this time, adjustment is carried out in the manner mentioned, and the center point refers to the center point on the straight line corresponding to the overlapping trajectory.
[0145] In this embodiment, the specific curve point refers to the inflection point existing on the curve, and the space cutting refers to the parallel cutting of the space according to the inflection point to achieve space cutting. And the center point of the curve point refers to the midpoint of the curve between two adjacent inflection points.
[0146] In this embodiment, the specified direction and the specified position are preset. For example, the two interaction surfaces are replaced with equal positions and parallel directions.
[0147] In this embodiment, optimizing the interaction duration means:
[0148]
[0149] Among them, biao represents the corresponding standard optimization factor; dang represents the optimization factor corresponding to the last interaction method, and biao > 2dang; T represents the optimized duration. Among them, the value of biao is generally 2.
[0150] The beneficial effects of the above technical solutions are: By performing the intersection processing of time periods and adjusting the time periods left and right, at the same time, combining different distance arrays to judge whether there is an interpenetrating overlap position, so as to obtain different interaction methods and further adjust the interaction duration, further effectively meeting the user experience effect.
[0151] The present invention provides a virtual reality interaction system based on spatial perception. The action interaction module includes:
[0152] A point acquisition unit, which is used to determine the interaction orientation of the first interaction object, the continuous guiding points and the separate guiding points in the interaction orientation, and at the same time, acquire the time sensing points of the interaction orientation through the action dissection and separation results of the virtual object when in the action posture state;
[0153] A behavior setting unit, which is used to input the time sensing points, the continuous guiding points and the separate guiding points into a behavior analysis model and output a self-logical behavior;
[0154] A line extraction unit, which is used to perform global line extraction and local line extraction on the self-logical behavior;
[0155] A vector line acquisition unit, which is used to obtain a first line vector line within the interaction range and a second line vector line outside the interaction range according to the extraction results;
[0156] A representable unit, which is used to determine the representable interaction behavior of the first line vector line according to the line ratio of the first line vector line and the second line vector line, and obtain a number of interaction trigger points;
[0157] According to the posture trajectory of the interaction trigger points, retrieve the interaction operation method from the trajectory-function database and execute the corresponding interaction function.
[0158] In this embodiment, as Figure 2 shown, 1 represents the first line vector line within the interaction range, 2 represents the second line vector line outside the interaction range, and the setting of the line ratio refers to the vector line that can be effectively referenced.
[0159] In this embodiment, the interaction trigger point refers to the interaction point locked from the representable interaction behavior, and the interaction point refers to the point that can trigger function interaction.
[0160] In this embodiment, the acquisition of the representable behavior is as follows:
[0161]
[0162] Among them, Y1 represents the reference value corresponding to the first line vector; w1 represents the first line vector line; w2 represents the second line vector line; w3 represents the total line vector line in the virtual reality environment; h01 represents the line density corresponding to the first line vector line; h02 represents the line density formed by the first line vector line and the second line vector line; l n represents the symbol of the logarithmic function.
[0163] Lock a sub-behavior library from a preset behavior library according to the reference value, and then obtain an interaction behavior that can be represented according to the line ratio and the line condition of the first line vector line.
[0164] In this embodiment, the posture trajectory is composed of interaction trigger points.
[0165] In this embodiment, the trajectory-function database includes different posture trajectories and the interaction functions matched with the posture trajectories.
[0166] In this embodiment, the behavior analysis model is pre-trained and includes different point combinations and the point sensing times matched with the point combinations as samples, and is trained with the matched self-logical behavior as the output sample. Because the trajectories formed by different point positions and the actions represented by the sensing triggers at different time points in the trajectory are different, the self-logical behavior is obtained through the behavior analysis model.
[0167] In this embodiment, the self-logical behavior can be regarded as the action trajectory of the object. Global line extraction refers to the lines that can be extracted within the maximum range in the virtual reality scene, that is, global line extraction.
[0168] Local line extraction is related to the corresponding virtual scene, that is, the virtual scene will capture the actions within a specific spatial range, so as to achieve local extraction.
[0169] The beneficial effects of the above technical solutions are as follows: By obtaining the point positions and time sensing of different points, it is convenient to obtain the self-logical behavior, and then through the extraction of global and local lines, it is convenient to obtain the interaction behavior that can be represented, providing a guarantee for the subsequent execution of the interaction function.
[0170] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these changes and modifications.
Claims
1. A virtual reality interaction system based on spatial perception, characterized in that, Including: An interaction state capture module, configured to lock a first interaction object in a virtual reality scene, capture and analyze the interaction state of the first interaction object; An interaction surface adjustment module, configured to, when the interaction state is interface interaction, perform interaction adjustment of direction and distance on the interaction surface according to a first positional relationship between an interface to be interacted with and a virtual reality environment and in accordance with an object interaction intention; An action interaction module, configured to, when the interaction state is gesture interaction, obtain a virtual action of the first interaction object, perform action dissection and separation, determine an interaction trigger point, and execute a corresponding interaction function according to a second positional relationship between the interaction trigger point and the virtual reality environment and in combination with a gesture trajectory of the interaction trigger point; The interaction surface adjustment module includes: A range determination unit, configured to capture an interaction focus point of a first interaction object, determine a focus type of the interaction focus point, and at the same time, determine a first interaction surface at a current position of the first interaction object in the virtual reality environment and an adjustable direction range of the first interaction surface based on the virtual reality environment and an adjustable length range of each adjustable direction; An information acquisition unit, configured to, when the focus type is related to a first virtual interaction object corresponding to a third-party actual person in the virtual reality environment, acquire first interaction information between the first interaction object and the first virtual interaction object; An information analysis unit, configured to analyze the first interaction information and determine a first interaction intention of the first interaction object and a second interaction intention of the first virtual interaction object; A first determination unit, configured to perform a first determination on a current adjustment direction of an adjustable direction of the first interaction surface and a current adjustment length of an adjustable length based on the first interaction intention; A second determination unit, configured to perform a second determination on a current adjustment direction and a current adjustment length of a second interaction surface of the first virtual interaction object according to the second interaction intention; A first interaction adjustment unit, configured to determine an interaction duration between the first interaction surface and the second interaction surface according to the first interaction intention and the second interaction intention, and in combination with a first determination result and a second determination result, determine an adjustment process to implement interaction adjustment of the first interaction surface and the second interaction surface.
2. The virtual reality interaction system based on spatial perception according to claim 1, characterized in that, The interaction state capture module includes: A scene construction unit, configured to construct a virtual reality scene based on a selected preset scene model and scene devices matching the preset scene model; A scene scanning unit, configured to perform a global scan on the virtual reality scene to lock a first interaction object; A log capture unit, configured to capture an execution log of the first interaction object in the virtual reality scene from a virtual reality record database; A log analysis unit, configured to analyze the execution log to obtain an execution input instruction of the first interaction object based on an operation device, and acquire the interaction state of the first interaction object.
3. The virtual reality interaction system based on spatial perception according to claim 1, wherein The interaction surface adjustment module further includes: A process generation unit, configured to, when the focus type is related to a second virtual interaction object of the virtual reality environment itself, obtain an interaction array according to a third interaction intention of the first interaction object, and generate an interaction surface adjustment process based on the interaction array; A second interaction adjustment unit, configured to perform interaction adjustment on the first interaction surface according to a generation result.
4. The virtual reality interaction system based on spatial perception according to claim 1, characterized in that, The first determination unit includes: A first building block, configured to construct a position relationship function R1(Y1, r02, r03, r04) between a first position of a first interaction object and a position of a first interaction surface, where Y1 represents the first position, r02 represents a first center bias, r03 represents a first display width, and r04 represents a first display height; A second building block, configured to construct an intention function R(r11, r12, r13) according to the first interaction intention, where r11 represents a bias factor after interaction determined based on the first interaction intention; r12 represents a width factor after interaction determined based on the first interaction intention; r13 represents a height factor after interaction determined based on the first interaction intention; A third building block, configured to construct a function to be compared R2(Y1, x1, x2, x3) according to the position relationship function R1 and the intention function R, where x1 represents a height to be adjusted; x2 represents a width to be adjusted; x3 represents a bias to be adjusted; x1=r04 r13 +a1 x2=r03 r12 +a2 x3 = r02 r11 + a3 A comparison block, configured to compare the function to be compared R2 with a standard function R3(f01, f02), where f01 represents an adjustable direction range, and f02 represents an adjustable length range for each adjustable direction; a1, a2, and a3 represent constants related to corresponding factors; A fourth building block, configured to construct a new function R4(Y1, x01, x02, x03) according to a comparison result, where x01 represents a height to be adjusted; x22 represents a width after current adjustment; x03 represents a bias after current adjustment; A result determination block, configured to obtain a first determination result based on the new function R4.
5. The virtual reality interaction system based on spatial perception according to claim 3, wherein, The first interaction adjustment unit includes: A time period extraction unit, configured to extract a first interaction time period in the first interaction intention and a second interaction time period in the second interaction intention, and obtain an intersection time period; A duration analysis unit, configured to analyze a first duration of a left time period and a second duration of a left time period in a non-intersection time period; A duration adjustment unit, configured to adjust the intersection time period based on the first duration and the second duration to obtain an interaction duration; An array determination unit, configured to determine a first distance array in the first determination result and determine a second distance array in the second determination result; Meanwhile, extract same elements in the first determination result and the second determination result to obtain a third distance array; A judgment unit, configured to analyze whether there is an overlapping position during the interaction adjustment between the first interaction surface and the second interaction surface according to the first distance array, the second distance data, and the third distance data; If so, determine the overlapping position based on an overlapping trajectory of the virtual reality scene; A trajectory analysis unit, configured to obtain the center point of the overlapping trajectory when the overlapping trajectory is a straight line, and control the first interaction surface and the second interaction surface to perform surface reduction at the center point, and perform surface expansion after passing through the center point, which is used as the first interaction method; When the overlapping trajectory is not a straight line, lock multiple specific curve points, and perform spatial cutting on the first interaction surface and the second interaction surface according to adjacent specific curve points, and reduce the cutting surface at the center point of the adjacent specific curve points, and perform expansion and splicing after passing through, which is used as the second interaction method; If not, perform parallel transmission of the first interaction surface and the second interaction surface in a specified direction and at a specified position, which is used as the third interaction method; A duration optimization unit, configured to optimize the interaction duration based on the last interaction method, and control the first interaction surface and the second interaction surface to perform interaction for the corresponding interaction duration.
6. The virtual display interaction system based on spatial perception according to claim 5, characterized in that The optimized interaction duration includes the initial interaction duration and the increased duration caused by using different interaction methods.
7. The virtual reality interaction system based on spatial perception according to claim 1, characterized in that, The action interaction module includes: A point acquisition unit, configured to determine the interaction orientation of the first interaction object, the continuous points and the individual points in the interaction orientation in the interaction orientation, and at the same time, obtain the time sensing points of the interaction orientation through the action dissection and separation results of the virtual object when in the action gesture state; A behavior setting unit, configured to input the time sensing points, the continuous points and the individual points in the interaction orientation into a behavior analysis model, and output a self-logical behavior; A line extraction unit, configured to perform global line extraction and local line extraction on the self-logical behavior; A vector line acquisition unit, configured to obtain a first line vector line within the interaction range and a second line vector line outside the interaction range according to the extraction results; A representable unit, configured to determine the representable interaction behavior of the first line vector line according to the line ratio of the first line vector line and the second line vector line, and obtain a number of interaction trigger points; According to the posture trajectory of the interaction trigger points, retrieve the interaction operation method from the trajectory-function database and execute the corresponding interaction function.
Citation Information
Patent Citations
Live broadcast interaction method and system based on virtual reality technology
CN114466211A
Method for generating sense of reality of virtual object in teaching scene
US11282404B1