Interaction method, apparatus, electronic device, and computer-readable storage medium

CN117788756BActive Publication Date: 2026-10-30BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211153786.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-21
Publication Date
2026-10-30
Estimated Expiration
2042-09-21

AI Technical Summary

Technical Problem

[0004]本公开提供了一种交互方法、装置、电子设备和计算机可读存储介质,以解决现有技术在扩展现实空间中如何显示射线的问题

Benefits of technology

[0043]本公开实施例提供的技术方案中,通过获取射线与扩展现实交互空间中的目标对象的碰撞点的位置信息,其中,所述射线的起点为交互控制设备所处的位置;基于所述碰撞点的位置信息,获取所述射线的起点至所述碰撞点的距离;基于所述距离确定所述射线的显示参数,并基于所述射线的显示参数显示所述射线。通过本申请提供的技术方案可首先基于获取的射线与扩展现实交互空间中的目标对象的碰撞点的位置信息确定射线的起点至所述碰撞点的距离,进而根据所述距离可以确定射线的显示参数,由于在确定射线的显示参数的过程中,考虑了射线的起点至碰撞点的距离,从而,确定的显示参数更加合理,更符合用户的视觉需求。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117788756B_ABST
    Figure CN117788756B_ABST
Patent Text Reader

Abstract

The present disclosure provides an interaction method and device, electronic equipment and computer readable storage medium, relating to the technical field of computers, which comprises the following steps: acquiring position information of a collision point of a ray and a target object in an extended reality interaction space; acquiring a distance from a starting point of the ray to the collision point based on the position information of the collision point; determining a display parameter of the ray based on the distance; and displaying the ray based on the display parameter of the ray. Since the distance from the starting point of the ray to the collision point is considered in the process of determining the display parameter of the ray, the determined display parameter is more reasonable and more in line with the visual needs of the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more particularly to an interaction method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] Extended reality interactive spaces are playing an increasingly important role in people's lives, including various forms such as Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR).

[0003] In existing technologies, there is spatial distance in extended reality interactive space, and controllers and other devices operate on objects in extended reality interactive space by emitting rays. Summary of the Invention

[0004] This disclosure provides an interactive method, apparatus, electronic device, and computer-readable storage medium to address the problem of how to display rays in extended reality in the prior art.

[0005] Firstly, this disclosure provides an interaction method applied in an extended real-world interaction space, including:

[0006] Obtain the position information of the collision point between the ray and the target object in the extended reality interactive space, wherein the starting point of the ray is the position of the interactive control device;

[0007] Based on the location information of the collision point, the distance from the starting point of the ray to the collision point is obtained;

[0008] The display parameters of the ray are determined based on the distance, and the ray is displayed based on the display parameters of the ray.

[0009] As an optional implementation of this application, the display parameters of the ray include: the length of the ray, and / or the size of the cursor that the ray projects onto the target object.

[0010] As an optional implementation of this application, the step of determining the display parameters of the ray based on the distance and displaying the ray based on the display parameters of the ray includes:

[0011] The target length of the ray is determined based on the distance, the length of the ray is adjusted to the target length, and the ray is displayed.

[0012] As an optional implementation of this application, the step of determining the target length of the ray based on the distance, adjusting the length of the ray to the target length, and displaying the ray includes:

[0013] The target length of the ray is determined based on the distance;

[0014] The ray is adjusted from its initial length to the target length and displayed, wherein the initial length of the ray is infinite, or greater than a first preset length but less than a second preset length.

[0015] As an optional implementation of this application, the initial state of the ray is either visible or invisible.

[0016] The step of adjusting the ray from its initial length to the target length and displaying it includes:

[0017] The ray is adjusted from its initial length to the target length and displayed in a visible state.

[0018] As an optional implementation of this application, determining the target length of the ray based on the distance includes:

[0019] The target length of the ray is determined based on a preset smoothing function and the distance.

[0020] As an optional implementation of this application, determining the target length of the ray based on a preset smoothing function and the distance includes:

[0021] According to y = 1.6 * log a (2x) Determine the target length of the ray, where x is the distance, x is greater than or equal to 0.5 meters, y is the target length of the ray, and a is a real number greater than 1.

[0022] As an optional implementation of this application, obtaining the position information of the collision point between the ray and the target object in the extended reality interaction space includes:

[0023] Based on collision detection technology, the first object that collides with the ray in the extended reality interaction space is identified as the target object.

[0024] Obtain the location information of the collision point of the target object.

[0025] As an optional implementation of this application, obtaining the position information of the collision point between the ray and the target object in the extended reality interaction space includes:

[0026] Based on collision detection technology, candidate objects that could collide with the ray in the extended reality interactive space are identified.

[0027] Based on the penetration characteristics of the candidate objects, the first object that generates a collision with an impenetrable penetration characteristic is determined as the target object;

[0028] Obtain the location information of the collision point of the target object.

[0029] Secondly, this disclosure provides an interactive device, comprising:

[0030] The acquisition module is used to acquire the position information of the collision point between the ray and the target object in the extended reality interactive space, wherein the starting point of the ray is the position of the interactive control device.

[0031] The acquisition module is further configured to acquire the distance from the starting point of the ray to the collision point based on the location information of the collision point;

[0032] An adjustment module is used to determine the display parameters of the ray based on the distance, and to display the ray based on the display parameters of the ray.

[0033] As an optional implementation of this application, the display parameters of the ray include: the length of the ray, and / or the size of the cursor that the ray projects onto the target object.

[0034] As an optional implementation of this application, the adjustment module is specifically used to determine the target length of the ray based on the distance, adjust the length of the ray to the target length, and display the ray.

[0035] As an optional implementation of this application, the adjustment module is specifically used to determine the target length of the ray based on the distance; adjust the ray from its initial length to the target length and display it, wherein the initial length of the ray is infinite, or greater than a first preset length and less than a second preset length.

[0036] As an optional implementation of this application, the adjustment module is specifically used to adjust the ray from its initial length to the target length and display it in a visible state.

[0037] As an optional implementation of this application, the adjustment module is specifically used to determine the target length of the ray based on a preset smoothing function and the distance.

[0038] As an optional implementation of this application, the adjustment module 112 is specifically used for: according to y = 1.6 * log a (2x) Determine the target length of the ray, where x is the distance, x is greater than or equal to 0.5 meters, y is the target length of the ray, and a is a real number greater than 1.

[0039] As an optional implementation of this application, the acquisition module 111 is specifically used to determine the first object that collides with the ray in the extended reality interaction space as the target object based on collision detection technology; and to acquire the position information of the collision point of the target object.

[0040] As an optional implementation of this application, the acquisition module is specifically used to determine, based on collision detection technology, candidate objects that collide with the ray in the extended reality interaction space; based on the penetration characteristics of the candidate objects, determine the first object that collided with the object whose penetration characteristics are impenetrable as the target object; and acquire the position information of the collision point of the target object.

[0041] Thirdly, this disclosure provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; characterized in that, when the one or more processors execute the one or more computer programs, the electronic device causes the electronic device to implement the interaction method as described in any of the first aspects.

[0042] Fourthly, this disclosure provides a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the interaction method as described in any of the first aspects.

[0043] In the technical solution provided by this disclosure, the location information of the collision point between a ray and a target object in the extended reality interactive space is obtained, wherein the starting point of the ray is the location of the interactive control device; based on the location information of the collision point, the distance from the starting point of the ray to the collision point is obtained; based on the distance, the display parameters of the ray are determined, and the ray is displayed based on the display parameters. The technical solution provided by this application can first determine the distance from the starting point of the ray to the collision point based on the obtained location information of the collision point between the ray and the target object in the extended reality interactive space, and then determine the display parameters of the ray based on the distance. Because the distance from the starting point of the ray to the collision point is considered in the process of determining the display parameters of the ray, the determined display parameters are more reasonable and better meet the user's visual needs. Attached Figure Description

[0044] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0045] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure;

[0047] Figure 2 This disclosure provides a schematic diagram of an interactive control device in an embodiment of an interactive method.

[0048] Figure 3 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure;

[0049] Figure 4 A schematic diagram of a ray in an embodiment of an interactive method provided in this disclosure;

[0050] Figure 5 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure;

[0051] Figures 6a-6b This is a schematic diagram illustrating the penetration of candidate objects in an embodiment of an interaction method provided in this disclosure;

[0052] Figure 7 This is a schematic diagram illustrating the distance between the collision point and the starting point of the ray in one embodiment of the interaction method provided in this disclosure.

[0053] Figure 8 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure;

[0054] Figures 9a-10b This is a schematic diagram of adjusting the ray length in an embodiment of an interactive method provided in this disclosure;

[0055] Figure 11 This is a schematic diagram of a cursor in one embodiment of the present disclosure;

[0056] Figure 12 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure;

[0057] Figure 13 This is a schematic diagram illustrating the relationship between scaling ratio and distance in one embodiment of this disclosure;

[0058] Figure 14 This is a schematic diagram illustrating the change in cursor size with distance in one embodiment of this disclosure;

[0059] Figure 15 This is a schematic diagram of the structure of an interactive device provided in this disclosure. Detailed Implementation

[0060] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0061] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0062] This disclosure provides an interaction method for use in extended reality interactive spaces, which enables the distance from the starting point of the ray to the collision point to be determined based on the position information of the collision point between the ray and the target object in the extended reality interactive space. Then, the length of the ray is adjusted to the target length for display based on the distance, thereby ensuring that the ray does not penetrate the target object and improving the user's visual experience.

[0063] The interaction method disclosed herein is executed by an electronic device or an application program within an electronic device. The electronic device may be a tablet computer, mobile phone, wearable device, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), smart TV, smart screen, high-definition TV, 4K TV, smart speaker, smart projector, etc. This disclosure does not impose any limitations on the specific type of electronic device.

[0064] This disclosure does not limit the type of operating system used in electronic devices. Examples include Android, Linux, Windows, and iOS.

[0065] The technical solutions of this disclosure are described below with reference to several specific embodiments.

[0066] Figure 1 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure, such as... Figure 1 As shown, the method in this embodiment includes the following steps:

[0067] S11. Obtain the position information of the collision point between the ray and the target object in the extended reality interaction space.

[0068] The starting point of the ray is the location of the interactive control device, and the ray is emitted from the model corresponding to the interactive control device in the extended reality space. The ray is a virtual ray.

[0069] Extended reality interactive spaces can include various forms such as augmented reality (AR), virtual reality (VR), and mixed reality (MR). The interactive control device can refer to... Figure 2 As shown, it includes a handle 21. A ray is emitted from the interactive control device at the corresponding model in the extended reality space, allowing the user to manipulate the target object based on the ray.

[0070] The location information of the collision point can be the coordinate information of the collision point in the extended reality interactive space.

[0071] First, the target object needs to be acquired. Then, the collision point where the target object collides with the ray can be obtained, and the position information of the collision point can be acquired. The target object can be acquired in the following two exemplary ways:

[0072] Method 1: Based on collision detection technology, determine the first object that collides with the ray in the extended reality interaction space as the target object.

[0073] That is, it can be understood that the object closest to the starting point of the ray is the target object on the propagation path of the ray.

[0074] Method 2: Based on collision detection technology, determine the candidate objects that will collide with the ray in the extended reality interaction space; based on the penetration characteristics of the candidate objects, determine the first object that will collide with the ray as the target object.

[0075] That is, it can be understood that the target object is the object with the most penetrating properties that is closest to the starting point of the ray along the propagation path of the ray and is impenetrable.

[0076] Accordingly, a specific implementation method for obtaining the location information of the collision point of the target object includes the following steps S111 to S112, referring to... Figure 3 As shown.

[0077] S111. Based on collision detection technology, the first object that collides with the ray in the extended reality interaction space is determined as the target object.

[0078] The target object can be understood as the object that needs to be manipulated based on rays.

[0079] The ray, in its unadjusted state, is infinitely long and can penetrate every object it collides with; for example, see [reference]. Figure 4 As shown, this example illustrates the concept of two objects (object A and object B) in an extended reality interactive space. These two objects are merely used to illustrate the penetrability of the initial ray and do not constitute any limitation. The ray can penetrate object A upon its first collision, and then, after colliding with object B, it also passes through object B, without forming a focal point on object A and / or object B, thus preventing manipulation of object A and / or object B. If N objects exist along the propagation path of the initial ray, all N objects will be penetrated.

[0080] When determining the target object, the first object that the ray collides with in the extended reality interaction space is taken as the target object. For example, when the first object that the ray collides with in the extended reality interaction space is object A, object A is determined as the target object; when the first object that the ray collides with in the extended reality interaction space is object B, object B is determined as the target object.

[0081] S112. Obtain the position information of the collision point of the target object.

[0082] The location information of the collision point of the target object is the location information of the focal point of the ray on the target object.

[0083] Optionally, another specific implementation method for obtaining the location information of the collision point of the target object includes the following steps S113 to S115, as referred to Figure 5 As shown.

[0084] S113. Based on collision detection technology, determine the candidate objects that will collide between the ray and the extended reality interaction space.

[0085] In this embodiment, the candidate object can be understood as the object that collides with the ray on the transmission path in the extended reality interactive space. When there are multiple candidate objects, the penetration characteristics of each candidate object may be the same or different.

[0086] S114. Based on the penetration characteristics of the candidate objects, determine the first object that generates a collision as the target object, since the penetration characteristics are impenetrable.

[0087] The following examples illustrate this:

[0088] Example 1: In an extended reality interactive space, if the penetration property of multiple candidate objects is penetrable, and a ray can pass through each candidate object, then there is no target object in the propagation path of the ray.

[0089] Example 2: In an extended reality interactive space, there are multiple candidate objects. Among these, there are both impenetrable and permeable candidate objects. The first object that collides with the ray, the one with impenetrable penetration, is identified as the target object, based on the ray's propagation direction. For example, suppose there are candidate objects a, b, c, and d in the extended reality interactive space. Candidate objects a and b are both permeable, while candidate objects c and d are both impenetrable. The distances between the positions of candidate objects a, b, c, and d and the starting point of the ray increase sequentially, meaning candidate object a is closest to the ray's starting point, and candidate object d is farthest. Candidate object a is the first candidate object to collide with the ray. The ray passes through candidate objects a and b in sequence, colliding with candidate object c. Since candidate object c is impenetrable, it is identified as the target object. (See reference...) Figure 6a As shown, the ray will not penetrate candidate object c, and therefore will not collide with candidate object d. Instead, it will form a focal point on candidate object c, allowing the user to manipulate candidate object c through the ray.

[0090] Example 3: Following on from Example 2 above, refer to... Figure 6b As shown, if the penetration characteristic of candidate object a is impenetrable, then candidate object a is determined as the target object. The ray forms a focal point on candidate object a and will not penetrate candidate object a to collide with candidate object b, candidate object c and candidate object d located after candidate object a.

[0091] S115. Obtain the position information of the collision point of the target object.

[0092] S12. Based on the location information of the collision point, obtain the distance from the starting point of the ray to the collision point.

[0093] For example, refer to Figure 7 As shown, Figure 7 The distance L between the collision point O and the starting point of the ray shown is the distance from the starting point of the ray to the collision point. The distance from the starting point of the ray to the collision point can be determined using the coordinates of the collision point in the extended reality interactive space and the coordinates of the starting point of the ray.

[0094] S13. Determine the display parameters of the ray based on the distance, and display the ray based on the display parameters of the ray.

[0095] The display parameters of the ray include: the length of the ray, and / or the size of the cursor that the ray projects onto the target object.

[0096] That is, the display parameters of the ray may include the length of the ray; or, the display parameters of the ray may include the size of the cursor projected by the ray on the target object; or the display parameters of the ray may simultaneously include the length of the ray and the size of the cursor projected by the ray on the target object.

[0097] When the display parameters of the ray only include the length of the ray, the specific implementation of step S13 above can be: determining the target length of the ray based on the distance, adjusting the length of the ray to the target length, and displaying the ray.

[0098] In the technical solution provided by this disclosure, the location information of the collision point between a ray and a target object in the extended reality interactive space is obtained, wherein the starting point of the ray is the location of the interactive control device; based on the location information of the collision point, the distance from the starting point of the ray to the collision point is obtained; the display parameters of the ray are determined based on the distance, and the ray is displayed based on the display parameters. The technical solution provided by this application can first determine the distance from the starting point of the ray to the collision point based on the obtained location information of the collision point between the ray and the target object in the extended reality interactive space, and then determine the display parameters of the ray based on the distance. Since the distance from the starting point of the ray to the collision point is considered in the process of determining the display parameters of the ray, the determined display parameters are more reasonable and better meet the user's visual needs. Furthermore, the target length of the ray is determined based on the distance, the length of the ray is adjusted to the target length, and the ray is displayed. The technical solution provided in this application can first determine the distance from the starting point of the ray to the collision point based on the position information of the collision point between the ray and the target object in the extended reality interactive space. Then, based on the distance, the length of the ray is adjusted to the target length for display, so that the ray will not penetrate the target object and forms a focal point on the target object, which makes it easier for users to operate on the target object through the ray and improves the user's visual experience.

[0099] Optionally, determining the target length of the ray based on the distance, adjusting the length of the ray to the target length, and displaying the ray may include the following steps S131 to S132, as shown below. Figure 8 As shown, Figure 8 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure.

[0100] S131. Determine the target length of the ray based on the distance.

[0101] Optionally, the target length of the ray can be determined based on a preset smoothing function and the distance.

[0102] For example, determining the target length of the ray based on a preset smoothing function and the distance includes: based on y = 1.6 * log a (2x) Determine the target length of the ray, where x is the distance, x is greater than or equal to 0.5 meters, y is the target length of the ray, and a is a real number greater than 1.

[0103] The above formula is the preset smoothing function, used to smoothly transition the ray from its initial infinite length to the target length, improving the user's visual experience. The above formula is merely an example and is not intended to limit the scope. The preset smoothing function in this embodiment should include any function capable of smoothly transitioning the ray from its initial infinite length to the target length.

[0104] S132. Adjust the ray from its initial length to the target length and display it.

[0105] The initial length of the ray is either infinite or greater than a first preset length but less than a second preset length.

[0106] The initial length of the ray being greater than a first preset length indicates that the initial length of the ray is non-zero, and being less than a second preset length indicates that the initial length of the ray is not infinite.

[0107] For example, refer to Figure 9a and Figure 9b As shown, Figure 9a In the diagram, the distance between the collision point M where the target object e collides with the ray and the emission source 22 is x. The initial length of the ray is infinite, and the initial length of the ray can be visible. After the target length is determined, according to the formula above, y = 1.6 * log a (2x) will Figure 9a The ray in the middle is adjusted from the initial length to Figure 9b The target length y is shown in the figure.

[0108] Alternatively, the initial length of the ray may be greater than a first preset length but less than a second preset length. The initial length of the ray can be the distance between the collision point where an object collides with the ray and the emission source in the extended real-world interactive space. For example, refer to... Figure 10a As shown, the initial length of the ray is x, which is also the distance between the collision point where object e collides with the ray and the emission source. When the target length between the collision point N where the target object f collides with the ray and the emission source is determined to be y, based on the formula y = 1.6 * log a (2x) will Figure 10a The initial length of the ray is adjusted from x to Figure 10b The y shown.

[0109] Optionally, the initial state of the ray is a visible state, as shown in the reference. Figures 9a to 10b As shown, it can also be in an invisible state.

[0110] For example, when the initial state of the ray is visible, adjusting the ray from its initial length to the target length and displaying it includes: adjusting the ray from its initial length to the target length and displaying it in a visible state, as shown in the example. Figures 9a to 10b As shown.

[0111] When the initial state of the ray is invisible, adjusting the ray from its initial length to the target length and displaying it includes: adjusting the ray from its initial length to the target length and displaying it in a visible state. This application embodiment will not provide specific examples.

[0112] Alternatively, if the display parameters of the ray only include the size of the cursor projected by the ray on the target object, the specific implementation of step S13 above can be: determining the target size of the cursor projected by the ray on the target object based on the distance, and displaying the cursor projected by the ray on the target object at the target size.

[0113] The position of the cursor on which the ray projects onto the target object is the position of the collision point where the ray collides with the target object.

[0114] For example, refer to Figure 11 As shown, the ray collides with the target object F, and the cursor 110 is projected at the location where the collision occurs.

[0115] Optionally, determining the target size of the cursor projected by the ray onto the target object based on the distance, and displaying the cursor projected by the ray onto the target object at the target size, may include the following steps S133 to S134, referencing... Figure 12 As shown, Figure 12 This is a flowchart illustrating an embodiment of an interaction method provided in this disclosure.

[0116] S133. Determine the scaling ratio of the cursor projected by the ray onto the target object based on the distance.

[0117] Optionally, it can be based on f(x) = (0.7 * log... a (2x)+1)*0.089 determines the scaling ratio of the cursor projected by the ray onto the target object; where f(x) is the scaling ratio, x is the distance (greater than or equal to 0.02 meters), and a is a real number greater than 1. For example, the relationship between the scaling ratio and the distance is as follows: Figure 13 As shown.

[0118] The scaling ratio is directly proportional to the distance; that is, the greater the distance between the ray source and the point where the ray collides with the target object, the greater the scaling ratio.

[0119] S134. Determine the target size of the cursor based on the scaling ratio and the default size of the cursor.

[0120] The default size of the cursor can be understood as the default size of the cursor, the default area of ​​the cursor, etc. For example, if the cursor is circular, the default size of the cursor can be the default diameter or the default area of ​​the cursor; if the cursor is square, the default size of the cursor can be the default side length or the default area of ​​the cursor.

[0121] The default size of the cursor and a determined scaling ratio can be calculated using a preset calculation method, such as multiplying them, to obtain the target size of the cursor. For example, by multiplying the default diameter of the cursor by the scaling ratio, the target diameter of the cursor can be obtained; by multiplying the default area of ​​the cursor by the scaling ratio, the target area of ​​the cursor can be obtained. The preset calculation method can also be other calculation methods, which are not specifically limited in this embodiment.

[0122] The greater the distance, the larger the scaling ratio, and the larger the target size of the cursor. For example, refer to... Figure 14 As shown, the distances from the ray origin to target objects C, D, and E increase sequentially. Therefore, the scaling ratio determined by the distance between the ray origin and the collision point on target object C is the smallest, the scaling ratio determined by the distance between the ray origin and the collision point on target object D is in the middle, and the scaling ratio determined by the distance between the ray origin and the collision point on target object E is the largest. Correspondingly, the target size of the cursor on target objects C, D, and E increases sequentially.

[0123] In existing solutions, the cursor size remains constant at a default value. Even as the distance between the ray's origin and its collision point on the target object increases, the cursor size remains the default, resulting in a smaller cursor for the user, which is detrimental to manipulating and controlling the target object. In this embodiment, the cursor size increases according to the distance between the ray's origin and its collision point on the target object. This ensures that the user can clearly see the cursor on the target object even when they are far away, enabling precise manipulation and control of the target object.

[0124] Figure 15 This is a schematic diagram of the structure of an interactive device provided in this disclosure, such as... Figure 15As shown, the apparatus of this embodiment includes: an acquisition module 151 and an adjustment module 152, wherein,

[0125] The acquisition module 151 is used to acquire the position information of the collision point between the ray and the target object in the extended reality interactive space, wherein the starting point of the ray is the position of the interactive control device.

[0126] The acquisition module 151 is further configured to acquire the distance from the starting point of the ray to the collision point based on the location information of the collision point;

[0127] The adjustment module 152 is used to determine the display parameters of the ray based on the distance, and to display the ray based on the display parameters of the ray.

[0128] Optionally, the adjustment module 152 is specifically used to determine the target length of the ray based on the distance, adjust the length of the ray to the target length, and display the ray.

[0129] Optionally, the adjustment module 152 is specifically used to determine the target length of the ray based on the distance; adjust the ray from its initial length to the target length and display it, wherein the initial length of the ray is infinite, or greater than a first preset length and less than a second preset length.

[0130] Optionally, the adjustment module 152 is specifically used to adjust the ray from its initial length to the target length and display it in a visible state.

[0131] Optionally, the adjustment module 152 is specifically used to determine the target length of the ray based on a preset smoothing function and the distance.

[0132] Optionally, the adjustment module 152 is specifically used to: adjust according to y = 1.6 * log a (2x) Determine the target length of the ray, where x is the distance, x is greater than or equal to 0.5 meters, y is the target length of the ray, and a is a real number greater than 1.

[0133] Optionally, the acquisition module 151 is specifically used to determine the first object that collides with the ray in the extended reality interaction space as the target object based on collision detection technology; and to acquire the position information of the collision point of the target object.

[0134] Optionally, the acquisition module is specifically used to determine, based on collision detection technology, candidate objects that collide with the ray in the extended reality interaction space; and based on the penetration characteristics of the candidate objects, determine the first object that collided with the object whose penetration characteristics are impenetrable as the target object.

[0135] The apparatus in this embodiment can be used to execute the steps of the above method embodiments, and its implementation principle and technical effect are similar, so they will not be described again here.

[0136] This disclosure also provides an electronic device, including: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; and when the one or more processors execute the one or more computer programs, the electronic device performs the steps of the above-described method embodiments.

[0137] This disclosure also provides a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the steps of the above-described method embodiments.

[0138] In the above embodiments, all or part of the functionality can be implemented by software, hardware, or a combination of software and hardware. When implemented using software, it can be implemented wholly or partially in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this disclosure is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0139] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0140] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An interaction method, characterized in that, Applied to extended reality interactive spaces, the method includes: Obtain the position information of the collision point between the ray and the target object in the extended reality interactive space, wherein the starting point of the ray is the position of the interactive control device; Based on the location information of the collision point, the distance from the starting point of the ray to the collision point is obtained; The display parameters of the ray are determined based on the distance, and the ray is displayed based on the display parameters of the ray; the display parameters of the ray include: the length of the ray, and / or, the size of the cursor projected by the ray onto the target object; When the display parameters of the ray include the length of the ray, determining the display parameters of the ray based on the distance includes: determining the target length of the ray according to a preset smoothing function and the distance.

2. The method according to claim 1, characterized in that, The step of determining the display parameters of the ray based on the distance, and displaying the ray based on the display parameters of the ray, includes: The target length of the ray is determined based on the distance, the length of the ray is adjusted to the target length, and the ray is displayed.

3. The method according to claim 2, characterized in that, The steps of determining the target length of the ray based on the distance, adjusting the length of the ray to the target length, and displaying the ray include: The target length of the ray is determined based on the distance; The ray is adjusted from its initial length to the target length and displayed, wherein the initial length of the ray is infinite, or greater than a first preset length but less than a second preset length.

4. The method according to claim 3, characterized in that, The initial state of the ray is either visible or invisible; The step of adjusting the ray from its initial length to the target length and displaying it includes: The ray is adjusted from its initial length to the target length and displayed in a visible state.

5. The method according to claim 4, characterized in that, Determining the target length of the ray based on a preset smoothing function and the distance includes: Based on y=1.6 log a (2x) Determine the target length of the ray, where x is the distance, x is greater than or equal to 0.5 meters, y is the target length of the ray, and a is a real number greater than 1.

6. The method according to claim 1, characterized in that, The step of determining the display parameters of the ray based on the distance, and displaying the ray based on the display parameters of the ray, includes: The target size of the cursor projected by the ray onto the target object is determined based on the distance, and the cursor projected by the ray onto the target object is displayed at the target size.

7. The method according to claim 6, characterized in that, Determining the target size of the cursor projected by the ray onto the target object based on the distance includes: The scaling ratio of the cursor projected by the ray onto the target object is determined based on the distance; The target size of the cursor is determined based on the scaling ratio and the default size of the cursor.

8. The method according to claim 6, characterized in that, Determining the scaling ratio of the cursor projected by the ray onto the target object based on the distance includes: According to f(x) = (0.7) log a (2x)+1) 0.089 determines the scaling ratio of the cursor projected by the ray onto the target object; where f(x) is the scaling ratio, x is the distance, x is greater than or equal to 0.02 meters, and a is a real number greater than 1.

9. The method according to any one of claims 1-8, characterized in that, The acquisition of the location information of the collision point between the ray and the target object in the extended reality interaction space includes: Based on collision detection technology, the first object that collides with the ray in the extended reality interaction space is identified as the target object. Obtain the location information of the collision point of the target object.

10. The method according to any one of claims 1-8, characterized in that, The acquisition of the location information of the collision point between the ray and the target object in the extended reality interaction space includes: Based on collision detection technology, candidate objects that could collide with the ray in the extended reality interactive space are identified. Based on the penetration characteristics of the candidate objects, the first object that generates a collision with an impenetrable penetration characteristic is determined as the target object; Obtain the location information of the collision point of the target object.

11. An interactive device, characterized in that, include: The acquisition module is used to acquire the position information of the collision point between the ray and the target object in the extended reality interactive space, wherein the starting point of the ray is the position of the interactive control device. The acquisition module is further configured to acquire the distance from the starting point of the ray to the collision point based on the location information of the collision point; An adjustment module is used to determine the display parameters of the ray based on the distance, and to display the ray based on the display parameters of the ray; the display parameters of the ray include: the length of the ray, and / or, the size of the cursor projected by the ray on the target object; When the display parameters of the ray include the length of the ray, determining the display parameters of the ray based on the distance includes: determining the target length of the ray according to a preset smoothing function and the distance.

12. An electronic device, comprising: One or more processors; Memory; And one or more computer programs; wherein the one or more computer programs are stored in the memory; characterized in that, when the one or more processors execute the one or more computer programs, the electronic device causes the electronic device to implement the interaction method as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the interaction method as described in any one of claims 1-10.

Citation Information

Patent Citations

  • Eye-tracking simulation method and device and head-mounted display device

    CN109002167A

  • Game interaction method and device based on 3D screen interaction and computer equipment

    CN112451967A