Method and device for interaction in virtual scene, equipment and storage medium

By dynamically adjusting the display of indicators and virtual objects according to distance relationships in the virtual scene, the problem of inaccurate interactions in the virtual scene is solved, and the accuracy and authenticity of the interaction are improved.

CN118939105APending Publication Date: 2024-11-12BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310524214.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In virtual scenarios, it is difficult for users to accurately judge the positional relationship between the virtual object and the target object, resulting in inaccurate interaction.

Method used

By determining the distance from the target object to the virtual object, dynamically present the indicator, adjust the display of the indicator according to the distance relationship (negative or positive correlation) to improve the accuracy of the interaction, and adjust the display angle of the virtual object when the distance changes to Prompt interaction status.

Benefits of technology

It improves the accuracy and authenticity of interactions in virtual scenes, helps users better position the objects to be interacted with, and enhances the interactive experience in virtual scenes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939105A_ABST
    Figure CN118939105A_ABST
Patent Text Reader

Abstract

According to the embodiment of the invention, a method, a device and equipment for interaction in a virtual scene and a storage medium are provided. The method comprises the following steps: determining a first distance from a target object for interaction to a first virtual object in a virtual scene; and presenting a first indicator of the first virtual object based on the first distance, where a second distance of the first indicator to the first virtual object is negatively correlated to the first distance. Therefore, the user can be helped to more clearly position the interactive object in the virtual scene.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for interacting in a virtual scene. Background Art

[0002] Extended Reality (XR) has been widely studied and applied. XR integrates virtual content and real scenes by combining hardware devices and a variety of technical means to provide users with a unique sensory experience. XR includes, for example, Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), etc. VR is a virtual world that uses computers to simulate three-dimensional space, providing users with an immersive experience in vision, hearing, touch, etc. AR allows the real environment and virtual objects to be superimposed in the same space in real time and exist at the same time. MR is a new visualization environment that integrates the real world and the virtual world, where objects in the physical real world scene coexist with objects in the virtual world in real time.

[0003] Therefore, XR-based virtual scenes can be used to provide users with an immersive interactive experience. Summary of the invention

[0004] In a first aspect of the present disclosure, a method for interacting in a virtual scene is provided. The method comprises: determining a first distance from a target object for interaction to a first virtual object in the virtual scene; and presenting a first indicator of the first virtual object based on the first distance, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

[0005] In a second aspect of the present disclosure, a method for interacting in a virtual scene is provided. The method comprises: presenting a virtual object at a first angle in the virtual scene; in response to detecting that a target object for interaction contacts a trigger area of ​​the virtual object, determining that the target object contacts the trigger area of ​​the virtual object;

[0006] and presenting the virtual object at a second angle in the virtual scene, such that the angular difference between the second angle and the first angle is positively correlated with the distance.

[0007] In a third aspect of the present disclosure, a device for interacting in a virtual scene is provided. The device includes: a first determination module configured to determine a first distance from a target object for interaction to a first virtual object in the virtual scene; and a first presentation module configured to present a first indicator of the first virtual object based on the first distance, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

[0008] In a fourth aspect of the present disclosure, a device for interaction in a virtual scene is provided. The device includes: a second presentation module configured to present a virtual object at a first angle in the virtual scene; a second determination module configured to determine the distance from the target object to the trigger area in response to detecting that the target object for interaction is in contact with the trigger area of ​​the virtual object; and a third presentation module configured to present the virtual object at a second angle in the virtual scene, such that the angle difference between the second angle and the first angle is positively correlated with the distance.

[0009] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect or the second aspect.

[0010] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect or the second aspect.

[0011] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0013] Figure 1 A diagram showing several example environments in which embodiments of the present disclosure can be implemented

[0014] intention;

[0015] Figure 2A-2D A schematic diagram showing interaction in a virtual scene according to some embodiments of the present disclosure is shown;

[0016] Figure 3 A schematic diagram showing transitions between interaction states according to some embodiments of the present disclosure;

[0017] Figure 4 A schematic diagram showing interaction in a virtual scene according to some embodiments of the present disclosure is shown;

[0018] Figure 5 A schematic diagram showing a process of interacting in a virtual scene according to some embodiments of the present disclosure;

[0019] Figure 6 A schematic diagram showing a process of interacting in a virtual scene according to some embodiments of the present disclosure;

[0020] Figure 7 A block diagram of an apparatus for interacting in a virtual scene according to some embodiments of the present disclosure is shown;

[0021] Figure 8 A block diagram showing an apparatus for interacting in a virtual scene according to some embodiments of the present disclosure; and

[0022] Fig. 9 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0023] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0024] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0025] As an optional but non-limiting implementation, in response to receiving the active request from the user, the prompt information can be sent to the user in the form of a pop-up window, in which the prompt information can be presented in text form. In addition, the pop-up window can also carry a message for the user to select P22071558501CN

[0026] Select “Agree” or “Disagree” to provide personal information to electronic devices.

[0027] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0028] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0029] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0030] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0031] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0032] As used in this article, the term "model" can learn the association between corresponding inputs and outputs from training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. In this article, "model" may also be referred to as "machine learning model", "machine learning network P22071558501CN

[0033] A model may also include different types of processing units or networks.

[0034] As used herein, a "unit", "operating unit" or "subunit" may consist of a machine learning model or network of any suitable structure. As used herein, a group of elements or similar expressions may include one or more such elements. For example, a "group of convolutional units" may include one or more convolutional units.

[0035] In an XR-based virtual scene, some virtual objects (e.g., various types of buttons or other interactive elements) are distributed in the virtual scene for interaction. Such virtual objects may be two-dimensional or three-dimensional.

[0036] However, when people interact with such virtual objects in a virtual scene, they may have difficulty accurately judging the positional relationship between the virtual object and the target object for interaction (e.g., the user's finger or the virtual target object in the virtual scene), which may make it difficult for people to accurately interact with the desired virtual object.

[0037] Embodiments of the present disclosure provide a scheme for interaction in a virtual scene. According to various embodiments of the present disclosure, a first distance from a target object for interaction to a first virtual object in a virtual scene may be determined. Further, based on the first distance, a first indicator of the first virtual object may be presented, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

[0038] Based on this approach, the embodiments of the present disclosure can dynamically present the foreground of the corresponding virtual object according to the target object for interaction to the virtual object, thereby prompting the user of the object to be interacted with, thereby improving the accuracy of the interaction in the virtual scene.

[0039] Example Environment

[0040] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the environment 100, a user 140 may wear an XR device 110. The XR device 110 communicates with a computing device 120 to construct a virtual scene for the user 140 or merge virtual content with a real scene.

[0041] In some embodiments, the environment 110 may also include other users (not shown in the figure), and the other users may wear corresponding XR devices and may communicate with the XR device 110 or P22071558501CN.

[0042] The computing device 120 performs wired or wireless communication to build a common virtual scene for multiple users without restricting the users to be in the same physical space. In the present disclosure, the user is also referred to as the operator. The virtual scene built based on VR technology, and the scene that integrates virtual content and real scene based on AR technology or MR technology are collectively referred to as virtual scene 130.

[0043] The XR device 110 may be a head-mounted or wearable near-eye display device, such as a head-mounted display, smart glasses, etc., supporting technologies such as VR, AR, and MR. The XR device 110 may include an image generation component and an optical display component for constructing a virtual scene 130 and displaying virtual objects in a monocular or binocular field of view. Virtual objects may include three-dimensional virtual objects and / or two-dimensional virtual objects. Virtual objects are, for example, display blocks in a virtual scene 130. In some examples, a display block may be a two-dimensional window without thickness, which is used to load content such as web pages and documents. In some examples, a display block is also referred to as a "facet."

[0044] In some embodiments, the computing device 120 may be a separate device capable of communicating with the XR device 110 and / or other image capture devices, such as a server, computing node, etc. for image or data processing, or may be integrated with the XR device 110 and / or other image capture devices. In some embodiments, the computing device 120 may be implemented as an XR device 110, that is, in this case, the XR device 110 may implement all functions of the computing device 120. It should be understood that the above description of the computing device 120 is merely exemplary and non-restrictive, and the computing device 120 may be implemented as a variety of forms, structures or categories of devices, and the embodiments of the present disclosure are not limited thereto.

[0045] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and does not imply any limitation on the scope of the present disclosure.

[0046] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0047] Example Interaction

[0048] Example interaction scenario 1

[0049] Figure 2A-2D A schematic diagram of interaction in a virtual scene according to some embodiments of the present disclosure is shown. Such a virtual scene may be composed of Figure 1 Provided by the XR device 110 shown in .

[0050] P22071558501CN

[0051] like Figure 2AAs shown, the XR device 110 can provide a virtual scene 205, for example. Such a virtual scene 205 may include a VR scene, an AR scene, or an MR scene. As shown in the figure, the virtual scene 205 may include various types of interactive virtual objects, also referred to as virtual elements or virtual controls.

[0052] by Figure 2A As shown, the virtual object in the virtual scene 205 may include a panel 215, which may further include a group of button controls (also referred to as a button group). In the present disclosure, such individual button controls 220-1, 220-2, 220-3, and 220-4 (individually or collectively referred to as buttons 220) may also be referred to as a virtual object in the virtual scene 205.

[0053] The user 140 may interact with the virtual objects in the virtual scene 205 by, for example, controlling the target object 210. Such a target object 210 may include, for example, a body part (e.g., a finger, a wrist, a palm, etc.) of the user 140. Alternatively, such a target object 210 may also be, for example, a virtual indicator (e.g., a virtual finger) in the virtual scene, and its position may change based on the hand movement of the user 140 or the control of the manipulator.

[0054] In some embodiments, the XR device 110 may determine the distance between the button 220 and the target object 210, and when it is determined that the distance is far (for example, greater than or equal to a certain threshold), the button 220 is placed in an idle state (also referred to as an Idle state). The idle state may correspond to a default display style of the button 220, for example, to indicate that there is no corresponding interaction.

[0055] In some embodiments, such a distance may include the distance from an appropriate position point of the target object 210 (e.g., the closest position point to the button 220) to an appropriate position point of the button (e.g., the center position of the button) or an appropriate plane (e.g., the plane where the button is located).

[0056] In some embodiments, the distance considered by the XR device 110 and compared with the threshold value may also be, for example, the projection distance of the straight-line distance from the finger to the button in a preset direction. Such a preset direction may include, for example, the direction of the normal vector of the display plane of the button 220.

[0057] like Figure 2B As shown, as the target object 210 approaches the button 220, the button 220-1, the button 220-2, and the button 220-3 may enter a hovering state (also referred to as a Hover state). Exemplarily, the XR device 110 may cause the button 220 to enter a hovering state when it is determined that the distance between the target object 210 and the button 220 is less than the threshold discussed above.

[0058] As shown in FIG. 2 , the distances from button 220 - 1 , button 220 - 2 , and button 220 - 3 to target object 210 may be smaller than the threshold, while the distance from button 220 - 4 to target object 210 may be smaller than the threshold.

[0059] The distance is, for example, greater than or equal to the threshold. As a result, the buttons 220-1, 220-2, and 220-3 enter the hovering state, while the button 220-4 remains in the idle state.

[0060] Taking button 220-2 as an example, in the hover state, button 220-2 may present an indicator that is highlighted relative to button 220-2. Such an indicator may include a foreground frame 225, which may protrude a certain distance in the direction of button 220-2.

[0061] In some embodiments, the indicator may further include, for example, an interaction area 230. When the interaction area 230 is displayed, the user may select the interaction area 230 by controlling the target object 210, thereby triggering the XR device 110 to present a set of interaction entrances corresponding to the interaction area 230.

[0062] For example, the user may move the target object 210 to indicate that the interaction focus falls into the interaction area 230 , thereby causing the XR device 110 to present a set of menus corresponding to the button 220 - 2 .

[0063] like Figure 2B As shown, button 220-1 may be similarly presented with a corresponding indicator, which may include, for example, a foreground frame 240 and / or an interactive area 245. In some embodiments, in order to facilitate the distinction of the object currently closest to the target object 210, the background area 235 of button 220-2 may be presented differently, for example. For example, the background area 235 of button 220-2 may present a preset color or pattern.

[0064] In some embodiments, in order to facilitate the user to more clearly locate the virtual object to be interacted with, the distance from the indicator to the corresponding virtual object may be negatively correlated with (eg, inversely proportional to) the distance from the target object 210 to the virtual object.

[0065] by Figure 2BAs an example, although both the button 220-1 and the button 220-2 are in the hovering state, the distance between the target object 210 and the button 220-2 is smaller than the distance between the target object 210 and the button 220-1. Accordingly, the distance that the indicator of the button 220-2 protrudes (for example, the distance that the plane where the foreground frame 225 is located protrudes relative to the button 220-2) will be greater than the distance that the indicator of the button 220-1 protrudes (for example, the distance that the plane where the foreground frame 240 is located protrudes relative to the button 220-1).

[0066] Accordingly, as the target object 210 moves, the distance that the indicator protrudes may also change dynamically, thereby presenting a corresponding dynamic special effect, thereby helping the user to better determine the virtual object to be interacted with.

[0067] P22071558501CN

[0068] For example, when the target object 210 continues to move toward the button 220-2, the distances from the button 220-2 and the button 220-1 will continue to decrease. Accordingly, the distances at which the indicators of the button 220-1 and the button 220-2 protrude will increase dynamically.

[0069] As another example, considering the distance from the target object 210 to the button 220-1 and the center point of the button 220-1, as the target object 210 moves upward along the panel 215 and the distance from the target object 210 to the panel 215 remains unchanged, the distance from the target object 210 to the button 220-1 will decrease, and the distance from the target object 210 to the button 220-2 may increase. As a result, the distance that the indicator of the button 220-1 protrudes will dynamically increase, while the distance that the indicator of the button 220-2 protrudes will dynamically decrease, thereby being able to more effectively prompt the user that the center of gravity of the current interaction is switching from the button 220-2 to the button 220-1.

[0070] In some embodiments, the XR device 110 may set such interaction logic for any appropriate virtual object, that is, presenting a dynamic indicator based on the distance of the target object to the virtual object.

[0071] In some embodiments, the XR device 110 may also implement this interaction logic only when there may be interaction confusion. Specifically, the XR device 110 may implement such interaction logic, i.e., determine the distance from the target object to the virtual object and present an indicator accordingly, only when it is determined that there are other objects within a preset distance of the virtual object targeted by the target object.

[0072] Although FIG. 2A to FIG. 2CIn the example of a button group, the interaction confusion scenario is described, but other similar scenarios may also include scenarios such as a label group or an action sheet. When two virtual objects constitute a button group, a label group, or an action sheet, the XR device 110 may execute the interaction logic.

[0073] In contrast, for a single, standalone button in a virtual scene, the XR device 110 , for example, may not implement this logic.

[0074] Continue to refer Figure 2C As the target object 210 approaches the button 220-2 further, the distance between the target object 210 and the button 220-2 may be less than or equal to a predetermined threshold. In some embodiments, such a predetermined threshold may be, for example, a maximum distance at which the indicator can be protruded.

[0075] For example, when it is detected that the distance between the target object 210 and the button 220-2 is less than or equal to the threshold, or when it is detected that the distance between the target object 210 and the indicator is less than the threshold, press P22071558501CN

[0076] Button 220-2 may enter a poking state (also referred to as a Poke state). Such a poking state may be understood as a state similar to a physical keyboard key being pressed from an initial state, but the corresponding key has not yet been triggered.

[0077] like Figure 2C As shown, after entering the pressed state of button 220 - 2 , the indicators of button 220 - 1 and button 220 - 3 may stop being presented accordingly, thereby helping the user to focus on the interaction with button 220 - 2 .

[0078] In the poking state, the distance from the indicator of button 220-2 (e.g., foreground frame 225 and interaction area 230) to button 220-2 may be positively correlated with the updated distance from target object 210 to button 220-2. For example, the updated distance may represent the current distance from the tip of the finger to button 220-2.

[0079] Exemplarily, when the target object 210 contacts the indicator (e.g., contacts the plane where the indicator is located), the distance from the indicator to the button 220-2 may always be equal to the distance from the target object 210 to the button 220-2, thereby achieving a dynamic effect in which the indicator follows the movement of the target object 210. For example, when it is determined that the distance from the target object 210 to the button 220-2 is equal to the distance from the indicator to the button 220-2, it can be determined that the target object 210 contacts the plane where the indicator is located. Accordingly, the indicator can present a dynamic effect of fitting the target object 210, similar to the state in which a physical button is pressed down by a finger.

[0080] Continue to refer Figure 2D , when the target object 210 continues to approach the button 220-2, the button 225 may enter the triggered state (also called the Armed state). Such a triggered state may be understood as a state similar to a physical keyboard key being pressed from an initial state to a triggered state. Exemplarily, after determining that the distance from the target object 210 to the button 220-2 is less than or equal to a predetermined threshold, the XR device 110 may determine that the button 220-2 enters the triggered state.

[0081] After entering the triggered state, the XR device 110 may, for example, adjust the display style of the button 220-2 to indicate that the button 220-2 is triggered. Figure 2D As shown, the pattern of the background area 235 of the button 220 - 2 may change to indicate that the button 220 - 2 is triggered (also called activated) or selected.

[0082] In some embodiments, after the button 220-2 is triggered, the target object 210 may move away from the button 220-2. At this time, the distance between the target object 210 and the button 220-2 may be less than the minimum distance for entering the hovering state, and the button 220-2 may enter the solution state accordingly.

[0083] The de-triggered state (also called the disarmed state) can be understood as a state similar to the state of a physical keyboard key from being triggered to not completely rebounding to the default state.

[0084] In some embodiments, in the release trigger state, similar to the poking state, the distance from the indicator to the button 220-2 may always be equal to the distance from the target object 210 to the button 220-2, thereby achieving a dynamic effect in which the indicator moves with the target object 210. For example, the indicator may protrude accordingly as the target object 210 moves away from the button 220-2, thereby presenting a state similar to that of a physical button rebounding with a finger after being pressed.

[0085] Furthermore, the target object 210 may continue to move away from the button 220 - 2 , and the button 220 - 2 may subsequently enter the hovering state until the idle state.

[0086] For information about the conversion of different display states of virtual objects, please refer to Figure 3 , Figure 3 Shown is a schematic diagram 300 illustrating transitions between interaction states according to some embodiments of the present disclosure.

[0087] like Figure 3 As described above, the virtual object may be configured to have one or more of the following display states and may switch between such display states: an idle state 310 , a hovering state 320 , a poked state 330 , a triggered state 340 , and a released triggered state 350 .

[0088] The switching logic between the display states may include, for example:

[0089] (1) Idle state 310: When the distance between the target object and the virtual object reaches an idle state threshold, the target object enters an idle state, which may present a default display style, for example.

[0090] (2) Hovering state 320: When the distance between the target object and the virtual object is less than the idle state threshold and greater than the hovering state threshold, the target object enters the hovering state, which may be presented as shown in the reference Figure 2B Discuss the interaction effects.

[0091] Accordingly, when the distance to the virtual object decreases to less than the idle state threshold and greater than the poking state threshold, the virtual object enters the hovering state from the idle state. Conversely, when the distance to the virtual object increases to reach the idle state threshold, the virtual object enters the idle state from the hovering state.

[0092] (3) Poking state 330: When the distance between the target object and the virtual object is less than or equal to the hovering state threshold and greater than the poking state threshold, the target object enters the poking state, which may be presented as shown in the reference Figure 2C Discuss the interaction effects.

[0093] Accordingly, when the distance to the virtual object decreases to less than or equal to the hovering state threshold, the virtual object enters the poking state from the hovering state.

[0094] When the hovering state threshold is reached, the virtual object enters the hovering state from the poking state.

[0095] (4) Trigger state 340: When the distance between the target object and the virtual object is less than or equal to the poking state threshold, the target object enters the trigger state, which may be presented as shown in the reference Figure 2D Discuss the interaction effects.

[0096] Accordingly, when the distance to the virtual object decreases to less than or equal to the poking state threshold, the virtual object enters the triggering state from the poking state. Conversely, when the distance to the virtual object increases to greater than the poking state threshold and the virtual object is deactivated, the virtual object enters the poking state from the triggering state.

[0097] (5) Release trigger state 350: When the distance between the target object and the virtual object increases to a value greater than the poking state threshold and less than or equal to the hovering state threshold, the target object enters the release trigger state.

[0098] Accordingly, when the distance to the virtual object increases to be greater than the poking state threshold and the virtual object remains activated, the virtual object enters the de-triggered state from the triggered state. Conversely, when the virtual object is already in the de-triggered state, if the distance from the detection target object to the virtual object decreases to be less than or equal to the poking state threshold, the virtual object may also enter the triggered state from the de-triggered state.

[0099] It should be understood that the display state switching process introduced above can be applied to any appropriate virtual object in the virtual scene, which may include but is not limited to: buttons, button groups, text, document paragraphs, input boxes, selectors, notification bars, label groups, operation tables, etc.

[0100] In some embodiments, different similar virtual objects may have different display states and / or different display logic in the same display state. For example, the interactive area may not be displayed in the indicator of some virtual objects that do not support menus.

[0101] In some embodiments, in the poking state, the XR device 110 may also receive other interactions of the target object 210. For example, when the virtual object is in the poking state and the sliding of the target object 210 is detected, the XR device 110 may control the virtual object to perform a horizontal or vertical slide.

[0102] In some embodiments, in the triggered state, the XR device 110, for example, further performs an operation similar to long pressing a virtual object according to the duration of the trigger state. Alternatively, in the triggered state, the XR device 110, for example, further performs an action of dragging a virtual object or an element in the virtual object according to the sliding of the target object, for example, to turn on or off a sliding switch. Alternatively, in the triggered state, P22071558501CN

[0103] The XR device 110 , for example, also performs selection of a virtual object according to a pinch action of the target object, or performs movement of a virtual object in a virtual scene in the case of pinch-drag.

[0104] In some embodiments, in the released trigger state, the XR device 110 performs a double-click operation on the virtual object, for example, according to re-entering the released trigger state within a predetermined time after entering the released trigger state.

[0105] Example interaction scenario 2

[0106] In some embodiments, in order to facilitate improving the realism of the interaction in the virtual scene, the XR device 110 may dynamically adjust the display angle of the virtual object in the virtual scene.

[0107] Figure 4 Schematic diagram 400 of an example interaction according to some embodiments of the present disclosure is shown. Figure 4As shown, the XR device 110 can present the virtual object 410 in the virtual scene at a first angle (e.g., 45 degrees). In some examples, such a first angle can be, for example, a default display angle of the virtual object 410, which can have different angle sizes according to different display designs.

[0108] In some embodiments, such a virtual object 410 may include, for example, an appropriate object in the virtual scene, such as a planar object with a certain thickness or without thickness. Such a first angle may, for example, indicate an angle between a display plane of the virtual object and a reference plane. Such a reference plane may, for example, be a reference horizontal plane in the virtual scene, or may also be a field of view plane of the current user in the virtual scene.

[0109] In some embodiments, the XR device 110 may detect whether the target object 420 for interaction comes into contact with the trigger area of ​​the virtual object 410. In some embodiments, the trigger area of ​​the virtual object 410 may include the trigger area of ​​the virtual object 410 as described above. FIG. 2A to FIG. 2D Regarding the indicator area discussed, the trigger area may, for example, protrude a certain distance relative to the virtual object 410 , and the distance may, for example, be dynamically determined based on the distance from the target object 420 to the virtual object 410 .

[0110] Regarding the dynamic change of the display style of the trigger area in the hovering state of the virtual object 410, please refer to the above discussion on the indicator, which will not be repeated here.

[0111] In some embodiments, the trigger area may also be located on the display plane of the target object 420. That is, contact with the trigger area is the release of the target object 420 itself.

[0112] Alternatively, the trigger area may also be parallel to the display plane and have a preset distance from the display plane, and may be presented or not presented in the virtual scene.

[0113] In some embodiments, the XR device 110 may detect that the target object 420 for interaction contacts the trigger area of ​​the virtual object 410. Accordingly, the XR device 110 may determine the distance between the target object 420 and the initial trigger area.

[0114] For example, when the target object 420 has contacted the trigger area of ​​the virtual object 410 and continues to press down on the virtual object 410, the XR device 110 may determine that the distance from the virtual object 410 to the trigger area is gradually increasing.

[0115] Accordingly, the XR device 110 may present the virtual object 410 at an updated second angle in the virtual scene. Figure 4 As an example, when the target object 420 gradually presses the virtual object 410 downward, the distance between the target object 420 and the trigger area gradually increases. Accordingly, the angle change of the updated second angle of the virtual object 410 relative to the first angle can gradually increase to be positively correlated with the distance. Exemplarily, the updated second angle can be 5 degrees, for example. For example, in the case of continued pressing, the second angle can continue to decrease, for example, the second angle can be reduced to 0 degrees at the minimum.

[0116] In some embodiments, the virtual object 410 may also have a minimum display angle, for example. Accordingly, the XR device 110 may present the virtual object at a second angle determined based on the distance only when it is determined that the distance from the target object 420 to the trigger area is less than a threshold.

[0117] In this case, the virtual object 410 may be, for example, only pressed but not yet activated, similar to the reference Figure 3 Accordingly, in this case, if it is detected that the target object 420 for interaction is released from contact with the trigger area, the XR device 110 can resume presenting the virtual object 410 at the first angle (eg, the initially set 45 degrees) in the virtual scene.

[0118] On the contrary, if the target object 420 continues to press the virtual object 410 and the distance between the target object and the trigger area reaches the threshold, the XR device 110 can present the virtual object 410 at a preset third angle in the virtual scene.

[0119] For example, Figure 4 As an example, if the virtual object 410 is configured with a minimum display angle (for example, 5 degrees), when the virtual object 410 has been adjusted to 5 degrees according to the distance, even if the target object 420 continues to be pressed, the display angle of the virtual object 410P22071558501CN will no longer change.

[0120] In some embodiments, the XR device 110 may also adjust the display style of the virtual object 410 to indicate that the virtual object is triggered. Figure 3 Regarding the trigger state discussed, the XR device 110 may, for example, also adjust the display style (eg, background style, foreground style, text style, etc.) of the virtual object 410 to indicate that the virtual object 410 has been triggered.

[0121] Accordingly, in this case, if it is detected that the target object 420 for interaction is released from contact with the trigger area, the XR device 110 can continue to present the virtual object 410 at a third angle (e.g., 5 degrees) in the virtual scene, thereby indicating that the virtual object 410 has been triggered. For example, when the target object 420 is lifted and away from the virtual object 410, the virtual object 410 will no longer be bounced up, but will still present a pressed display effect.

[0122] Based on the process discussed above, the embodiments of the present disclosure can more intuitively prompt the interaction status of the object based on the dynamic change of the angle, thereby helping the user to complete the interaction in the virtual scene more conveniently.

[0123] Example Process

[0124] Figure 5 1 is a flowchart of a process 500 for interacting in a virtual scene according to some embodiments of the present disclosure. The process 500 may be implemented at the computing device 120. Figure 1 Process 500 is described.

[0125] At block 510 , the computing device 120 determines a first distance of a target object for interaction to a first virtual object in a virtual scene.

[0126] At block 520 , the computing device 120 presents a first indicator of the first virtual object based on the first distance, wherein a second distance of the first indicator to the first virtual object is negatively correlated to the first distance.

[0127] In some embodiments, the virtual scene also includes a second virtual object, and process 500 also includes: determining a third distance from the target object to the second virtual object in the virtual scene, the third distance being greater than the first distance; and based on the third distance, presenting a second indicator of the second virtual object, wherein a fourth distance from the second indicator to the second virtual object is negatively correlated to the third distance, and the fourth distance is less than the second distance.

[0128] In some embodiments, the process 500 further includes: in response to the target object and the first indication P22071558501CN

[0129] When the distance between the two indicators is less than a threshold, stop presenting the second indicator of the second virtual object.

[0130] In some embodiments, determining the first distance includes: in response to a third virtual object existing within a preset distance of the first virtual object, determining a first distance from the target object to the first virtual object in the virtual scene.

[0131] In some embodiments, the first virtual object and the third virtual object constitute a button group, a tab group and / or an operation sheet.

[0132] In some embodiments, presenting the first indicator of the first virtual object includes: in response to the first distance being greater than a first threshold and less than a second threshold, presenting the first indicator of the first virtual object.

[0133] In some embodiments, process 500 also includes: determining an updated distance from the target object to a first virtual object in the virtual scene; and in response to the updated distance being less than or equal to a first threshold and greater than a third threshold, changing a second distance from the first indicator to the first virtual object based on the updated distance, so that the second distance is positively correlated with the update distance.

[0134] In some embodiments, process 500 further includes: in response to the update distance being less than or equal to a third threshold, adjusting a display style of the first virtual object to indicate that the first virtual object is triggered.

[0135] In some embodiments, the first indicator includes an interaction area, and process 500 further includes: in response to receiving a selection of the interaction area, presenting at least one interaction portal associated with the first virtual object.

[0136] Figure 6 FIG. 6 is a flowchart of a process 600 for interacting in a virtual scene according to some other embodiments of the present disclosure. The process 600 may be implemented at the computing device 120. Figure 1 Process 600 is described.

[0137] At block 610 , the computing device 120 presents a virtual object at a first angle in a virtual scene.

[0138] In block 620 , in response to detecting that the target object for interaction is in contact with the trigger area of ​​the virtual object, computing device 120 determines a distance from the target object to the trigger area.

[0139] At block 630 , the computing device 120 presents the virtual object at a second angle in the virtual scene such that an angular difference between the second angle and the first angle is positively correlated to the distance.

[0140] In some embodiments, the first angle indicates an angle of a display plane associated with the virtual object relative to a current user's field of view.

[0141] In some embodiments, the trigger area is parallel to the display plane and has P22071558501CN

[0142] The preset distance from the display plane.

[0143] In some embodiments, presenting the virtual object at the second angle in the virtual scene includes: in response to the distance being less than a fourth threshold, presenting the virtual object at the second angle determined based on the distance in the virtual scene.

[0144] In some embodiments, process 600 further includes: in response to detecting that the target object for interaction releases contact with the trigger area, presenting the virtual object at a first angle in the virtual scene.

[0145] In some embodiments, process 600 further includes: in response to the distance reaching a fourth threshold, presenting the virtual object at a preset third angle in the virtual scene.

[0146] In some embodiments, process 600 further includes: adjusting a display style of the virtual object to indicate that the virtual object is triggered.

[0147] In some embodiments, process 600 further includes: in response to detecting that the target object for interaction releases contact with the trigger area, presenting the virtual object at a third angle in the virtual scene.

[0148] Example devices and equipment

[0149] Figure 7 A schematic structural block diagram of an apparatus 700 for interacting in a virtual scene according to some embodiments of the present disclosure is shown. The apparatus 700 may be implemented as or included in a computing device 120. Each module / component in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0150] As shown in the figure, the apparatus 700 includes a first determining module 710 configured to determine a first distance from a target object for interaction to a first virtual object in a virtual scene.

[0151] The apparatus 700 further includes a first presentation module 720 configured to present a first indicator of the first virtual object based on the first distance, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

[0152] In some embodiments, the virtual scene further includes a second virtual object, and the first presentation module 720 is further configured to: determine a third distance from the target object to the second virtual object in the virtual scene, the third distance being greater than the first distance; and based on the third distance, present a second indicator of the second virtual object, wherein the second indicator is negatively correlated to the fourth distance of the second virtual object.

[0153] At the third distance, the fourth distance is smaller than the second distance.

[0154] In some embodiments, the first presentation module 720 is further configured to: in response to the distance between the target object and the first indicator being less than a threshold, stop presenting the second indicator of the second virtual object.

[0155] In some embodiments, the first determination module 710 is further configured to: in response to the presence of a third virtual object within a preset distance of the first virtual object, determine a first distance from the target object to the first virtual object in the virtual scene.

[0156] In some embodiments, the first virtual object and the third virtual object constitute a button group, a tab group and / or an operation sheet.

[0157] In some embodiments, the first presentation module 720 is further configured to present a first indicator of the first virtual object in response to the first distance being greater than a first threshold and less than a second threshold.

[0158] In some embodiments, the first presentation module 720 is also configured to: determine an updated distance from the target object to the first virtual object in the virtual scene; and in response to the updated distance being less than or equal to a first threshold and greater than a third threshold, change the second distance from the first indicator to the first virtual object based on the updated distance, so that the second distance is positively correlated with the update distance.

[0159] In some embodiments, the first presentation module 720 is further configured to: in response to the update distance being less than or equal to the third threshold, adjust the display style of the first virtual object to indicate that the first virtual object is triggered.

[0160] In some embodiments, the first indicator includes an interaction area, and the first presentation module 720 is further configured to: in response to receiving a selection of the interaction area, present at least one interaction portal associated with the first virtual object.

[0161] Figure 8 A schematic structural block diagram of an apparatus 800 for interacting in a virtual scene according to some other embodiments of the present disclosure is shown. The apparatus 800 may be implemented as or included in a computing device 120. Each module / component in the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0162] As shown in the figure, the device 800 includes a second rendering module 810, which is configured to present a virtual object at a first angle in a virtual scene; a second determination module 820, which is configured to determine the distance from the target object to the trigger area in response to detecting that the target object for interaction is in contact with the trigger area of ​​the virtual object; and a third rendering module 830, which is configured to

[0163] The virtual object is presented at a second angle such that an angular difference between the second angle and the first angle is positively correlated with the distance.

[0164] In some embodiments, the first angle indicates an angle of a display plane associated with the virtual object relative to a current user's field of view.

[0165] In some embodiments, the trigger area is parallel to the display plane, and the trigger area has a preset distance from the display plane.

[0166] In some embodiments, the third presentation module 830 is further configured to: in response to the distance being less than a fourth threshold, present the virtual object in the virtual scene at a second angle determined based on the distance.

[0167] In some embodiments, the third presentation module 830 is further configured to present the virtual object at a first angle in the virtual scene in response to detecting that the target object for interaction is released from contact with the trigger area.

[0168] In some embodiments, the third presentation module 830 is further configured to present the virtual object at a preset third angle in the virtual scene in response to the distance reaching a fourth threshold.

[0169] In some embodiments, the third presentation module 830 is further configured to: adjust the display style of the virtual object to indicate that the virtual object is triggered.

[0170] In some embodiments, the third presentation module 830 is further configured to present the virtual object at a third angle in the virtual scene in response to detecting that the target object for interaction is released from contact with the trigger area.

[0171] Fig. 9 A block diagram illustrating a computing device 900 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that Fig. 9 The computing device 900 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig. 9 The computing device 900 shown may be used to implement Figure 1 A computing device 120 is provided.

[0172] like Fig. 9 As shown, computing device 900 is in the form of a general-purpose computing device. Components of computing device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit 910 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 920. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve computing performance.

[0173] The parallel processing capability of computing device 900 is utilized.

[0174] The computing device 900 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the computing device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 900.

[0175] The computing device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig. 9 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 920 may include a computer program product 925 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0176] The communication unit 940 enables communication with other computing devices via a communication medium. Additionally, the functions of the components of the computing device 900 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0177] Input device 950 may be one or more input devices, such as a mouse, keyboard, tracking ball, etc. Output device 960 may be one or more output devices, such as a display, a speaker, a printer, etc. Computing device 900 may also communicate with one or more external devices (not shown) through communication unit 940 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow users to interact with computing device 900, or communicate with any device that allows computing device 900 to communicate with one or more other computing devices.

[0178] Any device (e.g., network card, modem, etc.) can communicate. Such communication can be performed via an input / output (I / O) interface (not shown).

[0179] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0180] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0181] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0182] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0183] The flowcharts and block diagrams in the accompanying drawings show possible architectures, functions, and operations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a portion of an instruction.

[0184] In some embodiments, a module, a program segment or a part of an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0185] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for interacting in a virtual scene, comprising: Determine a first distance from a target object for interaction to a first virtual object in a virtual scene; as well as Based on the first distance, a first indicator of the first virtual object is presented, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

2. The method according to claim 1, wherein the virtual scene further comprises a second virtual object, the method further comprising: Determine a third distance from the target object to the second virtual object in the virtual scene, wherein the third distance is greater than the first distance; as well as Based on the third distance, a second indicator of the second virtual object is presented, wherein a fourth distance from the second indicator to the second virtual object is negatively correlated to the third distance, and the fourth distance is smaller than the second distance.

3. The method according to claim 2, further comprising: In response to the distance between the target object and the first indicator being less than a threshold, stopping presenting the second indicator of the second virtual object.

4. The method of claim 1 , wherein determining the first distance comprises: In response to a third virtual object existing within a preset distance of the first virtual object, the first distance from the target object to the first virtual object in the virtual scene is determined. 5 . The method according to claim 4 , wherein the first virtual object and the third virtual object constitute a button group, a label group and / or an operation table.

6. The method of claim 1, wherein presenting a first indicator of the first virtual object comprises: In response to the first distance being greater than a first threshold and less than a second threshold, presenting the first indicator of the first virtual object.

7. The method according to claim 6, further comprising: Determining an updated distance from the target object to the first virtual object in the virtual scene; as well as In response to the updated distance being less than or equal to the first threshold and greater than a third threshold, the second distance from the first indicator to the first virtual object is changed based on the updated distance so that the second distance is positively correlated with the updated distance.

8. The method according to claim 7, further comprising: In response to the update distance being less than or equal to the third threshold, adjusting the display style of the first virtual object to indicate that the first virtual object is triggered.

9. The method of claim 1, wherein the first indicator comprises an interactive area, the method further comprising: In response to receiving a selection of the interaction area, at least one interaction portal associated with the first virtual object is presented.

10. A method for interacting in a virtual scene, comprising: presenting a virtual object at a first angle in a virtual scene; In response to detecting that a target object for interaction contacts a trigger area of ​​the virtual object, determining a distance from the target object to the trigger area; as well as The virtual object is presented at a second angle in the virtual scene, such that an angular difference between the second angle and the first angle is positively correlated with the distance.

11. The method according to claim 10, wherein the first angle indicates an angle of a display plane associated with the virtual object relative to a reference plane, the trigger area is parallel to the display plane, and the trigger area has a preset distance to the display plane.

12. The method of claim 10, wherein presenting the virtual object at a second angle in the virtual scene comprises: In response to the distance being less than a fourth threshold, presenting the virtual object in the virtual scene at the second angle determined based on the distance.

13. The method according to claim 12, further comprising: In response to detecting that the target object for interaction is released from contact with the trigger area, presenting the virtual object at the first angle in the virtual scene.

14. The method according to claim 12, further comprising: In response to the distance reaching the fourth threshold, presenting the virtual object at a preset third angle in the virtual scene.

15. The method according to claim 14, further comprising: The display style of the virtual object is adjusted to indicate that the virtual object is triggered.

16. The method according to claim 14, further comprising: In response to detecting that the target object for interaction is released from contact with the trigger area, presenting the virtual object at the third angle in the virtual scene.

17. A device for interacting in a virtual scene, comprising: A first determining module is configured to determine a first distance from a target object for interaction to a first virtual object in a virtual scene; as well as The first presentation module is configured to present a first indicator of the first virtual object based on the first distance, wherein a second distance from the first indicator to the first virtual object is negatively correlated to the first distance.

18. A device for interacting in a virtual scene, comprising: A second presentation module is configured to present the virtual object at a first angle in the virtual scene; A second determination module is configured to determine a distance from the target object to the trigger area in response to detecting that the target object for interaction is in contact with the trigger area of ​​the virtual object; as well as The third presentation module is configured to present the virtual object at a second angle in the virtual scene, so that the angle difference between the second angle and the first angle is positively correlated with the distance.

19. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform a method according to any one of claims 1 to 9 or 10 to 16.

20. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 9 or 10 to 16.