Interaction method and apparatus in virtual scene, device, and storage medium

Abstract

According to embodiments of the present disclosure, provided are an interaction method and apparatus in a virtual scene, a device, and a storage medium. The method comprises: presenting a livestreaming picture of a livestreaming room in a virtual scene; in response to detecting a first gesture in the virtual scene, presenting, in the virtual scene, a virtual interactive object associated with the first gesture, the virtual interactive object being associated with a target interactive resource in the livestreaming room; at least on the basis of the first gesture, controlling the virtual interactive object to perform a target motion process in the virtual scene; and triggering an interactive event, in the livestreaming room, associated with the target interactive resource. Thus, the interaction effect of a user in a virtual scene can be enriched, and the interaction experience is improved.

Description

An interaction method, device and equipment in a virtual scene and a storage medium

[0001] The present application claims priority to the Chinese patent application No. 202410869800.0, filed on June 28, 2024, entitled "An interaction method, device and equipment in a virtual scene and a storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The example embodiments of the present disclosure generally relate to the field of computers, and in particular, to an interaction method, device and equipment in a virtual scene and a computer readable storage medium. BACKGROUND

[0003] Extended Reality (XR) technology includes Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). The way a user interacts with a virtual interactive object in a virtual scene of an XR product greatly affects the user's interactive experience with the virtual scene. SUMMARY

[0004] In a first aspect of the present disclosure, an interaction method of a virtual scene is provided. The method comprises: presenting a live picture of a live room in the virtual scene; in response to detecting a first gesture in the virtual scene, presenting a virtual interactive object associated with the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource in the live room; controlling the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture; and triggering an interactive event associated with the target interactive resource in the live room.

[0005] In a second aspect of the present disclosure, an interaction device in a virtual scene is provided. The device comprises: a live picture presentation module configured to present a live picture of a live room in the virtual scene; a virtual interactive object presentation module configured to present a virtual interactive object associated with a first gesture in the virtual scene in response to detecting the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource in the live room; a virtual interactive object control module configured to control the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture; and an interactive event triggering module configured to trigger an interactive event associated with the target interactive resource in the live room.

[0006] In a third aspect of the disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the disclosure, a computer program product is provided. The computer program product includes computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method of the first aspect.

[0009] It is to be understood that the description in this summary section is not intended to define key or essential features of embodiments of the disclosure or to limit the scope of the disclosure. Other features of the disclosure will be apparent from review of the description below in conjunction with the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description in conjunction with the accompanying drawings. In the drawings, like reference numerals denote like elements, in which:

[0011] FIG. 1 shows a schematic diagram of a plurality of example environments in which embodiments of the present disclosure can be implemented;

[0012] FIGS. 2A-2F show schematic diagrams of a plurality of examples of a user interacting with a virtual interactive object in a virtual scene, according to some embodiments of the present disclosure;

[0013] FIG. 3 shows schematic diagrams of a plurality of examples of a like in a virtual scene, according to some embodiments of the present disclosure;

[0014] FIG. 4 shows a flowchart of an interaction process in a virtual scene, according to some embodiments of the present disclosure;

[0015] FIG. 5 shows a block diagram of an apparatus for presenting content in a virtual scene, according to some embodiments of the present disclosure; and

[0016] FIG. 6 shows a block diagram of a device capable of implementing a plurality of embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the use range, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0018] For example, in response to receiving an active request of a user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using personal information of the user. Thus, the user can autonomously select whether to provide personal information to the software or hardware such as an electronic device, an application program, a server or a storage medium, etc. performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0019] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information may be presented in the form of text in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0020] It can be understood that the above notification and obtaining of user authorization process is only illustrative, and does not limit the implementation manner of the present disclosure, and other manners meeting relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0021] It can be understood that the data involved in the present technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of relevant laws and regulations and relevant provisions.

[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms, and should not be interpreted as being limited to the embodiments set forth herein, rather, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the scope of protection of the present disclosure.

[0023] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiment described in the same section / subsection and / or a different section / subsection in any manner.

[0024] In the description of embodiments of the disclosure, the term "includes" and its similar terms are understood to be open-ended, i.e., "includes but is not limited to". The term "based on" is understood to be "based, at least in part, on". The term "one embodiment" or "the embodiment" is understood to be "at least one embodiment". The term "some embodiments" is understood to be "at least some embodiments". Other explicit or implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or same objects. Other explicit and implicit definitions can also be included below.

[0025] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, when implementing embodiments of the disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations. The specific notification and / or authorization mode can vary according to the actual situation and application scenario, and the scope of the disclosure is not limited in this respect.

[0026] In the schemes in the specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality basis (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. The user refuses to process personal information other than the necessary information required for basic functions, which does not affect the user's use of basic functions.

[0027] As briefly mentioned above, in the virtual scene of the XR product, the way of interaction between the user and the virtual object greatly affects the user's interactive experience with the virtual scene. XR technology includes virtual reality technology (VR), augmented reality technology (AR) and mixed reality technology (MR). XR technology uses hardware devices combined with various software technology means to present virtual scenes or fuse virtual content and real scenes, so that people's interaction mode changes from 2D interaction to 3D interaction. VR technology, for example, uses a head-mounted device to simulate a 3D interactive scene of the real world. AR technology, for example, superimposes various information and images onto the real world through electronic devices such as mobile phones, tablets, glasses, etc. MR technology is between VR technology and AR technology, and uses digital technology to realize real-time interaction in a complex scene between the virtual world, the real world and the user.

[0028] In some products, an interactive interface is still presented in a display device in a two-dimensional manner, and various virtual interactive objects in the interactive interface are also presented in the display device in a two-dimensional manner. When a user interacts with an interactive prop, the user can only interact with a virtual interactive object through a single operation (for example, a click), and the user experience of this interaction manner is poor.

[0029] Embodiments of the present disclosure propose an interaction scheme in a virtual scene. According to various embodiments of the present disclosure, a live picture of a live room is presented in a virtual scene; in response to detecting a first gesture in the virtual scene, a virtual interactive object associated with the first gesture is presented in the virtual scene, the virtual interactive object being associated with a target interactive resource in the live room; at least based on the first gesture, the virtual interactive object is controlled to perform a target motion process in the virtual scene; and an interactive event associated with the target interactive resource in the live room is triggered.

[0030] Based on such a manner, embodiments of the present disclosure can improve the interactive experience of a user in a virtual scene by enriching the interaction effect of the user with various components in the virtual scene.

[0031] Example implementations of the present disclosure will be described below with reference to the accompanying drawings.

[0032] Example environment

[0033] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. A user 140 in the environment 100 wears an XR device 110. The XR device 110 communicates with a computing device 120 to reconstruct a virtual scene for the user 140 or to fuse virtual content and a real scene. In the present disclosure, a virtual scene reconstructed based on VR technology, and a scene in which virtual content and a real scene are fused based on AR technology or MR technology, are collectively referred to as a virtual scene 130.

[0034] The XR device 110 can be a head-mounted or wearable near-eye display device, such as a head-mounted display, smart glasses, etc., supporting VR, AR, MR, etc. technology. The XR device 110 can include an image generation component and an optical display component for reconstructing the virtual scene 130 and displaying virtual objects in a monocular or binocular field of view. The virtual objects can include three-dimensional virtual objects and / or two-dimensional virtual objects, and the two-dimensional virtual objects can include two-dimensional windows without thickness for presenting various content in the virtual scene 130 like an electronic screen. For example, a display block in the virtual scene 130. The display block can be a window for loading web pages, documents, etc. content, also known as a “facelet”.

[0035] In some embodiments, the computing device 120 can determine the relative position between the hand of the user 130 (or its corresponding virtual hand) and the virtual object. The computing device 120 can be a separate device capable of communicating with the XR device 110 and / or other image capturing devices, such as a server, a computing node, etc. for image or data processing, or can be integrated with the XR device 110 and / or other image capturing devices. In some embodiments, the computing device 120 can be implemented as the XR device 110, i.e., in this case, the XR device 110 can implement all the functions of the computing device 120. It should be appreciated that the above description of the computing device 120 is merely exemplary and not limiting, and the computing device 120 can be implemented as a device in multiple forms, structures or categories, and the embodiments of the present disclosure are not limited in this regard.

[0036] It should be appreciated that the structure and function of the environment 100 are described for illustrative purposes only, and are not intended to imply any limitation on the scope of the present disclosure.

[0037] Some example embodiments of the present disclosure will be described below with continued reference to the drawings.

[0038] Interaction Examples

[0039] FIGS. 2A-2F show schematic diagrams of an example 200A, an example 200B, an example 200C, an example 200D, an example 200E, and an example 200F of interaction of a user with a virtual interactive object in a virtual scene, in accordance with some embodiments of the present disclosure. The example 200A, the example 200B, the example 200C, the example 200D, the example 200E, and the example 200F can be implemented at the computing device 120. The example 200A, the example 200B, the example 200C, the example 200D, the example 200E, and the example 200F are described below with reference to FIG. 1.

[0040] The computing device 120 can construct the window 210, the window 240, and the window 250 as shown in FIG. 2A in the virtual scene 130. In a VR scene, the computing device 120 can also render a virtual hand 260 as shown in FIG. 2B to represent the hand of the user 140, for example. Such a virtual hand 260 can be rendered based on tracking the hand of the user 140, so that gestures made by the user 140 can be detected and represented by the movement of the virtual hand 260 in the virtual scene 130. It should be appreciated that any appropriate way such as image recognition, sensor positioning, etc. can be employed to detect the hand actions of the operator, and the present disclosure is not intended to be limited in this regard.

[0041] It should be appreciated that in an AR scenario, the virtual hand 260 can also not be rendered, and the user 140 can directly interact with the window 210, the window 240, or the window 250 in the virtual scene 130 through the hand. For example, the window 210, the window 240, and the window 250 can be virtual objects superimposed in the real field of view of the user 140. The user 140 can interact with the window through a gesture. For the convenience of description only, the disclosure describes embodiments of the disclosure in conjunction with a VR scenario as an example.

[0042] In some embodiments, the computing device 120 can present a live picture of the live room in the virtual scene.

[0043] Specifically, the computing device 120 can present a live window in the virtual scene to present the live picture, or present the live picture as a background of the virtual scene.

[0044] As an example, as shown in FIG. 2A, the computing device 120 obtains the content 220 associated with the window 210 and presents the content 220 at the window 210. The window 210 can load a document, a webpage, a picture, a video, a live picture, or the like. The computing device 120 presents a window 250 in the virtual scene while presenting the live picture of the live room, and the window 250 at least includes an interactive unit 250-1 for calling out a resource selection component.

[0045] As another example, as shown in FIG. 2A, the window 210 can be a live interface, for example. The live content in the window 210 can be received by the computing device 120 from the cloud, or directly received by the computing device 120 from another computing device.

[0046] The computing device 120 can obtain a set of content 230 related to the content currently presented by the window 210, and render a window 240 corresponding to the set of content 230 in the virtual scene 130. The window 240 can be a viewing window of live bullet screen and / or a virtual object given, which can support the user 140 to present the live bullet screen and / or the given virtual object related to the content currently presented by the window 210 in the form of preview. For example, the window 240 can only present the live bullet screen in the order of time of publishing the live bullet screen. The window 240 can also present the live bullet screen and the given virtual object in the order of time of publishing the live bullet screen and the given virtual object, and present the live bullet screen and the given virtual object at different positions of the window 240.

[0047] In some embodiments, the computing device 120 presents a virtual interactive object associated with the first gesture in the virtual scene in response to detecting the first gesture in the virtual scene, and the virtual interactive object is associated with a target interactive resource in the live room.

[0048] In particular, the computing device 120 presents a resource selection component in the virtual scene, the resource selection component presents a set of interface elements corresponding to a set of candidate interactive resources; detects a first gesture associated with a target interface element in the set of interface elements, the target interface element corresponds to a target interactive resource; in response to detecting the first gesture, presents a virtual interactive object in the virtual scene.

[0049] Further, the computing device 120 adjusts a display style of the target interface element in the resource selection component in response to detecting the first gesture.

[0050] As an example, as shown in FIGS. 2B and 2C, the virtual hand 260 can point to the interactive element 250-1 by a gesture for selecting the interactive element 250-1. Additionally or alternatively, the computing device 120 detects the gesture of the virtual hand 260 and generates a virtual ray 280 for assisting the virtual hand 260 to interact with any interactive element in the window 250, such as the control 251. Optionally, the virtual ray 280 is invisible to the user 140 for enhancing the immersion of the user 140 in the virtual scene.

[0051] When the virtual hand 260 points to or selects the interactive element 250-1 in the window 250 by the first gesture, the resource selection component 270 is presented. The resource selection component 270 presents a set of interface elements corresponding to a set of candidate interactive resources.

[0052] As an example, as shown in FIG. 2D, the virtual hand 260 can point to or select the interface element 270-1 in the resource selection component 270 by the first gesture. At this time, the interface element 270-1 in the virtual scene is enlarged for presenting a virtual interactive object corresponding to the interface element 270-1 in the virtual scene. Also, when the virtual hand 260 selects the interface element 270-1, an interactive button is presented under the virtual interactive object corresponding to the interface element 270-1. It is noted that the interface element 270-1 can also be highlighted or bolded by other ways for drawing attention after the interface element 270-1 is selected.

[0053] As another example, as shown in FIG. 2E, the computing device 120 switches the currently selected interface element when receiving a gesture transformation instruction of the virtual hand 260. For example, the currently selected interface element is 270-1, and the computing device 120 switches the currently selected interface element to the target interface element 270-2 when receiving the gesture transformation instruction of the virtual hand 260. After switching the currently selected interface element, the target interface element 270-2 is enlarged, and the interface element 270-1 returns to the original size.

[0054] In some embodiments, the computing device 120 controls the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture.

[0055] Specifically, the computing device 120 changes the position and / or pose of the virtual interactive object in the virtual scene based on the first gesture. It should be understood that the first gesture can be pinching, fist clenching, or other gestures, and the specific gesture type can be limited according to the needs of those skilled in the art, and the present disclosure is not intended to be limited in this regard.

[0056] As an example, as shown in FIGS. 2E and 2F, after selecting the virtual interactive object 270-3 corresponding to the target interface element 270-2, the virtual hand 260 can drag the virtual interactive object 270-3 to any position in the virtual scene while maintaining the pinching gesture. In addition, the computing device 120 can also change the pose of the virtual interactive object 270-3 based on the received gesture instructions when receiving other gesture instructions of the virtual hand 260. For example, when the computing device 120 receives a rotating gesture instruction, the virtual interactive object 270-3 will change its pose in the direction of rotation.

[0057] In some embodiments, the computing device 120 can trigger an interactive event associated with the target interactive resource in the live room.

[0058] Specifically, the computing device 120 presents an interactive control associated with the candidate interactive resource in response to the end of the target motion process, and triggers an interactive event associated with the target interactive resource in the live room in response to a preset interaction with the interactive control.

[0059] The above-mentioned interactive event includes a virtual gift giving event in the live room, and the target interactive resource includes a virtual gift resource.

[0060] As an example, as shown in FIG. 2F, when the motion of the virtual interactive object 270-3 stops, an interactive button for giving gifts is presented below the virtual interactive object 270-3. When the user clicks on the interactive button, a gift is given to the live room.

[0061] Like example of a virtual scene

[0062] In some embodiments, presenting the virtual interactive object associated with the first gesture in the virtual scene includes presenting the virtual interactive object at a first position associated with the first gesture in the virtual scene. Here, the interactive event includes a quick interactive event in the live room, such as a like event and / or an expression sending event, and the target interactive resource includes a display resource corresponding to the like event and / or an expression resource.

[0063] As an example, as shown in FIG. 3, the virtual hand 260 can present a virtual interactive object 263 at a first position in the virtual scene 130 by a pinch gesture to like the current live room.

[0064] The first position can be limited according to the needs of those skilled in the art, or can not be limited. Without limiting the first position, the virtual hand 260 can present the virtual interactive object 263 by the first gesture at any position in the virtual scene 130.

[0065] The first gesture here can be a single pinch gesture or a continuous pinch gesture. When the computing device 120 receives a single pinch gesture, only one virtual interactive object is presented at the starting point of the pinch gesture. When the computing device 120 receives a continuous pinch gesture, multiple virtual interactive objects are presented at the starting point of the pinch gesture.

[0066] In some embodiments, the interaction method in the virtual scene includes: presenting a live picture of a live room in the virtual scene; in response to detecting a first gesture in the virtual scene, presenting a virtual interactive object associated with the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource in the live room; controlling the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture or at least on a third gesture; and triggering an interaction event associated with the target interactive resource in the live room. The third gesture can be different from the first gesture.

[0067] In some embodiments, the third gesture can be different from the first gesture based at least on the first gesture or at least on the third gesture to control the virtual interactive object to perform the target motion process in the virtual scene. For example, the first gesture is a pinch gesture, and the second gesture is a sliding gesture, of course, not limited to this. In some embodiments, controlling the virtual interactive object to perform the target motion process in the virtual scene includes: controlling the virtual interactive object to start performing the target motion process from a first position. For example, the virtual interactive object starts performing the target motion process from the first position based on the first gesture or the third gesture.

[0068] In some embodiments, the target motion process includes a movement process from the first position to a second position of the live picture. For example, the virtual interactive object performs the movement process from the first position to the second position of the live picture based on the first gesture or the third gesture. The virtual interactive object spontaneously moves from the first position to the second position, enriches the interaction effect, and further improves the interaction experience between the user and the virtual scene.

[0069] As shown in FIG. 3, when the virtual interactive object 263 is presented, the virtual interactive object 263 is assigned an initial speed. Thereafter, the virtual interactive object 263 can start to move in the initial motion direction at the initial speed from the pinch gesture of the virtual hand 260. For example, the virtual interactive object 263 moves at a speed of 5 cm / s to the center point of the window 210. It should be understood that the initial speed and the initial motion direction herein can be set according to the needs of those skilled in the art, and the present application does not limit this.

[0070] In some embodiments, controlling the virtual interactive object to perform the target motion process in the virtual scene based at least on the first gesture includes: in response to detecting a second gesture associated with the virtual interactive object, changing the moving process from the first position to the second position based on the second gesture.

[0071] For example, when the virtual interactive object is in the target motion process, the user can intervene in the moving process of the virtual interactive object through a second gesture to change the moving track of the virtual interactive object from the first position to the second position. The second gesture herein can be a pat, a click, or other gestures.

[0072] It should be noted that when the moving track of the virtual interactive object changes, the motion speed of the virtual interactive object can be changed accordingly to ensure that the time required for the target moving process does not change. However, it should be noted that although the moving track of the virtual interactive object changes, the starting point and the ending point of the moving process of the virtual interactive object are still the first position and the second position.

[0073] In summary, the embodiments of the present disclosure propose an interaction scheme of a virtual scene. According to various embodiments of the present disclosure, the position or posture of a virtual interactive object in a virtual scene can be changed based on a gesture of a user. Thus, the embodiments of the present disclosure can enrich the interaction effect between the user and the virtual interactive object, improve the interaction enthusiasm of the user for the virtual interactive object, and improve the interaction experience of the user in the virtual scene. In addition, by presenting multiple virtual interactive objects at the gesture position in the virtual scene, the embodiments of the present disclosure can also guide the user to more actively perform a quick interaction operation.

[0074] Example processes

[0075] FIG. 4 shows a flowchart of an interaction process 400 in a virtual scene according to some embodiments of the present disclosure. The process 400 can be implemented at the computing device 120. The process 400 is described below with reference to FIG. 1.

[0076] At block 410, the computing device 120 presents a live picture of a live room in a virtual scene.

[0077] At block 420, the computing device 120 presents, in the virtual scene, a virtual interactive object associated with the first gesture in response to detecting the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource within the live room.

[0078] At block 430, the computing device 120 controls the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture.

[0079] At block 440, the computing device 120 triggers an interactive event associated with the target interactive resource within the live room.

[0080] In some embodiments, to present, in the virtual scene, the virtual interactive object associated with the first gesture, the computing device 120 presents, in the virtual scene, a resource selection component that presents a set of interface elements corresponding to a set of candidate interactive resources; detects the first gesture associated with a target interface element of the set of interface elements, the target interface element corresponding to the target interactive resource; and presents, in the virtual scene, the virtual interactive object in response to detecting the first gesture.

[0081] In some embodiments, to control the virtual interactive object to perform the target motion process in the virtual scene based at least on the first gesture, the computing device 120 changes a position and / or a pose of the virtual interactive object in the virtual scene based on the first gesture.

[0082] In some embodiments, to trigger the interactive event associated with the target interactive resource within the live room, the process 400 further includes: presenting, in response to the target motion process ending, an interactive control associated with the candidate interactive resource; and triggering, in response to a preset interaction on the interactive control, the interactive event associated with the target interactive resource within the live room.

[0083] In some embodiments, the process 400 further includes: adjusting, in response to detecting the first gesture, a display style of the target interface element in the resource selection component.

[0084] In some embodiments, the interactive event includes a virtual gift-giving event in the live room, and the target interactive resource includes a virtual gift resource.

[0085] In some embodiments, to present, in the virtual scene, the virtual interactive object associated with the first gesture, the computing device 120 presents the virtual interactive object at a first position in the virtual scene associated with the first gesture.

[0086] In some embodiments, to control the virtual interactive object to perform the target motion process in the virtual scene based at least on the first gesture, the computing device 120 can control the virtual interactive object to perform the target motion process starting from the first position.

[0087] In some embodiments, the target motion process includes a movement process from a first position to a second position of the live picture.

[0088] In some embodiments, to control the virtual interactive object to perform the target motion process in the virtual scene based at least on the first gesture, the computing device 120 can change, in response to detecting a second gesture associated with the virtual interactive object, the movement process from the first position to the second position based on the second gesture.

[0089] In some embodiments, the interactive event includes a like event and / or an expression sending event in the live room, and the target interactive resource includes a display resource corresponding to the like event and / or an expression resource.

[0090] In some embodiments, to present the live picture of the live room in the virtual scene, the computing device 120 can present a live window in the virtual scene to present the live picture; or present the live picture as a background of the virtual scene.

[0091] Example apparatuses and devices

[0092] FIG. 5 illustrates a schematic structural block diagram of an interaction apparatus 500 in a virtual scene, according to certain embodiments of the present disclosure. The apparatus 500 can be implemented as or included in the computing device 120. Various modules / components in the apparatus 500 can be implemented by hardware, software, firmware, or any combination thereof.

[0093] As shown, the apparatus 500 includes a live picture presentation module 510 configured to present a live picture of a live room in a virtual scene; a virtual interactive object presentation module 520 configured to present, in response to detecting a first gesture in the virtual scene, a virtual interactive object associated with the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource within the live room; a virtual interactive object control module 530 configured to control the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture; and an interactive event triggering module 540 configured to trigger an interactive event associated with the target interactive resource within the live room.

[0094] In some embodiments, the virtual interactive object presentation module 520 is further configured to: present, in the virtual scene, a resource selection component, the resource selection component presenting a set of interface elements corresponding to a set of candidate interactive resources; detect the first gesture associated with a target interface element in the set of interface elements, the target interface element corresponding to the target interactive resource; and present, in response to detecting the first gesture, the virtual interactive object in the virtual scene.

[0095] In some embodiments, the virtual interactive object control module 530 is further configured to change the position and / or pose of the virtual interactive object in the virtual scene based on the first gesture.

[0096] In some embodiments, the interactive event trigger module 540 is further configured to: in response to the end of the target motion process, present an interactive control associated with the candidate interactive resource; and in response to a preset interaction on the interactive control, trigger the interactive event associated with the target interactive resource in the live room.

[0097] In some embodiments, the apparatus 500 further includes an interface element style adjustment module 550 configured to adjust a display style of the target interface element in the resource selection component in response to detecting the first gesture.

[0098] In some embodiments, the interactive event includes a virtual gift gifting event in the live room, and the target interactive resource includes a virtual gift resource.

[0099] In some embodiments, the virtual interactive object presentation module 520 is further configured to present the virtual interactive object at a first position in the virtual scene associated with the first gesture.

[0100] In some embodiments, the virtual interactive object control module 530 is further configured to control the virtual interactive object to perform the target motion process starting from the first position.

[0101] In some embodiments, the target motion process includes a movement process from the first position to a second position of the live picture.

[0102] In some embodiments, the virtual interactive object control module 530 is further configured to change the movement process from the first position to the second position based on a second gesture associated with the virtual interactive object in response to detecting the second gesture.

[0103] In some embodiments, the interactive event includes a like event and / or an expression sending event in the live room, and the target interactive resource includes a display resource corresponding to the like event and / or an expression resource.

[0104] In some embodiments, the live picture presentation module 510 is further configured to present a live window in the virtual scene to present the live picture, or present the live picture as a background of the virtual scene.

[0105] FIG. 6 illustrates a block diagram of a computing device 600 in which a number of embodiments of the present disclosure can be implemented. It should be understood that the computing device 600 illustrated in FIG. 6 is merely exemplary and should not be construed as limiting on the functionality and scope of the embodiments described herein. The computing device 600 illustrated in FIG. 6 can be used to implement the computing device 120 of FIG. 1.

[0106] As shown in FIG. 6, computing device 600 is in the form of a general-purpose computing device. Components of computing device 600 can include, but are not limited to, one or more processors or processing units 610, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit(s) 610 can be actual or virtual processors and capable of executing various processing in accordance with programs stored in memory 620. In a multi-processing system, multiple processing units execute computer-executable instructions in parallel to improve the processing power of computing device 600.

[0107] Computing device 600 typically includes a plurality of computer storage media. Such media can be volatile and nonvolatile media and removable and non-removable media implemented in any method or technology for storage of information such as program modules, data, and / or data structures. Memory 620 can be volatile (such as register, cache, and / or random access memory (RAM)), non-volatile (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or flash memory), or some combination thereof. Storage device 630 can be a removable or non-removable media implemented in any method or technology for storage of information such as program modules, training data for training, and / or data. Storage device 630 can be accessed by computing device 600 via one or more data media interfaces.

[0108] Computing device 600 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 6, a disk drive and / or disk drives can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile media such as a floppy disk, a ZIP® disk, a magnetic tape, or an optical disk, for example. In these cases, each drive can be connected to the bus by one or more data media interfaces. Memory 620 can include computer program product 625 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0109] Communication unit(s) 640 enable communication over communication media to other computing devices. Additionally, the functionality of components of computing device 600 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. Thus, computing device 600 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in a distributed environment.

[0110] Input device 650 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. Output device 660 can be one or more output devices, such as a display, a speaker, a printer, etc. Computing device 600 can also include, as desired, other input devices (not shown), such as a microphone, a joystick, etc., and other output devices (not shown), such as a printer, etc. Computing device 600 can also be connected to one or more external devices (not shown), such as a storage device, a display device, etc., through communication interface 640, as desired. It will be appreciated that the specific

[0111] According to an example implementation of the present disclosure, a computer-readable storage medium is provided having computer-executable instructions stored thereon, where the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, where the computer-executable instructions are executed by a processor to implement the method described above.

[0112] Various aspects of the disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, and computer program products according to implementations of the disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0113] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including a processor executable program of instructions implement functions / acts specified in the flowchart and / or block diagram block or blocks.

[0114] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0115] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can be one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can also be at least one or combination of controller(s) with associated computer program component(s), the computer program component(s) being an example of computer program product.

[0116] Various implementations of the disclosure have been described in detail above. The foregoing description is exemplary and explanatory only, and is not intended to be exhaustive or to limit various implementations of the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings without departing from the scope and spirit of the disclosure. It is intended that the scope of the disclosure be limited only by the claims and the equivalents thereof. The terms "comprise," "include," and "have," as well as variations thereof, are intended to be inclusive in a manner that the term does not exclude additional elements or steps. The terms "another" and "one or more" are defined as at least one and include any one or more. The terms "comprise," "comprising," "include," "including," "have," "has," "contain," "containing," "characterized by," "including the features of," "including the steps of," and the like are used inclusively and not with excluding further elements or steps. The terms "a," "an," and "the" are defined as one or more and include the singular and plural form. The terms "exemplary," "for example," and "e.g." are used to provide examples and not to limit the scope of the disclosure. The terms "about" and "substantially" are defined as approximately and include the exact value.

Claims

1. An interaction method in a virtual scene, comprising: Presenting the live stream footage of the live streaming room in a virtual environment; In response to detecting a first gesture in the virtual scene, a virtual interactive object associated with the first gesture is presented in the virtual scene, the virtual interactive object being associated with a target interactive resource within the live stream; Based at least on the first gesture, the virtual interactive object is controlled to perform a target movement process in the virtual scene; as well as Trigger interactive events within the live stream that are associated with the target interactive resource.

2. The method of claim 1, wherein presenting a virtual interactive object associated with the first gesture in the virtual scene comprises: A resource selection component is presented in the virtual scene, and the resource selection component presents a set of interface elements corresponding to a set of candidate interactive resources; Detect the first gesture associated with a target interface element in the set of interface elements, the target interface element corresponding to the target interactive resource; as well as In response to detecting the first gesture, the virtual interactive object is presented in the virtual scene.

3. The method according to claim 2, wherein controlling the virtual interactive object to perform a target movement process in the virtual scene based at least on the first gesture comprises: Based on the first gesture, the position and / or posture of the virtual interactive object in the virtual scene are changed.

4. The method according to claim 3, wherein triggering the interactive event associated with the target interactive resource within the live stream further includes: In response to the end of the target motion process, an interactive control associated with the candidate interactive resource is presented; as well as In response to a preset interaction with the interactive control, the interactive event associated with the target interactive resource within the live stream is triggered.

5. The method according to claim 2, further comprising: In response to detecting the first gesture, the display style of the target interface element in the resource selection component is adjusted.

6. The method according to claim 2, wherein the interactive event includes a virtual gift-giving event in the live broadcast room, and the target interactive resource includes a virtual gift resource.

7. The method of claim 1, wherein presenting a virtual interactive object associated with the first gesture in the virtual scene comprises: The virtual interactive object is presented at a first location in the virtual scene associated with the first gesture.

8. The method of claim 7, wherein controlling the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture comprises: The virtual interactive object is controlled to begin executing the target movement process from the first position.

9. The method of claim 7, wherein the target motion process includes a movement process from the first position to a second position of the live broadcast screen.

10. The method of claim 9, wherein controlling the virtual interactive object to perform a target motion process in the virtual scene based at least on the first gesture comprises: In response to detecting a second gesture associated with the virtual interactive object, the movement process from the first position to the second position is changed based on the second gesture.

11. The method according to claim 7, wherein the interactive events include like events and / or emoji sending events in the live broadcast room, and the target interactive resources include display resources and / or emoji resources corresponding to the like events.

12. The method according to claim 1, wherein presenting the live stream screen of the live streaming room in the virtual scene includes: A live streaming window is displayed in the virtual scene to present the live streaming screen; or The live stream footage is presented as the background of the virtual scene.

13. An interactive device for a virtual scene, comprising: The live streaming display module is configured to display the live streaming screen of the live streaming room in a virtual scene; A virtual interactive object presentation module is configured to, in response to detecting a first gesture in the virtual scene, present a virtual interactive object associated with the first gesture in the virtual scene, the virtual interactive object being associated with a target interactive resource within the live stream; The virtual interactive object control module is configured to control the virtual interactive object to perform a target motion process in the virtual scene, based at least on the first gesture. as well as The interactive event triggering module is configured to trigger interactive events associated with the target interactive resource within the live broadcast room.

14. An electronic device comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processing unit.

15. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 12.

16. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 12.

Images