Interaction method and device, equipment and storage medium

Abstract

The invention relates to an interaction method and device, equipment and a storage medium, and the method comprises the steps: obtaining a first article element in response to an element obtaining instruction; the first article element is at least used for indicating any environment object in a physical environment in which the terminal equipment is currently located; in response to a preset triggering operation for the first article element, displaying a second article element in a virtual space; the second item element is generated based on the first item element. According to the invention, the relevance between the second article element and the user corresponding to the terminal equipment is increased, and the interaction form in the virtual live broadcast can be enriched.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an interaction method, device, equipment and storage medium. Background Art

[0002] With the rapid development of technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR), virtual live streaming has become an increasingly popular form that combines virtual environments and the interaction of anchors to provide an unprecedented immersive viewing experience.

[0003] In the related art, during the virtual live broadcast, users can watch the host through head-mounted display devices and related accessories, and can interact with the live broadcast through methods such as commenting, giving virtual gifts, and giving likes. Among them, giving virtual gifts is usually achieved by selecting the target virtual gift in the gift panel, which lacks the correlation between the virtual gift given and the gift object, and also limits the interactive form in the virtual live broadcast. Summary of the invention

[0004] The present disclosure provides an interactive method, device, equipment and storage medium to solve at least one technical problem in the related art. The technical solution of the present disclosure is as follows: According to a first aspect of an embodiment of the present disclosure, there is provided an interaction method, which is applied to a terminal device and includes: In response to the element acquisition instruction, a first item element is acquired; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; In response to a preset triggering operation for the first item element, a second item element is displayed in the virtual space; the second item element is generated based on the first item element.

[0005] In some embodiments, before obtaining the first item element, the method further includes: Displaying a spatial picture of the virtual space, wherein the spatial picture of the virtual space includes a live broadcast picture and / or an element display area of ​​the first object; After obtaining the first item element, the method further includes: The first object element is displayed in the virtual space.

[0006] In some embodiments, in response to a preset triggering operation on the first item element, displaying the second item element in the virtual space includes: In response to a preset trigger operation for the first object element, the second object element is displayed on the live broadcast screen and / or the element display area.

[0007] In some embodiments, the preset trigger operation includes an element transfer operation and / or an element addition operation, and in response to the preset trigger operation for the first item element, displaying the second item element on the live screen and / or the element display area includes: In response to an element transfer operation on the first item element, displaying a second item element corresponding to the first item element in the live broadcast screen; In response to the element adding operation on the first item element, a second item element corresponding to the first item element is added in the element display area.

[0008] In some embodiments, the element display area includes a prop panel, and displaying a second item element corresponding to the first item element in the live broadcast screen includes: A second item element corresponding to the first item element is saved in the prop panel, and the second item element is displayed in the live broadcast screen.

[0009] In some embodiments, an add control and / or a transfer control for the first item element is also displayed in the virtual space, the add control matches the element adding operation, and the transfer control matches the element transferring operation.

[0010] In some embodiments, when the preset trigger operation includes an element transfer operation, in response to the preset trigger operation for the first item element, displaying the second item element in the virtual space includes: In response to an element transfer operation of the second object on the first item element, displaying a special effect of the second object transferring the first item element to the first object; The first object element is displayed in a live broadcast screen in the virtual space; the first object element is matched with the object image of the first object.

[0011] In some embodiments, when the preset trigger operation includes an element transfer operation, and the space screen of the virtual space includes a live screen of the first object, in response to the preset trigger operation for the first object element, displaying the second object element in the virtual space includes: In response to an element transfer operation of a second object on the first item element, acquiring a second item element corresponding to the first item element; Displaying a special effect of the second object transferring the second item element to the first object; The second object element is displayed in a live broadcast screen in the virtual space; the second object element can be integrated with the object image of the first object.

[0012] In some embodiments, obtaining a second item element corresponding to the first item element includes: determining an adjustment-required attribute of the first item element based on an element attribute of the first item element and an object image of the first object; The first item element is reconstructed based on the adjustment requirement attribute to obtain the second item element.

[0013] In some embodiments, in response to the element acquisition instruction, acquiring the first item element includes: In response to an element acquisition instruction, acquiring environmental scan data of the physical environment; extracting at least one object element from the environmental scan data; In response to an element selection operation, a target object element is determined from the at least one object element as the first item element.

[0014] In some embodiments, the spatial image of the virtual space includes an environmental image of the physical environment in which the terminal device is located.

[0015] In some embodiments, the method further comprises: In response to the element extraction instruction, a third element is acquired; the third element is based on any object in the target image triggered by the terminal device; In response to a preset trigger operation for the third element, a fourth element corresponding to the third element is displayed.

[0016] According to a second aspect of an embodiment of the present disclosure, there is provided an interaction apparatus, applied to a terminal device, comprising: A first acquisition module is configured to execute in response to an element acquisition instruction to acquire a first item element; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; The first interaction module is configured to execute a preset trigger operation for the first item element to display a second item element in a virtual space; the second item element is generated based on the first item element.

[0017] In some embodiments, the apparatus further comprises: A first display module is configured to display a space picture of the virtual space, wherein the space picture of the virtual space includes a live broadcast picture of the first object and / or an element display area; The device also includes: The second display module is configured to display the first item element in the virtual space.

[0018] In some embodiments, the first interaction module includes: The interaction submodule is configured to execute a preset trigger operation in response to the first object element, and display the second object element in the live broadcast screen and / or the element display area.

[0019] In some embodiments, the preset trigger operation includes an element transfer operation and / or an element addition operation, and the interaction submodule includes: A first interaction unit is configured to perform an element transfer operation in response to the first item element, and display a second item element corresponding to the first item element in the live broadcast screen; The second interaction unit is configured to execute, in response to an element adding operation on the first item element, adding a second item element corresponding to the first item element in the element display area.

[0020] In some embodiments, the element display area includes a prop panel, and the first interaction unit includes: The element interaction sub-unit is configured to save a second item element corresponding to the first item element in the prop panel and display the second item element in the live broadcast screen.

[0021] In some embodiments, an add control and / or a transfer control for the first item element is also displayed in the virtual space, the add control matches the element adding operation, and the transfer control matches the element transferring operation.

[0022] In some embodiments, when the preset trigger operation includes an element transfer operation, and the space picture of the virtual space includes a live picture of the first object, the first interaction module includes: an element acquisition submodule, configured to execute an element transfer operation on the first item element in response to a second object, and acquire a second item element corresponding to the first item element; A special effect display submodule, configured to perform a special effect of displaying that the second object transfers the second item element to the first object; The element display submodule is configured to display the second object element in the live broadcast screen in the virtual space; the second object element can be integrated with the object image of the first object.

[0023] In some embodiments, the element acquisition submodule includes: an attribute determination unit configured to determine an adjustment-required attribute of the first item element based on an element attribute of the first item element and an object image of the first object; The reconstruction unit is configured to perform element reconstruction on the first item element based on the adjustment requirement attribute to obtain the second item element.

[0024] In some embodiments, the first acquisition module includes: A first acquisition submodule is configured to execute in response to an element acquisition instruction to acquire environmental scanning data of the physical environment; An extraction submodule, configured to extract at least one object element from the environment scanning data; The first determining submodule is configured to determine a target object element from the at least one object element as the first item element in response to an element selection operation.

[0025] In some embodiments, the spatial image of the virtual space includes an environmental image of the physical environment in which the terminal device is located.

[0026] In some embodiments, the apparatus further comprises: A second acquisition module is configured to execute in response to the element extraction instruction to acquire a third element; the third element is based on any object in the target image triggered by the terminal device; The second interaction module is configured to execute a preset trigger operation in response to the third element and display a fourth element corresponding to the third element.

[0027] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the interaction method as described in any of the above embodiments.

[0028] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the interaction method as described in any of the above embodiments.

[0029] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, the computer program product comprising a computer program, and the computer program, when executed by a processor, implements the interaction method provided in any one of the above-mentioned embodiments.

[0030] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects: The disclosed embodiment acquires a first item element in response to an element acquisition instruction; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; in response to a preset trigger operation for the first item element, a second item element is displayed in a virtual space; the second item element is generated based on the first item element. In this way, by introducing the second item element generated based on the first item element in the virtual space, since the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located, on the one hand, the second item element can be associated with the current environment of the operating user of the terminal device, increasing the relevance between the second item element and the user corresponding to the terminal device and making it more personalized; on the other hand, different first item elements can be introduced according to different physical environments, thereby generating different second item elements, improving the element diversity of the second item element, thereby enriching the types of item elements displayed in the virtual space, improving the playability of the virtual space, and enriching the interactive forms in the virtual live broadcast.

[0031] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The drawings herein are incorporated into the specification and constitute a part of the present disclosure, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0033] Figure 1 The invention is an architecture diagram of a system of an application interaction method according to an exemplary embodiment.

[0034] Figure 2 The present invention is a flowchart of an interaction method according to an exemplary embodiment.

[0035] Figure 3A The diagram is a schematic diagram of a scene of an interaction process according to an exemplary embodiment.

[0036] Figure 3B and Figure 3C They are respectively partial interface schematic diagrams of an interaction process according to an exemplary embodiment.

[0037] Figure 4A It is a partial scene schematic diagram of another interaction process according to an exemplary embodiment.

[0038] Figure 4B According to an exemplary embodiment, Figure 4A A partial interface diagram of an interaction process.

[0039] Figure 5 It is a partial interface schematic diagram showing an interaction process according to an exemplary embodiment.

[0040] Figure 6 The figure is a block diagram of an interaction device according to an exemplary embodiment.

[0041] Figure 7 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0042] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0043] It should be noted that the terms "first", "second", etc. in the specification, claims, and drawings of the present disclosure are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as described in detail above.

[0044] In addition, the term "at least one" in the present disclosure refers to one or more, and the term "more than one" refers to two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0045] Figure 1 is an architecture diagram of a system of an application interaction method according to an exemplary embodiment. Figure 1 , the architecture diagram may include a terminal device 110 , a server 120 and a terminal device 130 .

[0046] Among them, the terminal device 110 or the terminal device 130 can be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart wearable device, a digital assistant, a virtual reality device (VirtualReality, VR), an augmented reality device (Augmented Reality, AR), a mixed reality device (Mix Reality, MR) and other physical devices or one or more applications running in the physical device. Among them, the virtual reality device is a virtual scene that uses a computer to simulate a three-dimensional space to provide users with an immersive experience in terms of vision, hearing, touch, etc. The augmented reality device allows the real environment and virtual objects to be superimposed in the same space in real time and exist simultaneously. The mixed reality device is a new visualization environment that integrates physical scenes and virtual scenes, and objects in the physical scene coexist with objects in the virtual scene in real time.

[0047] The terminal device 110 and the terminal device 130 are installed with applications with corresponding functions, such as clients, applets, etc., and may also be equipped with an operating system that supports running the applications. Figure 1 As shown, the terminal device 110 may be a smart phone of a live broadcast initiator, and a client for the live broadcast initiator to start or manage live broadcast, such as a client of a host user, may be running on the terminal device 110. The terminal device 130 may be a mixed reality device of a live broadcast participant participating in the live broadcast, and a client for the live broadcast participant to participate in virtual live broadcast, such as a client of an audience user, may be running on the terminal device 130.

[0048] The server 120 may be, but is not limited to, an independent server, or a server cluster or distributed system composed of multiple physical servers, or may be one or more cloud servers that provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and basic cloud computing services such as big data and artificial intelligence platforms. Optionally, the terminal device 110 and the server 120, and the terminal device 130 and the server 120 may be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present disclosure. Through the communication between the terminal device 110, the terminal device 130 and the server 120, the server 120 may provide corresponding background support for the terminal device 110 and the terminal device 130 to realize the interaction process.

[0049] The interactive method provided by the embodiments of the present disclosure may be executed by an interactive device, which may be integrated in an electronic device such as a terminal in the form of hardware or software, or may be executed by the terminal alone, or may be executed in collaboration with a terminal and a server.

[0050] It should be noted that the present disclosure involves user information and other related data. When the following embodiments of the present disclosure are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0051] Figure 2 is a flow chart of an interactive method according to an exemplary embodiment. Figure 2 As shown, the interaction method can be applied to a terminal device, and is described by taking the terminal device 130 in the above system architecture of the terminal device as an example, and includes the following steps.

[0052] In step S201, in response to an element acquisition instruction, a first item element is acquired; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located.

[0053] The element acquisition instruction may at least be used to represent an operation instruction for acquiring a custom element. The first item element may be a custom element different from a default item element indicated by the terminal device. Exemplarily, the default item element may include but is not limited to at least one of a default virtual gift and a default virtual sticker.

[0054] In this embodiment, the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located. Among them, the physical environment can be the environment of the real scene where the terminal device is located. Exemplarily, the physical environment can include but is not limited to a room, a shopping mall, a park, etc. The environmental object can refer to a real object in the real scene. Exemplarily, the environmental object can include but is not limited to tables and chairs in a room, goods in a shopping mall, flowers and plants in a park, etc. Optionally, the terminal device can obtain environmental data of the physical environment where the terminal device is currently located by responding to an element acquisition instruction generated based on the user's interactive trigger operation, and extract any environmental object from the environmental data as the first item element. As an example only, taking the terminal device as a mixed reality device as an example, the interactive trigger operation can include but is not limited to at least one of key operation, touch operation, gesture operation, visual interaction operation, voice interaction operation, etc. through an operating handle. Among them, the mixed reality device can specifically be, for example, a head-mounted display device, but is not limited to this.

[0055] It should be noted that, for the sake of convenience of description, the terminal device mentioned in the embodiments of the present disclosure is mainly described by taking a mixed reality device as an example. Of course, in some cases, the terminal device mentioned in the embodiments may also be at least one of an augmented reality device, a virtual reality device, or other suitable devices with functions such as a camera.

[0056] In some other embodiments, the first item element may be used to indicate any image object in the demand image or demand video obtained by the terminal device. The demand image or demand video contains the target object that the user needs to use as the first item element. The demand image or demand video may be different from the environmental image or environmental video of the current physical environment. For example, if the physical environment in which the terminal device is currently located is an indoor environment (such as a room), the demand image or demand video may be a picture or video of an outdoor environment (such as a park), or it may also be a picture or video of other indoor environments (such as a shopping mall). Optionally, the terminal device may upload the demand image or demand video through the terminal device in response to the element acquisition instruction generated by the user's interactive trigger operation, and extract a picture object from the demand image or demand video as the first item element. Exemplarily, if the demand image uploaded by the terminal device is a picture of "user a wearing a helmet and riding a motorcycle", a picture object extracted therefrom may be "helmet" or "motorcycle", and then the extracted picture object may be used as the first item element obtained. In this way, the first item element is obtained by introducing the required picture or required video obtained by the terminal device, so that the way to obtain the first item element is not limited to the current physical environment, enriching the element content of the first item element, and helping to improve the interactive form of the virtual space.

[0057] It should be noted that, in some embodiments, the environment object or picture object indicated by the first item element may not be limited to one, but may be multiple, that is, multiple environment objects or multiple picture objects are determined as the first item element.

[0058] In some embodiments, before obtaining the first item element, the method further includes: The spatial picture of the virtual space is displayed, where the spatial picture of the virtual space includes a live broadcast picture and / or an element display area of ​​the first object.

[0059] The virtual space refers to a virtual scene presented by a terminal device. The space picture of the virtual space refers to the scene picture of the virtual scene. Optionally, the user wears a head-mounted display device to present the scene environment of the virtual scene in the user's viewing perspective, that is, to display the space picture of the virtual space.

[0060] In this embodiment, the spatial screen of the virtual space may include a live screen and / or an element display area of ​​a first object. The first object may be a user object that initiates the live broadcast corresponding to the live screen, such as an anchor. The live screen is used to represent the screen of the anchor's live broadcast. The live screen can be displayed in a target display area in the spatial screen of the virtual space. Exemplarily, the target display area may be a central position area in the spatial screen. The element display area may be an area for displaying item elements. Exemplarily, the item element may include but is not limited to at least one of a virtual gift and a virtual sticker.

[0061] For example, Figure 3A As shown, after the user wears the head-mounted display device, a spatial picture of the virtual space is presented from the user's viewing perspective. The spatial picture may include a live screen 310 of the first object and an element display area 320, and multiple default item elements and custom item elements may be displayed in the element display area 320.

[0062] like Figure 3B As shown, the user can trigger the custom item element 321 in the element display area 320 through operations such as gestures, visual focus or visual gaze, and the element acquisition details 322 of the custom item element 321 can be displayed, so as to understand the details of the custom item element through the element acquisition details 322. Exemplarily, the element acquisition details may include but are not limited to one or more of the acquisition method, purpose, and example of the custom item element. The element acquisition details 322 may display the details in the form of text and / or pictures. When the custom item element acquisition conditions are met, the step of acquiring the custom item element can be entered, that is, the step of acquiring the first item element in response to the element acquisition instruction is executed. Among them, the custom item element acquisition conditions may include but are not limited to transferring a preset amount of virtual resources.

[0063] like Figure 3C As shown, the user can trigger a default item element (such as a lucky wreath) 323 in the element display area 320 through operations such as gestures, visual focus, or visual gaze, and the element details 324 of the default item element 323 can be displayed. The element details 324 can describe one or more of the item name, enlarged image of the item, description content of the item, and the amount of virtual resources required to obtain the item, etc. of the default item element 323 in the form of text and / or pictures. Afterwards, you can select any default item element in the element display area 320 to perform corresponding interactive operations, such as element transfer operations. It should be noted that Figure 3C The default item elements exemplified in the figure are not limited to the element content, display style, etc. shown in the figure.

[0064] Correspondingly, after obtaining the first item element, the method further includes: The first object element is displayed in the virtual space.

[0065] Optionally, after acquiring the first item element, the terminal device may also display the first item element in the space screen of the virtual space. Exemplarily, the first item element may be displayed in an area of ​​the space screen that is different from the target display area or element display area corresponding to the live screen.

[0066] In some embodiments, the spatial picture of the virtual space includes an environmental picture of the physical environment in which the terminal device is located. Exemplarily, taking the physical environment in which the terminal device is located as a room as an example, the environmental picture of the physical environment may refer to the room picture of the room. Among them, the environmental picture may be displayed in an environmental display area in the spatial picture of the virtual space, and the environmental display area may be different from the target display area and the element display area. Exemplarily, the target display area and the element display area may be independently displayed in the spatial picture, and the environmental display area may surround the target display area or the element display area, and appear as the target display area or the element display area embedded in the environmental display area. Optionally, the first object element acquired by the terminal device may be displayed in the environmental picture. In this way, by additionally displaying the environmental picture of the physical environment in which the terminal device is located, the virtual elements are better combined with the real environment, thereby improving the effect and efficiency of element interaction.

[0067] In some embodiments, in the above step S201, in response to the element acquisition instruction, acquiring the first item element includes: In response to an element acquisition instruction, acquiring environmental scan data of the physical environment; extracting at least one object element from the environmental scan data; In response to an element selection operation, a target object element is determined from the at least one object element as the first item element.

[0068] In this embodiment, the terminal device responds to the element acquisition instruction, calls the scanning component (such as a camera) on the terminal device to scan the physical environment where the terminal device is located, obtains the environmental scanning data of the physical environment where it is currently located, and extracts at least one object element from the environmental scanning data. Afterwards, the terminal device can respond to the element selection operation, determine the target object element from the at least one object element, and use the target object element as the first object element. Exemplarily, the element selection operation can be implemented by at least one operation such as visual interaction, voice, gesture, etc. In this way, by supporting the scanning component (such as a camera) on the terminal device to capture and identify the real object in the real environment as the first object element, so as to generate the second object element acting on the virtual space based on the first object element, the flexibility and convenience of obtaining the first object element are improved.

[0069] For example, Figure 4A and Figure 4B As shown, the virtual space image also displays an environment image 410 of the physical environment where the terminal device is located. Taking visual interaction as an example, when the acquisition condition of the custom item element is detected, in response to the element acquisition instruction, at least one object element in the physical environment is scanned, and the object element focused on by the user's perspective indicated by the terminal device is used as the target object element, such as Figure 4B In the example, a real object in the real environment (such as a scarf) is used as a target object element, that is, the real object in the real environment is used as the first object element 420.

[0070] In step S203, in response to a preset triggering operation on the first item element, a second item element is displayed in the virtual space; the second item element is generated based on the first item element.

[0071] The preset trigger operation refers to the target operation performed on the first item element. Exemplarily, the preset trigger operation includes but is not limited to at least one of an element transfer operation and an element addition operation. The element transfer operation is used to indicate the operation of performing an element transfer between account objects based on the first item element, such as transferring from the second object to the first object. The element addition operation is used to indicate the operation of performing an element addition based on the first item element; a custom item element can be added through the element addition operation.

[0072] In this embodiment, the second item element may be a new element generated based on the first item element, that is, the second item element is similar to the first item element, but may not be completely the same as the first item element. For example, the second item element may include, but is not limited to, one or more item elements such as virtual gifts (such as live broadcast gifts) and virtual stickers. Exemplarily, the second item element may be an element after the first item element is adjusted, and the element adjustment is not limited to element shape adjustment, element display state adjustment, element blur adjustment, etc. Among them, element shape adjustment may include, but is not limited to, adjustment of the element from a first shape size to a second shape size. The display state adjustment of the element may include, but is not limited to, adjusting the element from an expanded state to a collapsed state, etc. The blur adjustment of the element includes, but is not limited to, adjustment of blurring or clearing the brand name involved in the element, etc.

[0073] Of course, in some other embodiments, the second item element may be substantially the same in element form as the first item element, with only a change in display position.

[0074] In some embodiments, in response to a preset triggering operation on the first item element, displaying the second item element in the virtual space includes: In response to a preset trigger operation for the first object element, the second object element is displayed on the live broadcast screen and / or the element display area.

[0075] In this embodiment, the terminal device can respond to a preset trigger operation for the first object element and perform an interaction corresponding to the preset trigger operation to display the second object element in the live broadcast screen and / or the element display area.

[0076] In some embodiments, the preset trigger operation includes an element transfer operation and / or an element addition operation. In this case, in response to the preset trigger operation for the first item element, displaying the second item element on the live screen and / or the element display area includes: In response to an element transfer operation on the first item element, displaying a second item element corresponding to the first item element in the live broadcast screen; In response to the element adding operation on the first item element, a second item element corresponding to the first item element is added in the element display area.

[0077] In this embodiment, the terminal device can respond to the element transfer operation on the first item element, obtain the second item element corresponding to the first item element, and display the second item element in the live broadcast screen. Specifically, the second item element can be displayed on the first object in the live broadcast screen or near the object of the first object. The display position of the second item element can match the element type of the second item element. In this way, by performing the element transfer operation, the first item element in the real environment can be efficiently converted into a virtual gift in the live broadcast room, which can realize the personalized selection of users, generate live broadcast gifts in a diversified way, and improve the interactive form in the virtual live broadcast.

[0078] Alternatively, the terminal device may obtain a second item element corresponding to the first item element in response to the element adding operation for the first item element, and add the second item element to the element display area. It should be noted that the second item element added here may be completely identical to the first item element, or may be at least partially different from the first item element, for example, in element form, element style, etc. In this way, by adding a second item element corresponding to the first item element in the element display area, the subsequent repeated execution of the acquisition and conversion steps of the same first item element is omitted, thereby improving the efficiency of element interaction operations.

[0079] In some embodiments, an add control and / or a transfer control for the first item element is also displayed in the virtual space, the add control matches the element adding operation, and the transfer control matches the element transferring operation.

[0080] In this embodiment, while displaying the first item element in the virtual space, an add control and / or transfer control for the first item element may also be displayed. The add control matches the element adding operation, that is, the add control is triggered by, for example, the focus of the user's perspective, a gesture, or an auxiliary tool (such as an operating handle), and the corresponding element adding operation can be implemented for the first item element. The transfer control matches the element transfer operation, that is, the transfer control is triggered by, for example, the focus of the user's perspective, a gesture, or an auxiliary tool (such as an operating handle), and the corresponding element transfer operation can be implemented for the first item element. In this way, by adding the control form of the add control and / or transfer control in the virtual space, the corresponding preset trigger operation can be quickly implemented, which improves the operational convenience of performing diversified interactions in the virtual space and facilitates improving the user experience.

[0081] For example, continue as Figure 4BAs shown, an add control 430 and a transfer control 440 may be displayed around the first item element 420. By triggering the add control 430, the first item element 420 may be added to the element display area 320, and by triggering the transfer control 440, the first item element 420 may be transferred to other objects, such as Figure 4A The first object 450 in the live broadcast picture.

[0082] In some embodiments, the element display area includes a prop panel, and displaying a second item element corresponding to the first item element in the live broadcast screen includes: A second item element corresponding to the first item element is saved in the prop panel, and the second item element is displayed in the live broadcast screen.

[0083] In this embodiment, after acquiring the second item element corresponding to the first item element, the terminal device can first save the second item element in the prop panel in the element display area, and then display the second item element in the live broadcast screen. Among them, the prop panel refers to the area location for storing at least one of the aforementioned default item elements and / or just one custom item element. In this way, by saving the second item element corresponding to the first item element in the prop panel of the element display area, the second item element can be quickly called for use when needed later, thereby eliminating the need for additional conversion of the first item element to generate the second item element, reducing the amount of calculation in the element conversion process and the time-consuming element use.

[0084] In some embodiments, when the preset trigger operation includes an element transfer operation, and the space screen of the virtual space includes a live screen of the first object, in response to the preset trigger operation for the first object element, displaying the second object element in the virtual space includes: In response to an element transfer operation of a second object on the first item element, acquiring a second item element corresponding to the first item element; Displaying a special effect of the second object transferring the second item element to the first object; The second object element is displayed in a live broadcast screen in the virtual space; the second object element can be integrated with the object image of the first object.

[0085] In this embodiment, the terminal device is a device controlled by the second object. Taking the terminal device as a head-mounted display device as an example, the second object is a user object wearing the head-mounted display device. The terminal device can obtain a second item element corresponding to the first item element in response to the element transfer operation performed by the second object on the first item element. Afterwards, the special effect of the second object transferring the second item element to the first object (such as the anchor) is displayed in the virtual space. Then, the second item element is displayed at the target position in the live broadcast screen of the first object so that the second item element can be spatially integrated with the object image of the first object. Optionally, the target position can be related to the element type of the second item element. Exemplarily, taking the second item element as a live broadcast gift as an example, if the second item element is a scarf, the second item element is fused and displayed at the neck position of the first object (such as the anchor). If the second item element is a hat, the second item element is displayed and displayed on the head of the first object (such as the anchor). In this way, during the element transfer operation, by displaying the special effect of transferring the second object element to the first object, the user's immersion in the second object element is enhanced, and the user experience and interaction effect are improved. In addition, by integrating the second object element with the object image of the first object, the element display space sense and realism of the second object element are improved, further improving the overall interaction effect in the virtual live broadcast.

[0086] In some embodiments, obtaining a second item element corresponding to the first item element includes: determining an adjustment-required attribute of the first item element based on an element attribute of the first item element and an object image of the first object; The first item element is reconstructed based on the adjustment requirement attribute to obtain the second item element.

[0087] In this embodiment, the terminal device can obtain the element attributes of the first item element and the object image of the first object in the live broadcast screen, and determine the adjustment requirement attribute of the first item element. Then, based on the adjustment requirement attribute of the first item element, the first item element is reconstructed by the image generation model to obtain a second item element corresponding to the first item element, so that the second item element can better match the object image of the first object. Optionally, the image generation model can be any suitable model suitable for regenerating an image, such as an artificial intelligence generated content (AIGC) model, through which the second item element with the required attribute is automatically generated. The specific structure and generation strategy of the image generation model are not specifically limited here.

[0088] For example, Figure 5As shown, the object image of the first object (i.e., the anchor) is displayed in the live screen 510. If it is determined to perform the element transfer operation, a special effect 520 in which the second object transfers the second item element to the first object in the live screen can be displayed in the virtual space. The dynamic effect 520 includes a virtual hand 521 of the second object and a second item element 521 corresponding to the first item element 420. Compared with the first item element 420, the item form of the second item element 521 changes. Specifically, the first item element 420 displays an unfolded scarf, and the second item element 521 displays a folded scarf. After that, after the special effect 520 of the transfer operation is performed, an image in which the object image of the first object and the second item element 521 are integrated in the spatial dimension is displayed in the live screen 530. Specifically, the second item element 521 is worn as a live gift at the neck position of the first object (i.e., the anchor) in the live screen.

[0089] In the above embodiment, the adjustment requirement attribute of the first item element is introduced to reconstruct the first item element into the second item element based on the adjustment requirement attribute. Since the second item element is a three-dimensional element redrawn based on the first item element, it is different from the real item and is more in line with the effect of a preset trigger operation (such as an element transfer operation). The second item element and the first object can be integrated in space, with a strong sense of space, thereby improving the user experience.

[0090] In some embodiments, the method further comprises: In response to the element extraction instruction, a third element is acquired; the third element is based on any object in the target image triggered by the terminal device; In response to a preset trigger operation for the third element, a fourth element corresponding to the third element is displayed.

[0091] In this embodiment, the terminal device can respond to the element extraction instruction, obtain the target image triggered by the terminal device, and extract any object from the target image as the third element. Exemplarily, the target image can be a photo, video, etc. uploaded by the terminal device. Then, the terminal device can display a fourth element corresponding to the third element in the live screen or in the virtual space in response to the user's preset trigger operation on the third element. The fourth element can be generated based on the third element.

[0092] Optionally, the preset trigger operation may include but is not limited to an element transfer operation, an element addition operation, etc. Among them, the element transfer operation is used to indicate the operation of performing an element transfer between account objects based on the first item element, such as transferring from the second object to the first object. The element addition operation is used to indicate the operation of performing an element addition based on the first item element; a custom item element can be added through the element addition operation. In this way, by extracting an object as the third element based on the target image triggered by the terminal device, while simplifying the steps of obtaining personalized elements, the diversity of elements can be further enriched, which is conducive to improving the convenience and operation experience of user operations.

[0093] It should be noted that the specific details of generating the fourth element based on the third element and the specific details of displaying the fourth element can be found in the above-mentioned specific details of generating the second item element from the first item element and displaying the second item element, which will not be repeated here.

[0094] In the above embodiment, by introducing the second item element generated based on the first item element into the virtual space, since the first item element is at least used to indicate any environmental object in the physical environment currently located by the terminal device, on the one hand, the second item element can be associated with the current environment of the operating user of the terminal device, thereby increasing the correlation between the second item element and the user corresponding to the terminal device and making it more personalized; on the other hand, different first item elements can be introduced according to different physical environments, thereby generating different second item elements, thereby improving the element diversity of the second item elements, thereby enriching the types of item elements displayed in the virtual space, improving the playability of the virtual space, and enriching the interactive forms in the virtual live broadcast.

[0095] It should be understood that one or more elements such as controls, icons, cards, texts, pictures, special effects, etc. in the interface diagrams provided in the present disclosure are not limited to the specific contents shown in the diagrams, and may be other equivalent, similar or modified display forms and layouts.

[0096] It should be noted that the above embodiments may be executed separately, or may be executed crosswise or superimposedly when there is no technical conflict.

[0097] Figure 6 is a block diagram of an interactive device according to an exemplary embodiment. Figure 6 , the device is applied to a terminal device, which may include: The first acquisition module 610 is configured to execute in response to the element acquisition instruction to acquire a first item element; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; The first interaction module 620 is configured to execute a preset trigger operation for the first item element to display a second item element in the virtual space; the second item element is generated based on the first item element.

[0098] In some embodiments, the apparatus further comprises: A first display module is configured to display a space picture of the virtual space, wherein the space picture of the virtual space includes a live broadcast picture of the first object and / or an element display area; The device also includes: The second display module is configured to display the first item element in the virtual space.

[0099] In some embodiments, the first interaction module includes: The interaction submodule is configured to execute a preset trigger operation in response to the first object element, and display the second object element in the live broadcast screen and / or the element display area.

[0100] In some embodiments, the preset trigger operation includes an element transfer operation and / or an element addition operation, and the interaction submodule includes: A first interaction unit is configured to perform an element transfer operation in response to the first item element, and display a second item element corresponding to the first item element in the live broadcast screen; The second interaction unit is configured to execute, in response to an element adding operation on the first item element, adding a second item element corresponding to the first item element in the element display area.

[0101] In some embodiments, the element display area includes a prop panel, and the first interaction unit includes: The element interaction sub-unit is configured to save a second item element corresponding to the first item element in the prop panel and display the second item element in the live broadcast screen.

[0102] In some embodiments, an add control and / or a transfer control for the first item element is also displayed in the virtual space, the add control matches the element adding operation, and the transfer control matches the element transferring operation.

[0103] In some embodiments, when the preset trigger operation includes an element transfer operation, and the space picture of the virtual space includes a live picture of the first object, the first interaction module includes: an element acquisition submodule, configured to execute an element transfer operation on the first item element in response to a second object, and acquire a second item element corresponding to the first item element; A special effect display submodule, configured to perform a special effect of displaying that the second object transfers the second item element to the first object; The element display submodule is configured to display the second object element in the live broadcast screen in the virtual space; the second object element can be integrated with the object image of the first object.

[0104] In some embodiments, the element acquisition submodule includes: an attribute determination unit configured to determine an adjustment-required attribute of the first item element based on an element attribute of the first item element and an object image of the first object; The reconstruction unit is configured to perform element reconstruction on the first item element based on the adjustment requirement attribute to obtain the second item element.

[0105] In some embodiments, the first acquisition module includes: A first acquisition submodule is configured to execute in response to an element acquisition instruction to acquire environmental scanning data of the physical environment; An extraction submodule, configured to extract at least one object element from the environment scanning data; The first determining submodule is configured to determine a target object element from the at least one object element as the first item element in response to an element selection operation.

[0106] In some embodiments, the spatial image of the virtual space includes an environmental image of the physical environment in which the terminal device is located.

[0107] In some embodiments, the apparatus further comprises: A second acquisition module is configured to execute in response to the element extraction instruction to acquire a third element; the third element is based on any object in the target image triggered by the terminal device; The second interaction module is configured to execute a preset trigger operation in response to the third element and display a fourth element corresponding to the third element.

[0108] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0109] Figure 7 is a block diagram of an electronic device according to an exemplary embodiment. Figure 7 The electronic device includes a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the steps of any interaction method in the above-mentioned embodiments when executing the instructions stored in the memory.

[0110] The electronic device may be a terminal, a server or a similar computing device. For example, the electronic device is a terminal. Figure 7 is a block diagram of an electronic device for interaction according to an exemplary embodiment. Specifically: The terminal may include components such as an RF (Radio Frequency) circuit 1410, a memory 1420 including one or more computer-readable storage media, an input unit 1430, a display unit 1440, a sensor 1450, an audio circuit 1460, a WiFi (wireless fidelity) module 1470, a processor 1480 including one or more processing cores, and a power supply 1490. Those skilled in the art will appreciate that Figure 7 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. The RF circuit 1410 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 1480 for processing; in addition, the data related to the uplink is sent to the base station. Generally, the RF circuit 1410 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a user identity module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. In addition, the RF circuit 1410 can also communicate with the network and other terminals through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0111] The memory 1420 can be used to store software programs and modules, and the processor 1480 executes various functional applications and data processing by running the software programs and modules stored in the memory 1420. The memory 1420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 1420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 1420 may also include a memory controller to provide the processor 1480 and the input unit 1430 with access to the memory 1420.

[0112] The input unit 1430 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 1430 may include a touch-sensitive surface 1431 and other input devices 1432. The touch-sensitive surface 1431, also known as a touch display screen or a touch pad, can collect user touch operations on or near it (such as operations performed by the user using fingers, stylus, or any other suitable object or accessory on or near the touch-sensitive surface 1431), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 1431 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 1480, and can receive and execute commands sent by the processor 1480. In addition, the touch-sensitive surface 1431 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 1431, the input unit 1430 may further include other input devices 1432. Specifically, the other input devices 1432 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like. The display unit 1440 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 1440 may include a display panel 1441, and optionally, the display panel 1441 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 1431 may cover the display panel 1441, and when the touch-sensitive surface 1431 detects a touch operation on or near it, it is transmitted to the processor 1480 to determine the type of the touch event, and then the processor 1480 provides corresponding visual output on the display panel 1441 according to the type of the touch event. Among them, the touch-sensitive surface 1431 and the display panel 1441 can be two independent components to realize the input and output functions, but in some embodiments, the touch-sensitive surface 1431 and the display panel 1441 can also be integrated to realize the input and output functions.

[0113] The terminal may also include at least one sensor 1450, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1441 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1441 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the terminal posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; As for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can be configured in the terminal, they will not be repeated here.

[0114] The audio circuit 1460, the speaker 1461, and the microphone 1462 can provide an audio interface between the user and the terminal. The audio circuit 1460 can transmit the electrical signal converted from the received audio data to the speaker 1461, which is converted into a sound signal for output; on the other hand, the microphone 1462 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1460 and converted into audio data, and then the audio data is output to the processor 1480 for processing, and then sent to another terminal through the RF circuit 1410, or the audio data is output to the memory 1420 for further processing. The audio circuit 1460 may also include an earplug jack to provide communication between an external headset and the terminal.

[0115] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1470, which provides users with wireless broadband Internet access. Figure 7 A WiFi module 1470 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as needed without changing the essence of the invention.

[0116] The processor 1480 is the control center of the terminal, and uses various interfaces and lines to connect various parts of the entire terminal. By running or executing software programs and / or modules stored in the memory 1420, and calling data stored in the memory 1420, the processor 1480 performs various functions of the terminal and processes data, thereby monitoring the terminal as a whole. Optionally, the processor 1480 may include one or more processing cores; preferably, the processor 1480 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1480.

[0117] The terminal also includes a power supply 1490 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 1480 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 1490 can also include any element such as one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc.

[0118] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail herein. Specifically in this embodiment, the terminal also includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for executing the method provided in the above method embodiment.

[0119] In an exemplary embodiment, a computer storage medium is also provided. When instructions in the computer storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the steps of the method provided in any one of the above embodiments.

[0120] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program / instruction, and the computer program / instruction is executed by a processor to implement the method provided in any of the above embodiments. Optionally, the computer program is stored in a computer-readable storage medium. The processor of the electronic device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the electronic device performs the method provided in any of the above embodiments.

[0121] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing related hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0122] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0123] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive method, characterized in that: Applied to terminal equipment, including: In response to the element acquisition instruction, a first item element is acquired; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; In response to a preset triggering operation for the first item element, a second item element is displayed in the virtual space; the second item element is generated based on the first item element.

2. The method according to claim 1, characterized in that: Before obtaining the first item element, the method further includes: Displaying a spatial picture of the virtual space, wherein the spatial picture of the virtual space includes a live broadcast picture and / or an element display area of ​​the first object; After obtaining the first item element, the method further includes: The first object element is displayed in the virtual space.

3. The method according to claim 2, characterized in that The displaying of the second item element in the virtual space in response to the preset triggering operation on the first item element comprises: In response to a preset trigger operation for the first object element, the second object element is displayed on the live broadcast screen and / or the element display area.

4. The method according to claim 3, characterized in that The preset trigger operation includes an element transfer operation and / or an element addition operation, and in response to the preset trigger operation for the first item element, displaying the second item element on the live broadcast screen and / or the element display area includes: In response to an element transfer operation on the first item element, displaying a second item element corresponding to the first item element in the live broadcast screen; In response to the element adding operation on the first item element, a second item element corresponding to the first item element is added in the element display area.

5. The method according to claim 4, characterized in that The element display area includes a prop panel, and the second item element corresponding to the first item element displayed in the live broadcast screen includes: A second item element corresponding to the first item element is saved in the prop panel, and the second item element is displayed in the live broadcast screen.

6. The method according to claim 4, characterized in that An add control and / or a transfer control for the first item element is also displayed in the virtual space, wherein the add control matches the element adding operation, and the transfer control matches the element transferring operation.

7. The method according to claim 1, characterized in that In a case where the preset trigger operation includes an element transfer operation, and the space picture of the virtual space includes a live picture of the first object, the displaying the second object element in the virtual space in response to the preset trigger operation for the first object element includes: In response to an element transfer operation of a second object on the first item element, acquiring a second item element corresponding to the first item element; Displaying a special effect of the second object transferring the second item element to the first object; The second object element is displayed in a live broadcast screen in the virtual space; the second object element can be integrated with the object image of the first object.

8. The method according to claim 7, characterized in that The acquiring the second item element corresponding to the first item element comprises: determining an adjustment-required attribute of the first item element based on an element attribute of the first item element and an object image of the first object; The first item element is reconstructed based on the adjustment requirement attribute to obtain the second item element.

9. The method according to claim 1, characterized in that: In response to the element acquisition instruction, acquiring the first item element includes: In response to an element acquisition instruction, acquiring environmental scan data of the physical environment; extracting at least one object element from the environmental scan data; In response to an element selection operation, a target object element is determined from the at least one object element as the first item element.

10. The method according to any one of claims 1 to 9, characterized in that: The space picture of the virtual space includes the environment picture of the physical environment where the terminal device is located.

11. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: In response to the element extraction instruction, a third element is acquired; the third element is based on any object in the target image triggered by the terminal device; In response to a preset trigger operation for the third element, a fourth element corresponding to the third element is displayed.

12. An interactive device, characterized in that: Applied to terminal equipment, including: A first acquisition module is configured to execute in response to an element acquisition instruction to acquire a first item element; the first item element is at least used to indicate any environmental object in the physical environment where the terminal device is currently located; The first interaction module is configured to execute a preset trigger operation for the first item element to display a second item element in a virtual space; the second item element is generated based on the first item element.

13. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the interaction method as described in any one of claims 1 to 11.

14. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the interaction method as claimed in any one of claims 1 to 11.

Images