Interface interaction method and device, equipment and storage medium

Abstract

The embodiment of the invention relates to an interface interaction method and device, equipment and a storage medium. The method provided by the invention comprises the steps that a live broadcast interface is presented at the electronic equipment, a live broadcast picture presented by the live broadcast interface comprises a plurality of layers, and the plurality of layers correspond to different depths; and based on the attitude information of the electronic device, adjusting the display content of at least one of the plurality of layers to update the live broadcast picture. In this way, according to the embodiment of the invention, multiple layers and depth information are introduced, so that the live broadcast picture can be expanded from a traditional two-dimensional plane to a three-dimensional space, and the stereoscopic impression and the sense of space are enhanced. In addition, the image layer display content can be adjusted by changing the posture information of the electronic equipment, so that the visual effect similar to the visual angle change in the real world is obtained, and the transmission effect of the live broadcast content is improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and particularly to methods, apparatuses, devices, and computer-readable storage media for interface interaction. Background Art

[0002] With the rapid development of intelligence, various forms of electronic devices can greatly enrich people's daily lives. For example, users can conduct live interactions based on some electronic devices. How to improve the interactive experience of users in the live broadcast room is a focus issue of concern. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for interface interaction is provided. The method includes: presenting a live broadcast interface at an electronic device, where the live broadcast image presented by the live broadcast interface includes multiple layers, and the multiple layers correspond to different depths; and adjusting the display content of at least one of the multiple layers based on the pose information of the electronic device to update the live broadcast image.

[0004] In a second aspect of the present disclosure, a method for live broadcast is provided. The method includes: providing a configuration interface to the live broadcaster; and in response to receiving a live broadcast start request using multiple layers via the configuration interface, determining multiple layers via the configuration interface to present a live broadcast image including multiple layers in the live broadcast interface of the live broadcaster.

[0005] In a third aspect of the present disclosure, an apparatus for interface interaction is provided. The apparatus includes: an interface presentation module configured to present a live broadcast interface at an electronic device, where the live broadcast image presented by the live broadcast interface includes multiple layers, and the multiple layers correspond to different depths; and a content adjustment module configured to adjust the display content of at least one of the multiple layers based on the pose information of the electronic device to update the live broadcast image.

[0006] In a fourth aspect of the present disclosure, an apparatus for live broadcast is provided. The apparatus includes: an interface providing module configured to provide a configuration interface to the live broadcaster; and a request receiving module configured to, in response to receiving a live broadcast start request using multiple layers via the configuration interface, determine multiple layers via the configuration interface to present a live broadcast image including multiple layers in the live broadcast interface of the live broadcaster.

[0007] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect or the second aspect.

[0008] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided. A computer program is stored on the computer-readable storage medium and can be executed by a processor to implement the method of the first aspect or the second aspect.

[0009] It should be understood that the content described in this part is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understandable through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. In the drawings, the same or similar reference numerals denote the same or similar elements, where:

[0011] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figures 2A to 2B An example interface of five layers according to some embodiments of the present disclosure;

[0013] Figures 2C to 2D An example interface of three layers according to some embodiments of the present disclosure;

[0014] Figure 3 A schematic diagram showing the depth of multiple layers according to some embodiments of the present disclosure;

[0015] Figure 4 A schematic diagram showing the live broadcast process according to some embodiments of the present disclosure;

[0016] Figures 5A to 5F An example interface according to some embodiments of the present disclosure;

[0017] Figure 6A A flowchart showing an example process of interface interaction according to some embodiments of the present disclosure;

[0018] Figure 6B A flowchart showing an example process for live broadcast according to some embodiments of the present disclosure;

[0019] Figure 7A A schematic block diagram showing an example device for interface interaction according to some embodiments of the present disclosure;

[0020] Figure 7B A schematic block diagram showing an example device for live broadcast according to some embodiments of the present disclosure; and

[0021] Figure 8A block diagram of an electronic device capable of implementing multiple embodiments of the present disclosure is shown. Detailed implementation manners

[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0023] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this document, and any type of embodiment can be included under any section / subsection. In addition, the embodiments described in any section / subsection can be combined with any other embodiments described in the same section / subsection and / or different section / subsections in any manner.

[0024] In the description of the embodiments of the present disclosure, the term "including" and its similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter. The terms "first", "second", etc. may refer to different or the same objects. There may also be other explicit and implicit definitions hereinafter.

[0025] The embodiments of the present disclosure may involve the user's data, data acquisition and / or use, etc. These aspects all comply with the corresponding laws, regulations and related provisions. In the embodiments of the present disclosure, the collection, acquisition, processing, processing, forwarding, use, etc. of all data are carried out on the premise that the user is aware and confirms. Accordingly, when implementing the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained through appropriate means according to the relevant laws and regulations. The specific informing and / or authorization methods may vary according to the actual situation and application scenarios, and the scope of the present disclosure is not limited in this regard.

[0026] In the solutions of this specification and embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for performing a contract, etc.), and will only be processed within the specified or agreed scope. If the user refuses to process personal information other than the necessary information required for the basic functions, it will not affect the user's use of the basic functions.

[0027] According to traditional solutions, most live broadcasts are presented in a flat and fixed perspective. There are also a small number of live broadcasts that require special devices to present a three-dimensional live broadcast effect (also known as a 3D live broadcast effect). However, this more three-dimensional and vivid 3D live broadcast effect requires higher configurations for both the live broadcast devices and the viewing devices, which makes it difficult to popularize among users and thus affects the user experience.

[0028] Embodiments of the present disclosure propose a solution for interface interaction. According to this solution, at an electronic device, a live broadcast interface can be presented, and the live broadcast image presented by the live broadcast interface includes multiple layers, and the multiple layers correspond to different depths; and based on the posture information of the electronic device, the display content of at least one of the multiple layers is adjusted to update the live broadcast image.

[0029] In this way, the embodiments of the present disclosure can expand the live broadcast image from a traditional two-dimensional plane to a three-dimensional space by introducing multiple layers and depth information, enhancing the three-dimensional sense and the sense of space. In addition, the present disclosure can adjust the layer display content by changing the posture information of the electronic device, so as to obtain a visual effect similar to the perspective change in the real world, improving the transmission effect of the live broadcast content.

[0030] The following further describes various example implementations of this solution in detail with reference to the accompanying drawings.

[0031] Example environment

[0032] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. As Figure 1 shown, the example environment 100 may include an electronic device 110.

[0033] In this example environment 100, the electronic device 110 may run an application 120 that supports interface interaction. The application 120 may be any suitable type of application for interface interaction, and its examples may include but are not limited to: video applications, social applications, or other suitable applications. The user 140 may interact with the application 120 via the electronic device 110 and / or its attached devices.

[0034] In Figure 1 the environment 100, if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120.

[0035] In some embodiments, the electronic device 110 communicates with the server 130 to implement the supply of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable game terminals, VR / AR devices, Personal Communication System (PCS) devices, personal navigation devices, Personal Digital Assistant (PDA), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, game devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of user interface (such as a "wearable" circuit, etc.).

[0036] The server 130 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. The server 130 can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and so on. The server 130 can provide back-end services for the application 120 that supports content presentation in the electronic device 110.

[0037] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this regard. In the embodiments of the present disclosure, the server 130 and the electronic device 110 can implement signaling interaction through the communication connection therebetween.

[0038] It should be understood that the structures and functions of the various elements in the environment 100 are described only for exemplary purposes and do not imply any limitation on the scope of the present disclosure.

[0039] Some exemplary embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0040] Example interaction

[0041] The process of an example interface interaction according to an embodiment of the present disclosure will be described below with reference to the accompanying drawings.

[0042] Figures 2A to 2D Example interfaces 200A to 200D according to some embodiments of the present disclosure are shown. Interfaces 200A to 200D may be provided by Figure 1 the electronic device 110 shown. Such interfaces 200A to 200D may be associated with respective users watching a live broadcast, that is, the electronic device 110 may be, for example, the electronic device corresponding to the target user watching the live broadcast. The target user may be a host party, a participating party, an audience, etc., which will not be elaborated here.

[0043] In an embodiment of the present disclosure, live broadcast interfaces 200A to 200B may be presented at the electronic device 110, and live broadcast interfaces 200C to 200D may also be presented, which may be determined based on the selection of the live broadcast mode by the live broadcast party. The live broadcast images presented by such live broadcast interfaces 200A to 200B, or live broadcast interfaces 200C to 200D, include multiple layers. Specifically, such multiple layers may include at least one picture layer determined based on the shooting content associated with the live broadcast party of the live broadcast interface. As an example, the shooting content may be, for example, the live broadcast picture content collected by the electronic device 110 at the live broadcast party. For example, it may be the picture of the host conducting a live broadcast in a room.

[0044] In some embodiments, the quantity or content corresponding to the multiple layers may be associated with the live broadcast mode. When the specific live broadcast modes are different, the quantity and content corresponding to the multiple layers included in the corresponding live broadcast interface may not be exactly the same.

[0045] Taking Figure 2A as an example, the live broadcast interface 200A may correspond to a first live broadcast mode. In some embodiments, the at least one layer may include a single first layer corresponding to the shooting content. Since the shooting content may include foreground content and background content, this single first layer may be a layer that includes both foreground content and background content. The foreground content is an object or element located in the foreground part of the shooting content, usually the core subject of the live broadcast, such as the host party, the object (item) shown by the host party during the live broadcast. The background content may be an object or element located in the background part of the shooting content, which is not the core theme of the live broadcast, such as the background environment where the host party conducts the live broadcast, etc.

[0046] In some embodiments, the multiple layers may contain different contents, such as video streams, pictures, special effects, texts, etc.

[0047] In some embodiments, the multiple layers may correspond to different depths. The depth may indicate the positional relationship of the layers in space, where layers with different depths will visually present different near - far relationships, thus forming a sense of three - dimensional space. For example, a layer with a shallower depth will be closer to the user watching the live stream, while a layer with a deeper depth will be farther away from the user watching the live stream. This makes the user watching the live stream think that the content or elements in the layer with a shallower depth are closer to the user themselves when watching the live stream.

[0048] Taking Figure 2A as an example, foreground content and background content can be set in the same single layer. Further, the electronic device 110 can adjust the display content of at least one of the multiple layers based on the posture information of the electronic device 110 to update the live - broadcast image. In some embodiments, the posture information can be any appropriate information, such as the tilt angle, rotation direction, moving speed, etc. of the electronic device 110. In some embodiments, such posture information can be determined, for example, by sensors at the terminal device, such as gyroscopes, acceleration sensors, angle sensors, and so on.

[0049] In some embodiments, the posture information of the electronic device 110 can be adjusted by a user's predetermined operation. The predetermined operation can be any appropriate operation. For example, the user can rotate the mobile phone in any direction (left - right, front - back, up - down, etc.).

[0050] Specifically, the electronic device can adjust the display angle of a predetermined object in the at least one layer based on the posture information. The predetermined object can be any appropriate object, such as a foreground object in the captured content. As an example, taking the predetermined object as the host, the electronic device can adjust the host from a frontal view to a side view in response to the user rotating the electronic device to the left or right.

[0051] Specifically, the electronic device can determine the parameter information of the virtual camera based on the posture information. The parameter information can be any appropriate information, such as the orientation, position, focal length, field of view (FOV), etc. corresponding to the virtual camera or viewfinder. Further, the electronic device can adjust the display content of the at least one layer based on the parameter information and the depth information of the multiple layers. Specifically, the electronic device can dynamically adjust attribute information such as the position, size, angle, transparency, etc. of the layer according to the parameter information of the virtual camera and the depth information of the layer.

[0052] Taking Figure 2B as an example, in response to the operation of the target user rotating the electronic device 110 to the right, the electronic device 110 can present as Figure 2BThe interface 200B shown. In the interface 200B, the electronic device 110 can adjust the display angle of the layers where the person and the background are located based on the operation of turning to the right, so as to present more background content, for example, a window.

[0053] It should be noted that since the captured content corresponds to a single layer, that is, the foreground content and the background content are located in the same layer, when the posture information of the electronic device changes, the offset ranges corresponding to the foreground content and the background content are generally less than the threshold. For Figure 2B As an example, the difference between the relative positions of the anchor and the door in the captured content corresponding to the user before turning the electronic device 110 to the right and the relative positions of the anchor and the door in the captured content corresponding to the user after turning the electronic device 110 to the right is less than the threshold.

[0054] For Figure 2C As an example, the live interface 200C can also correspond to a second live broadcast mode. In some embodiments, this at least one layer may include a second layer corresponding to the foreground content in the captured content (for example, a person layer) and a third layer corresponding to the background content in the captured content (for example, a background layer), that is, the foreground content and the background content are located in different layers. Specifically, the depths corresponding to the layer of the foreground content and the layer of the background content are different.

[0055] Since the objects or elements in the foreground part are the core themes of the live broadcast, the present disclosure can set the depth of the third layer corresponding to the background content to be greater than the depth of the second layer corresponding to the foreground content.

[0056] Furthermore, the electronic device 110 can adjust the display content of at least one layer among multiple layers based on the posture information of the electronic device 110 to update the live broadcast screen. In some embodiments, the posture information can be any appropriate information, such as the tilt angle, rotation direction, moving speed, etc. of the electronic device 110. In some embodiments, such posture information can be determined, for example, by sensors at the terminal device, such as a gyroscope, an acceleration sensor, an angle sensor, and so on.

[0057] In some embodiments, the posture information of the electronic device 110 can be adjusted by a predetermined operation of the user. The predetermined operation can be any appropriate operation, such as the user can turn the mobile phone in any direction (left - right, front - back, up - down, etc.).

[0058] For Figure 2D example, in response to the operation of the target user turning the electronic device 110 to the right, the electronic device 110 can present as Figure 2DThe interface 200D shown. In the interface 200D, the electronic device 110 can adjust the display angles of the layers where the person and the background are located based on the operation of turning to the right, so as to present more background content, for example, a window.

[0059] It should be noted that since the second layer and the third layer corresponding to the captured content, that is to say, the foreground content and the background content are located on different layers, when the attitude information of the electronic device changes, the offset ranges corresponding to the foreground content and the background content are generally greater than or equal to the threshold. Taking Figure 2D as an example, the difference between the relative positions of the anchor side and the door in the captured content corresponding to the user before turning the electronic device 110 to the right and the relative positions of the anchor side and the door in the captured content corresponding to the user after turning the electronic device 110 to the right is greater than or equal to the threshold.

[0060] The generation processes of the second layer and the third layer will be described below. The second layer and the third layer can be generated by the server, or can be generated by other devices other than the server. For the convenience of description, the case where the second layer and the third layer are generated by the server is taken as an example for description.

[0061] In some embodiments, the server 130 can extract the foreground object from the captured content. The foreground object can be any appropriate object, such as an anchor side, an animal, a commodity, etc. Further, the server can construct a three-dimensional model associated with the foreground object. The three-dimensional model can be a virtual three-dimensional representation for describing information such as the shape, texture, and spatial position of the foreground object. Further, the server can construct the second layer based on the three-dimensional model. For example, the server can render the three-dimensional model as a two-dimensional image and place it on a certain layer to complete the construction of the second layer.

[0062] In some embodiments, the server 130 can remove the area corresponding to the foreground object from the captured content. The foreground image can be any appropriate object, such as the area corresponding to the anchor side in the captured content. Further, the server 130 can construct the third layer corresponding to the background content by filling this area. As an example, the server 130 can fill elements or objects associated with the background content in this area to construct the third layer.

[0063] To improve the live broadcast effect, these multiple layers can further include at least one material layer. In some embodiments, the at least one material layer includes material content configured by the live party of the live broadcast interface. The material content can be any appropriate content, which can include pictures, videos, animations, special effects, texts, etc. Taking Figures 2A to 2DAny interface diagram in [the example] can present a light effect in the shape of a star. In some embodiments, if there are multiple such material layers, the material content included in each material layer may be the same or different.

[0064] Taking Figure 3 as an example, the embodiments of the present disclosure can convert the live broadcast screen from a two-dimensional plane to a three-dimensional space with multiple layers (for example, layer 1, layer 2... layer n). As an example, layer 1, layer 2, and layer 4 can be material layers, layer 3 is a character layer, and layer 5 is a background layer.

[0065] Figure 4 shows a schematic diagram of the live broadcast start process according to some embodiments of the present disclosure.

[0066] In block 401, in response to the live broadcaster's trigger of a function entry (such as the preset control 212) in the configuration interface, the electronic device 110 can receive a live broadcast start request using multiple layers.

[0067] In block 402, the electronic device 110 can construct at least one corresponding material layer based on the live broadcaster's selection of at least one material content in the configuration interface. Such at least one material content can be, for example, pictures, videos, animations, special effects, text, etc.

[0068] In block 403, the electronic device 110 can synthesize a preview of the effect based on the above-set at least one material content and the live broadcast content for the live broadcaster to view.

[0069] Further, in block 404, after the live broadcaster constructs multiple layers corresponding to the live broadcast interface in the configuration interface, the electronic device 110 can send the live broadcast content and the corresponding multiple layers to the server 130, so that the server can trigger different subsequent processes based on the live broadcaster's selection of the live broadcast mode (for example, the first live broadcast mode or the second live broadcast mode).

[0070] In block 405, the server 130 can extract a foreground object (such as a human object) from the captured content to construct a three-dimensional model associated with the foreground object. That is, the server 130 can perform matte extraction on the captured content to separate the human from the background in the captured content to construct a three-dimensional model of the human. Further, the server 130 can construct a second layer based on the three-dimensional model.

[0071] In block 406, the server 130 may remove the area corresponding to the foreground object from the captured content. Further, the server 130 may construct a third layer corresponding to the background content by filling the area. As an example, the server 130 may, for example, remove the area corresponding to the human object from the captured content. Further, the server 130 may perform background filling on the area after removing the human using a target algorithm to construct a third layer corresponding to the background content.

[0072] As an example, the second live broadcast mode may take five layers as an example. For example, material layer 1, material layer 2, human layer (or second layer), material layer 3, background layer (or third layer). In some embodiments, the depth of such a third layer may be greater than the depth of the second layer.

[0073] In addition, in block 407, the server 130 may also perform depth estimation on the human. In block 408, the server may also perform two-dimensional to three-dimensional conversion or depth quantization on the human.

[0074] Further, in block 409, the service 130 may splice the content formed above into a video stream. Such a video stream includes but is not limited to: live source stream, human edge information stream, background filling stream, and depth stream.

[0075] In block 410, the server 130 may encode the video stream and send it to the electronic device at the user's side.

[0076] In block 411, the electronic device may decode the video stream.

[0077] In block 412, the electronic device may perform depth inverse quantization on the decoded video stream, so that it can be viewed on the electronic device.

[0078] In block 413, the electronic device 110 may receive the converted video stream and multi-layer material content, perform content rendering, etc. through the electronic device 110, and finally present a multi-layer live broadcast with a "spatial dislocation" effect on the user's electronic device. Taking three layers as an example, the electronic device 110 may perform multi-layer material rendering on the three layers and may change the content displayed by the three layers by sensing the change of the gyroscope. Taking five layers as an example, the electronic device 110 may perform human modeling and real-time texture mapping on layer 3 (for example, the human layer) and may perform multi-layer rendering processing on the five layers. Further, the electronic device 110 may also change the content displayed by the five layers by sensing the change of the gyroscope.

[0079] In an embodiment of the present disclosure, an electronic device adjusts the display content of at least one layer among multiple layers based on the attitude information of the electronic device to update the live broadcast screen. In some embodiments, such attitude information can be determined, for example, by sensors at the electronic device, such as a gyroscope, an acceleration sensor, an angle sensor, and the like.

[0080] In some embodiments, based on the attitude information, the display angle of a predetermined object in at least one layer can be adjusted, and the predetermined object is a foreground object in the shooting content.

[0081] In some embodiments, based on the attitude information, the parameter information of a virtual camera can be determined. Further, the electronic device 110 can adjust the display content of at least one layer based on the parameter information and the depth information of multiple layers, that is, by sensing the changes of the gyroscope, the layers interact and change with each other to present a 3D visual effect.

[0082] In this way, the embodiments of the present disclosure can expand the live broadcast screen from a traditional two-dimensional plane to a three-dimensional space by introducing multiple layers and depth information, enhancing the sense of three-dimensionality and space. In addition, the present disclosure can adjust the layer display content by changing the attitude information of the electronic device, so as to obtain a visual effect similar to the perspective change in the real world and improve the transmission effect of the live broadcast content.

[0083] Example interaction

[0084] The process of an example interface interaction according to an embodiment of the present disclosure will be described below with reference to the accompanying drawings.

[0085] Figures 5A to 5F Examples of interfaces 500A to 500F according to some embodiments of the present disclosure are shown. The interfaces 500A to 500F can be provided by Figure 1 the electronic device 110 shown. Such interfaces 500A to 500F can be associated with the live broadcaster, that is, the electronic device 110 can be, for example, the electronic device corresponding to the live broadcaster.

[0086] Figure 5A An example configuration interface 500A according to some embodiments of the present disclosure is shown. In some embodiments, the configuration interface 500A can be a configuration interface provided for the live broadcaster. In some embodiments, such a configuration interface 500A can display, for example, a live broadcast preview screen, live broadcast effect configuration controls, and the like. As Figure 5A shown, the electronic device 110 can present a live broadcast preview component 510 in the configuration interface 500A to add the current live broadcast screen, for example, a game screen, a sports live broadcast screen, or the screen of the anchor himself, etc., so as to realize the preview of the live broadcast screen.

[0087] In some embodiments, the electronic device may receive a request to start a live broadcast using multiple layers via the configuration interface 500A. As an example, the electronic device 110 may provide a preset control 512 in the configuration interface 500A, and this preset component 512 may be associated with the stereoscopic effect of the live broadcast screen. For example, the user may achieve a 3D live broadcast effect based on this preset control 512. Specifically, the electronic device 110 may receive a live broadcast start request to start a live broadcast using multiple layers in response to the user's trigger of the preset control 512. At this time, the electronic device may present an interface 500B as shown in Figure 5B The interface 500B can also be presented in the form of an interactive panel, for example, this interactive panel can be presented on the configuration interface 500B with a preset transparency and / or a preset size. Further, the electronic device may determine multiple layers via the configuration interface 500B.

[0088] Continuing to refer to Figure 5B , the electronic device 110 may present a preview component 520 in the interface 500B to display a preview screen of the current live broadcast, for example, the screen of the anchor himself / herself. Further, the electronic device 110 may present a selection control corresponding to the live broadcast mode in the interface 500B to support the user to select the live broadcast mode via the configuration interface 500B, and then the electronic device may determine the live broadcast mode.

[0089] As an example, the electronic device 110 may present a first control 522 in the interface 500B, and this first control 522 may be used to select whether to generate a three-dimensional model associated with a predetermined object in the captured content (preview screen). The captured content may be presented in the preview component 520. The predetermined object may be any appropriate object, such as a person, an animal, etc. Taking the preset object as a person as an example, the first control 522 may be used to select whether to enable person keying to generate a three-dimensional model associated with the person in the preview screen (captured content), and the person and the background in the preview screen may be separated to obtain a person layer and a background layer.

[0090] Specifically, the electronic device may determine that the current live broadcast mode indicates generating a three-dimensional model associated with the person in the captured content in response to receiving an operation to turn on the first control 522. The electronic device may determine that the current live broadcast mode indicates not generating a three-dimensional model associated with the person in the captured content in response to receiving an operation to turn off the first control 522 or when the first control 522 is not selected. To make the 3D live broadcast effect more realistic, the electronic device 110 may also present a set of candidate materials, and the source of such a set of candidate materials may include preset materials in the application, materials uploaded by other users, materials uploaded by individuals, etc. Taking Figure 5BFor example, the electronic device 110 can present a set of candidate materials in the interface 500B. For example, the candidate materials 524-1, the candidate materials 524-2, and the candidate materials 524-3 (individually or collectively referred to as the candidate materials 524). Such candidate materials 524 include, but are not limited to, image materials, video materials, etc. It can be understood that the present disclosure is not intended to limit the source, style, and number of such candidate materials.

[0091] In some embodiments, the electronic device 110 can determine the display style of the material layer based on the user's selection. As an example, in response to the user's selection of the first control 522, the electronic device 110 can enable the person keying function to obtain the person layer and the background layer. Further, the electronic device 110 can determine the display style of the material layer in response to the user's selection of the target candidate material (e.g., material 3) in the candidate materials 524. It can be understood that the order of the above steps is only an exemplary illustration. The user can also first select the target candidate material and then enable the person keying function, or the electronic device 110 can default to enabling the person keying function in response to the user's selection of the target candidate material.

[0092] In some embodiments, in response to receiving the user's selection of the target candidate material, the electronic device 110 can present Figure 5C the interface 500C as shown. In the interface 500C, the electronic device 110 can present the 3D live broadcast effect of the preview screen after adding the material layer in the preview component 520. For example, the user can perform a drag operation on the preview screen based on the left mouse button to view the 3D effect of the preview screen.

[0093] To implement the editing operation of the material layer, in response to receiving the user's selection of the target candidate material, the electronic device 110 can also present a second control 530 on the image cover corresponding to the target candidate material (e.g., material 3). Specifically, in response to receiving the user's selection of the second control 530, the electronic device 110 can present Figure 5D the interface 500D as shown. In the interface 500D, the electronic device 110 can present the layer editing component 540 corresponding to the target candidate material (e.g., material 3).

[0094] In some embodiments, the electronic device 110 may present a set of layers in the layer editing component 540, such a set of layers may include, for example, a material layer, a character layer, and a background layer, and the set of layers is a plurality of images determined based on the broadcast mode indicating the generation of a three-dimensional model associated with a character in the captured content. In order to make the live broadcast effect viewed by the user more three-dimensional and vivid, the live broadcast screen may also include a plurality of material layers. Such a plurality of material layers may be materials of the same style or materials of different styles. For ease of description, the following is an introduction to material layers of the same style. In some embodiments, these multiple layers may correspond to a predetermined depth relationship. As an example, in order to highlight the character, the depth corresponding to the character layer is generally lower than the depth of the background layer.

[0095] Taking five layers as an example, the electronic device 110 can display five layers in the layer editing component 540. The order of such layers can be, for example, the first layer: material layer; the second layer: material layer; the third layer: the character layer obtained after the character is cut out; the fourth layer: the material layer; the fifth layer: the background layer obtained after the character is cut out and the background is filled.

[0096] Further, the electronic device 110 may support the user to edit the display position and / or quantity of the material layer based on the layer editing component 540, for example, the operation of hiding or displaying the material layer. Specifically, the electronic device 110 may provide a set of preset controls corresponding to the material layer, for example, a preset control 542-1 corresponding to the first layer, a preset control 542-2 corresponding to the second layer, and a preset control 542-3 corresponding to the fourth layer (individually or collectively referred to as preset controls 542). As an example, the electronic device 110 may hide or display the material layer in response to the user's selection of the preset control 542-1 corresponding to the first layer.

[0097] In the layer editing component 540, the electronic device 110 can also present a set of preset controls 544 to implement editing for the set of layers (e.g., five layers). As an example, the electronic device 110 can be restored to the material selection based on the user's triggering of control 1 (e.g., cancel) in a set of preset controls 544, and the user's current editing result for the layer is not saved. The electronic device 110 can be restored to the default selection based on the user's triggering of control 2 (e.g., reset) in a set of preset controls 544. The electronic device 110 can return to the material selection based on the user's triggering of control 3 (e.g., save) in a set of preset controls 544, and the current editing result for the layer can still be saved after the target candidate material is replaced. For example, the electronic device 110 can still present the editing result of the material layer corresponding to the hidden second layer in the layer editing component 540 in response to the user replacing material 3 with material 2.

[0098] As can be seen from the above description, the electronic device can adjust the depth relationship between multiple layers via the configuration interface 500D. For example, when the second layer is hidden, the depths corresponding to the third, fourth, and fifth layers all become shallower, while the depth corresponding to the first layer remains unchanged. For another example, when the reset control in the configuration interface 500D is selected, the current multiple layers are updated to the first layer, the second layer, the third layer, the fourth layer, and the fifth layer again. At this time, compared with the situation where the second image is hidden, the depths corresponding to the third, fourth, and fifth layers all become deeper.

[0099] Reference Figure 5E , in some other embodiments, the electronic device 110 can close the person keying in response to the user closing the first control 522, and the electronic device 110 can present a set of layers in the layer editing component 540 in response to the user's selection of a target candidate material (for example, material 3). Such a set of layers can be, for example, a preset number of layers, for example, three layers. In some embodiments, such three layers can be determined based on a preset order. For example, the first layer: material layer; the second layer: material layer; the third layer: live content layer. Specifically, these three layers are multiple images determined based on a live broadcast mode indicating not to generate a three-dimensional model associated with the person in the captured content. In this scenario, the electronic device 110 can display two material layers, and when both material layers are closed, the 3D live broadcast effect can be default closed. In some embodiments, these two material layers can also be of the same style or different styles. In some embodiments, there can also be a predetermined depth relationship between these three layers.

[0100] Furthermore, the electronic device 110 can support the user to edit the display position and / or quantity of the material layer based on the layer editing component 540, for example, operations for hiding or displaying the material layer. Specifically, the electronic device 110 can provide a set of preset controls corresponding to the material layer, for example, the preset control 550-1 corresponding to the first layer and the preset control 550-2 corresponding to the second layer (collectively or individually referred to as the preset control 550). As an example, the electronic device 110 can hide or display the material layer in response to the user's selection of the preset control 550-1 corresponding to the first layer. As an example, the electronic device 110 can hide or display the material layer in response to the user's selection of the preset control 550-2 corresponding to the second layer.

[0101] Further, the electronic device 110 can be restored to material selection based on the user's trigger of control 1 (e.g., cancel) among a set of preset controls 544, and the current editing result of the user for the layer is not saved. The electronic device 110 can be restored to the default selection based on the user's trigger of control 2 (e.g., reset) among a set of preset controls 544. The electronic device 110 can return to the interface 500F as shown Figure 5F based on the user's trigger of control 3 (e.g., save) among a set of preset controls 544. In the interface 500F, the word "edited" can be presented in the cover image of the target candidate material (e.g., material 3), that is, the current 3D live effect is displayed with material 3 as the material layer.

[0102] Further, the electronic device can perform material selection via the interface 500E, and still save the current editing result for the layer after replacing the target candidate material. For example, when the electronic device 110 responds to the user replacing material 3 with material 2, it can still present the editing result of hiding the material layer corresponding to the second layer in the layer editing component 540.

[0103] As can be seen from the above description, the electronic device can adjust the depth relationship between multiple layers via the configuration interface 500E. For example, when the second layer is hidden, the depths corresponding to the third layer all become shallower, while the depth corresponding to the first layer remains unchanged. Another example is that when the first layer is hidden, the depths corresponding to the second layer and the third layer both become shallower.

[0104] Example process

[0105] Figure 6A shows a flowchart of an example interface interaction process 600A according to some embodiments of the present disclosure. The process 600A can be implemented at the electronic device 110. The following refers to Figure 1 describe the process 600A.

[0106] As Figure 6A shown, at block 610, the electronic device 110 presents a live interface at the electronic device, and the live video presented in the live interface includes multiple layers, and the multiple layers correspond to different depths.

[0107] At block 620, the electronic device 110 adjusts the display content of at least one layer among the multiple layers based on the attitude information of the electronic device to update the live video.

[0108] In this way, embodiments of the present disclosure can expand the live broadcast screen from a traditional two-dimensional plane to a three-dimensional space by introducing multiple layers and depth information, enhancing the sense of three-dimensionality and spatiality. Additionally, the present disclosure can adjust the layer display content by changing the pose information of the electronic device, thereby obtaining a visual effect similar to the perspective change in the real world and improving the transmission effect of the live broadcast content.

[0109] In some embodiments, the multiple layers include at least one picture layer determined based on the shooting content associated with the live broadcaster of the live broadcast interface.

[0110] In this way, embodiments of the present disclosure can use the shooting content of the live broadcaster as at least one picture layer, and combine it with other layers in the multiple layers to display richer visual effects during the live broadcast.

[0111] In some embodiments, the live broadcast interface corresponds to a first live broadcast mode, and at least one picture layer includes a single first layer corresponding to the shooting content.

[0112] In this way, embodiments of the present disclosure can use the shooting content as a single first layer, which can ensure that the core content dominates the live broadcast screen, avoid being interfered by the content of other layers, and improve the quality of the live broadcast content.

[0113] In some embodiments, the live broadcast interface corresponds to a second live broadcast mode, and at least one picture layer includes: a second layer corresponding to the foreground content in the shooting content; and a third layer corresponding to the background content in the shooting content.

[0114] In this way, embodiments of the present disclosure can place the foreground and background content in different layers respectively, so that the live broadcast screen can present richer depth information and three-dimensionality, and can achieve a richer visual hierarchy.

[0115] In some embodiments, the second layer is generated based on the following process: extracting the foreground object from the shooting content; constructing a three-dimensional model associated with the foreground object; and constructing the second layer based on the three-dimensional model.

[0116] In this way, embodiments of the present disclosure can extract the foreground object from the shooting content to ensure the separation of the foreground content from the background, providing a clear object for subsequent three-dimensional modeling. Additionally, constructing a three-dimensional model based on the extracted foreground object endows the foreground object with depth and three-dimensionality, and generating the second layer based on the three-dimensional model can make the foreground content have a three-dimensional and dynamic effect in the live broadcast screen.

[0117] In some embodiments, the third layer is generated based on the following process: removing the area corresponding to the foreground object from the shooting content; and constructing the third layer corresponding to the background content by filling the area.

[0118] In this way, embodiments of the present disclosure can fill the area after removing the foreground object, construct a complete background layer, and ensure the integrity and aesthetics of the background layer.

[0119] In some embodiments, the depth of the third layer is greater than the depth of the second layer.

[0120] Since the background is usually farther away than the foreground, in this way, embodiments of the present disclosure can, through this depth relationship between the second layer and the third layer, make it conform to the human vision's perception of the real world, thereby enhancing the three-dimensional sense and spatial sense of the live broadcast screen.

[0121] In some embodiments, the multiple layers include at least one material layer, and the at least one material layer includes material content configured by the live broadcaster of the live broadcast interface.

[0122] In this way, embodiments of the present disclosure can effectively enhance the richness and diversity of the live broadcast content by adding diverse material content.

[0123] In some embodiments, adjusting the display content of at least one layer among the multiple layers includes: based on the pose information, adjusting the display angle of a predetermined object in at least one layer, where the predetermined object is the foreground object in the captured content.

[0124] In this way, embodiments of the present disclosure enable users to view different angles of the foreground object in real time by changing the pose of the device (such as rotation, tilt), so that users can more comprehensively understand the details of the foreground object and improve the information transmission efficiency.

[0125] In some embodiments, adjusting the display content of at least one layer among the multiple layers to update the live broadcast screen includes: based on the pose information, determining the parameter information of the virtual camera; and based on the parameter information and the depth information of the multiple layers, adjusting the display content of at least one layer.

[0126] In this way, embodiments of the present disclosure can adjust the viewing angle in real time by changing the pose of the device (such as rotation, tilt) to observe different layer contents in the live broadcast screen, enhancing the visual attraction. In addition, by combining the depth information of the multiple layers and adjusting the display content of the layers according to the parameters of the virtual camera, a more realistic three-dimensional visual effect can be achieved.

[0127] In some embodiments, the multiple layers are constructed based on the following process: providing a configuration interface to the live broadcaster of the live broadcast interface; and in response to receiving a live broadcast start request using the multiple layers via the configuration interface, determining the multiple layers via the configuration interface.

[0128] In this way, embodiments of the present disclosure can complete the settings and previews of all layers through a configuration interface, improving the configuration efficiency of the layers.

[0129] In some embodiments, determining a plurality of layers via the configuration interface includes: via the configuration interface, determining a live broadcast mode, where the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the captured content; and based on the live broadcast mode, determining a plurality of layers.

[0130] In this way, embodiments of the present disclosure can, via the configuration interface, set the live broadcast mode and can automatically determine the layer structure according to the live broadcast mode, effectively improving the configuration efficiency of the layers. Additionally, different live broadcast modes can meet different live broadcast requirements.

[0131] In some embodiments, determining a plurality of layers via the configuration interface includes: via the configuration interface, adding at least one piece of material content to construct at least one material layer corresponding to the at least one piece of material content.

[0132] In this way, embodiments of the present disclosure can, via the configuration interface, add diverse material content, effectively enhancing the richness and diversity of the live broadcast content. Moreover, the creation of the material layer can be achieved via the configuration interface without any other additional operations, effectively improving the configuration efficiency of the material layer.

[0133] In some embodiments, determining a plurality of layers via the configuration interface includes: via the configuration interface, adjusting the depth relationship between a plurality of layers.

[0134] In this way, embodiments of the present disclosure can adjust the depth relationship via the configuration interface, improving the management efficiency of the depth relationship. Additionally, the present disclosure can, by adjusting the depth relationship, make the live broadcast screen closer to the visual effect of the real world, enhancing the three-dimensional sense and spatial sense.

[0135] Figure 6B Shows a flowchart of an example process 600B for live broadcast according to some embodiments of the present disclosure. Process 600B can be implemented at the electronic device 110. The following refers to Figure 1 Describe process 600B.

[0136] As Figure 6B shown, at block 630, the electronic device 110 provides a configuration interface to the live broadcaster.

[0137] At block 640, in response to a live broadcast request received via the configuration interface that utilizes a plurality of layers, the electronic device 110 determines a plurality of layers via the configuration interface to present a live broadcast screen including a plurality of layers in the live broadcaster's live broadcast interface.

[0138] In some embodiments, the live broadcast interface is configured to: adjust the display content of at least one layer among a plurality of layers based on the attitude information of the electronic device presenting the live broadcast interface, so as to update the live broadcast screen.

[0139] In some embodiments, determining the plurality of layers via the configuration interface includes: determining, via the configuration interface, a live broadcast mode, where the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the shooting content; and determining the plurality of layers based on the live broadcast mode.

[0140] In some embodiments, determining the plurality of layers via the configuration interface includes: adding at least one piece of material content via the configuration interface to construct at least one material layer corresponding to the at least one piece of material content.

[0141] In some embodiments, determining the plurality of layers via the configuration interface includes: adjusting the depth relationship among the plurality of layers via the configuration interface.

[0142] Example device and equipment

[0143] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes. Figure 7A The schematic structural block diagram of an example apparatus 700A for interface interaction according to certain embodiments of the present disclosure is shown. Apparatus 700A can be implemented as or included in an electronic device 110. Each module / component in apparatus 700A can be implemented by hardware, software, firmware, or any combination thereof.

[0144] As Figure 7A shown, apparatus 700A includes an interface presentation module 710, configured to present a live broadcast interface at the electronic device, where the live broadcast screen presented by the live broadcast interface includes a plurality of layers, and the plurality of layers correspond to different depths; and a content adjustment module 720, configured to adjust the display content of at least one layer among the plurality of layers based on the attitude information of the electronic device, so as to update the live broadcast screen.

[0145] In some embodiments, the plurality of layers include at least one screen layer determined based on the shooting content associated with the live broadcast party of the live broadcast interface.

[0146] In some embodiments, the live broadcast interface corresponds to a first live broadcast mode, and the at least one screen layer includes a single first layer corresponding to the shooting content.

[0147] In some embodiments, the live broadcast interface corresponds to a second live broadcast mode, and the at least one screen layer includes: a second layer corresponding to the foreground content in the shooting content; and a third layer corresponding to the background content in the shooting content.

[0148] In some embodiments, the second layer is generated based on the following process: extracting a foreground object from the captured content; constructing a three-dimensional model associated with the foreground object; and constructing the second layer based on the three-dimensional model.

[0149] In some embodiments, the third layer is generated based on the following process: removing the area corresponding to the foreground object from the captured content; and constructing the third layer corresponding to the background content by filling the area.

[0150] In some embodiments, the depth of the third layer is greater than the depth of the second layer.

[0151] In some embodiments, the multiple layers include at least one material layer, and the at least one material layer includes material content configured by the live broadcaster of the live interface.

[0152] In some embodiments, the content adjustment module 720 is further configured to adjust the display angle of a predetermined object in at least one layer based on the pose information, and the predetermined object is the foreground object in the captured content.

[0153] In some embodiments, the content adjustment module 720 is further configured to determine the parameter information of the virtual camera based on the pose information; and adjust the display content of at least one layer based on the parameter information and the depth information of the multiple layers.

[0154] In some embodiments, the multiple layers are constructed based on the following process: providing a configuration interface to the live broadcaster of the live interface; and determining the multiple layers via the configuration interface in response to a live broadcast request using the multiple layers received via the configuration interface.

[0155] In some embodiments, determining the multiple layers via the configuration interface includes: determining, via the configuration interface, a live broadcast mode, where the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the captured content; and determining the multiple layers based on the live broadcast mode.

[0156] In some embodiments, determining the multiple layers via the configuration interface includes: adding at least one item of material content via the configuration interface to construct at least one material layer corresponding to the at least one item of material content.

[0157] In some embodiments, determining the multiple layers via the configuration interface includes: adjusting the depth relationship between the multiple layers via the configuration interface.

[0158] The modules included in apparatus 700A can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to the machine-executable instructions, some or all of the modules in apparatus 700A can be at least partially implemented by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0159] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes. Figure 7B A schematic structural block diagram of an exemplary apparatus 700B for interface interaction according to certain embodiments of the present disclosure is shown. Apparatus 700B can be implemented as or included in an electronic device 110. Each module / component in apparatus 700B can be implemented by hardware, software, firmware, or any combination thereof.

[0160] As Figure 7B shown, apparatus 700B includes an interface providing module 730 configured to provide a configuration interface to a live broadcaster; and a request receiving module 740 configured to, in response to a live broadcast start request using multiple layers received via the configuration interface, determine multiple layers via the configuration interface to present a live broadcast screen including multiple layers in the live broadcaster's live broadcast interface.

[0161] In some embodiments, the live broadcast interface is configured to: based on the attitude information of the electronic device presenting the live broadcast interface, adjust the display content of at least one of the multiple layers to update the live broadcast screen.

[0162] In some embodiments, the request receiving module 740 is further configured to, via the configuration interface, determine a live broadcast mode, where the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the captured content; and based on the live broadcast mode, determine multiple layers.

[0163] In some embodiments, the request receiving module 740 is further configured to, via the configuration interface, add at least one piece of material content to construct at least one material layer corresponding to the at least one piece of material content.

[0164] In some embodiments, the request receiving module 740 is further configured to, via the configuration interface, adjust the depth relationship between the multiple layers.

[0165] The modules included in apparatus 700B can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to the machine-executable instructions, some or all of the modules in apparatus 700B can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0166] As Figure 8 shown, electronic device 800 is in the form of a general-purpose electronic device. The components of electronic device 800 can include, but are not limited to, one or more processors or processing units 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 can be an actual or virtual processor and is capable of performing various processes according to the programs stored in the memory 820. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing ability of electronic device 800. Figure 8 The electronic device 800 shown can be used to implement Figure 1 electronic device 110.

[0167] Electronic device 800 generally includes multiple computer storage media. Such media can be any accessible media that can be obtained by electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be volatile memory (such as registers, caches, random access memory (RAM)), non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be removable or non-removable media and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 800.

[0168] Electronic device 800 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 8As shown, a disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from and writing to a removable, non-volatile optical disk can be provided. In these cases, each drive can be connected to a bus (not shown) by one or more data medium interfaces. Memory 820 may include a computer program product 825 having one or more program modules configured to perform the various methods or acts of the various embodiments of the present disclosure.

[0169] Communication unit 840 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of electronic device 800 can be implemented in a single computing cluster or multiple computer machines that are capable of communicating via a communication connection. Thus, electronic device 800 can operate in a networked environment using a logical connection to one or more other servers, network personal computers (PCs), or another network node.

[0170] Input device 850 can be one or more input devices such as a mouse, keyboard, trackball, etc. Output device 860 can be one or more output devices such as a display, speaker, printer, etc. Electronic device 800 can also communicate with one or more external devices (not shown) as needed via communication unit 840, the external devices such as storage devices, display devices, etc., communicate with one or more devices that enable a user to interact with electronic device 800, or communicate with any device that enables electronic device 800 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0171] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, where the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the methods described above.

[0172] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0173] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, when executed by the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in one or more boxes of the flowchart and / or block diagram. These computer-readable program instructions may also be stored in a computer-readable storage medium that causes a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises a manufacture including instructions that implement various aspects of the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0174] The computer-readable program instructions may be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other devices to produce a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other devices implement the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0175] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of code, or a portion of an instruction, which comprises one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can be implemented by special-purpose hardware-based systems that perform the specified functions or acts, or combinations of special-purpose hardware and computer instructions.

[0176] The implementations of the present disclosure have been described above. The description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terms used herein is intended to best explain the principles of the implementations, the practical application, or improvements made to the technology in the marketplace, or to enable other ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An interface interaction method, comprising: At an electronic device, presenting a live broadcast interface, wherein the live broadcast image presented by the live broadcast interface includes multiple layers, and the multiple layers correspond to different depths; And Based on the posture information of the electronic device, adjusting the display content of at least one layer among the multiple layers to update the live broadcast image.

2. The method according to claim 1, wherein the multiple layers include at least one picture layer determined based on the shooting content associated with the live broadcaster of the live broadcast interface.

3. The method according to claim 2, wherein the live broadcast interface corresponds to a first live broadcast mode, and the at least one picture layer includes a single first layer corresponding to the shooting content.

4. The method according to claim 2, wherein the live broadcast interface corresponds to a second live broadcast mode, and the at least one picture layer includes: A second layer corresponding to the foreground content in the shooting content; And A third layer corresponding to the background content in the shooting content.

5. The method according to claim 4, wherein the second layer is generated based on the following process: Extracting a foreground object from the shooting content; Constructing a three-dimensional model associated with the foreground object; and Based on the three-dimensional model, constructing the second layer.

6. The method according to claim 4, wherein the third layer is generated based on the following process: Removing the area corresponding to the foreground object from the shooting content; and By filling the area, constructing the third layer corresponding to the background content.

7. The method according to claim 4, wherein the depth of the third layer is greater than the depth of the second layer.

8. The method according to claim 1, wherein the multiple layers include at least one material layer, and the at least one material layer includes material content configured by the live broadcaster of the live broadcast interface.

9. The method according to claim 1, wherein adjusting the display content of at least one layer among the multiple layers includes: Based on the posture information, adjusting the display angle of a predetermined object in the at least one layer, and the predetermined object is the foreground object in the shooting content.

10. The method according to claim 1, wherein adjusting the display content of at least one layer among the multiple layers to update the live broadcast image includes: Based on the posture information, determining parameter information of a virtual camera; And Based on the parameter information and the depth information of the multiple layers, adjusting the display content of the at least one layer.

11. The method according to claim 1, wherein the multiple layers are constructed based on the following process: Providing a configuration interface to the live broadcaster of the live broadcast interface; and In response to a live broadcast request using multiple layers received via the configuration interface, determining the multiple layers via the configuration interface.

12. The method according to claim 11, wherein determining multiple layers via the configuration interface includes: Via the configuration interface, determining a live broadcast mode, and the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the shooting content; And Determine the multiple layers based on the live broadcast mode.

13. The method according to claim 11, wherein determining the multiple layers via the configuration interface includes: Via the configuration interface, add at least one piece of material content to construct at least one material layer corresponding to the at least one piece of material content.

14. The method according to claim 11, wherein determining the multiple layers via the configuration interface includes: Via the configuration interface, adjust the depth relationship between the multiple layers.

15. A method for live broadcast, including: Provide a configuration interface to the live broadcaster; And In response to a live broadcast request using multiple layers received via the configuration interface, determine the multiple layers via the configuration interface to present a live broadcast image including the multiple layers in the live broadcast interface of the live broadcaster.

16. The method according to claim 15, wherein the live broadcast interface is configured to: Based on the attitude information of the electronic device presenting the live broadcast interface, adjust the display content of at least one of the multiple layers to update the live broadcast image.

17. The method according to claim 15, wherein determining the multiple layers via the configuration interface includes: Via the configuration interface, determine a live broadcast mode, where the live broadcast mode indicates whether to generate a three-dimensional model associated with a predetermined object in the captured content; And Based on the live broadcast mode, determine the multiple layers.

18. The method according to claim 15, wherein determining the multiple layers via the configuration interface includes: Via the configuration interface, add at least one piece of material content to construct at least one material layer corresponding to the at least one piece of material content.

19. The method according to claim 15, wherein determining the multiple layers via the configuration interface includes: Via the configuration interface, adjust the depth relationship between the multiple layers.

20. A device for interface interaction, including: An interface presentation module, configured to present a live broadcast interface at an electronic device, where the live broadcast image presented by the live broadcast interface includes multiple layers, and the multiple layers correspond to different depths; And A content adjustment module, configured to adjust the display content of at least one of the multiple layers based on the attitude information of the electronic device to update the live broadcast image.

21. A device for live broadcast, including: An interface providing module, configured to provide a configuration interface to the live broadcaster; And A request receiving module, configured to, in response to a live broadcast request using multiple layers received via the configuration interface, determine the multiple layers via the configuration interface to present a live broadcast image including the multiple layers in the live broadcast interface of the live broadcaster.

22. An electronic device, including: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device executes the method according to any one of claims 1 to 14 or claims 15 to 19.

23. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 14 or claims 15 to 19.

Images