Interface interaction method and device, equipment and storage medium
By presenting the virtual objects corresponding to the participants in the live broadcast interface and dynamically updating them based on the audio input, the problem that users cannot determine the voice information of other participants is solved, and the efficiency and experience of live broadcast interaction are improved.
Patent Information
- Application Number
- CN202411670567.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-20
- Publication Date
- 2025-03-18
AI Technical Summary
During the process of multi-person connection in the live broadcast room, users cannot determine the voice information of other participants in the live broadcast interface, which limits the user's interaction efficiency.
By presenting a live broadcast interface associated with a live broadcast interactive event, the interface includes multiple preset areas, each area corresponds to a participant, presents a virtual object in the corresponding area, and determines the dynamic effect based on the participant's audio input.
It realizes the presentation of virtual objects corresponding to participants in the live broadcast interface, and dynamically updates based on audio input, improving the acquisition efficiency and interactive experience of live broadcast content.
Smart Images

Figure CN119653156A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for interface interaction. Background Art
[0002] With the development of computer technology, more and more users use the Internet for interface interaction. For example, users can use video applications or video services provided by other applications to interact with other users. During the interface interaction, users can connect to multiple microphones. For example, users enter a live broadcast room to connect to multiple microphones. Summary of the invention
[0003] In a first aspect of the present disclosure, a method for interface interaction is provided. The method includes: presenting a live broadcast interface associated with a live broadcast interactive event, the live broadcast interface including a plurality of preset areas, the preset areas corresponding to corresponding participants of the live broadcast interactive event; presenting a first virtual object in a first area of the plurality of preset areas, the first virtual object corresponding to a first participant of the live broadcast interactive event; and presenting a dynamic effect associated with the first virtual object in the first area, the dynamic effect being determined based on an audio input of the first participant.
[0004] In a second aspect of the present disclosure, a device for interface interaction is provided. The device includes: a first presentation module configured to present a live broadcast interface associated with a live broadcast interactive event, wherein the live broadcast interface includes a plurality of preset areas, and the preset areas correspond to corresponding participants of the live broadcast interactive event; a second presentation module configured to present a first virtual object in a first area of the plurality of preset areas, and the first virtual object corresponds to a first participant of the live broadcast interactive event; and a third presentation module configured to present a dynamic effect associated with the first virtual object in the first area, and the dynamic effect is determined based on an audio input of the first participant.
[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.
[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0009] Figure 1 A schematic diagram showing an example environment in which embodiments according to the present disclosure may be implemented;
[0010] FIG. 2A to FIG. 2B shows an example interface according to some embodiments of the present disclosure;
[0011] FIG. 3A to FIG. 3C shows an example interface according to some embodiments of the present disclosure;
[0012] Figure 4 A flowchart of generating dynamic effects according to some embodiments of the present disclosure is shown;
[0013] Figure 5 A flowchart showing an example process of interface interaction according to some embodiments of the present disclosure;
[0014] Figure 6 A schematic structural block diagram showing an example device for interface interaction according to some embodiments of the present disclosure; and
[0015] Figure 7 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0017] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.
[0018] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.
[0019] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects are subject to the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user knows and confirms. Accordingly, when implementing each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.
[0020] In this specification and the embodiments, if personal information processing is involved, it will be processed on the premise of having a legal basis (such as obtaining the consent of the subject of personal information, or it is necessary to perform a contract, etc.), and will only be processed within the scope of regulations or agreements. If a user refuses to process personal information other than the necessary information for basic functions, it will not affect the user's use of basic functions.
[0021] As mentioned above, connecting to the microphone in the live broadcast room is an important type of interface interaction. For example, as a guest in the live broadcast room, you can go on the microphone to participate in the multi-person connection event in the live broadcast room. In the traditional solution, the multi-person connection event only presents information such as the user's avatar. However, users cannot confirm the voice information of other participants in the live broadcast interface, which limits the user's interaction efficiency to a certain extent.
[0022] The embodiment of the present disclosure proposes a scheme for interface interaction. The scheme includes: presenting a live broadcast interface associated with a live broadcast interactive event, wherein the live broadcast interface includes multiple preset areas, and the preset areas correspond to corresponding participants of the live broadcast interactive event; presenting a first virtual object in a first area of the multiple preset areas, and the first virtual object corresponds to a first participant of the live broadcast interactive event; and presenting a dynamic effect associated with the first virtual object in the first area, and the dynamic effect is determined based on the audio input of the first participant.
[0023] In this way, the embodiments of the present disclosure can present virtual objects corresponding to the participants in the live broadcast interface, and can present dynamic effects corresponding to the virtual objects accordingly based on the audio input of the participants. Thus, the embodiments of the present disclosure can help improve the efficiency of obtaining live broadcast content and enhance the experience of live broadcast interaction.
[0024] Various example implementations of the solution are described in detail below in conjunction with the accompanying drawings.
[0025] Example Environment
[0026] Figure 1 1 is a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, example environment 100 may include electronic device 110 .
[0027] In this example environment 100, the electronic device 110 may run an application 120 that supports interface interaction. The application 120 may be any appropriate type of application for interface interaction, examples of which may include but are not limited to: an online voice application or other appropriate application that provides interface interaction services. The user 140 may interact with the application 120 via the electronic device 110 and / or its attached device.
[0028] exist Figure 1 In the environment 100, if the application 120 is in an active state, the electronic device 110 can present an interface 150 for supporting interface interaction through the application 120.
[0029] In some embodiments, the electronic device 110 communicates with the server 130 to provide services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a game device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).
[0030] The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 120 that supports interface interaction in the electronic device 110.
[0031] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.
[0032] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.
[0033] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.
[0034] Example Interaction
[0035] FIG. 2A to FIG. 2B 200A to 200B according to some embodiments of the present disclosure. The interfaces 200A to 200B may be composed of, for example, Figure 1 The electronic device 110 shown is provided. The electronic device 110 may correspond to any appropriate user associated with the live interactive event, for example, a host user, a guest user, or an audience user.
[0036] like Figure 2A As shown, the electronic device 110 may present a live interface 200A associated with a live interactive event. In some embodiments, a live interactive event may be associated with multiple participants. As an example, a live interactive event may be a microphone connection event between multiple anchor users. As another example, a live interactive event may also be an audio interactive event between an anchor user and one or more guest users in a live studio.
[0037] Furthermore, the live broadcast interface 200A may include a plurality of preset areas. For example, the plurality of preset areas may include a first area 210, a second area 212, a third area 214, a fourth area 216, etc. in the live broadcast interface 200A.
[0038] As an example, each preset area may correspond to a corresponding participant of the live interactive event. For example, the first area 210 may correspond to the first participant of the live interactive event (e.g., user A), the second area 212 may correspond to the second participant of the live interactive event (e.g., user B), the third area 214 may correspond to the third participant of the live interactive event (e.g., user C), and the fourth area 216 may correspond to the fourth participant of the live interactive event (e.g., user D).
[0039] As an example, the electronic device 110 may present a first virtual object 220 corresponding to a participant (e.g., user A) of the live interactive event in the first area 210. As will be described in detail below, the first virtual object 220 may include a virtual object preset by the platform, a virtual object selected by user A, or a virtual object generated based on generation parameters configured by user A. The specific configuration process of the first virtual object 220 will be described in detail below.
[0040] In some embodiments, when user A inputs audio in a live interactive event, the electronic device 110 may present a dynamic effect associated with the first virtual object 220 in the first area 210. For example, the dynamic effect may include movement of a preset part of the first virtual object 220, such as a mouth movement.
[0041] In some embodiments, the dynamic effect may be determined based on the audio input of user A. In some embodiments, in response to user A being in a first state (e.g., audio input state), the electronic device 110 may present a dynamic effect associated with the first virtual object 220. For example, when the electronic device corresponding to user A detects the audio input of the first participant, the live interface 200A associated with the live interactive event may present a dynamic effect corresponding to the audio input, such as mouth movement.
[0042] In some embodiments, Figure 2BAs shown, in response to user A being in the second state, the electronic device 110 may present preset content associated with the first virtual object 220 in the first area 210. Specifically, the second state may indicate that no audio input of user A is detected. As an example, in a state where user A does not provide audio input, the electronic device 110 may, for example, present preset content associated with the first virtual object 220. As an example, the preset content may, for example, include a static visual representation of the first virtual object 220. In other embodiments, the preset content may also include a preset dynamic representation of the first virtual object 220, such as eye movement, head movement, etc.
[0043] As described above, Figure 2A The dynamic effect shown includes the movement of a preset part of the first virtual object 220, for example, the movement of the mouth. Figure 2B For example, in the preset content corresponding to the second state, the preset part of the first virtual object 220 may be in a stationary state. Figure 2B In the preset content shown, the mouth of the first virtual object 220 may be in a static state. Alternatively, the mouth of the first virtual object 220 may also be in a state of slight movement, which may be different from the dynamic effect corresponding to the first state, for example.
[0044] In some embodiments, Figure 2A As shown, the electronic device 110 can display multiple virtual objects corresponding to multiple participants in the live broadcast interface 200A. For example, the electronic device 110 can present a second virtual object 222 in the second area 212, and the second virtual object 222 corresponds to user B. The electronic device 110 can also present a third virtual object 224 in the third area 214, and the third virtual object 224 corresponds to user C. The electronic device 110 can present a fourth virtual object 226 in the fourth area 216, and the fourth virtual object 226 corresponds to user D.
[0045] Similar to the example described above, the electronic device 110 may also present dynamic effects associated with the second to fourth virtual objects 222 to 226 in response to audio input of the corresponding participants.
[0046] In this way, the embodiments of the present disclosure can facilitate users to intuitively perceive the participants who are currently providing audio input in a live interactive event, thereby improving the efficiency of obtaining live information.
[0047] The following will further refer to FIG. 3A to FIG. 3C To describe an example process for configuring a virtual object. FIG. 3A to FIG. 3C 300A to 300C according to some embodiments of the present disclosure. The interfaces 300A to 300C may be composed of, for example, Figure 1The electronic device 110 shown is provided. As an example, the interfaces 300A to 300C may correspond to the first participant (eg, user A) described above.
[0048] In some embodiments, Figure 3A As shown, upon receiving a request from a first participant (e.g., user A) to join a live interactive event, the electronic device 110 may present a configuration panel. Further, the configuration panel may include a generation entry 305 and a group of candidate virtual objects. As an example, a group of candidate virtual objects may include a first candidate virtual object 310, a second candidate virtual object 312, and a third candidate virtual object 314.
[0049] Additionally, the electronic device 110 may receive the first participant's selection of a first virtual object from a set of candidate virtual objects to determine the first virtual object. For example, the electronic device 110 receives user A's selection of the first candidate virtual object 310 and determines the first candidate virtual object 310 as the first virtual object.
[0050] Additionally, the electronic device 110 may also support generating the first virtual object by generating an entry. For example, the electronic device 110 receives a selection of the generation entry 305 by user A, and generates the first virtual object according to the generation operation of user A.
[0051] In some embodiments, Figure 3B As shown, the electronic device 110 may present a generation interface 300B based on the selection of the generation entry 305. Specifically, the electronic device 110 may obtain at least one generation parameter via the generation interface 300B.
[0052] In some embodiments, the at least one generation parameter obtained may include a reference image 320. As an example, the reference image 320 may include an image captured via the generation interface 300B. Alternatively or additionally, the reference image 320 may also include an image uploaded via the generation interface 300B. For example, user A may use the captured image as the reference image 320.
[0053] Additionally, at least one of the generation parameters may also include a prompt word input by the first participant. For example, user A may input a prompt word in the prompt word area 322 in the generation interface 300B. Alternatively, or a style parameter selected by the first participant. For example, user A may select a corresponding style parameter in the style area 324 in the generation interface 300B.
[0054] Additionally, the electronic device 110 may trigger the generation of the first virtual object based on at least one generation parameter. For example, the electronic device 110 may trigger the generation of the first virtual object based on the image captured by user A, the prompt word input by user A, and the style parameter selected by user A using the generation model. As an example, such a generation model may include but is not limited to any appropriate generation model, such as a generation model of a two-dimensional image or a three-dimensional image, etc. Accordingly, the first virtual object may include, for example, a two-dimensional image, a three-dimensional image, or three-dimensional model data.
[0055] In some embodiments, Figure 3C As shown, in response to the completion of the generation of the first virtual object, the electronic device 110 may also update a set of candidate virtual objects in the configuration panel. For example, the electronic device 110 may add the generated first virtual object 330 to a set of candidate virtual objects displayed in the configuration panel. Further, in response to the completion of the generation of the first virtual object, the electronic device 110 may also present a preview content of the first virtual object in the configuration panel.
[0056] Therefore, the embodiments of the present disclosure can support participants to customize corresponding virtual objects, thereby improving the quality of virtual objects.
[0057] The following will further combine Figure 4 To describe the generation process of the dynamic effects described above. Figure 4 An example process of generating dynamic effects according to some embodiments of the present disclosure is shown.
[0058] In some scenarios, the server 130 may, for example, pre-generate multiple videos based on the image data of the virtual object mentioned above. As an example, the multiple videos may include a dynamic video 410 (also referred to as a first video) corresponding to the first state (e.g., voice input state) mentioned above. Alternatively, the multiple videos may also include a static video 415 (also referred to as a second video) corresponding to the second state (i.e., a state in which no voice input is detected).
[0059] As an example, dynamic video 410 may include the movement of the virtual object's mouth. In contrast, in static video 415, the virtual object's mouth may be stationary.
[0060] Accordingly, when the voice input of a participant (eg, a guest user) is detected, the dynamic effect of the virtual object played by the live interface may be determined based on the first video. Figure 4 As shown, the terminal device 420 corresponding to the participant can obtain the dynamic video 410 and the static video 415 from the video cloud 405. Further, the terminal device 420 can extract one or more video frames from the dynamic video 410 to obtain the video frame 425 corresponding to the participant.
[0061] Furthermore, the RTC server 430 can merge the audio data and the video data to push them to the CDN (Content Distribution Network) 435. Furthermore, the client 440 corresponding to the audience user in the live broadcast room can obtain the push content from the CDN 435, thereby presenting the dynamic effect of the virtual object.
[0062] On the contrary, if the terminal device 420 does not detect the audio input, the terminal device 420 can generate the streaming content based on the static video 415 so that the client 440 can present the preset content of the virtual object, for example, a still picture of the mouth.
[0063] Combination of the above Figure 4 The invention describes dynamically generating corresponding pictures of virtual objects by pre-generating video content corresponding to multiple states, so that the movement of virtual objects can be driven based on the state of audio input. In this way, such dynamic effects are preset effects that can be opposed to the content of the audio input of the participants.
[0064] In some embodiments, the dynamic effect corresponding to the virtual object can also be generated based on the content of the audio input. For example, the mouth movement of the virtual object can be driven based on the text content corresponding to the audio input, thereby achieving a more realistic dynamic effect.
[0065] In this way, the embodiments of the present disclosure can present virtual objects corresponding to the participants in the live broadcast interface, and can present dynamic effects corresponding to the virtual objects accordingly based on the audio input of the participants. Thus, the embodiments of the present disclosure can help improve the efficiency of obtaining live broadcast content and enhance the experience of live broadcast interaction.
[0066] Example Process
[0067] Figure 5 FIG. 5 is a flowchart showing an example process 500 of interface interaction according to some embodiments of the present disclosure. The process 500 may be implemented at the electronic device 110. Figure 1 The process 500 is described below.
[0068] like Figure 5 As shown, in box 510, the electronic device 110 presents a live broadcast interface associated with the live broadcast interactive event, and the live broadcast interface includes multiple preset areas, and the preset areas correspond to corresponding participants of the live broadcast interactive event.
[0069] In box 520, the electronic device 110 presents a first virtual object in a first area of multiple preset areas, and the first virtual object corresponds to a first participant of the live interactive event.
[0070] In box 530, the electronic device 110 presents a dynamic effect associated with the first virtual object in the first area, and the dynamic effect is determined based on the audio input of the first participant.
[0071] In some embodiments, presenting a dynamic effect associated with the first virtual object includes: in response to the first party being in a first state, presenting a dynamic effect associated with the first virtual object, the first state indicating that an audio input of the first party is detected.
[0072] In some embodiments, process 500 further includes presenting preset content associated with the first virtual object in the first area in response to the first participant being in a second state, the second state indicating that no audio input of the first participant is detected.
[0073] In some embodiments, the dynamic effect includes movement of a preset part of the first virtual object, and in the preset content, the preset part of the first virtual object is in a stationary state.
[0074] In some embodiments, the dynamic effect is determined based on a first video corresponding to a first state, the preset content is determined based on a second video corresponding to a second state, and the first video and the second video are pre-generated based on image data of the first virtual object.
[0075] In some embodiments, the dynamic effect is generated based on the content of the audio input; or the dynamic effect is a preset effect associated with the first virtual object, and the preset effect is independent of the content of the audio input.
[0076] In some embodiments, the first virtual object includes: a preset virtual object; a virtual object selected by the first party from a plurality of candidate virtual objects; or a virtual object generated based on generation parameters configured by the first party.
[0077] In some embodiments, the first virtual object is determined based on the following process: in response to receiving a request from a first participant to join a live interactive event, presenting a configuration panel, the configuration panel including a generation entrance and a set of candidate virtual objects; and receiving a selection of a first virtual object from a set of candidate virtual objects by the first participant, or generating the first virtual object based on the selection of the generation entrance.
[0078] In some embodiments, generating a first virtual object based on selection of a generation entry includes: presenting a generation interface based on selection of the generation entry; acquiring at least one generation parameter via the generation interface, the at least one generation parameter including a reference image, the reference image including a captured image and / or an uploaded image; and triggering generation of the first virtual object based on at least one generation parameter.
[0079] In some embodiments, at least one generation parameter further includes: a prompt word input by the first participant; or a style parameter selected by the first participant.
[0080] In some embodiments, process 500 further includes: in response to completion of generation of the first virtual object, updating a set of candidate virtual objects in the configuration panel.
[0081] In some embodiments, the audio input is a first audio input, the dynamic effect is a first dynamic effect, and the method further includes: presenting a second virtual object in a second area of multiple preset areas, the second virtual object corresponding to a second participant in the live interactive event; and presenting a second dynamic effect associated with the second virtual object in the second area, the second dynamic effect being determined based on a second audio input of the second participant.
[0082] Example devices and equipment
[0083] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 6 A schematic structural block diagram of an example apparatus 600 for interface interaction according to some embodiments of the present disclosure is shown. The apparatus 600 may be implemented as or included in the electronic device 110. Each module / component in the apparatus 600 may be implemented by hardware, software, firmware, or any combination thereof.
[0084] like Figure 6 As shown, the device 600 includes: a first presentation module 610, configured to present a live broadcast interface associated with a live broadcast interactive event, the live broadcast interface including a plurality of preset areas, the preset areas corresponding to corresponding participants of the live broadcast interactive event; a second presentation module 620, configured to present a first virtual object in a first area among the plurality of preset areas, the first virtual object corresponding to a first participant of the live broadcast interactive event; and a third presentation module 630, configured to present a dynamic effect associated with the first virtual object in the first area, the dynamic effect being determined based on the audio input of the first participant.
[0085] In some embodiments, presenting a dynamic effect associated with the first virtual object includes: in response to the first party being in a first state, presenting a dynamic effect associated with the first virtual object, the first state indicating that an audio input of the first party is detected.
[0086] In some embodiments, the device 600 also includes: a fourth presentation module, configured to present preset content associated with the first virtual object in the first area in response to the first participant being in a second state, and the second state indicates that no audio input of the first participant is detected.
[0087] In some embodiments, the dynamic effect includes movement of a preset part of the first virtual object, and in the preset content, the preset part of the first virtual object is in a stationary state.
[0088] In some embodiments, the dynamic effect is determined based on a first video corresponding to a first state, the preset content is determined based on a second video corresponding to a second state, and the first video and the second video are pre-generated based on image data of the first virtual object.
[0089] In some embodiments, the dynamic effect is generated based on the content of the audio input; or the dynamic effect is a preset effect associated with the first virtual object, and the preset effect is independent of the content of the audio input.
[0090] In some embodiments, the first virtual object includes: a preset virtual object; a virtual object selected by the first party from a plurality of candidate virtual objects; or a virtual object generated based on generation parameters configured by the first party.
[0091] In some embodiments, the first virtual object is determined based on the following process: in response to receiving a request from a first participant to join a live interactive event, presenting a configuration panel, the configuration panel including a generation entrance and a set of candidate virtual objects; and receiving a selection of a first virtual object from a set of candidate virtual objects by the first participant, or generating the first virtual object based on the selection of the generation entrance.
[0092] In some embodiments, generating a first virtual object based on selection of a generation entry includes: presenting a generation interface based on selection of the generation entry; acquiring at least one generation parameter via the generation interface, the at least one generation parameter including a reference image, the reference image including a captured image and / or an uploaded image; and triggering generation of the first virtual object based on at least one generation parameter.
[0093] In some embodiments, at least one generation parameter further includes: a prompt word input by the first participant; or a style parameter selected by the first participant.
[0094] In some embodiments, the apparatus 600 further includes an updating module configured to update a set of candidate virtual objects in the configuration panel in response to completion of generation of the first virtual object.
[0095] In some embodiments, the audio input is a first audio input, the dynamic effect is a first dynamic effect, and the method further includes: presenting a second virtual object in a second area of multiple preset areas, the second virtual object corresponding to a second participant in the live interactive event; and presenting a second dynamic effect associated with the second virtual object in the second area, the second dynamic effect being determined based on a second audio input of the second participant.
[0096] like Figure 7 As shown, the electronic device 700 is in the form of a general electronic device. The components of the electronic device 700 may include, but are not limited to, one or more processors or processing units 710, a memory 720, a storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processing unit 710 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 720. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 700.
[0097] The electronic device 700 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 720 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 730 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 700.
[0098] The electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 7 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 720 may include a computer program product 725 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.
[0099] The communication unit 740 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 700 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 700 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0100] The input device 750 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 760 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 700 may also communicate with one or more external devices (not shown) through the communication unit 740 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 700, or communicate with any device that allows the electronic device 700 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0101] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0102] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0103] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0104] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0105] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0106] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for interface interaction, comprising: Presenting a live broadcast interface associated with the live broadcast interactive event, wherein the live broadcast interface includes a plurality of preset areas, and the preset areas correspond to corresponding participants of the live broadcast interactive event; Presenting a first virtual object in a first area of the plurality of preset areas, where the first virtual object corresponds to a first participant of the live interactive event; as well as A dynamic effect associated with the first virtual object is presented in the first area, the dynamic effect being determined based on an audio input of the first participant.
2. The method according to claim 1, wherein presenting a dynamic effect associated with the first virtual object comprises: In response to the first participant being in a first state, presenting the dynamic effect associated with the first virtual object, the first state indicating that the audio input of the first participant is detected.
3. The method according to claim 2, further comprising: In response to the first participant being in a second state, preset content associated with the first virtual object is presented in the first area, and the second state indicates that no audio input of the first participant is detected.
4. The method according to claim 3, wherein: The dynamic effect includes movement of a preset part of the first virtual object, and In the preset content, the preset part of the first virtual object is in a stationary state.
5. The method according to claim 3, wherein the dynamic effect is determined based on a first video corresponding to the first state, the preset content is determined based on a second video corresponding to the second state, and the first video and the second video are pre-generated based on the image data of the first virtual object.
6. The method according to claim 1, wherein: The dynamic effect is generated based on the content of the audio input; or The dynamic effect is a preset effect associated with the first virtual object, and the preset effect is independent of the content of the audio input.
7. The method according to claim 1, wherein the first virtual object comprises: Preset virtual objects; a virtual object selected by the first participant from a plurality of candidate virtual objects; or A virtual object generated based on generation parameters configured by the first participant.
8. The method according to claim 1, wherein the first virtual object is determined based on the following process: In response to receiving a request from a first participant to join the live interactive event, presenting a configuration panel, the configuration panel including a generation portal and a set of candidate virtual objects; and A selection of a first virtual object from the set of candidate virtual objects is received by the first participant, or the first virtual object is generated based on the selection of the generation entry.
9. The method according to claim 8, wherein generating the first virtual object based on the selection of the generation portal comprises: Based on the selection of the generation entry, presenting a generation interface; Acquiring at least one generation parameter via the generation interface, wherein the at least one generation parameter includes a reference image, and the reference image includes a captured image and / or an uploaded image; as well as The trigger generates the first virtual object based on the at least one generation parameter.
10. The method according to claim 9, wherein the at least one generation parameter further comprises: A prompt word input by the first participant; or The style parameters selected by the first party.
11. The method according to claim 8, further comprising: In response to the completion of generating the first virtual object, the set of candidate virtual objects in the configuration panel is updated.
12. The method of claim 1, wherein the audio input is a first audio input, the dynamic effect is a first dynamic effect, and the method further comprises: Presenting a second virtual object in a second area of the plurality of preset areas, wherein the second virtual object corresponds to a second participant of the live interactive event; as well as A second dynamic effect associated with the second virtual object is presented in the second area, and the second dynamic effect is determined based on a second audio input of the second participant.
13. A device for interface interaction, comprising: A first presentation module is configured to present a live broadcast interface associated with a live broadcast interactive event, wherein the live broadcast interface includes a plurality of preset areas corresponding to corresponding participants of the live broadcast interactive event; A second presentation module is configured to present a first virtual object in a first area of the plurality of preset areas, wherein the first virtual object corresponds to a first participant of the live interactive event; as well as A third presentation module is configured to present a dynamic effect associated with the first virtual object in the first area, where the dynamic effect is determined based on the audio input of the first participant.
14. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processing unit.
15. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Joint live broadcast method and device, electronic equipment and computer readable storage medium
CN114374880A
Virtual object interaction method and device, computer equipment, storage medium and program product
CN116974507A
Image generation method and device, equipment and storage medium
CN117785002A
Method, device and equipment for live broadcast interaction and storage medium
CN118784891A
Virtual object interaction method and device, and storage medium and computer program product
WO2023071917A1
Cited By
Interface interaction method and apparatus, device, and storage medium
WO2026108926A1