Live interactive method, device, equipment and storage medium

Abstract

The present invention discloses a live interactive method, device, equipment and storage medium, including: displaying virtual characters and interaction types on an interface including different live windows according to a user's virtual interactive request; switching the live window on the interface when receiving a user's switching instruction for the live window; determining a target interaction type when receiving a user's selection instruction for the interaction type, and obtaining user viewing information based on the target interaction type; obtaining virtual interaction information matching the user viewing information, and controlling the virtual character to interact with the user in live broadcast with reference to the virtual interaction information. By displaying live screens in different live windows, and switching the live windows according to user needs, or using virtual characters to interact with users according to interactive needs, the audience can participate in the live scene in an immersive way, thereby significantly improving the user's viewing experience and participation.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a live broadcast interaction method, device, equipment and storage medium. Background Art

[0002] Currently, online live broadcasting has been widely promoted. Through the live broadcast screen, users can see real-time news developments and obtain the latest real-time information intuitively and quickly.

[0003] However, current news live broadcasts are often limited by fixed camera positions and a single broadcasting method, making it difficult to provide users with a rich visual experience. In addition, in order to increase user participation during live broadcasts, although there are traditional interactive methods such as chat rooms, bullet screens or likes, the current interactive methods are very simple and cannot increase the user's immersion in watching live broadcasts, thereby reducing the user's enthusiasm for participation during the live broadcast. Summary of the invention

[0004] The present invention provides a live broadcast interactive method to achieve live broadcast window switching and enhance virtual interactivity during the live broadcast process.

[0005] According to a first aspect of the present invention, a live broadcast interaction method is provided, comprising: displaying virtual characters and interaction types on an interface including different live broadcast windows according to a user's virtual interaction request, wherein the interaction types include creation, expression interaction, voice interaction and text interaction;

[0006] Switching the live broadcast window on the interface when receiving a user's instruction to switch the live broadcast window;

[0007] When receiving a user's selection instruction for the interaction type, determining a target interaction type, and acquiring user viewing information based on the target interaction type;

[0008] Acquire virtual interaction information that matches the user viewing information, and control the virtual character to perform live interaction with the user with reference to the virtual interaction information.

[0009] According to another aspect of the present invention, a live broadcast interaction device is provided, comprising: a virtual character display module, for displaying a virtual character and interaction types on an interface including different live broadcast windows according to a user's virtual interaction request, wherein the interaction types include creation, expression interaction, voice interaction and text interaction;

[0010] A live broadcast window switching interactive module, used to switch the live broadcast window on the interface when receiving a user's switching instruction for the live broadcast window;

[0011] A user viewing information acquisition module, configured to determine a target interaction type when receiving a user selection instruction for the interaction type, and acquire user viewing information based on the target interaction type;

[0012] The virtual character interaction module is used to obtain virtual interaction information matching the user viewing information, and control the virtual character to perform live interaction with the user with reference to the virtual interaction information.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can perform the method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method described in any embodiment of the present invention when executed.

[0018] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, and when the computer program is executed by a processor, the method described in any embodiment of the present invention is implemented.

[0019] The beneficial technical effect of the present invention is that by displaying live broadcast images in different live broadcast windows and switching the live broadcast windows according to user needs, or using virtual characters to interact with users according to interactive needs, the audience can participate in the live broadcast scene in an immersive way, thereby significantly improving the user's viewing experience and participation.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a flow chart of a live interactive method provided according to Embodiment 1 of the present invention;

[0023] Figure 2 is a schematic diagram of an interface including different live broadcast windows provided according to the first embodiment of the present invention;

[0024] Figure 3 is a schematic diagram of an interface including a virtual character provided according to the first embodiment of the present invention;

[0025] Figure 4 is a flow chart of a live interactive method provided according to Embodiment 2 of the present invention;

[0026] Figure 5 is a structural diagram of a live interactive device provided according to Embodiment 3 of the present invention;

[0027] Figure 6 It is a schematic diagram of the structure of an electronic device provided by Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] Embodiment 1

[0031] Figure 1A flowchart of a live interactive method is provided for the first embodiment of the present invention. This embodiment is applicable to the case of live interactive during a live broadcast. The method can be executed by a live interactive device, which can be implemented in the form of hardware and / or software. Figure 1 As shown, the method includes:

[0032] Step S101, displaying virtual characters and interaction types on an interface including different live broadcast windows according to a user's virtual interaction request.

[0033] Optionally, virtual characters and interaction types are displayed on an interface containing different live broadcast windows according to the user's virtual interaction request, including: obtaining the video type of the video data when the user's virtual interaction request is received, wherein the video types include competition, ancient style, modern style or scenery; querying from a virtual character database according to the video type to obtain a virtual character that matches the video type; and displaying the matching virtual character and pre-configured interaction type on the interface.

[0034] Specifically, Figure 2 The figure shows an interface diagram including different live windows, in which different live windows contain different viewing angles of the same live program, so that users can watch the live program from multiple angles and in an all-round way. In this embodiment, the specific number of live windows included in the interface is not limited. And when the user finds the live content boring during the viewing process, the virtual interaction button on the interface can be triggered to trigger the interaction with the virtual characters. When the terminal device receives the virtual interaction request, it will obtain the video data corresponding to the live window, and analyze the video data to obtain the video type. Since each live window displays the same program, the video type corresponding to the video data in each live window is the same, so the video data in any live window can be extracted for analysis, which is not limited in this embodiment. When the video type is obtained, a query will be performed from the virtual character database according to the video type to obtain a virtual character that matches the video type. Since the video types include competition, ancient style, modern style or scenery, virtual characters corresponding to each video type are pre-created and saved in the virtual character database, and the display image of each virtual character is different. For example, the virtual character that matches the ancient style type is an ancient virtual character image, and the virtual character that matches the modern type is a modern virtual character image. The ancient virtual character image and the modern virtual character image are different in clothing and makeup. The specific image of each virtual character is not limited in this embodiment, and can be set according to the actual interaction scenario.

[0035] Among them, Figure 3What is shown is a schematic diagram of an interface including virtual characters, and specifically displays the image of ancient virtual characters. Therefore, the corresponding live broadcast program can be an opera program or an ancient drama, etc., and while displaying the virtual characters, pre-configured interaction types will also be displayed on the interface to facilitate users to choose from them, thereby increasing the ways of interaction with the virtual characters. For example, the interaction types can include creation, expression interaction, voice interaction and text interaction. Of course, this embodiment is only an example for illustration, and does not limit the specific content of the interaction type. The interaction type can be specifically displayed at the top of the interface and is displayed synchronously with the virtual character.

[0036] Step S102, switching the live broadcast window on the interface when receiving a switching instruction from the user for the live broadcast window.

[0037] Optionally, when a user's switching instruction for the live broadcast window is received, the live broadcast window on the interface is switched, including: when a user's displacement switching instruction for the live broadcast window is received, the target live broadcast window and the target position are determined, and the target window is moved to the target position; when a user's deletion switching instruction for the live broadcast window is received, the target live broadcast window is determined, and the target live broadcast window is deleted on the interface.

[0038] Specifically, in this embodiment, the user can switch the live broadcast window displayed on the interface, such as Figure 2 As shown, the window corresponding to video 3 and the window corresponding to video 1 can be swapped by dragging, that is, different live screens can be viewed by scrolling up and down. In addition, the window corresponding to video 2 can be deleted by long pressing the window corresponding to video 2. Of course, this embodiment only uses the horizontal screen model as an example for explanation. Of course, the vertical screen mode can also be used to switch the live window. The principle is roughly the same as the horizontal screen mode. The difference is that the vertical sliding method is used to browse when switching the live window position.

[0039] Among them, the live broadcast method through multiple live broadcast windows in this embodiment allows users to watch live programs from multiple angles and in an all-round manner, and can switch the live broadcast windows according to viewing needs, so as to focus on watching the live broadcast angle of concern, thereby improving the user's immersion and facilitating the maximum probability of eliminating the user's viewing fatigue.

[0040] Step S103, when receiving the user's selection instruction for the interaction type, determining the target interaction type, and obtaining the user viewing information based on the target interaction type.

[0041] Optionally, obtaining user viewing information based on the target interaction type includes: when the target interaction type is determined to be expression interaction, collecting the user's facial expressions through the front-end camera, and determining the user's viewing emotions based on the facial expressions; when the target interaction type is determined to be voice interaction, collecting the user's voice through a recording device; when the target interaction type is determined to be text interaction, displaying a text box on the interface, and receiving the text entered by the user in the text box; when the target interaction type is determined to be creation, displaying a creation template on the interface, and receiving the creation content entered by the user in the creation template.

[0042] Specifically, in this embodiment, when a user's selection instruction for an interaction type is received, different user viewing information will be obtained according to the determined target interaction type, wherein the user viewing information mainly includes different feedback information during the user's live broadcast process, such as viewing emotions, voice, input comment text, or creative content input inspired by watching the live broadcast, wherein the creative content may include poems, articles or paintings, which are not limited in this embodiment.

[0043] For example, when the target interaction type is determined to be expression interaction, the front-end camera will be started, and the user's facial expression will be collected through the front-end camera. The facial expression will be identified through image recognition technology to determine the user's viewing emotion, where viewing emotions include happiness, anger or disappointment, etc. For example, the current live broadcast window is broadcasting a live football match, but the team supported by the user has been at a disadvantage in the score, then the user's facial expression collected by the front-end camera will be identified, and it can be determined that the user's current viewing emotion is disappointment, and the viewing emotion of disappointment will be used as the user's viewing information; when the target type is determined to be text interaction, a text box will be displayed on the interface to facilitate the user to make live comments or ask questions in the text box. For example, the current live broadcast window is broadcasting a live opera performance , but the user does not know where the performance is, so he can enter "Where is this performance?" in the text box, and the text entered by the user during the live broadcast is used as the user viewing information; when the target type is determined to be voice interaction, the recording device will be turned on, and the user's voice will be collected through the recording device. For example, when the user feels that typing is cumbersome, he can directly select voice interaction and enter the voice "Can you introduce the results of the current game?" through the recording device, and the voice entered by the user during the live broadcast is used as the user viewing information; when the target type is determined to be creation, the creation template option will be displayed on the interface, where the creation template includes painting templates, poetry templates and article templates, etc., for the user to select the adapted creation template. After the creation template is selected, the creation content entered by the user in the creation template will be received, for example, a painting, a poem or an article created by inspiration during the live broadcast, and the creation content entered by the user will be used as the user viewing information. Of course, this embodiment is only an example, and does not limit the specific content of the user viewing information. As long as it is user feedback on the current live content, it is within the protection scope of this application.

[0044] Step S104, obtaining virtual interaction information matching the user's viewing information, and controlling the virtual character to perform live interaction with the user with reference to the virtual interaction information.

[0045] Optionally, obtaining virtual interaction information that matches the user viewing information includes: obtaining a target feedback database that matches the user viewing information, wherein the target feedback database contains a correspondence between the user viewing information and the virtual interaction information; and querying the target feedback database according to the user viewing information to obtain virtual interaction information that matches the user viewing information.

[0046] Specifically, in this embodiment, only the virtual character is displayed on the interface, but the virtual character needs to make corresponding reactions based on the user's viewing information, such as actions, expressions, and language, that is, the virtual character is animated to enhance the interaction with the user. However, different feedback databases are corresponding to different user viewing information, and the feedback database contains the corresponding relationship between the user viewing information and the virtual interaction information.

[0047] For example, when it is determined that the user's viewing information is a disappointing emotion, the first feedback database will be queried, and the virtual interaction information corresponding to the disappointing emotion will be queried therefrom. For example, the virtual interaction information includes actions - fist-clenching and cheering actions, expressions - inspirational expressions, and language - "Don't lose heart, the sun always comes after the rain", and all the above-mentioned virtual interaction information is set on the virtual character to control the virtual character to use the determined expressions, actions and language for dynamic display, so as to encourage the user's current disappointing emotion, thereby realizing live interaction with the user. Of course, this implementation is only an example for illustration, and does not limit the specific content of the determined virtual interaction information; when it is determined that the user's viewing information is a voice "Can you introduce the results of the current game?", the key voice content "introduce the results of the game" will be extracted from it, and the second feedback database will be queried. A feedback database is used to query virtual interaction information corresponding to the key voice content, and all the obtained virtual interaction information is set to the virtual character. The specific setting process is roughly the same as the setting process based on viewing emotions, and is not repeated in this embodiment; when it is determined that the user viewing information is the text "Where is the performance?", the keyword "where is the performance" is extracted from it, and the second feedback database is queried to query the virtual interaction information corresponding to the keyword, and all the obtained virtual interaction information is set to the virtual character; when it is determined that the user viewing information is a creative content a painting describing the beautiful mountains and rivers of China, the creative content is identified by type, and the third feedback database is queried to query the virtual interaction information corresponding to the type of the creative content, and all the obtained virtual interaction information is set to the virtual character.

[0048] In the implementation manner of the present application, by displaying the live broadcast screen in different live broadcast windows and switching the live broadcast windows according to user needs, or using virtual characters to interact with users according to interactive needs, the audience can participate in the live broadcast scene in an immersive way, thereby significantly improving the user's viewing experience and participation.

[0049] Embodiment 2

[0050] Figure 4A flowchart of a live interactive method provided in the second embodiment of the present invention. This embodiment is based on the above embodiment. Before displaying virtual characters and interaction types on an interface containing different live windows according to the user's virtual interaction request, it also includes: when receiving a live viewing request from a user, obtaining multi-camera video data of the same live program, and generating a camera information list based on the multi-camera video data; and displaying the video data collected by the specified camera in different live windows of the interface according to the user's selection instructions for the camera information list. Figure 4 As shown, the method includes:

[0051] Step S201, when receiving a live broadcast viewing request from a user, multi-camera video data of the same live broadcast program is obtained, and a camera information list is generated according to the multi-camera video data.

[0052] Specifically, when the terminal device receives a live broadcast viewing request from a user, it obtains multiple video data collected by different camera positions of the same live broadcast program from the network server, and generates a camera position information list based on the video data, such as Figure 2 As shown, in landscape mode, the camera information list will be displayed on the right edge of the interface, and the camera information list can be slid by clicking the two small triangle arrows, so that the user can select and display the target camera from it.

[0053] It should be noted that when a user's intuitive viewing update request is received, the video data will be re-downloaded according to the live program selected by the user, and the camera position data in the camera position information list will be updated, so that the user can view different live programs conveniently and quickly.

[0054] Step S202, according to the user's selection instruction on the camera position information list, the video data collected by the specified camera position are displayed in different live broadcast windows of the interface respectively.

[0055] Among them, users can select camera video data by clicking, and place the selected camera video data in the designated live window for display by dragging and dropping, so that users can watch the live program from multiple angles and in all directions according to their viewing needs. Figure 2 The example of displaying three live broadcast windows on the interface at the same time is used for explanation. In this implementation, the specific number of live broadcast windows displayed on the interface is not limited.

[0056] It is worth mentioning that in this embodiment, the user's operation instruction can also be received to enlarge or reduce the specified live window, so as to adaptively adjust the screen size in the live window according to the viewing needs, thereby further enhancing the user's viewing experience. Of course, this embodiment is only an example, and does not limit the specific operation method of the live window.

[0057] Step S203, displaying virtual characters and interaction types on an interface including different live broadcast windows according to the user's virtual interaction request.

[0058] Optionally, virtual characters and interaction types are displayed on an interface containing different live broadcast windows according to the user's virtual interaction request, including: obtaining the video type of the video data when the user's virtual interaction request is received, wherein the video types include competition, ancient style, modern style or scenery; querying from a virtual character database according to the video type to obtain a virtual character that matches the video type; and displaying the matching virtual character and pre-configured interaction type on the interface.

[0059] Step S204, switching the live broadcast window on the interface when receiving a switching instruction from the user for the live broadcast window.

[0060] Optionally, when a user's switching instruction for the live broadcast window is received, the live broadcast window on the interface is switched, including: when a user's displacement switching instruction for the live broadcast window is received, the target live broadcast window and the target position are determined, and the target window is moved to the target position; when a user's deletion switching instruction for the live broadcast window is received, the target live broadcast window is determined, and the target live broadcast window is deleted on the interface.

[0061] Step S205, when receiving the user's selection instruction for the interaction type, determining the target interaction type, and obtaining the user viewing information based on the target interaction type.

[0062] Optionally, obtaining user viewing information based on the target interaction type includes: when the target interaction type is determined to be expression interaction, collecting the user's facial expressions through the front-end camera, and determining the user's viewing emotions based on the facial expressions; when the target interaction type is determined to be voice interaction, collecting the user's voice through a recording device; when the target interaction type is determined to be text interaction, displaying a text box on the interface, and receiving the text entered by the user in the text box; when the target interaction type is determined to be creation, displaying a creation template on the interface, and receiving the creation content entered by the user in the creation template.

[0063] Step S206, obtaining virtual interaction information that matches the user's viewing information, and controlling the virtual character to perform live interaction with the user with reference to the virtual interaction information.

[0064] Optionally, obtaining virtual interaction information that matches the user viewing information includes: obtaining a target feedback database that matches the user viewing information, wherein the target feedback database contains a correspondence between the user viewing information and the virtual interaction information; and querying the target feedback database according to the user viewing information to obtain virtual interaction information that matches the user viewing information.

[0065] In the implementation manner of the present application, by displaying the live broadcast screen in different live broadcast windows and switching the live broadcast windows according to user needs, or using virtual characters to interact with users according to interactive needs, the audience can participate in the live broadcast scene in an immersive way, thereby significantly improving the user's viewing experience and participation.

[0066] Embodiment 3

[0067] Figure 5 This is a schematic diagram of the structure of a live interactive device provided by Embodiment 3 of the present invention. Figure 5 As shown, the device includes: a virtual character display module 310, a live window switching interaction module 320, a user viewing information acquisition module 330 and a virtual character interaction module 340.

[0068] The virtual character display module 310 is used to display the virtual character and the interaction type on the interface including different live broadcast windows according to the user's virtual interaction request, wherein the interaction type includes creation, expression interaction, voice interaction and text interaction;

[0069] The live window switching interactive module 320 is used to switch the live window on the interface when receiving a user's instruction to switch the live window;

[0070] The user viewing information acquisition module 330 is used to determine the target interaction type when receiving the user's selection instruction for the interaction type, and acquire the user viewing information based on the target interaction type;

[0071] The virtual character interaction module 340 is used to obtain virtual interaction information that matches the user's viewing information, and control the virtual character to perform live interaction with the user with reference to the virtual interaction information.

[0072] Optionally, the device further comprises a video data display module, which is used to obtain multi-camera video data of the same live program when receiving a live broadcast viewing request from a user, and generate a camera information list according to the multi-camera video data;

[0073] According to the user's selection instructions for the camera position information list, the video data collected by the specified camera position is displayed in different live broadcast windows of the interface.

[0074] Optionally, a virtual character display module is used to obtain the video type of the video data when receiving a virtual interaction request from the user, wherein the video type includes competition, ancient style, modern style or landscape;

[0075] Searching from a virtual character database according to the video type to obtain a virtual character matching the video type;

[0076] The matching virtual characters and pre-configured interaction types are displayed on the interface.

[0077] Optionally, a live broadcast window switching interactive module is used to determine a target live broadcast window and a target position when receiving a user's instruction to switch the live broadcast window, and move the target window to the target position;

[0078] When receiving a deletion and switching instruction from the user for the live broadcast window, the target live broadcast window is determined and deleted on the interface.

[0079] Optionally, a user viewing information acquisition module is used to collect the user's facial expression through a front-end camera when the target interaction type is determined to be expression interaction, and determine the user's viewing emotion based on the facial expression;

[0080] When the target interaction type is determined to be voice interaction, the user's voice is collected through a recording device;

[0081] When the target interaction type is determined to be text interaction, a text box is displayed on the interface, and the text entered by the user in the text box is received;

[0082] When the target interaction type is determined to be creation, the creation template is displayed on the interface, and the creation content input by the user in the creation template is received.

[0083] Optionally, a virtual character interaction module is used to obtain a target feedback database that matches the user viewing information, wherein the target feedback database contains a corresponding relationship between the user viewing information and the virtual interaction information;

[0084] A query is performed from a target feedback database according to the user viewing information to obtain virtual interaction information matching the user viewing information.

[0085] The live broadcast interactive device provided in the embodiment of the present invention can execute the live broadcast interactive method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0086] Embodiment 4

[0087] Figure 6A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0088] like Figure 6 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0089] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0090] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the live interactive method.

[0091] In some embodiments, the live interactive method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the live interactive method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the live interactive method in any other appropriate manner (e.g., by means of firmware).

[0092] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0093] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0094] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0095] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0096] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0097] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0098] Embodiment 5

[0099] An embodiment of the present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements the live broadcast interaction method provided in any embodiment of the present application.

[0100] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0101] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0102] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A live interactive method, characterized in that: include: Displaying virtual characters and interaction types on an interface including different live broadcast windows according to a user's virtual interaction request, wherein the interaction types include creation, expression interaction, voice interaction, and text interaction; Switching the live broadcast window on the interface when receiving a user's instruction to switch the live broadcast window; When receiving a user's selection instruction for the interaction type, determining a target interaction type, and acquiring user viewing information based on the target interaction type; Acquire virtual interaction information that matches the user viewing information, and control the virtual character to perform live interaction with the user with reference to the virtual interaction information.

2. The method according to claim 1, characterized in that Before displaying the virtual characters and the interaction types on the interface including different live broadcast windows according to the user's virtual interaction request, the method further includes: When receiving a live broadcast viewing request from a user, acquiring multi-camera video data of the same live broadcast program, and generating a camera information list according to the multi-camera video data; According to the user's selection instructions for the camera position information list, the video data collected by the specified camera position are respectively displayed in different live broadcast windows of the interface.

3. The method according to claim 2, characterized in that The displaying of virtual characters and interaction types on an interface including different live broadcast windows according to a user's virtual interaction request includes: acquiring the video type of the video data when receiving a virtual interaction request from the user, wherein the video type includes competition, ancient style, modern style or landscape; Searching a virtual character database according to the video type to obtain a virtual character matching the video type; The matched virtual character and the pre-configured interaction type are displayed on the interface.

4. The method according to claim 1, characterized in that: The step of switching the live broadcast window on the interface when receiving a user's instruction to switch the live broadcast window comprises: When receiving a user's instruction to shift the live broadcast window, determining a target live broadcast window and a target position, and moving the target window to the target position; When receiving a deletion and switching instruction from the user for the live broadcast window, a target live broadcast window is determined, and the target live broadcast window is deleted on the interface.

5. The method according to claim 1, characterized in that The acquiring user viewing information based on the target interaction type includes: When it is determined that the target interaction type is expression interaction, the user's facial expression is collected through a front-end camera, and the user's viewing emotion is determined according to the facial expression; When it is determined that the target interaction type is voice interaction, collecting the user's voice through a recording device; When it is determined that the target interaction type is text interaction, a text box is displayed on the interface, and text input by the user in the text box is received; When it is determined that the target interaction type is creation, a creation template is displayed on the interface, and the creation content input by the user in the creation template is received.

6. The method according to claim 5, characterized in that The acquiring of virtual interactive information matching the user viewing information includes: Acquire a target feedback database matching the user viewing information, wherein the target feedback database contains a correspondence between the user viewing information and the virtual interaction information; The target feedback database is queried according to the user viewing information to obtain the virtual interaction information matching the user viewing information.

7. A live interactive device, characterized in that: The device comprises: A virtual character display module, used to display virtual characters and interaction types on an interface including different live broadcast windows according to the user's virtual interaction request, wherein the interaction types include creation, expression interaction, voice interaction and text interaction; A live broadcast window switching interactive module, used to switch the live broadcast window on the interface when receiving a user's switching instruction for the live broadcast window; A user viewing information acquisition module, configured to determine a target interaction type when receiving a user selection instruction for the interaction type, and acquire user viewing information based on the target interaction type; The virtual character interaction module is used to obtain virtual interaction information matching the user viewing information, and control the virtual character to perform live interaction with the user with reference to the virtual interaction information.

8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 6 when being executed by a processor.

Images