Live broadcast interaction method, electronic equipment and system
Through a unified platform framework and interface, third-party developers are allowed to customize the static resources of live broadcast interactive tools, solving the problems of poor openness and expansion in the existing technology, and achieving rich live broadcast interactive content and efficient interactive experience.
Patent Information
- Application Number
- CN202411216000.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-15
- Publication Date
- 2024-12-03
AI Technical Summary
The existing live broadcast interaction technology cannot support access and customization of third-party developers, and the openness and expansion are poor, limiting the richness and flexibility of live broadcast interaction.
Provide a live interaction method, through a unified platform framework and interface, allowing third-party developers to customize the static resource collection of interactive tools. The initiator and the audience can adjust the interaction process according to actual needs. The initiator only needs to obtain static from the platform. Resource and send interactive messages, and the audience loads the corresponding interface according to the message.
It improves the compatibility, extensibility and openness of live interaction, supports rich interactive content, and enhances security and interactive experience.
Smart Images

Figure CN119071524A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202111082703.X, and the original application date is September 15, 2021. The entire contents of the original application are incorporated into this application by reference. Technical Field
[0002] The embodiments of the present application relate to the field of communication technology, and in particular to a live interactive method, electronic device, and system. Background Art
[0003] With the advancement of network communication technology, live streaming is increasingly being used in life, social interaction, entertainment, education and other fields due to its real-time and interactive features. In order to enrich the experience and communication of live streaming users, live streaming interaction is also increasingly being used in live streaming.
[0004] However, in conventional live broadcast interactions, the initiator usually performs corresponding types of interactions based on interactive messages of different formats, such as sending gifts, cards, emoticons, shopping links, bullet comments, etc. However, the above conventional technologies cannot support the access and customization of third-party developers, and have poor openness and scalability. Summary of the invention
[0005] The present application provides a live broadcast interaction method, electronic device and system, which can improve the compatibility, scalability and openness of live broadcast interaction.
[0006] In order to achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0007] In a first aspect, a live broadcast interaction method is provided, and the method is applied to a live broadcast interaction process between a first device and a second device, and the method includes: in response to receiving a selection operation of a first tool by a first user on a first interface, the first device displays a second interface according to a first static resource in a static resource set corresponding to the first tool, and the second interface is used for the first user to set interaction parameters; the static resource set is customized by a third-party developer according to interaction requirements, and the first static resource is used to indicate a first interactive business process; the first device receives the interaction parameter setting by the first user on the second interface; the first device sends an interaction message to the second device according to the interaction parameter setting by the first user on the second interface, and the interaction message includes the parameters.
[0008] The solution provided in the first aspect above can realize adaptive adjustment of the interaction process according to actual interaction needs by providing third-party developers with the function of customizing the interaction process of interactive tools. Based on this, during live interaction, the initiator only needs to obtain the static resources corresponding to the interactive tool from the platform, load the corresponding interface, and send interactive messages to the audience according to the interactive parameters set by the initiator user. Based on the unified platform framework and interface provided by this application, live interaction is not limited to a single interactive content, but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0009] In a possible implementation, the first device sends an interactive message to the second device according to the setting of the interactive parameters by the first user on the second interface, including: the first device displays a third interface according to the setting of the interactive parameters by the first user on the second interface, the third interface includes a first button, and the first button is used to confirm the setting of the interactive parameters; in response to receiving an operation on the first button, the first device sends an interactive message to the second device. As a case, the interactive message can be sent from the first device to the second device when the first device receives an operation on the first button. This application does not limit the timing of sending the interactive message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0010] In a possible implementation, the static resource set is obtained by the first device from a third device, the third device is used to manage interactive services, and the static resource set is customized by a third-party developer in the third device according to interactive needs. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device can obtain from the third device a static resource set customized by a third-party developer according to interactive needs.
[0011] In a possible implementation, the first device stores a static resource set. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device may store a static resource set.
[0012] In a possible implementation, the method further includes: the second device obtains a static resource set according to the interactive message; the second device displays a fourth interface according to the second static resource in the static resource set in combination with the interactive parameters, and the fourth interface contains information corresponding to the interactive parameters. In the present application, during live interaction, the audience end only needs to obtain the static resources corresponding to the interactive tool according to the interactive message and load the corresponding interface. This solution can support third-party developers to customize the static resources corresponding to the interactive tool according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0013] In a possible implementation, the above-mentioned interactive message also includes an identifier of a static resource set; the second device obtains the static resource set according to the interactive message, including: the second device obtains the static resource set from a third device according to the identifier of the static resource set in the interactive message, the third device is used to manage interactive services, and the static resource set is customized in the third device by a third-party developer according to interactive needs. This application does not limit the channel for the second device to obtain the static resource set after receiving the interactive message. For example, the second device can obtain from the third device a static resource set customized by a third-party developer according to interactive needs.
[0014] In a possible implementation, the method further includes: the second device receives the feedback parameter setting of the second user on the fourth interface, displays the fifth interface, the fifth interface includes a second button, and the second button is used to confirm the setting of the feedback parameter; in response to receiving the operation of the second button, the second device sends a feedback message to the first device, and the feedback message includes the feedback parameter; the first device displays the sixth interface according to the feedback message. As a case, the feedback message can be sent by the second device to the first device when the second device receives the operation of the second button. This application does not limit the timing of sending the feedback message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0015] In one possible implementation, the fourth interface includes one or more edit boxes and / or one or more options; the second device receives the feedback parameter setting by the second user on the fourth interface, including: the second device receives the second user's editing operation on at least one of the one or more edit boxes on the fourth interface, and / or the selection operation on at least one of the one or more options on the fourth interface. The present application does not limit the specific content of the feedback parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set feedback parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0016] In a possible implementation, the first device displays the second interface according to the first static resource in the static resource set corresponding to the first tool, including: the first device parses the first static resource corresponding to the first tool and the business interaction process indicated by the first static resource; the first device runs the first tool according to the business interaction process indicated by the first static resource and displays the second interface. In this application, the interaction initiator can display the interaction parameter interface based on the static resources customized by the third party. This solution can support third-party developers to customize the static resources corresponding to the interactive tool according to actual interaction needs, with high flexibility, compatibility, scalability and openness.
[0017] In one possible implementation, the second interface includes one or more edit boxes and / or one or more options; the first device receives the setting of the interactive parameters by the first user on the second interface, including: the first device receives the first user's editing operation on at least one of the one or more edit boxes on the second interface, and / or the selection operation on at least one of the one or more options on the second interface. The present application does not limit the specific content of the interactive parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set interactive parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0018] In a possible implementation, the first static resource is the first static resource called predefined in the static resource set. In the present application, the device can call static resources one by one according to the calling sequence of static resources predefined by the third-party developer.
[0019] In a possible implementation, the first device sends an interactive message to the second device according to the interactive parameter setting of the first user on the second interface, including: the first device sends the interactive message to the second device through a fourth device according to the interactive parameter setting of the first user on the second interface, and the fourth device is used to manage the live broadcast service. In some cases, the interactive initiator can forward the interactive message to the audience end through the device used to manage the live broadcast service. This solution can be implemented based on a conventional live broadcast architecture and has strong compatibility.
[0020] In a second aspect, a live broadcast interaction method is provided, the method comprising: in response to receiving a selection operation of a first tool by a first user on a first interface, the first device displays a second interface according to a first static resource in a static resource set corresponding to the first tool, the second interface being used for the first user to set interaction parameters; the static resource set is customized by a third-party developer according to interaction requirements, and the first static resource is used to indicate a first interactive business process; the first device receives the interaction parameter setting by the first user on the second interface; the first device sends an interaction message to the second device according to the interaction parameter setting by the first user on the second interface, the interaction message including the parameters; the first device receives a feedback message from the second device; the first device displays a sixth interface according to the feedback message.
[0021] The solution provided in the second aspect above can realize adaptive adjustment of the interaction process according to actual interaction needs by providing third-party developers with the function of customizing the interaction process of interactive tools. Based on this, during live interaction, the initiator only needs to obtain the static resources corresponding to the interactive tool from the platform, load the corresponding interface, and send interactive messages to the audience according to the interactive parameters set by the initiator user. Based on the unified platform framework and interface provided by this application, live interaction is not limited to a single interactive content, but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0022] In a possible implementation, the first device sends an interactive message to the second device according to the setting of the interactive parameters by the first user on the second interface, including: the first device displays a third interface according to the setting of the interactive parameters by the first user on the second interface, the third interface includes a first button, and the first button is used to confirm the setting of the interactive parameters; in response to receiving an operation on the first button, the first device sends an interactive message to the second device. As a case, the interactive message can be sent from the first device to the second device when the first device receives an operation on the first button. This application does not limit the timing of sending the interactive message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0023] In a possible implementation, the static resource set is obtained by the first device from a third device, the third device is used to manage interactive services, and the static resource set is customized by a third-party developer in the third device according to interactive needs. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device can obtain from the third device a static resource set customized by a third-party developer according to interactive needs.
[0024] In a possible implementation, the first device stores a static resource set. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device may store a static resource set.
[0025] In a possible implementation, the first device displays the second interface according to the first static resource in the static resource set corresponding to the first tool, including: the first device parses the first static resource corresponding to the first tool and the business interaction process indicated by the first static resource; the first device runs the first tool according to the business interaction process indicated by the first static resource and displays the second interface. In this application, the interaction initiator can display the interaction parameter interface based on the static resources customized by the third party. This solution can support third-party developers to customize the static resources corresponding to the interactive tool according to actual interaction needs, with high flexibility, compatibility, scalability and openness.
[0026] In one possible implementation, the second interface includes one or more edit boxes and / or one or more options; the first device receives the setting of the interactive parameters by the first user on the second interface, including: the first device receives the first user's editing operation on at least one of the one or more edit boxes on the second interface, and / or the selection operation on at least one of the one or more options on the second interface. The present application does not limit the specific content of the interactive parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set interactive parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0027] In a possible implementation, the first static resource is the first static resource called predefined in the static resource set. In the present application, the device can call static resources one by one according to the calling sequence of static resources predefined by the third-party developer.
[0028] In a possible implementation, the first device sends an interactive message to the second device according to the interactive parameter setting of the first user on the second interface, including: the first device sends the interactive message to the second device through a fourth device according to the interactive parameter setting of the first user on the second interface, and the fourth device is used to manage the live broadcast service. In some cases, the interactive initiator can forward the interactive message to the audience end through the device used to manage the live broadcast service. This solution can be implemented based on a conventional live broadcast architecture and has strong compatibility.
[0029] According to a third aspect, a live interactive method is provided, which includes: a second device receives an interactive message from a first device, the interactive message includes interactive parameters; the second device obtains a static resource set according to the interactive message, the static resource set is customized by a third-party developer according to interactive requirements, and the static resource set is used to indicate one or more interactive business processes; the second device displays a fourth interface based on the second static resource in the static resource set and the interactive parameters. The fourth interface includes information corresponding to the interactive parameters.
[0030] The solution provided in the third aspect above can realize adaptive adjustment of the interaction process according to actual interaction needs by providing third-party developers with the function of customizing the interaction process of interactive tools. Based on this, during live interaction, the audience only needs to obtain the static resources corresponding to the interactive tool according to the interactive message and load the corresponding interface. Based on the unified platform framework and interface provided by this application, live interaction is not limited to a single interactive content, but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0031] In a possible implementation, the second device stores a static resource set. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device may store a static resource set.
[0032] In a possible implementation, the above-mentioned interactive message also includes an identifier of a static resource set; the second device obtains the static resource set according to the interactive message, including: the second device obtains the static resource set from a third device according to the identifier of the static resource set in the interactive message, the third device is used to manage interactive services, and the static resource set is customized in the third device by a third-party developer according to interactive needs. This application does not limit the channel for the second device to obtain the static resource set when receiving the interactive message. For example, the second device can obtain from the third device a static resource set customized by a third-party developer according to interactive needs.
[0033] In a possible implementation, the method further includes: the second device receives the feedback parameter setting by the second user on the fourth interface, displays the fifth interface, and the fifth interface includes a second button, and the second button is used to confirm the setting of the feedback parameter; in response to receiving the operation of the second button, the second device sends a feedback message to the first device, and the feedback message includes the feedback parameter. As a case, the feedback message can be sent by the second device to the first device when the second device receives the operation of the second button. This application does not limit the timing of sending the feedback message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0034] In one possible implementation, the fourth interface includes one or more edit boxes and / or one or more options; the second device receives the feedback parameter setting by the second user on the fourth interface, including: the second device receives the second user's editing operation on at least one of the one or more edit boxes on the fourth interface, and / or the selection operation on at least one of the one or more options on the fourth interface. The present application does not limit the specific content of the feedback parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set feedback parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0035] In a fourth aspect, a first device is provided, the first device comprising: a memory for storing a computer program; a transceiver for receiving or sending a radio signal; a processor for executing the computer program, so that the first device, in response to receiving a selection operation of a first user on a first interface for a first tool, displays a second interface for the first user to set interaction parameters according to a first static resource in a static resource set corresponding to the first tool; receives the setting of the interaction parameters by the first user on the second interface; sends an interaction message to the second device according to the setting of the interaction parameters by the first user on the second interface, the interaction message including the parameters; receives a feedback message from the second device; and displays a sixth interface according to the feedback message. The static resource set is customized by a third-party developer according to interaction requirements, and the first static resource is used to indicate a first interaction business process.
[0036] The solution provided in the fourth aspect above can realize adaptive adjustment of the interaction process according to actual interaction needs by providing third-party developers with the function of customizing the interaction process of interactive tools. Based on this, during live interaction, the initiator only needs to obtain the static resources corresponding to the interactive tool from the platform, load the corresponding interface, and send interactive messages to the audience according to the interactive parameters set by the initiator user. Based on the unified platform framework and interface provided by this application, live interaction is not limited to a single interactive content, but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0037] In a possible implementation, the processor is specifically used to execute the computer program so that the first device displays a third interface including a first button according to the setting of the interactive parameters by the first user on the second interface; and, in response to receiving an operation on the first button, sends an interactive message to the second device. The first button is used to confirm the setting of the interactive parameters. As a case, the interactive message can be sent from the first device to the second device when the first device receives an operation on the first button. This application does not limit the timing of sending the interactive message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0038] In a possible implementation, the static resource set is obtained by the first device from a third device via a transceiver, the third device is used to manage interactive services, and the static resource set is customized in the third device by a third-party developer according to interactive needs. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device can obtain from the third device a static resource set customized by a third-party developer according to interactive needs.
[0039] In a possible implementation, a static resource set is stored in the memory of the first device. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device may store a static resource set.
[0040] In one possible implementation, the processor is specifically used to execute the computer program so that the first device parses the first static resource of the business interaction process indicated by the first tool; and runs the first tool according to the business interaction process indicated by the first static resource to display the second interface. In this application, the interaction initiator can display the interaction parameter interface based on the static resources customized by a third party. This solution can support third-party developers to customize the static resources corresponding to the interactive tools according to actual interaction needs, with high flexibility, compatibility, scalability and openness.
[0041] In one possible implementation, the second interface includes one or more edit boxes and / or one or more options; the processor is specifically used to execute the computer program so that the first device receives the first user's editing operation on at least one of the one or more edit boxes on the second interface, and / or the selection operation on at least one of the one or more options on the second interface. The present application does not limit the specific content of the interactive parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set interactive parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0042] In a possible implementation, the first static resource is the first static resource called predefined in the static resource set. In the present application, the device can call static resources one by one according to the calling sequence of static resources predefined by the third-party developer.
[0043] In a possible implementation, the processor is specifically used to execute the computer program so that the first device sends an interactive message to the second device through a fourth device according to the interactive parameter setting of the first user on the second interface; wherein the fourth device is used to manage the live broadcast service. In some cases, the interactive initiator can forward the interactive message to the audience end through the device used to manage the live broadcast service. This solution can be implemented based on a conventional live broadcast architecture and has strong compatibility.
[0044] In a fifth aspect, a second device is provided, the second device comprising: a memory for storing a computer program; a transceiver for receiving or sending a radio signal; a processor for executing the computer program, so that the second device receives an interactive message including an interactive parameter from the first device; obtains a static resource set customized by a third-party developer according to interactive requirements according to the interactive message; and displays a fourth interface according to a second static resource in the static resource set in combination with the interactive parameter, wherein the fourth interface includes information corresponding to the interactive parameter. The static resource set is used to indicate one or more interactive business processes.
[0045] The solution provided in the fifth aspect above can realize adaptive adjustment of the interaction process according to actual interaction needs by providing third-party developers with the function of customizing the interaction process of interactive tools. Based on this, during live interaction, the audience only needs to obtain the static resources corresponding to the interactive tool according to the interactive message and load the corresponding interface. Based on the unified platform framework and interface provided by this application, live interaction is not limited to a single interactive content, but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0046] In a possible implementation, a static resource set is stored in the memory of the second device. This application does not limit the channel through which the first device obtains the static resource set when receiving the first user's selection operation on the first tool on the first interface. For example, the first device may store a static resource set.
[0047] In a possible implementation, the interactive message also includes an identifier of a static resource set; the processor is specifically used to execute the computer program so that the second device obtains the static resource set from the third device according to the identifier of the static resource set in the interactive message; wherein the third device is used to manage interactive services, and the static resource set is customized in the third device by a third-party developer according to interactive requirements. This application does not limit the channel through which the second device obtains the static resource set when receiving the interactive message. For example, the second device can obtain from the third device a static resource set customized by a third-party developer according to interactive requirements.
[0048] In one possible implementation, the processor is also used to execute the computer program so that the second device receives the feedback parameter setting by the second user on the fourth interface and displays a fifth interface including a second button; and, in response to receiving an operation on the second button, sends a feedback message to the first device, the feedback message including the feedback parameter. The second button is used to confirm the setting of the feedback parameter. As a case, the feedback message can be sent by the second device to the first device when the second device receives an operation on the second button. The present application does not limit the timing of sending the feedback message, which depends on the customization of the third-party developer, and has high flexibility, compatibility and scalability.
[0049] In one possible implementation, the fourth interface includes one or more edit boxes and / or one or more options; the processor is specifically used to execute the computer program so that the second device receives the second user's editing operation on at least one of the one or more edit boxes on the fourth interface, and / or the selection operation on at least one of the one or more options on the fourth interface. The present application does not limit the specific content of the feedback parameter setting interface. For example, the interface may include one or more edit boxes and / or one or more options for users to set feedback parameters. This solution can support third-party developers to customize static resources corresponding to interactive tools according to actual interactive needs, with high flexibility, compatibility, scalability and openness.
[0050] In a sixth aspect, a communication system is provided, comprising: a first device as in any possible implementation of the fourth aspect, and a second device as in any possible implementation of the fifth aspect.
[0051] In a possible implementation manner, the above communication system further includes: a third device, configured to manage interactive services.
[0052] In a possible implementation, the communication system further includes: a fourth device for managing live broadcast services.
[0053] In a seventh aspect, a computer-readable storage medium is provided, on which a computer program code is stored. When the computer program code is executed by a processor, the processor implements a method in any possible implementation of the second aspect or the third aspect.
[0054] In an eighth aspect, a chip system is provided, the chip system comprising a processor and a memory, wherein a computer program code is stored in the memory; when the computer program code is executed by the processor, the processor implements the method in any possible implementation of the second aspect or the third aspect. The chip system may be composed of a chip, or may include a chip and other discrete devices.
[0055] In a ninth aspect, a computer program product is provided, the computer program product comprising computer instructions. When the computer instructions are executed on a computer, the computer implements the method in any possible implementation of the second aspect or the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] Figure 1 Schematic diagram of the live broadcast system architecture provided in the embodiment of the present application Figure 1 ;
[0057] Figure 2 Schematic diagram of the live broadcast system architecture provided in the embodiment of the present application Figure 2 ;
[0058] Figure 3 Schematic diagram of the live broadcast system architecture provided in the embodiment of the present application Figure 3 ;
[0059] Figure 4 A schematic diagram of the hardware structure of an electronic device (such as an initiator or a receiver) provided in an embodiment of the present application;
[0060] Figure 5 A schematic diagram of the software structure of an electronic device (such as an initiator or a receiver) provided in an embodiment of the present application;
[0061] Figure 6 A schematic diagram of a live broadcast system architecture for live broadcast interaction provided in an embodiment of the present application;
[0062] Figure 7 A live interactive method provided in the embodiment of the present application Figure 1 ;
[0063] Figure 8 A live interactive method provided in the embodiment of the present application Figure 2 ;
[0064] Fig. 9 An interactive diagram of a live interactive method in an online classroom live broadcast scenario provided by an embodiment of the present application;
[0065] Fig.10 A schematic diagram of an online classroom live broadcast interface (i.e., a first interface) provided in an embodiment of the present application;
[0066] Fig.11 A schematic diagram of a question editing interface (i.e., the second interface) provided in an embodiment of the present application;
[0067] Fig.12 A schematic diagram of an interactive parameter confirmation interface (i.e., the third interface) provided in an embodiment of the present application;
[0068] Fig.13 A schematic diagram of an answer sheet interface (i.e., the fourth interface) provided in an embodiment of the present application;
[0069] Fig.14 A schematic diagram of a feedback parameter confirmation interface (i.e., the fifth interface) provided in an embodiment of the present application;
[0070] Fig.15 A schematic diagram of a feedback result display (i.e., the sixth interface) provided in an embodiment of the present application. DETAILED DESCRIPTION
[0071] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0072] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
[0073] The embodiment of the present application provides a live interactive method, which is applied to the process of interaction between a live broadcast end and an audience end during network live broadcast. The party initiating the live broadcast is called the live broadcast end, and the party receiving the live broadcast content is called the audience end.
[0074] The live broadcast in the embodiments of the present application may include but is not limited to conference live broadcast, classroom live broadcast, shopping live broadcast, video live broadcast or game live broadcast, etc. For example, the live broadcast end may broadcast live on the network through a live broadcast application installed on the device or other applications that support the live broadcast function, and accordingly, the audience end may receive the live broadcast content through a live broadcast application installed on the device or other applications that support the live broadcast function. Exemplarily, the live broadcast application may be a conference live broadcast application, a teaching live broadcast application, a shopping live broadcast application, an entertainment live broadcast application, etc., which is not limited in the embodiments of the present application.
[0075] Taking classroom live broadcast as an example, the live broadcast end that initiates the live broadcast is the teacher’s electronic device, and the audience end that receives the live broadcast content is the students’ electronic device.
[0076] Please refer to Figure 1 , Figure 1 A schematic diagram of a webcast process is shown. In some embodiments, webcast can be based on Figure 1 The live broadcast system shown is composed of a live broadcast end, an audience end and a streaming media live broadcast platform.
[0077] like Figure 1 As shown, the live broadcast end and the audience end include a live streaming media unit. The streaming media live broadcast platform is used to manage the live broadcast business. The streaming media live broadcast platform includes a live streaming service unit and a message service unit. Among them, the live streaming media unit of the live broadcast end is responsible for sending the live stream (such as real-time audio and video (RTC) stream) corresponding to the live screen of the live broadcast end to the live streaming service unit of the streaming media live broadcast platform according to the user's operation. The live streaming media unit of the audience end is responsible for obtaining the live stream from the live broadcast end from the live streaming service unit of the streaming media live broadcast platform, and displaying the corresponding live content on the audience end. The live streaming service unit of the streaming media live broadcast platform is used to forward the live stream of the live broadcast end to the audience end. The message service unit of the streaming media live broadcast platform is responsible for the message or signaling surface control in the live broadcast, such as controlling the full mute in the meeting.
[0078] Among them, in the embodiments of the present application, electronic devices (such as live broadcast terminals or audience terminals) may include but are not limited to smart phones, personal computers (PCs) (such as laptops, desktop computers, ultra-mobile personal computers (UMPCs), etc.), tablet computers, televisions, augmented reality (AR) / virtual reality (VR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in transportation safety, wireless terminals in smart cities, sensor devices (such as monitoring terminals), Internet of Things (IOT) devices, etc. The present application does not limit the specific functions and structures of electronic devices.
[0079] like Figure 1 As shown, the live broadcast end providing the live broadcast service to the audience end may specifically include the following S101 and S102:
[0080] S101: The live streaming media unit of the live broadcast end sends a live streaming to the live streaming service unit of the streaming media live broadcast platform.
[0081] S102: The live streaming service unit of the live streaming platform sends the live streaming from the live broadcast end to the live streaming unit of the audience end.
[0082] Furthermore, the audience end displays a corresponding live broadcast interface according to the live broadcast stream from the live broadcast end.
[0083] In some embodiments, for live broadcast on the Internet, there is an interactive scene between the live broadcast end and the audience end. Figure 1 The message service unit of the streaming live platform can also be used to forward chat messages, gift forwarding and other messages or signaling plane control during live broadcast. In order to provide interactive services during live broadcast, a server is further provided in the live broadcast system architecture to process interactive messages between the end sides, generate interactive content, forward interactive content, etc.
[0084] Among them, when the live broadcast end interacts with the audience end, the party that initiates the interaction is called the initiator end, and the other party is called the audience end.
[0085] During live webcast interaction, the initiator may be the live broadcast end or the audience end. Correspondingly, the audience end may be the audience end or the live broadcast end.
[0086] For example, a live broadcast interactive scenario may be that the live broadcast end shows a shopping link to the audience end. In this case, the live broadcast end is the initiating end and the audience end is the receiving end. Another example is that the audience end sends a gift to the live broadcast end. In this case, the audience end is the initiating end and the live broadcast end is the receiving end. The embodiments of the present application do not limit the specific functions of the initiating end and the receiving end and the specific interactive scenarios.
[0087] like Figure 2 As shown, the initiator and the receiver include an interactive unit and a message parsing unit. The interactive unit is responsible for providing an interactive window or interface, receiving user interactive operations, sending interactive messages to the server, and other related contents. The message parsing unit is responsible for parsing the received interactive content.
[0088] like Figure 2 As shown, in response to the user's operation of initiating interaction, the initiator end sends an interactive message to the audience end, which may specifically include the following S201-S205:
[0089] S201: The interactive unit at the initiating end displays an interactive window or interface.
[0090] S202: The interactive unit of the initiating end receives the interactive operation of the user on the interactive window or interface, wherein the interactive operation is such as selecting a send operation.
[0091] S203: In response to receiving the user's interactive operation on the interactive window or interface, the interactive unit of the initiating end sends interactive messages such as gifts, cards, emoticons, shopping links, barrages or raising hands to the server end.
[0092] S204: The server generates corresponding interactive content and sends it to the message service unit of the streaming media live broadcast platform.
[0093] S205: The message service unit of the streaming media live broadcast platform forwards the interactive content from the initiator to the message parsing unit of the audience end.
[0094] Furthermore, the message parsing unit at the audience end parses the received interactive content and displays it accordingly, such as displaying gifts, cards, emoticons, shopping links, bullet comments, or hand-raising prompts.
[0095] As an example, for different types of interactions (such as gifts, cards, emoticons, shopping links, bullet comments, or hand-raising, etc.), the formats of interactive messages will be different. The audience can parse the interactive content corresponding to the interactive messages in different formats and display them accordingly.
[0096] but, Figure 2 In the live broadcast system architecture shown, the server is limited to providing services for specific business scenarios and cannot support access and customization by third-party developers, so its openness and scalability are poor.
[0097] As another possible structure, Figure 3 As shown, the initiator and the audience end include a service call entry, a message parsing unit, and a page management unit. Among them, the service call entry is responsible for providing interactive tools, receiving user selections of interactive tools, and requesting corresponding pages from the page management unit according to the user's selections of interactive tools. The message parsing unit is responsible for parsing received interactive messages. The page management unit is responsible for managing pages (such as hypertext markup language (HTML)5 pages), obtaining page-related resources from the server, page display, receiving user selection operations on the page, and forwarding interactive messages.
[0098] like Figure 3 As shown, based on Figure 3 In the live broadcast system architecture shown, in response to the user's interactive operation, the initiator sends an interactive message to the audience, which may specifically include the following S301-S308:
[0099] S301: The initiator determines an interactive tool according to the selection operation of the user through the service calling portal.
[0100] S302: The service call entry of the initiating end requests the page management unit to pull up the page corresponding to the interactive tool.
[0101] S303: The page management unit of the initiating end requests page-related resources from the server end to display the corresponding interface.
[0102] S304: The page management unit of the initiating end sends an interactive message to the server end according to the user's selection operation on the page.
[0103] S305: The server sends an interactive message to the message service unit of the streaming media live broadcast platform.
[0104] S306: The message service unit of the streaming media live broadcast platform forwards the interactive message from the initiator to the message parsing unit of the audience end.
[0105] S307: After parsing the received interactive message, the message parsing unit at the audience end requests the page management unit to pull up the corresponding interactive interface.
[0106] S308: The page management unit of the audience side requests page-related resources from the server side to display the corresponding interface.
[0107] but, Figure 3 In the live broadcast system architecture shown, the server needs to be independently deployed to maintain specific page resources. If the business scenario changes, the content in the server needs to be adjusted, which increases the development cost. Figure 3In the live broadcast system architecture shown, the server is limited to providing services for specific business scenarios and cannot support access and customization by third-party developers, so its openness and scalability are poor.
[0108] In order to solve the above-mentioned problems in the conventional network live broadcast interaction process, the embodiment of the present application provides a live broadcast interaction method, which provides a unified platform framework and interface to facilitate third-party developers to customize the interaction process according to the actual live broadcast interaction needs. When the initiator needs to start the interaction, it only needs to obtain the static resources related to the tool from the static resource service, load the corresponding interface, and send an interactive message to the audience end according to the operation of the initiator user. Based on the interactive message, the audience end obtains the relevant static resources for the interaction from the static resource service, loads the interactive interface, and feeds back to the initiator end according to the operation of the audience end user. Through a unified platform framework and interface, this method can enrich the content of live broadcast interaction and improve the compatibility, scalability and openness of live broadcast interaction. In addition, through a unified platform framework and interface, the live broadcast content and the interactive content are independent of each other, which can ensure that the live broadcast content and the interactive content will not interfere with each other, and the security is higher.
[0109] In addition, based on Figure 2 The live broadcast system architecture shown in the figure shows that the interaction between the initiator and the audience is limited to one direction during the live broadcast, that is, the interaction between the initiator and the audience, and there is no back-and-forth interaction between the two ends. Figure 2 In the live broadcast system architecture shown, the interaction is based on interactive messages in the corresponding format of the interaction type, so the live broadcast interactions that can be supported are relatively simple, such as sending gifts, cards, emoticons, shopping links, bullet screens, or raising hands. Figure 3 In the live broadcast system architecture shown in the figure, when performing conventional network live broadcast, the interaction between the initiator and the audience is often in the form of cards or links as the entrance. When a single interaction ends, the entire interaction ends, and the interactivity is poor. However, the unified platform framework and interface provided by the embodiment of the present application can enrich the content of live broadcast interaction.
[0110] The following will describe in detail a live interactive method, electronic device and system provided in an embodiment of the present application in conjunction with the accompanying drawings.
[0111] Please refer to Figure 4 , Figure 4 Taking a smart phone as an example, a hardware structure diagram of an electronic device (such as an initiator or a receiver) provided by an embodiment of the present application is shown. Figure 4As shown, the electronic device may include a processor 410, a memory (including an external memory interface 420 and an internal memory 421), a universal serial bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, a button 490, a motor 491, an indicator 492, a camera assembly 493, a display screen 494, a subscriber identity module (SIM) interface 495, etc. Among them, the sensor module 480 may include a gyroscope sensor, an acceleration sensor, a magnetic sensor, a touch sensor, a fingerprint sensor, a pressure sensor, an air pressure sensor, a distance sensor, a proximity light sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.
[0112] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0113] The processor 410 may include one or more processing units. For example, the processor 410 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.
[0114] The processor 410 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may store instructions or data that the processor 410 has just used or cyclically used. If the processor 410 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 410, and thus improves the efficiency of the system.
[0115] In some embodiments, the processor 410 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface, etc.
[0116] The charging management module 440 is used to receive charging input from the charger. The power management module 441 is used to connect the battery 442, the charging management module 440 and the processor 410. The power management module 441 receives input from the battery 442 and / or the charging management module 440 to power the processor 410, the internal memory 421, the display screen 494, the camera assembly 493, and the wireless communication module 460.
[0117] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 450, wireless communication module 460, modem processor and baseband processor.
[0118] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0119] The mobile communication module 450 can provide wireless communication solutions including 2G / 3G / 4G / 5G / future communication networks applied in electronic devices. The mobile communication module 450 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 450 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 450 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 450 can be set in the processor 410. In some embodiments, at least some of the functional modules of the mobile communication module 450 can be set in the same device as at least some of the modules of the processor 410.
[0120] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 470A, a receiver 470B, etc.), or displays an image or video through a display screen 494. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 410 and be set in the same device as the mobile communication module 450 or other functional modules.
[0121] The wireless communication module 460 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth BT, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 460 can be one or more devices integrating at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 410. The wireless communication module 460 can also receive the signal to be sent from the processor 410, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0122] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 450, and the antenna 2 is coupled to the wireless communication module 460, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), new radio (NR), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0123] The electronic device implements the display function through a GPU, a display screen 494, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 410 may include one or more GPUs that execute program instructions to generate or change display information.
[0124] The display screen 494 is used to display images, videos, etc. The display screen 494 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 494, where N is a positive integer greater than 1.
[0125] In an embodiment of the present application, the electronic device can render an interface (such as a live broadcast interface, an interactive parameter setting interface, a feedback parameter setting interface, a feedback result display interface, etc.) through a GPU and display the corresponding interface through a display screen 494.
[0126] The electronic device can realize the shooting function through ISP, camera component 493, video codec, GPU, display screen 494 and application processor.
[0127] The external memory interface 420 can be used to connect an external memory card, such as a Micro SD card, a solid state drive, etc., to expand the storage capacity of the electronic device. The external memory card communicates with the processor 410 through the external memory interface 420 to implement a data storage function. For example, files such as music, videos, and images can be stored in the external memory card.
[0128] The internal memory 421 can be used to store computer executable program codes, which include instructions. The internal memory 421 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio and video data, etc.), etc. In addition, the internal memory 421 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 410 executes various functional applications and data processing of the electronic device by running instructions stored in the internal memory 421 and / or instructions stored in a memory provided in the processor.
[0129] The electronic device can realize audio functions through the audio module 470, the speaker 470A, the receiver 470B, the microphone 470C and the application processor, such as music playing and recording. For the specific working principles and functions of the audio module 470, the speaker 470A, the receiver 470B and the microphone 470C, reference can be made to the introduction in the conventional technology.
[0130] The key 490 includes a power key, a volume key, etc. The key 490 may be a mechanical key or a touch key. The electronic device may receive key input and generate key signal input related to user settings and function control of the electronic device.
[0131] It should be noted that Figure 4 The hardware modules included in the electronic device are only described for example, and do not limit the specific structure of the electronic device. For example, if the electronic device is a PC, the electronic device may also include components such as a keyboard and a mouse.
[0132] In this application, the operating system of the electronic device (such as the initiator or the receiver) may include but is not limited to Microsoft apple And other operating systems.
[0133] Including layered architecture For example, the electronic equipment of the system Figure 5 As shown in Figure 1, the software of electronic devices can be divided into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. Figure 5 As shown, the software structure of an electronic device (such as an initiator or a recipient) can be divided into three layers from top to bottom: application layer (referred to as application layer), application framework layer (referred to as framework layer), system library, Android runtime and kernel layer (also called driver layer).
[0134] The application layer may include a series of application packages, such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, short message and live broadcast applications. For the convenience of description, the application is referred to as application below.
[0135] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. Figure 5As shown, the application framework layer may include a window manager service (WMS), an activity manager service (AMS) and an input event management server (IMS). In some embodiments, the application framework layer may also include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. ( Figure 5 not shown).
[0136] The system library and Android runtime contain the function functions that need to be called by the framework layer, the Android core library, and the Android virtual machine. The system library can include multiple functional modules. For example: browser kernel, three-dimensional (3D) graphics, font library, etc.
[0137] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0138] The kernel layer is the layer between hardware and software. The kernel layer may include display drivers, input / output device drivers (e.g., keyboards, touch screens, headphones, speakers, microphones, etc.), device nodes, camera drivers, audio drivers, and sensor drivers. Users perform input operations through input devices, and the kernel layer can generate corresponding raw input events based on the input operations and store them in device nodes. Input / output device drivers can detect user input events. For example, a microphone can detect the voice uttered by the user.
[0139] It should be noted that Figure 5 Only layered architecture This application does not limit the specific architecture of the electronic device software system, and for the specific introduction of software systems with other architectures, reference can be made to conventional technologies.
[0140] As an example, the live interactive method provided in the embodiment of the present application can be based on Figure 6 The live broadcast system architecture is shown in the figure. Figure 6 As shown, the live broadcast system architecture includes an initiator (such as a first device), an audience (such as a second device), a streaming media live broadcast platform, and a static resource service platform.
[0141] The streaming media live broadcast platform includes a live streaming service unit and a message service unit. The live streaming service unit is used to provide audio, video, messages and other content during the live broadcast process. Exemplarily, the live streaming service unit is used to forward the live stream (such as RTC stream) corresponding to the live screen of the live broadcast end to the audience end. The message service unit is responsible for the message or signaling plane control in the live broadcast, such as chat message forwarding, gift forwarding, and controlling the full mute in the meeting.
[0142] The static resource service platform is used to manage the live interactive business. The static resource service platform includes a resource import interface and a storage unit. Among them, the resource import interface is used to accept the customization of third-party developers and import static resources into the storage unit. For example, third-party developers can upload resource files of interactive tools to the static resource service platform through the resource import interface. The storage unit is used to store tool resource files used for live interactive, that is, static resources.
[0143] The resource import interface can adapt to various types of terminal devices with different hardware and software structures, such as smartphones, PCs, tablets, etc. Microsoft apple For example, the static resource service platform can adapt and encapsulate terminal devices with different hardware and software structures, and provide a unified resource import interface for third-party developers.
[0144] like Figure 6 As shown, both the initiator and the audience end include a live streaming unit and a live interactive unit.
[0145] Among them, the live streaming media unit is responsible for sending the live stream (such as RTC stream) corresponding to the live screen to the live stream service unit of the streaming media live broadcast platform according to the user's operation when the device is broadcasting live; or, the live streaming media unit is responsible for obtaining the live stream (such as RTC stream) corresponding to the live screen of the live end from the live stream service unit of the streaming media live broadcast platform when the device is the audience end, so as to display the corresponding live screen.
[0146] The live broadcast interaction unit includes a tool management unit and a platform process management unit. The tool management unit is responsible for the interaction during the live broadcast, parsing static resources, running static resources, executing the live broadcast interaction process according to the business interaction process indicated by the static resources, and displaying the interface related to the static resources. The platform process management unit is responsible for obtaining the static resources corresponding to the interactive tools from the static resource service platform, managing the entrance of the interactive tools during the live broadcast (such as the platform interface), providing tool options for users to choose from, and launching the tool process according to the user's choice. For example, the platform process management unit may include a platform interface ( Figure 6 Not shown), such as the SendData(String message) interface.
[0147] Understandably, based on Figure 6 Based on the live broadcast system architecture shown in the figure, third-party developers can customize the resource files of live broadcast interactive tools through the resource import interface provided by the static resource service platform according to the actual live broadcast interactive needs, and import the resource files of live broadcast interactive tools into the static resource service platform in the form of static resources. Figure 6 The live broadcast system architecture shown can provide live broadcast interactions with richer content and more interactivity, and can improve the compatibility, scalability and openness of live broadcast interactions.
[0148] In some embodiments, Figure 6 The tool management unit is also responsible for providing a relatively independent process environment to independently run interactive tools. Figure 6 The live broadcast system architecture shown can provide independent process environments for live broadcast streams and interactive messages, ensuring that the live broadcast process and the interactive process do not interfere with each other, thereby providing higher security.
[0149] The following will be combined Figure 6 The live broadcast system architecture shown takes the initiator as the first device, the first device belongs to the first user, the audience end is the second device, and the second device belongs to the second user as an example to specifically introduce a live broadcast interaction method provided in an embodiment of the present application.
[0150] Among them, Figure 7 As shown, a live interactive method provided in an embodiment of the present application may include the following S701-S708:
[0151] S701: In response to receiving an operation of initiating a live interactive session from a first user, a first device displays a first interface including one or more tool options.
[0152] The first interface is used for the user to select an interactive tool or to display the currently supported interactive tools to the user. For example, the first interface is the current live broadcast interface, which includes one or more tool options.
[0153] As an example, the operation of initiating live interaction may include but is not limited to operations on a virtual button used to initiate live interaction (such as single-clicking, double-clicking, etc.), operations on a drop-down box or hidden box, preset operations on actual hardware (such as pressing the power button and the "+" volume button of a mobile phone at the same time) or voice commands, etc., depending on the input device driver supported by the first device, and is not limited in the embodiments of the present application.
[0154] S702: In response to receiving a selection operation of a first user on a first interface for a first tool, the first device acquires a static resource set corresponding to the first tool. The first tool is one of the one or more tools mentioned above.
[0155] The first tool may correspond to one or more static resources, that is, the static resource set corresponding to the first tool may include one or more static resources, and the static resources are used to indicate the business interaction process. For example, the static resource set includes a first static resource, a second static resource, and a third static resource.
[0156] Among them, in the embodiment of the present application, if the static resource set corresponding to the first tool includes multiple static resources, the multiple static resources have a predefined calling order; and / or, one or more of the multiple static resources have a predefined calling condition, such as being called upon receiving a preset operation. For example, the preset operation can be a preset operation of the user on the interface corresponding to the previous static resource.
[0157] For example, assuming that the static resource set corresponding to the first tool includes a first static resource (such as resource 1), a second static resource (such as resource 2) and a third static resource (such as resource 3), where the predefined calling order of resource 1, resource 2 and resource 3 is resource 1→resource 2→resource 3, then after the first tool is pulled up on the first device, the static resource calls and subsequent corresponding interface displays will be performed in the calling order of resource 1→resource 2→resource 3.
[0158] For another example, assuming that the static resource set corresponding to the first tool includes resource 1, resource 2, and resource 3, where the predefined calling conditions of resource 1, resource 2, and resource 3 are operation 1, operation 2, and operation 3, respectively, after the first device pulls up the first tool, when it receives operation 3 from the first user, it calls resource 3 and displays the subsequent corresponding interface.
[0159] For another example, assuming that the static resource set corresponding to the first tool includes resource 1, resource 2, and resource 3, wherein the predefined calling order of resource 1, resource 2, and resource 3 is resource 1→resource 2→resource 3, and the predefined calling condition of resource 2 is operation 2, then after the first device launches the first tool, it first calls resource 1, and then if the first device receives operation 2, the first device continues to call resource 2. If the first device does not receive operation 2 after calling resource 1, the first device abandons calling resource 2 and calls resource 3. For example, operation 2 is a preset operation on the corresponding interface displayed when the user calls resource 1 on the first device.
[0160] by Figure 6 Taking the initiator structure shown as an example, the tool management unit of the first device can request the platform process management unit to obtain the static resource set corresponding to the first tool. Correspondingly, the platform process management unit of the first device obtains the static resource set corresponding to the first tool.
[0161] As a possible implementation, the first device (such as the platform process management unit of the first device) can obtain from the third device (such as the static resource service platform (such as Figure 6 The storage unit of the static resource service platform obtains a static resource set corresponding to the first tool. The static resource service platform stores a static resource set corresponding to at least one interactive tool.
[0162] For example, assuming that the first device launches the process of the first tool for the first time, the first device obtains the static resource set corresponding to the first tool from the static resource service platform. In some embodiments, further, the first device can save the static resource set corresponding to the first tool obtained from the static resource service platform locally.
[0163] As another possible implementation, the first device (such as the platform process management unit of the first device) stores a static resource set corresponding to the first tool, and the first device can obtain the static resource set corresponding to the first tool locally. For example, the static resource set corresponding to the first tool stored by the first device is obtained from the static resource service platform when the first device has the need to launch the first tool for the first time. Among them, the static resource service platform stores a static resource set corresponding to at least one interactive tool.
[0164] As an example, the selection operation of the first tool may include but is not limited to the operation of the virtual button corresponding to the first tool (such as single-click, double-click, etc.) or voice commands, etc., depending on the input device driver supported by the first device, and is not limited in the embodiments of the present application.
[0165] It should be noted that the method provided in the embodiment of the present application may not include S701, but may be directly triggered by the first user's selection operation on the first tool on the first interface. For example, the first interface is the current live broadcast interface, and a virtual button corresponding to the first tool is displayed on the live broadcast interface. In response to receiving a click operation of the first user on the virtual button corresponding to the first tool on the first interface, the first device obtains a static resource set corresponding to the first tool.
[0166] S703: The first device displays a second interface according to the first static resource in the static resource set. The second interface is used for the first user to set interaction parameters. The second interface includes one or more edit boxes and / or one or more options.
[0167] As an example, the first static resource is a static resource that is predefined and called for the first time in the static resource set.
[0168] by Figure 6 Taking the initiator structure shown as an example, the platform process management unit of the first device can display the second interface according to the first static resource in the acquired static resource set.
[0169] As a possible implementation, the first device (such as the platform process management unit of the first device) displays the second interface according to the first static resource in the static resource set, which specifically includes: first, the first device parses the first static resource and obtains the business interaction process indicated by the first static resource. Then, the first device runs the first tool according to the business interaction process indicated by the first static resource. Finally, the first device displays the result of running the first tool, that is, displays the interface corresponding to the first static resource (that is, the second interface).
[0170] Exemplarily, one or more editing boxes on the second interface may be used for, but not limited to, editing one or more of the following: title, bullet screen, comment, message, shopping link, download link, etc. One or more options on the second interface may include, but are not limited to, one or more of the following: candidate answer options, expression options, card options, animation options, gift options, action options (such as raising a hand, etc.), etc.
[0171] S704: The first device receives the setting of the interaction parameter by the first user.
[0172] As an example, the first user may set the interactive parameters through editing operations and / or selection operations on the second interface.
[0173] For example, the editing operation of the first user on the second interface may include but is not limited to the operation of the first user editing the title, bullet screen, comment, message, shopping link, download link and other information on the second interface. The selection operation of the first user on the second interface may include but is not limited to the operation of the first user selecting options such as emoticons, cards, animations, gifts, actions (such as raising hands, etc.) on the second interface.
[0174] As an implementation method, after receiving the setting of the interaction parameter by the first user, the first device executes the following S705.
[0175] As another implementation, after receiving the setting of the interaction parameter by the first user, the first device displays a third interface, wherein the third interface includes a virtual button for confirming the setting of the interaction parameter, and is used to confirm the setting of the interaction parameter by the first user by clicking the virtual button to trigger the sending of the interaction message, that is, to execute the following S705.
[0176] S705: The first device sends an interactive message to the streaming live broadcast platform (ie, the fourth device).
[0177] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, S705 includes: the tool management unit of the first device sends an interactive message to the message service unit of the streaming media live broadcast platform.
[0178] As an example, the interactive message carries the identifier of the static resource set corresponding to the first tool and the interactive parameters, wherein the identifier of the static resource set corresponding to the first tool is such as ID (identity) or the storage address of the static resource set corresponding to the first tool on the static resource service platform.
[0179] The interaction parameter is used to characterize the information edited and / or the options selected by the first user on the second interface. For example, assuming that the first user edits the title on the second interface, the interaction parameter is used to characterize the title. For another example, assuming that the first user edits the title and selects multiple options on the second interface, the interaction parameter is used to characterize the title and the multiple options.
[0180] For example, the platform process management unit of the first device can call the tool management unit (such as the platform interface of the tool management unit, such as the SendData (String message) interface) to send an interactive message to the tool management unit of the first device, so that the tool management unit of the first device sends the interactive message to the message service unit of the streaming live broadcast platform.
[0181] As a possible implementation manner, the format of the interactive message may be extensible markup language (XML), extensible message processing field protocol (XMPP), etc., which is not limited in this application.
[0182] Taking the interactive message in XMPP format as an example, the interactive message can be as follows:
[0183] <message id="xc3S4-42"to="userid.hicloud.com"from="userid.hicloud.com"
[0184] type="chat"seq="155457744">
[0185] <livecontrol xmlns="custom">
[0186] <content>
[0187] {"roomid":"943212","command":"livetools",
[0188] "attr":{"src":"parameter 1","data":"parameter 2"}}
[0189] < / content>
[0190]
[0191] .
[0192] Among them, in the above interactive message example, ""src":"parameter 1"" is the address of the static resource (that is, the address of the static resource set corresponding to the first tool), and ""data":"parameter 2"" is the interactive parameter.
[0193] S706: The live streaming platform forwards the interactive message from the first device to the second device.
[0194] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, the message service unit of the streaming media live broadcast platform forwards the interactive message from the first device to the platform process management unit of the second device.
[0195] S707: The second device obtains a static resource set corresponding to the first tool according to the interactive message.
[0196] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, the tool management unit of the second device can obtain the static resource set corresponding to the first tool based on the interactive message.
[0197] As a possible implementation method, the second device can parse the interactive message to obtain the identifier of the static resource set corresponding to the first tool and the interactive parameters carried in the interactive message. Further, the second device can obtain the static resource set corresponding to the first tool according to the identifier of the static resource set corresponding to the first tool carried in the interactive message.
[0198] For example, assuming that the interactive message carries an identifier of a static resource set corresponding to the first tool, the second device can search for the static resource set corresponding to the first tool locally according to the identifier, or search for the static resource set corresponding to the first tool from a static resource service platform (such as Figure 6 The storage unit of the static resource service platform shown in the figure) obtains the static resource set corresponding to the first tool.
[0199] For another example, assuming that the interactive message carries the address of the static resource set corresponding to the first tool, the second device can obtain the static resource service platform (such as Figure 6 The static resource set corresponding to the first tool is obtained through the corresponding path of the storage unit of the static resource service platform shown.
[0200] S708: The second device displays a fourth interface according to the second static resource in the static resource set and the interaction parameter. The fourth interface includes information corresponding to the interaction parameter.
[0201] As an example, the second static resource is a static resource of a second call that is predefined in the static resource set.
[0202] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, the tool management unit of the second device can determine the fourth interface based on the second static resource in the static resource set and the interactive parameters, and display the fourth interface.
[0203] The fourth interface includes information corresponding to the interaction parameter. For example, assuming that the interaction parameter is used to represent the question edited by the first user, the fourth interface includes the question. For another example, assuming that the interaction parameter is used to represent the multiple-choice question and multiple candidate answer options edited by the first user, the fourth interface includes the multiple-choice question and the multiple candidate answer options.
[0204] As a possible implementation, the second device (such as the tool management unit of the second device) can parse the second static resource to obtain the business interaction process indicated by the second static resource. Then, the second device (such as the tool management unit of the second device) runs the first tool according to the business interaction process indicated by the second static resource, loads the interaction parameters, and determines the fourth interface. Finally, the second device displays the fourth interface.
[0205] like Figure 7 As shown, based on Figure 6 The live broadcast system architecture shown can realize the interaction between the initiator and the audience. Figure 6 The live broadcast system architecture shown can also realize the back-and-forth interaction of the initiator → the audience → the initiator.
[0206] like Figure 8 As shown, after S708, a live interactive method provided in an embodiment of the present application may further include the following S801-S804:
[0207] S801: The second device receives the feedback parameter setting made by the second user on the fourth interface.
[0208] As an example, the fourth interface may also include one or more edit boxes, and / or one or more options for the second user to set feedback parameters, that is, the second user may set feedback parameters through editing operations and / or selection operations on the fourth interface.
[0209] For example, the editing operation of the second user on the fourth interface may include but is not limited to the operation of the second user editing answers, bullet comments, comments, replies, etc. on the fourth interface. The selection operation of the second user on the fourth interface may include but is not limited to the operation of the second user selecting options such as emoticons, cards, animations, gifts, actions, etc. on the fourth interface.
[0210] As an implementation manner, after receiving the feedback parameter setting by the second user, the second device executes the following S802.
[0211] As another implementation, after receiving the feedback parameter setting by the second user, the second device displays a fifth interface, wherein the fifth interface includes a virtual button for confirming the feedback parameter, and is used to confirm the second user's response to the interaction parameter (i.e., the setting of the feedback parameter) by clicking the virtual button, so as to trigger the sending of the feedback message, i.e., execute the following S802.
[0212] S802: The second device sends a feedback message to the streaming live broadcast platform.
[0213] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, S802 includes: the tool management unit of the second device sends a feedback message to the message service unit of the streaming media live broadcast platform.
[0214] The feedback message carries a feedback parameter. The feedback parameter is used to characterize the information edited and / or the option selected by the second user on the fourth interface. For example, assuming that the second user edits the answer to the question in the interactive parameter on the fourth interface, the feedback parameter is used to characterize the answer. For another example, assuming that the second user selects multiple candidate answer options on the fourth interface, the feedback parameter is used to characterize the selection result.
[0215] For example, the platform process management unit of the second device can call the tool management unit (such as the platform interface of the tool management unit, such as the SendData (String message) interface) to send an interactive message to the tool management unit of the second device, so that the tool management unit of the second device sends the feedback message to the message service unit of the live streaming platform.
[0216] As a possible implementation manner, the format of the feedback message may be XML, XMPP, etc., which is not limited in this application.
[0217] Taking the feedback message in XMPP format as an example, the feedback message may be as follows:
[0218] <message id="xc3S4-42"to="userid.hicloud.com"from="userid.hicloud.com"
[0219] type="chat"seq="155457744">
[0220] <livecontrol xmlns="custom">
[0221] <content>
[0222] {"roomid":"943212","command":"livetools",
[0223] "attr":{"data":"Parameter 3"}}
[0224] < / content>
[0225]
[0226] .
[0227] In the above feedback message example, ""data":"parameter 3"" refers to the feedback parameter.
[0228] It can be understood that since the first device has obtained the static resource set corresponding to the first tool in S702, it can be considered that the static resource set corresponding to the first tool has been saved in the first device. Therefore, the feedback message may not include the address of the static resource (that is, the address of the static resource set corresponding to the first tool), but only include feedback parameters.
[0229] S803: The streaming media live broadcast platform forwards the feedback message to the first device.
[0230] by Figure 6Taking the live broadcast system architecture and device structure shown as an example, the message service unit of the streaming media live broadcast platform forwards the feedback message from the second device to the platform process management unit of the first device.
[0231] S804: The first device calls the third static resource according to the feedback message and displays the sixth interface.
[0232] The third static resource is a third static resource predefined in the static resource set.
[0233] by Figure 6 Taking the live broadcast system architecture and device structure shown as an example, the tool management unit of the first device can call the third static resource according to the feedback message, combine the feedback parameters, determine the sixth interface, and display the sixth interface.
[0234] In some embodiments, the tool management unit of the first device can parse the feedback message to obtain the feedback parameters carried in the feedback message. Further, the first device can call the third static resource to run the first tool according to the business interaction process indicated by the third static resource, and load the feedback parameters to determine the sixth interface. Finally, the first device sends the sixth interface. As an example, the first device can call the third static resource based on a predefined calling sequence.
[0235] The embodiment of the present application provides a live interactive method based on a unified platform framework (such as including Figure 6 Static resource service platform) and interface (such as Figure 6 The resource import interface shown in the figure) allows third-party developers to customize the interaction process of interactive tools according to actual live interaction needs, and import them into the static resource service platform in the form of static resources.
[0236] Based on this unified platform framework and interface, when the initiator of live interaction needs to start the interaction, it only needs to obtain the static resources related to the tool from the static resource service, load the corresponding interface, and send interactive messages to the audience according to the operation of the initiator. The audience of live interaction obtains the relevant static resources of the interactive tool from the static resource service based on the interactive message, loads the interactive interface, and provides feedback to the initiator according to the operation of the audience. Through this solution, live interaction is not limited to conventional single interactive content (such as sending cards, gifts, emoticons, shopping links, barrage, raising hands or animation effects, etc.), but can adaptively enrich the content of live interaction and improve the compatibility, scalability and openness of live interaction.
[0237] In addition, since the processes responsible for interactive services and live broadcast services are relatively independent, the live broadcast interactive method provided in the embodiment of the present application can also ensure the independence between services by isolating processes or providing a sandbox environment, thereby ensuring that the live broadcast content and the interactive content will not interfere with each other, and the security is higher.
[0238] The following will be combined Figure 6 The live broadcast system architecture shown takes the live broadcast interaction during the online classroom live broadcast as an example to introduce a live broadcast interaction method in the online classroom live broadcast scenario provided by an embodiment of the present application.
[0239] For example, suppose that during the live broadcast of an online class, the teacher sends a test (such as multiple-choice questions) to online students through the teacher-side device (i.e., the initiator of the live broadcast interaction). Students receive the multiple-choice questions through the student-side device (i.e., the audience of the live broadcast interaction) and answer them. The teacher-side device (i.e., the initiator of the live broadcast interaction) displays the answer results based on the students' answers. Figure 6 The initiator (i.e., the first device) and the student device (i.e., Figure 6 In the audience end (i.e., the second device) shown, the teacher is the first user, and the student is the second user.
[0240] It should be noted that, in this scenario example, the static resource service platform has stored static resources corresponding to the in-class test interactive tool in the storage unit. The static resources are customized by a third-party developer and imported into the static resource service platform through a resource import interface.
[0241] like Fig. 9 As shown, the interaction process of the live interactive method in the online classroom live broadcast scenario may include S901-S908.
[0242] S901: In response to receiving an operation of a teacher initiating a live interactive broadcast, the teacher's terminal device displays a first interface including an option of a class test tool.
[0243] The first interface is used by teachers to select interactive tools or to display currently supported interactive broadcast tools to teachers. For example, the first interface is the current online class live broadcast interface, which includes one or more tool options. The one or more tools include a classroom test tool.
[0244] For example, please refer to Fig.10 , Fig.10 FIG. 1 shows an example of a first interface provided by an embodiment of the present application. Fig.10 As shown, the first interface is the current online class live interface, which includes a drop-down box of interactive tools, including three tools: in-class test, countdown and raising hands.
[0245] S902: In response to receiving the selection operation of the in-class test tool on the first interface by the teacher, the teacher-side device obtains a static resource set corresponding to the in-class test tool.
[0246] The static resource set corresponding to the in-class test tool may include multiple static resources, and the multiple static resources are used to indicate multiple interactive business processes.
[0247] For example, taking the in-class test tool as an example, the static resource set includes a first static resource, a second static resource, and a third static resource. For example, for the in-class test tool, the first static resource is used to indicate the interactive parameter process. The second static resource is used to indicate the interactive interface display process. The third static resource is used to indicate the feedback result display process.
[0248] As an example, the predefined calling order of static resources in the static resource set corresponding to the in-class test tool is: first static resource → second static resource → third static resource. After the teacher's end device launches the in-class test tool, it will call the static resources and display the corresponding interface in the calling order of first static resource → second static resource → third static resource.
[0249] As another example, one or more static resources in the static resource set corresponding to the in-class test tool have predefined calling conditions, such as being called upon receiving a preset operation. For example, the preset operation may be a preset operation on the interface corresponding to the previous static resource.
[0250] In some embodiments, the teacher's terminal device can access the static resource service platform (such as Figure 6 The storage unit of the static resource service platform shown in the figure) obtains the static resource collection corresponding to the in-class testing tool.
[0251] For example, assuming that the teacher's terminal device starts the process of the classroom test tool for the first time, the teacher's terminal device obtains the static resource set corresponding to the classroom test tool from the static resource service platform. In some embodiments, further, the teacher's terminal device can save the static resource set corresponding to the classroom test tool obtained from the static resource service platform locally.
[0252] In other embodiments, the teacher-side device (such as the platform process management unit of the teacher-side device) stores a static resource set corresponding to the in-class test tool, and the teacher-side device can obtain the static resource set corresponding to the in-class test tool locally. For example, the static resource set corresponding to the in-class test tool stored in the teacher-side device is obtained from the static resource service platform when the teacher-side device has the need to pull up the in-class test tool for the first time. Among them, the static resource service platform stores at least one static resource set corresponding to the interactive tool.
[0253] S903: The teacher's terminal device displays a second interface according to the first static resource in the static resource set. The second interface is used by the teacher to edit the content of the multiple-choice question. The second interface includes one or more edit boxes and one or more options.
[0254] As an example, the first static resource is a static resource that is predefined and called for the first time in the static resource set.
[0255] As a possible implementation method, the teacher-side device (such as the platform process management unit of the teacher-side device) displays the second interface according to the first static resource in the static resource set, which specifically includes: first, the teacher-side device parses the first static resource and obtains the interactive business process indicated by the first static resource. Then, the teacher-side device runs the in-class test tool according to the interactive business process indicated by the first static resource. Finally, the teacher-side device displays the result of running the in-class test tool, that is, displays the interface corresponding to the first static resource (that is, the second interface).
[0256] Among them, in the interactive scene of the in-class test, one or more editing boxes on the second interface can be used for, but not limited to, editing one or more of the following: multiple-choice questions, fill-in-the-blank questions, true-or-false questions, short-answer questions, etc. One or more options on the second interface correspond to one or more question types, or one or more candidate answers.
[0257] For example, after the static resource is parsed and the interactive tool is run, the teacher's device displays Fig.11 The test question editing interface (i.e., the second interface) shown in the figure includes the question type options (e.g., Fig.11 Multiple choice options, fill-in-the-blank options, true-or-false options, and short-answer options) and multiple edit boxes (such as Fig.11 An edit box for editing the question and an edit box for editing the answer are shown).
[0258] It should be noted that Fig.11 This is only an example of a multiple-choice question editing interface. The embodiment of the present application does not limit the specific type of test questions, such as fill-in-the-blank questions, true-or-false questions, short-answer questions, etc. In addition, the embodiment of the present application does not limit the specific content and display format of the second interface. For example, the second interface may also include options and / or edit boxes for setting the answer time.
[0259] S904: The teacher-side device receives the teacher's settings for the interaction parameters (ie, the multiple-choice question parameters).
[0260] As an example, the teacher can Fig.11 The interactive parameters are set through editing operations and / or selection operations on the question editing interface shown in the figure.
[0261] For example, teachers can Fig.11 The question type selection, question editing and candidate answer option editing are performed on the interface shown. For example, the teacher selects the multiple-choice option on the question editing interface and edits the multiple-choice title and candidate answer options. Among them, the multiple-choice title is "Who is the author of the poem "The waterfall falls three thousand feet straight down, and it seems that the Milky Way falls from the sky"?", and the candidate answer options include "A (Li Bai), B (Du Fu), C (Bai Juyi), D (Wang Wei)", then the question editing interface is as follows Fig.12 shown.
[0262] As an implementation method, after receiving the settings of the interactive parameters (such as multiple-choice question parameters) from the teacher, the teacher-side device directly executes the following S905.
[0263] As another implementation, after receiving the settings of the interactive parameters (such as the multiple choice question parameters) from the teacher, the teacher-side device displays a third interface. The third interface includes a virtual button (such as Fig.12 The "Start Test Button" shown in the figure is used to determine the teacher's setting of the interactive parameters by clicking the virtual button to trigger the sending of the interactive message.
[0264] S905: The teacher's device sends an interactive message to the live streaming platform.
[0265] As an example, the interactive message carries the identifier of the static resource set corresponding to the first tool (such as the in-class test tool) and the interactive parameters (such as the multiple-choice question parameters). Among them, the identifier of the static resource set corresponding to the first tool (such as the in-class test tool) is such as ID (identity) or the storage address of the static resource set corresponding to the in-class test tool on the static resource service platform.
[0266] The interaction parameters are used to characterize the teacher's Fig.12 The information edited and / or the options selected on the topic editing interface shown in the figure. Fig.12 As shown, the teacher edits the multiple-choice question title and multiple candidate answer options on the second interface, and the dynamic parameter is used to characterize the multiple-choice question title and the multiple candidate answer options.
[0267] Taking the interactive message including multiple-choice question parameters and the interactive message in XMPP format as an example, the interactive message may be as follows:
[0268] <message id="xc3S4-42"to="userid.hicloud.com"from="userid.hicloud.com"
[0269] type="chat"seq="155457744">
[0270] <livecontrol xmlns="custom">
[0271] <content>
[0272] {"roomid":"943212","command":"livetools",
[0273] "attr":{"src":"https: / / hicloud.com / static / livetools / selection.zip","data":"Who is the author of the poem "The waterfall plunges three thousand feet, as if it is the Milky Way falling from the sky"?, A(Li Bai), B(Du Fu), C(Bai Juyi), D(Wang Wei)"}}
[0274] < / content>
[0275]
[0276] .
[0277] In the above interactive message example, src is the address of the static resource (i.e., the address of the static resource collection corresponding to the in-class test tool), such as https: / / hicloud.com / static / livetools / selection.zip. data is the selection parameter, which includes the title of the multiple-choice question and four candidate answer options.
[0278] S906: The live streaming platform forwards the interactive message from the teacher's terminal device to the student's terminal device.
[0279] S907: The student-end device obtains a static resource set corresponding to the in-class test tool according to the interactive message.
[0280] As a possible implementation method, the student-end device can parse the interactive message to obtain the identifier of the static resource set corresponding to the in-class test tool (i.e., the first tool) carried in the interactive message and the interactive parameters. Further, the student-end device can obtain the static resource set corresponding to the in-class test tool (i.e., the first tool) according to the identifier of the static resource set corresponding to the in-class test tool (i.e., the first tool) carried in the interactive message.
[0281] For example, assuming that the interactive message carries the identifier of the static resource set corresponding to the in-class test tool, the student-end device can search for the static resource set corresponding to the in-class test tool locally according to the identifier, or search for the static resource set corresponding to the in-class test tool from the static resource service platform (such as Fig. 9 The storage unit of the static resource service platform shown in the figure) obtains the static resource collection corresponding to the in-class testing tool.
[0282] For another example, assuming that the interactive message carries the address of the static resource collection corresponding to the in-class test tool (such as https: / / hicloud.com / static / livetools / selection.zip), the student-end device can obtain the static resource service platform (such as Fig. 9 The static resource collection corresponding to the in-class testing tool is obtained by using the corresponding path of the storage unit of the static resource service platform shown in the figure.
[0283] S908: The student terminal device displays a fourth interface based on the second static resource in the static resource set and the interactive parameter (ie, the multiple-choice question parameter). The fourth interface includes information corresponding to the interactive parameter (ie, the multiple-choice question parameter).
[0284] As an example, the second static resource is a second static resource predefined in the static resource set. Taking the in-class test tool as an example, the second static resource is used to indicate the interactive interface display process.
[0285] The fourth interface includes information corresponding to the interactive parameter. For example, assuming that the interactive parameter is used to represent the title of the multiple-choice question edited by the teacher and multiple candidate answer options, the fourth interface includes the title of the multiple-choice question and the multiple candidate answer options.
[0286] As a possible implementation, the student-end device (such as the tool management unit of the student-end device) can parse the second static resource to obtain the interactive business process indicated by the second static resource. Then, the student-end device runs the in-class test tool according to the interactive business process indicated by the second static resource, loads the interactive parameters, and determines the fourth interface. Finally, the student-end device displays the fourth interface.
[0287] For example, after the static resources are parsed and the interactive tools are run, the student device displays Fig.13 The answer sheet interface (i.e., the fourth interface) shown in FIG. Among them, the answer sheet interface (i.e., the fourth interface) includes multiple-choice questions (such as Fig.13 As shown in the following figure: Who is the author of the poem "The waterfall falls three thousand feet straight down, as if it is the Milky Way falling from the sky"? ) and multiple candidate answer options (such as Fig.13 As shown: A (Li Bai), B (Du Fu), C (Bai Juyi), D (Wang Wei)).
[0288] It should be noted that Fig.13 This is only an example of an answer sheet interface, and the embodiments of the present application do not limit the specific content and display format of the answer sheet.
[0289] S909: The student-end device receives the feedback parameter settings made by the student on the fourth interface.
[0290] As an example, the fourth interface may also include one or more editing boxes, and / or one or more options for students to set feedback parameters, that is, students may set feedback parameters through editing operations and / or selection operations on the fourth interface.
[0291] Taking the answer sheet interface (i.e., the fourth interface) including multiple-choice questions and multiple candidate answer options as an example, students can set feedback parameters by selecting operations on the answer sheet interface (i.e., the fourth interface). Fig.14As shown, the student-end device receives the student's selection operation on candidate answer option A on the answer sheet interface (ie, the fourth interface).
[0292] As an implementation method, after receiving the setting of the feedback parameters, the student-end device directly executes the following S910.
[0293] As another implementation, after receiving the setting of the feedback parameter, the student terminal device displays the fifth interface. The fifth interface includes a virtual button (such as Fig.14 The "Submit Answer" button shown in the figure) is used to determine the student's response to the interactive parameters (i.e., the setting of the feedback parameters) by clicking the virtual button to trigger the sending of the feedback message.
[0294] S910: The student-end device sends a feedback message to the streaming live broadcast platform.
[0295] The feedback message carries feedback parameters. The feedback parameters are used to represent the information edited and / or the options selected by the student on the fourth interface. Fig.14 Taking the interface shown as an example, the feedback message is used to represent the student's selection results.
[0296] Taking the feedback message including the selection result and the feedback message in XMPP format as an example, the feedback message may be as follows:
[0297] <message id="xc3S4-42"to="userid.hicloud.com"from="userid.hicloud.com"
[0298] type="chat"seq="155457744">
[0299] <livecontrol xmlns="custom">
[0300] <content>
[0301] {"roomid":"943212","command":"livetools",
[0302] "attr":{"data":"A"}}
[0303] < / content>
[0304]
[0305] .
[0306] In the above feedback message example, data is the selection result (ie, feedback parameter), such as option A.
[0307] S911: The live streaming platform forwards the feedback message to the teacher's device.
[0308] S912: The teacher-end device calls the third static resource according to the feedback message and displays the sixth interface.
[0309] The third static resource is the third static resource predefined in the static resource set. Taking the in-class test tool as an example, the third static resource is used to indicate the feedback result display process.
[0310] As an example, the platform process management unit of the teacher-end device may call the tool management unit (such as the platform interface of the tool management unit, such as the getData interface) to send a feedback result to the tool management unit of the teacher-end device.
[0311] For example, the feedback results can be<uid,value> The tool management unit sends the feedback to the platform process management unit in the form of a data format, so that the platform process management unit can do more information processing and display. Among them, uid is the user's ID, value is used to represent the feedback parameters in the feedback message, and value can be customized by third-party developers according to needs. For example, value can include data in the feedback message in the above XMPP format. For example, the feedback result can be {(ID1,A), (ID2,B), (ID3,C), (ID4,D)}, which is used to represent that the user represented by ID1 has selected option A, the user represented by ID2 has selected option B, the user represented by ID3 has selected option C, and the user represented by ID4 has selected option D.
[0312] In some embodiments, the teacher-side device (such as the tool management unit of the teacher-side device) can obtain the feedback parameters carried in the feedback message by parsing the feedback message. Further, the teacher-side device can call the third static resource to run the third static resource according to the interactive business process indicated by the third static resource, and load the feedback parameters to determine the sixth interface. Finally, the teacher-side device sends the sixth interface. As an example, the teacher-side device can call the third static resource based on a predefined calling sequence.
[0313] As an example, the teacher-side device displays the feedback parameters of each student after parsing the feedback message and calling the third static resource.
[0314] As another example, the teacher-side device parses the feedback message from each student-side device and calls the third static resource to display the student's feedback results in a statistical form.
[0315] For example, the student feedback results can be displayed in the form of the names of students who selected each candidate answer option. For another example, the student feedback results can be displayed in the form of the number of students who selected each candidate answer option. Fig.15As shown, the number of students taking the in-class test is 30 (the class size is 32), of which 25, 2, 2 and 1 students choose A, B, C and D respectively. The embodiment of the present application does not limit the specific display form of the feedback result, which depends on the static resources defined by the third-party developer.
[0316] It is understandable that, in order to implement the functions of any of the above-mentioned embodiments, the electronic device (such as the first device, the second device or the third device) includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0317] The embodiment of the present application can divide the electronic device (such as the first device, the second device or the third device) into functional modules. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0318] It should be understood that each module in the electronic device (such as the first device, the second device or the third device) can be implemented in the form of software and / or hardware, without specific limitation. In other words, the electronic device is presented in the form of functional modules. The "module" here can refer to an application-specific integrated circuit ASIC, a circuit, a processor and a memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above functions.
[0319] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disk (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
[0320] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in a hardware manner, or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in an electronic device or an SSD. Of course, the processor and the storage medium can also be present in an electronic device as discrete components.
[0321] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
Claims
1. A live interactive method, characterized in that: The method is applied to an application with a live broadcast function, and the method comprises: Display the first interface; In response to receiving a selection operation of a first tool by a first user on the first interface, displaying a second interface according to a first static resource corresponding to the first tool, wherein the second interface is used for the first user to set interaction parameters; and the first static resource is used to indicate a first interactive business process; According to the setting of the interaction parameters by the first user on the second interface, an interaction message is sent to the second user, and the interaction message includes the interaction parameters.
2. The method according to claim 1, characterized in that The application includes one or more of the following: a conference live broadcast application, a teaching live broadcast application, a shopping live broadcast application, and an entertainment live broadcast application.
3. The method according to claim 1 or 2, characterized in that: The sending of an interactive message to the second user according to the interactive parameter setting by the first user on the second interface includes: According to the setting of the interaction parameters by the first user on the second interface, displaying a third interface, wherein the third interface includes a first button, and the first button is used to confirm the setting of the interaction parameters; In response to receiving an operation on the first button, sending an interactive message to the second user.
4. The method according to any one of claims 1 to 3, characterized in that The first static resource belongs to a static resource set, and the static resource set is customized by a third-party developer according to interaction requirements.
5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Acquire a static resource set according to the interactive message; According to the second static resource in the static resource set and in combination with the interactive parameter, a fourth interface is displayed, wherein the fourth interface includes information corresponding to the interactive parameter.
6. The method according to claim 5, characterized in that The interactive message also includes an identifier of a static resource set; and obtaining the static resource set according to the interactive message includes: The static resource set is acquired according to the identifier of the static resource set in the interactive message.
7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: receiving a feedback parameter setting by a second user on the fourth interface, and displaying a fifth interface, wherein the fifth interface includes a second button, and the second button is used to confirm the setting of the feedback parameter; In response to receiving an operation on the second button, sending a feedback message to the first user, the feedback message including the feedback parameter; According to the feedback message, the sixth interface is displayed.
8. The method according to claim 7, characterized in that The fourth interface includes one or more edit boxes and / or one or more options; the receiving of the feedback parameter setting by the second user on the fourth interface includes: Receive an editing operation of the second user on at least one of the one or more editing boxes on the fourth interface, and / or a selection operation on at least one of the one or more options on the fourth interface.
9. The method according to any one of claims 1 to 8, characterized in that The displaying the second interface according to the first static resource corresponding to the first tool includes: Parsing a first static resource corresponding to the first tool, and acquiring a business interaction process indicated by the first static resource; The first tool is run according to the business interaction process indicated by the first static resource to display the second interface.
10. The method according to any one of claims 1 to 9, characterized in that The second interface includes one or more editing boxes and / or one or more options; the receiving the setting of the interaction parameter by the first user on the second interface includes: Receive an editing operation of the first user on at least one of the one or more editing boxes on the second interface, and / or a selection operation on at least one of the one or more options on the second interface.
11. The method according to any one of claims 1 to 10, characterized in that The first static resource is a first called static resource predefined in the static resource set.
12. A live interactive method, characterized in that: The method comprises: Display the first interface; In response to receiving a selection operation of a first tool by a first user on the first interface, displaying a second interface according to a first static resource corresponding to the first tool, wherein the second interface is used for the first user to set interaction parameters; and the first static resource is used to indicate a first interactive business process; Sending an interactive message to the second user according to the interactive parameters set by the first user on the second interface, wherein the interactive message includes the interactive parameters; receiving a feedback message from the second user; According to the feedback message, the sixth interface is displayed.
13. The method according to claim 12, characterized in that The application includes one or more of the following: a conference live broadcast application, a teaching live broadcast application, a shopping live broadcast application, and an entertainment live broadcast application.
14. The method according to claim 12 or 13, characterized in that The sending of an interactive message to the second user according to the interactive parameter setting by the first user on the second interface includes: According to the setting of the interaction parameters by the first user on the second interface, displaying a third interface, wherein the third interface includes a first button, and the first button is used to confirm the setting of the interaction parameters; In response to receiving an operation on the first button, sending an interactive message to the second user.
15. The method according to any one of claims 12 to 14, characterized in that: The first static resource belongs to a static resource set, and the static resource set is customized by the third-party developer according to interaction requirements.
16. The method according to any one of claims 12 to 15, characterized in that: The displaying the second interface according to the first static resource corresponding to the first tool includes: Parsing a first static resource corresponding to the first tool, and acquiring a business interaction process indicated by the first static resource; The first tool is run according to the business interaction process indicated by the first static resource to display the second interface.
17. The method according to any one of claims 12 to 16, characterized in that: The second interface includes one or more editing boxes and / or one or more options; the receiving the setting of the interaction parameter by the first user on the second interface includes: Receive an editing operation of the first user on at least one of the one or more editing boxes on the second interface, and / or a selection operation on at least one of the one or more options on the second interface.
18. The method according to any one of claims 12 to 17, characterized in that: The first static resource is a first called static resource predefined in a static resource set.
19. A live interactive method, characterized in that: The method is applied to an application with a live broadcast function, and the method comprises: receiving an interactive message from a first user, wherein the interactive message includes an interactive parameter; Acquire a second static resource according to the interactive message; According to the second static resource and in combination with the interactive parameters, a fourth interface is displayed, wherein the fourth interface includes information corresponding to the interactive parameters.
20. The method according to claim 19, characterized in that The acquiring the second static resource according to the interactive message includes: Acquire a static resource set according to the interactive message, wherein the static resource set is customized by a third-party developer according to interactive requirements, and the static resource set is used to indicate one or more interactive business processes; The second static resource in the static resource collection is obtained, where the second static resource is a second called static resource predefined in the static resource collection.
21. The method according to claim 19, characterized in that The interactive message also includes an identifier of a static resource set; and obtaining the second static resource according to the interactive message includes: Acquire the static resource set according to the identifier of the static resource set in the interactive message, wherein the static resource set is customized by the third-party developer according to the interactive demand; The second static resource in the static resource collection is obtained, where the second static resource is a second called static resource predefined in the static resource collection.
22. The method according to any one of claims 19 to 21, characterized in that The method further comprises: receiving a feedback parameter setting by a second user on the fourth interface, and displaying a fifth interface, wherein the fifth interface includes a second button, and the second button is used to confirm the setting of the feedback parameter; In response to receiving an operation on the second button, sending a feedback message to the first user, the feedback message including the feedback parameter.
23. The method according to claim 22, characterized in that The fourth interface includes one or more edit boxes and / or one or more options; the receiving of the feedback parameter setting by the second user on the fourth interface includes: Receive an editing operation of the second user on at least one of the one or more editing boxes on the fourth interface, and / or a selection operation on at least one of the one or more options on the fourth interface.
24. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program code, and when the computer program code is executed by a processing circuit, the method according to any one of claims 1-11, 12-18 or 19-23 is implemented.
25. A chip system, characterized in that: The chip system includes a processing circuit and a storage medium, wherein the storage medium stores a computer program code; when the computer program code is executed by the processing circuit, the method as described in any one of claims 1-11, 12-18 or 19-23 is implemented.
26. A computer program product, characterized in that The computer program product is used to run on a computer to implement the method according to any one of claims 1-11, 12-18 or 19-23.
