Live streaming interactive method, system and related devices
The live streaming interactive method and system address the challenge of limited interaction and resource waste by capturing and matching viewer and live streamer operation characteristics, providing real-time feedback through special effects and enhancing viewer engagement.
Patent Information
- Application Number
- JP2023579350
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-11-08
- Filing Date
- 2022-10-17
- Publication Date
- 2025-06-10
- Estimated Expiration
- 2042-10-17
AI Technical Summary
Existing live streaming interactive systems face challenges in providing effective feedback to viewers, leading to limited interaction and wasted resources due to the lack of real-time matching and special effects during interactive operations.
A live streaming interactive method and system that includes a viewer's terminal and a server, where the viewer's terminal captures interactive images with operation characteristics and matches them with the live streamer's characteristics, presenting special effects on the interface based on the matching results.
This solution enhances viewer engagement by providing immediate feedback through special effects, improving the sense of participation and resource utilization by ensuring that interactive operations are acknowledged and responded to in real-time.
Smart Images

Figure 0007690617000001 
Figure 0007690617000002 
Figure 0007690617000003
Abstract
Description
Technical Field
[0001] This disclosure claims the priority of a Chinese patent application filed with the China National Intellectual Property Administration on November 8, 2021, with an application number of 202111316021.0 and an invention title of "Live Streaming Interactive Method, System and Related Devices", and the entire content thereof is incorporated herein by reference.
[0002] This disclosure relates to the field of computer technologies, and particularly to live streaming interactive methods, systems, devices, equipment, computer-readable storage media, and computer program products.
Background Art
[0003] With the continuous development of computer technologies, particularly mobile Internet technologies, live streaming applications (APPs) have emerged. The live streaming application can be installed on terminals such as mobile phones. Based on this, a live streamer can record videos based on the live streaming application on the terminal, and the live streamer's terminal can transmit the videos to a live streaming platform in the form of video streams. Then, the live streaming platform can push the video streams to the viewers' terminals, and the viewers can watch the videos recorded by the live streamer through the viewers' terminals.
[0004] During the live stream, viewers can interact with the live streamer in various ways. For example, viewers can trigger interactive operations such as "liking", "sending gifts", and "sending bullet screens" through the viewers' terminals, and these interactive operations are usually displayed in a relatively fixed public chat area.
[0005] When a viewer triggers the above-described interactive operation, it is necessary to occupy resources (such as computing resources and memory resources). However, after the viewer triggers the above-described interactive operation, it is difficult to obtain feedback from the live streamer. The degree of interaction that allows the viewer and the live streamer to interact is limited, and it is difficult for the viewer to feel a unique sense of participation in the interactive process with the live streamer. Then, the resources occupied by the trigger of the above interactive operation are wasted, and the resource utilization rate is reduced.
Summary of the Invention
Means for Solving the Problems
[0006] Embodiments of the present disclosure provide a live streaming interactive method, system, device, equipment, computer-readable storage medium, and computer program product, and aim to improve resource utilization.
[0007] According to a first aspect, embodiments of the present disclosure provide a live streaming interactive method applied to a terminal. The method includes: presenting a live streaming interface including an interactive control for supporting interaction; when a viewer triggers an interactive operation via the interactive control, obtaining an interactive image including the viewer's operation characteristics when the viewer executes the interactive operation; when the viewer's operation characteristics match the operation characteristics of the live streamer, presenting a special effect of successful matching on the live streaming interface.
[0008] According to a second aspect, embodiments of the present disclosure provide a live streaming interactive method applied to a server. The method includes: Obtaining the operation characteristics of the viewer and the operation characteristics of the live streamer, wherein the operation characteristics of the viewer are obtained based on the interactive image when the viewer performs an interactive operation; Matching the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result; Based on the matching result, sending a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer; and the method includes the above steps.
[0009] According to a third aspect, an embodiment of the present disclosure provides a live streaming interactive system including a viewer's terminal, a live streamer's terminal, and a server. The viewer's terminal presents a live streaming interface including an interactive control for supporting interaction. When the viewer triggers an interactive operation through the interactive control, it is configured to obtain an interactive image including the operation characteristics of the viewer when the viewer performs the interactive operation. The live streamer's terminal is configured to send the operation characteristics of the live streamer to the server. The server is configured to obtain the operation characteristics of the viewer, match the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, and based on the matching result, send a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer. The viewer's terminal is further configured to present a special effect corresponding to the matching result based on the special effect command.
[0010] According to a fourth aspect, an embodiment of the present disclosure provides a live streaming interactive device. A display module configured to present a live streaming interface including an interactive control for supporting interaction; When a viewer triggers an interactive operation via the interactive control, an acquisition module configured to acquire an interactive image including the viewer's motion characteristics when the viewer performs the interactive operation is included. The display module is further configured to present a special effect of successful matching to the live streaming interface when the motion characteristics of the viewer match the motion characteristics of the live streamer.
[0011] According to a fifth aspect, an embodiment of the present disclosure provides a live streaming interactive device. An acquisition module configured to acquire the motion characteristics of a viewer and the motion characteristics of a live streamer, wherein the motion characteristics of the viewer are obtained based on an interactive image when the viewer performs an interactive operation. A matching module configured to match the motion characteristics of the viewer with the motion characteristics of the live streamer, obtain a matching result, and send a special effect command for instructing the viewer's terminal to present a special effect corresponding to the matching result based on the matching result to the viewer's terminal.
[0012] According to a sixth aspect, an embodiment of the present disclosure provides a computer-readable medium storing a computer program, which when executed by a processing device, realizes the steps of the method according to any one of the first aspect or the second aspect of the present disclosure.
[0013] According to a seventh aspect, an embodiment of the present disclosure provides an electronic device. A storage device storing a computer program. A processing device configured to execute the computer program in the storage device and realize the steps of the method according to any one of the first aspect or the second aspect of the present disclosure.
[0014] According to the eighth aspect, an embodiment of the present disclosure provides a computer program product including instructions, which, when executed on a device, cause the device to execute the method described in any of the implementation manners of the first aspect or the second aspect.
[0015] As can be seen from the above technical solutions, the embodiments of the present disclosure have the following advantages.
[0016] In this method, the viewer triggers an interactive operation through the interactive control of the live streaming interface, and the viewer's terminal acquires an interactive image when the viewer executes the interactive operation. During the process of the viewer executing the interactive operation, the viewer can feel a unique sense of participation in interacting with the live streamer. Moreover, the viewer's interactive image has the viewer's motion characteristics. When the viewer's motion characteristics match the motion characteristics of the live streamer, the live streaming interface presents a special effect of successful matching, enabling the viewer to feel feedback from the live streamer and improving the viewer experience. Therefore, this method can reduce the waste of resources utilized by devices such as terminals and servers to acquire the viewer's interactive operations and improve resource utilization.
[0017] Other features and advantages of the embodiments of the present disclosure will be described in detail in the section on the mode for carrying out the invention below.
[0018] To more clearly illustrate the technical methods of the embodiments of the present disclosure, the drawings required in the embodiments are briefly introduced below.
Brief Description of the Drawings
[0019]
Figure 1
Figure 2
Figure 3
Figure 4A
Figure 4B
Figure 5A
Figure 5B
Figure 6A
Figure 6B
Figure 7A
Figure 7B
Figure 8
Figure 9
Figure 10
Embodiments for Carrying Out the Invention
[0020] In the embodiments of the present disclosure, the terms "first" and "second" are used only for the purpose of explanation, and cannot be understood as indicating relative importance, suggesting, or implicitly indicating the number of the indicated technical features. Therefore, the features defined by "first" and "second" explicitly or implicitly include one or more of the features.
[0021] First, some technical terms related to the embodiments of the present disclosure will be introduced.
[0022] The live streaming application is installed on a terminal such as a mobile phone, and the live streamer can perform live streaming based on the live streaming application on the terminal. For example, the live streamer can perform live streaming of a class in a classroom, a sports event, entertainment, etc. The viewer can also view the above content live-streamed by the live streamer based on the live streaming application on the terminal.
[0023] Normally, the viewer can interact with the live streamer in a way that triggers an interactive operation. For example, the viewer can send bullet comments, give likes, send gifts, etc. When the viewer triggers the above interactive operation, it is necessary to occupy computing resources, memory resources, etc. However, the above interactive operations are all one-sided operations of the viewer, and it is difficult to obtain feedback from the live streamer. The degree of interaction between the viewer and the live streamer is limited, and it is difficult for the viewer to feel a unique sense of participation in interacting with the live streamer. Furthermore, the resources occupied to trigger the above interactive operations are wasted, causing a reduction in resource utilization.
[0024] In view of this, the embodiments of the present disclosure provide a live streaming interactive method. In this method, the viewer triggers an interactive operation through the interactive control of the live streaming interface, and the viewer's terminal acquires an interactive image when the viewer executes the interactive operation. During the process of the viewer executing the interactive operation, the viewer can feel a unique sense of participation in interacting with the live streamer. Moreover, the viewer's interactive image has the viewer's motion characteristics. When the viewer's motion characteristics match the live streamer's motion characteristics, the live streaming interface presents a special effect of successful matching, enabling the viewer to feel feedback from the live streamer and improving the viewer experience.
[0025] Therefore, this method can reduce the waste of resources occupied by devices such as terminals and servers by obtaining the interactive operations of viewers, and improve the resource utilization rate.
[0026] This method is further applied to a live delivery application. When this method is applied to a live delivery application, specifically, it is realized in the form of a computer program. In some embodiments, the computer program may be independent. For example, it may be an independent application with corresponding functions. In some other embodiments, the computer program may be a functional module or a plug-in, etc., and is installed and executed in an existing live delivery application.
[0027] The live delivery interactive method provided by the embodiments of the present disclosure may be executed in cooperation between a terminal (for example, a terminal on which a live delivery application is installed) and a server (for example, a server of a live delivery application). To make the technical solution of the embodiments of the present disclosure clearer and easier to understand, the structure of the live delivery interactive system according to the embodiments of the present disclosure will be introduced below with reference to the drawings.
[0028] Referring to the system configuration diagram of the live interactive system 100 shown in FIG. 1, the live interactive system 100 includes a terminal 112 of the viewer 111, a terminal 122 of the live broadcaster 121, and a server 130. The terminal 112 of the viewer 111, the terminal 122 of the live broadcaster 121, and the server 130 are connected via a network. The terminal includes, but is not limited to, a smartphone, a tablet computer, a notebook computer, a personal digital assistant (PDA), or a smart wearable device, etc. The server 130 may be a cloud server. For example, it may be a central server in a central cloud computing cluster or an edge server in an edge cloud computing cluster. Of course, the server 130 may also be a server in a local data center. The local data center refers to a data center directly controlled by the user.
[0029] In the live interactive system 100, the live broadcaster 121 can perform live broadcasts via the live broadcast application installed on the terminal 122. For example, the live broadcaster 121 can perform live broadcasts of entertainment, sports events, etc. During the live broadcast, the live broadcaster 121 can start a lottery activity to increase the popularity of the live broadcast room. The viewer 111 can view the content (such as entertainment, sports events) live broadcast by the live broadcaster 121 via the live broadcast application installed on the terminal 112, and the viewer 111 can also participate in the lottery activity started by the live broadcaster 121.
[0030] Specifically, the live streamer 121 selects operation features via the terminal 122 and transmits the operation features selected by the live streamer to the server 130. The viewer 111 can trigger an interactive operation via the interactive control in the live stream interface presented by the terminal 112. The terminal 112 acquires an interactive image when the viewer executes the interactive operation. For example, the terminal 112 has a feature of capturing, with an imaging device, an interactive image including the operation features of the viewer when the viewer executes the interactive operation. In this way, in the process of the viewer executing the interactive operation, the viewer can feel a unique sense of involvement in interacting with the live streamer.
[0031] In some examples, the terminal 112 of the viewer 111 may transmit the interactive image to the server 130, and the server 130 may recognize the operation features of the viewer from the interactive image. In some other examples, the terminal 112 of the viewer 111 may recognize the interactive image, obtain the operation features of the viewer, and transmit the operation features of the viewer to the server 130.
[0032] After the server 130 acquires the operation features of the viewer and the operation features of the live streamer, the server 130 matches the operation features of the viewer with the operation features of the live streamer to obtain a matching result. Then, based on the matching result, the server 130 transmits a special effect command to the terminal 112 of the viewer 111. The special effect command is configured to instruct the terminal 112 of the viewer 111 to present a special effect corresponding to the matching result.
[0033] The terminal 112 of the viewer 111 presents a special effect corresponding to the matching result based on the special effect command. For example, when the matching result indicates that the operation features of the viewer match the operation features of the live streamer, the terminal 112 presents a special effect of successful matching. When the matching result indicates that the operation features of the viewer do not match the operation features of the live streamer, the terminal 112 presents a special effect of failed matching, giving the viewer a perceptually strong feedback.
[0034] To make the technical solutions of the embodiments of the present disclosure clearer and easier to understand, the live streaming interactive method according to the embodiments of the present disclosure will be introduced below from the perspectives of the viewer's terminal 112, the live streamer's terminal 122, and the server 130. FIG. 2 is a flowchart of the live streaming interactive method according to the embodiments of the present disclosure. The method includes S201 to S210.
[0035] S201: The live streamer's terminal 122 receives the operation characteristics selected by the live streamer.
[0036] During the live stream, the live streamer can interact with the viewers, thereby increasing the popularity of the live stream room and attracting more viewers. In some examples, during the live stream, the live streamer starts an interactive activity to improve the viewers' activity and trigger more interactive operations such as sending barrage messages and giving likes to the viewers. The interactive activity may be a lottery activity or an interactive mini-game. For example, during the live stream, the live streamer can interact with the viewers in the form of an interactive mini-game, and both the live streamer and the viewers can participate in the interactive mini-game to enhance the viewers' sense of participation.
[0037] In some embodiments, the live streamer can start a lottery activity during the live stream. The live streamer's terminal 122 can receive the operation characteristics pre-selected by the live streamer. Here, the operation characteristics include body movement characteristics and / or facial expression characteristics, and the body movement characteristics may be gesture characteristics, posture characteristics, etc. Then, by having the viewers guess the operation characteristics selected by the live streamer, the selected viewers can be determined.
[0038] S202: Based on the operation characteristics selected by the live streamer, the live streamer's terminal 122 sends an interactive request to the server 130.
[0039] After the terminal 122 of the live streamer obtains the operation characteristics selected by the live streamer, based on the operation characteristics of the live streamer, it can send an interactive request to the server 130. Here, the operation characteristics of the live streamer are carried in the interactive request, so that the server 130 can obtain the operation characteristics of the live streamer.
[0040] It should be noted that the embodiments of the present disclosure do not specifically limit the method for the server 130 to obtain the operation characteristics of the live streamer. The terminal 122 of the live streamer may directly send the operation characteristics of the live streamer to the server.
[0041] S203: Based on the interactive request, the server 130 instructs the terminal 112 of the viewer to present an interactive control that supports interaction.
[0042] After receiving the interactive request, the server 130 can instruct the terminal 112 of the viewer to present an interactive control that supports interaction, so that the viewer can participate in the interactive activity started by the live streamer through the interactive control that supports interaction.
[0043] S204: The terminal 112 of the viewer presents an interactive control on the live stream interface.
[0044] As shown in FIG. 3, this figure is a schematic diagram of a live stream interface according to an embodiment of the present disclosure. The terminal 112 of the viewer can present a live stream interface as shown in FIG. 3, and the live stream interface may include live streamer information 310, a public chat area 320, etc.
[0045] After the live streamer starts the interactive activity, the viewer's terminal 112 can add an activity entry to the live stream interface shown in FIG. 3. As shown in FIG. 4A, this figure is a schematic diagram of the activity entry according to an embodiment of the present disclosure. The viewer can participate in the interactive activity by clicking on the activity entry 410.
[0046] In some embodiments, after the viewer's terminal 112 detects a click operation by the viewer on the activity entry 410, the viewer's terminal 112 can present an interactive control that supports interaction with the viewer, and candidate actions. As shown in FIG. 4B, this figure is a schematic diagram of yet another live stream interface according to an embodiment of the present disclosure. The live stream interface includes an interactive control 420 that supports interaction and a plurality of candidate actions, for example, candidate action 431, candidate action 432, and candidate action 433. Candidate action 431 may be a "heart mark gesture", candidate action 432 may be an "OK gesture", and candidate action 433 may be a "666 gesture". The viewer can select and execute one from the above plurality of candidate actions. For example, the viewer can select and execute candidate action 432, that is, the viewer performs an "OK gesture".
[0047] The embodiments of the present disclosure do not specifically limit the position of the activity entry 410 in the live stream interface. The activity entry 410 may be located on the left side of the live stream interface, on the right side of the live stream interface. In some examples, the activity entry 410 may be located in the middle of the live stream interface, whereby the viewer can directly participate in the interactive activity.
[0048] S205: When the viewer triggers the interaction via the interactive control, the viewer's terminal 112 acquires an interactive image when the viewer executes the interactive action.
[0049] Taking the example that the viewer selects and executes the candidate action 432, the viewer can trigger an interactive action via the interactive control 420. The viewer clicks on the interactive control 420, and after the viewer's terminal 112 detects the click operation of the viewer on the interactive control 420, the imaging device can capture an interactive image including the viewer's motion characteristics when the viewer executes the interactive action. The motion characteristics include body motion characteristics and / or facial expression characteristics.
[0050] As shown in FIG. 5A, this figure is a schematic diagram of gesture characteristics according to an embodiment of the present disclosure. In some examples, in the process of the viewer executing an interactive action based on the candidate action 432, the viewer's terminal 112 can obtain an image when the viewer executes the interactive action. As shown in FIG. 5A, the viewer's terminal 112 obtains an interactive image when the viewer makes an "OK gesture".
[0051] After the viewer's terminal 112 obtains the interactive image when the viewer executes the interactive action, the terminal 112 recognizes the interactive image and obtains the viewer's motion characteristics in the image from each other. As shown in FIG. 5B, after the viewer's terminal 112 recognizes the viewer's motion characteristics from the interactive image, it can present a special effect that matches the viewer's motion characteristics. Continuing with the above example, the interactive action executed by the viewer is to make an "OK gesture". When the viewer's terminal 112 recognizes the "OK gesture" from the interactive image, it presents a special effect that matches the "OK gesture", for example, a plurality of "OK expressions" scatter from top to bottom, etc. The embodiments of the present disclosure do not specifically limit the form of the special effect. By presenting the special effect, the visual feedback to the viewer can be enhanced, and the viewer experience can be improved.
[0052] In some embodiments, the viewer can further modify the selected candidate action. The viewer re-executes the interactive action, whereby the viewer's terminal 112 re-acquires the interactive image when the viewer executes the interactive action, thereby enabling a modification to the previously selected candidate action. For example, the interactive action re-executed by the viewer is to perform a "heart mark gesture", and the viewer's terminal 112 recognizes the "heart mark gesture" from the new interactive image, and further realizes modifying the "OK gesture" to the "heart mark gesture". Similarly, when the viewer's terminal 112 recognizes a "heart mark gesture" from the new interactive image, it can present a special effect that matches the "heart mark gesture".
[0053] Note that the viewer's terminal 112 needs to obtain the viewer's permission in advance. After obtaining the permission to use the viewer's corresponding data, the viewer's terminal 112 can acquire the interactive image when the viewer executes the interactive action.
[0054] S206: The viewer's terminal 112 transmits the viewer's motion characteristics in the interactive image to the server 130.
[0055] The viewer's terminal 112 transmits the viewer's motion characteristics recognized from the interactive image to the server 130, whereby the server 130 can perform a comparison. Of course, in some other embodiments, after the viewer's terminal 112 acquires the interactive image when the viewer executes the interactive action, it directly transmits the interactive image to the server 130, and the server 130 can also recognize the interactive image to obtain the viewer's motion characteristics.
[0056] Note that the embodiments of the present disclosure do not specifically limit the method for the server 130 to obtain the viewer's motion characteristics, and those skilled in the art can select the method for the server 130 to obtain the viewer's motion characteristics according to actual needs.
[0057] S207: Server 130 matches the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result.
[0058] After obtaining the operation characteristics of the viewer and the operation characteristics of the live streamer, server 130 can match the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result.
[0059] In some examples, different operation characteristics can correspond to different identifiers. For example, the "heart mark gesture" corresponds to identifier 1, the "OK gesture" corresponds to identifier 2, and the "666 gesture" corresponds to identifier 3. Server 130 can obtain a matching result based on the identifier corresponding to the operation characteristics of the viewer and the identifier corresponding to the operation characteristics of the live streamer. When the identifier corresponding to the operation characteristics of the viewer matches the identifier corresponding to the operation characteristics of the live streamer, server 130 obtains a matching result that the operation characteristics of the viewer match the operation characteristics of the live streamer. When the identifier corresponding to the operation characteristics of the viewer does not match the identifier corresponding to the operation characteristics of the live streamer, server 130 obtains a matching result that the operation characteristics of the viewer do not match the operation characteristics of the live streamer.
[0060] S208: Server 130 sends a special effect command to the terminal 112 of the viewer based on the matching result.
[0061] The special effect command is configured to instruct the terminal 112 of the viewer to present a special effect corresponding to the matching result. In some examples, server 130 may include the matching result in the special effect command and send it to the terminal 112 of the viewer at the same time. In this way, the terminal 112 of the viewer can know the matching result. In some other examples, server 130 may send the matching result to the terminal 112 of the viewer alone.
[0062] In some embodiments, the live streamer can further set a timing for the interactive activity. For example, the timing can be 5 minutes, and when the timing ends, the server 130 may send a special effect command to the viewer's terminal 112. In this way, the viewer's terminal 112 can present the special effects of successful matching or failed matching only after the timing ends, giving the viewer a sense of anticipation and improving the viewer experience.
[0063] In some embodiments, the server 130 can further send the matching result to the live streamer's terminal 122. The live streamer's terminal 122 presents the matching result to the live streamer, and further, the live streamer can know the viewer who matches the live streamer's operation characteristics according to the matching result.
[0064] S209: When the operation characteristics of the viewer match the operation characteristics of the live streamer, the viewer's terminal 112 presents the special effect of successful matching.
[0065] As shown in FIG. 6A, this figure is a schematic diagram of the special effect of successful matching according to an embodiment of the present disclosure. Taking the example that the interactive operation performed by the viewer is the "heart mark gesture", the special effect of successful matching may present a heart special effect on the live stream interface, or present other special effects that can indicate successful matching. In this way, the visual feedback to the viewer is enhanced, the sense of participation of the viewer in the interactive activity is improved, and the viewer experience is improved.
[0066] In some embodiments, the interactive activity may be a lottery activity, and when the operation characteristics of the viewer match those of the live streamer, it can indicate that the viewer has won. As shown in FIG. 6B, which is a schematic diagram of winning prompt information according to an embodiment of the present disclosure. The viewer's terminal 112 presents winning prompt information 610 and a prize information input area 620 on the live streaming interface. Here, the winning prompt information 610 is configured to prompt the viewer that they have won, and the viewer can input prize information into the prize information input area 620 based on the winning prompt information 610.
[0067] In some examples, the prize may be a physical prize, and the prize information may be the shipping address, recipient information (recipient's name, recipient's contact information, etc.) entered by the viewer. Based on this, the viewer's terminal 112 transfers the prize information to the live streamer's terminal 122 by the server 130, so that the live streamer can mail the prize to the viewer based on the prize information.
[0068] In some other examples, the prize may be a virtual prize (such as an electronic discount coupon, electronic lucky money), and the prize information may be the account entered by the viewer. The viewer's terminal 112 transfers the prize information to the live streamer's terminal 122 by the server 130, so that the live streamer can charge the virtual prize to the account entered by the viewer based on the prize information. Furthermore, since the virtual prize can be obtained by the viewer through an interactive operation and participating in the interactive activity, it is easier for the viewer to use the electronic discount coupon in the virtual prize.
[0069] S210: When the operation characteristics of the viewer do not match those of the live streamer, the viewer's terminal 112 presents a special effect of matching failure.
[0070] As shown in FIG. 7A, this figure is a schematic diagram of the special effect of matching failure according to an embodiment of the present disclosure. Taking the interactive operation performed by the viewer as the "heart mark gesture" and the operation feature selected by the live streamer as the "OK gesture" as an example, the special effect of matching failure may be the special effect that the "heart mark expression" and the "OK expression" collide and become fragments, or it may be other special effects that can indicate matching failure.
[0071] Continuing with the above example, taking the interactive activity as a lottery activity as an example, when the operation feature of the viewer does not match the operation feature of the live streamer, it can indicate that the viewer has not won. As shown in FIG. 7B, this figure is a schematic diagram of the prompt information for not winning according to an embodiment of the present disclosure. The terminal 112 of the viewer can present the prompt information 710 for not winning on the live stream interface. In some examples, the prompt information for not winning may be "Sorry, you did not win".
[0072] Based on the above description, the embodiments of the present disclosure provide a live stream interactive method. The viewer triggers an interactive operation through the interactive control on the live stream interface presented by the viewer's terminal. When the viewer triggers an interactive operation through the interactive control, the viewer's terminal can obtain an interactive image when the viewer performs the interactive operation, and the viewer can feel a unique sense of participation in interacting with the live streamer. Moreover, the viewer's interactive image is further provided with the viewer's operation feature. When the viewer's operation feature matches the operation feature of the live streamer, the viewer's terminal presents a special effect of successful matching on the live stream interface, and the viewer can feel the feedback from the live streamer, improving the viewer experience.
[0073] FIG. 8 is a schematic diagram of a live streaming interactive device shown by an exemplary disclosure embodiment. The live streaming interactive device can implement the functions of the viewer terminal 112 described above. As shown in FIG. 8, the live streaming interactive device 800 includes a display module 801 configured to present a live streaming interface including an interactive control for supporting interactions, an acquisition module 802 configured to acquire an interactive image including the viewer's motion characteristics when the viewer performs the interactive operation when the viewer triggers the interactive operation via the interactive control, and the display module 801 is further configured to present a special effect of successful matching on the live streaming interface when the viewer's motion characteristics match the live streaming provider's motion characteristics.
[0074] Specifically, the acquisition module 802 is preferably configured to present candidate operations to the viewer and acquire an interactive image when the viewer performs the interactive operation based on the candidate operations.
[0075] Preferably, the motion characteristics include body motion characteristics and / or facial expression characteristics.
[0076] The acquisition module 802 is further configured to acquire the viewer's motion characteristics based on the interactive image. Preferably, the display module 801 is further configured to present a special effect that matches the viewer's motion characteristics based on the viewer's motion characteristics.
[0077] Preferably, the display module 801 is further configured to present a special effect of failed matching on the live streaming interface when the viewer's motion characteristics do not match the live streaming provider's motion characteristics.
[0078] The display module 801 is further configured to present the winning prompt information on the live streaming interface, Preferably, the acquisition module 802 is further configured to acquire the award information input by the viewer based on the winning prompt information.
[0079] The functions of each of the above-described modules have been described in detail in the steps of the method of the previous embodiment, and detailed descriptions are omitted here.
[0080] FIG. 9 is a schematic diagram of a live streaming interactive device shown by an exemplary disclosed embodiment. The live streaming interactive device can implement the functions of the above server 130. As shown in FIG. 9, the live streaming interactive device 900 includes an acquisition module 901 configured to acquire the operation characteristics of the viewer and the operation characteristics of the live streamer, where the operation characteristics of the viewer are obtained based on the interactive image when the viewer performs an interactive operation, and the acquisition module 901, a matching module 902 configured to match the operation characteristics of the viewer and the operation characteristics of the live streamer, obtain a matching result, and send a special effect command for instructing to present a special effect corresponding to the matching result to the viewer's terminal based on the matching result to the viewer's terminal.
[0081] Preferably, the operation characteristics include body movement characteristics and / or facial expression characteristics.
[0082] The functions of each of the above-described modules have been described in detail in the steps of the method of the previous embodiment, and detailed descriptions are omitted here.
[0083] Referring to FIG. 10, which is a schematic configuration diagram of an electronic device 1000 suitable for implementing embodiments of the present disclosure, the electronic device may be a viewer's terminal 112, and the viewer's terminal 112 is configured to implement functions corresponding to the live distribution interactive device 800 as shown in FIG. 8. The electronic device may also be a server 130, and the server 130 is configured to implement functions corresponding to the live distribution interactive device 900 as shown in FIG. 9. The electronic device shown in FIG. 10 is merely an example and does not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.
[0084] As shown in FIG. 10, the electronic device 1000 may include a processing device (e.g., a central processor, a graphics processor, etc.) 1001, and the processing device 1001 can execute various appropriate operations and processes based on a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 further stores various programs and data necessary for the operation of the electronic device 1000. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0085] Generally, the following devices can be connected to the I / O interface 1005. For example, an input device 1006 including a touch panel, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc., an output device 1007 including a liquid crystal display (LCD), a speaker, an oscillator, etc., a storage device 1008 including a magnetic tape, a hard disk, etc., and a communication device 1009. The communication device 1009 can permit the electronic device 1000 to communicate with other devices wirelessly or wiredly to exchange data. Although FIG. 10 shows an electronic device 1000 having various devices, it should be understood that it is not required to implement or include all the shown devices. Instead, more or fewer devices can be implemented or included.
[0086] In particular, based on the embodiments of the present disclosure, the above-described processes described with reference to the flowchart may be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program stored on a non-transitory computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1009, or may be installed from the storage device 1008, or may be installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above functions defined by the method of the embodiments of the present disclosure are executed.
[0087] Note that the computer-readable medium in the embodiments of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that includes or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the embodiments of the present disclosure, the computer-readable signal medium may be included in a baseband or may be a data signal propagated as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal may take multiple forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer-readable signal medium may further be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can transmit, propagate, or transmit a program used by or in combination with an instruction execution system, apparatus, or device. The program code included in the computer-readable medium can be transmitted over any suitable medium, including, but not limited to, wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0088] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol, such as HTTP (Hyper Text Transfer Protocol), and can be interconnected with digital data communication of any form or medium (e.g., communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-developed network.
[0089] The computer-readable medium may be included in the electronic device or may exist independently without being incorporated into the electronic device.
[0090] One or more programs are placed on the computer-readable medium. When the one or more programs are executed by the electronic device, the electronic device is caused to present a live distribution interface including an interactive control for supporting interactions. When a viewer triggers an interactive operation via the interactive control, an interactive image including the viewer's operation characteristics when the viewer executes the interactive operation is acquired. When the viewer's operation characteristics match the operation characteristics of the live distributor, a special effect of successful matching is presented on the live distribution interface, or The viewer's operation characteristics and the operation characteristics of the live distributor are acquired. The viewer's operation characteristics are obtained based on the interactive image when the viewer executes the interactive operation. The viewer's operation characteristics are matched with the operation characteristics of the live distributor to obtain a matching result. Based on the matching result, a special effect command for instructing the viewer's terminal to present a special effect corresponding to the matching result is transmitted to the viewer's terminal.
[0091] Computer program code for performing the operations of the present disclosure can be created in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, C++, etc., and further including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user computer, partially on the user computer, executed as an independent software package, partially on the user computer and partially on a remote computer, or executed entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).
[0092] Flowcharts and block diagrams in the drawings illustrate the possible system configurations, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. Here, each box in a flowchart or block diagram can represent a module, a program segment, or a part of code, and the module, program segment, or part of code includes one or more executable instructions for implementing a given logical function. Note that in some alternative implementations, the functions assigned to the boxes may occur in an order different from the order shown in the drawings. For example, two consecutively shown boxes may actually be executed substantially in parallel, and they may also be executed in reverse order, which is determined by such functions. Note that each box in the block diagram and / or flowchart, and combinations of boxes in the block diagram and / or flowchart, may be implemented by a system of dedicated hardware for performing a given function or operation, or may be implemented by a combination of dedicated hardware and computer instructions.
[0093] The modules described in the embodiments of the present disclosure may be implemented in the form of software or in the form of hardware. Here, the name of a module does not limit the module itself in some cases. For example, the first acquisition module may also be described as "a module for acquiring at least two Internet protocol addresses".
[0094] The functions described in this specification may be executed at least in part by one or more hardware logic components. For example, without limitation, typical examples of types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0095] In the context of embodiments of the present disclosure, a machine-readable medium may be a tangible medium that includes or stores a program, the program being used by, or used in combination with, an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium includes, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. More specific examples of the machine-readable storage medium may include electrical connections by one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0096] Based on one or more embodiments of the present disclosure, Example 1 provides a live streaming interactive method applied to a terminal, the method comprising: presenting a live streaming interface including an interactive control for supporting interaction; when a viewer triggers an interactive operation via the interactive control, obtaining an interactive image including the operation characteristics of the viewer when the viewer performs the interactive operation; when the operation characteristics of the viewer match the operation characteristics of the live streamer, presenting a special effect of successful matching on the live streaming interface.
[0097] Based on one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein the step of obtaining an interactive image when the viewer performs the interactive operation comprises: presenting candidate operations to the viewer; Obtaining an interactive image when the viewer executes the interactive operation based on the candidate operation.
[0098] Based on one or more embodiments of the present disclosure, Example 3 provides the method of Example 1 or 2, and the operation characteristics include body movement characteristics and / or facial expression characteristics.
[0099] Based on one or more embodiments of the present disclosure, Example 4 provides the method of Examples 1 to 3, and the method includes: Obtaining the operation characteristics of the viewer based on the interactive image; Further including presenting a special effect that matches the operation characteristics of the viewer based on the operation characteristics of the viewer.
[0100] Based on one or more embodiments of the present disclosure, Example 5 provides the method of Examples 1 to 4, and the method includes: When the operation characteristics of the viewer do not match the operation characteristics of the live streamer, further including presenting a special effect of matching failure on the live streaming interface.
[0101] Based on one or more embodiments of the present disclosure, Example 6 provides the method of Examples 1 to 4, and the method includes: Presenting winning prompt information on the live streaming interface; Further including obtaining the award information input by the viewer based on the winning prompt information.
[0102] Based on one or more embodiments of the present disclosure, Example 7 provides a live streaming interactive method applied to a server, and the method includes: Obtaining the operation characteristics of the viewer and the operation characteristics of the live streamer, where the operation characteristics of the viewer are obtained based on an interactive image when the viewer executes an interactive operation. Matching the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, and based on the matching result, sending a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer.
[0103] Based on one or more embodiments of the present disclosure, Embodiment 8 provides the method of Embodiment 7, and the operation characteristics include body movement characteristics and / or facial expression characteristics.
[0104] Based on one or more embodiments of the present disclosure, Embodiment 9 provides a live streaming interactive system including a viewer's terminal, a live streamer's terminal, and a server. The viewer's terminal presents a live streaming interface including an interactive control for supporting interaction. When the viewer triggers an interactive operation through the interactive control, it is configured to obtain an interactive image including the operation characteristics of the viewer when the viewer performs the interactive operation. The live streamer's terminal is configured to send the operation characteristics of the live streamer to the server. The server is configured to obtain the operation characteristics of the viewer, match the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, and based on the matching result, send a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer. The viewer's terminal is further configured to present a special effect corresponding to the matching result based on the special effect command.
[0105] Based on one or more embodiments of the present disclosure, Embodiment 10 provides a live streaming interactive device. A display module configured to present a live streaming interface including an interactive control for supporting interaction. When a viewer triggers an interactive operation via the interactive control, an acquisition module configured to acquire an interactive image including the viewer's motion characteristics when the viewer performs the interactive operation. The display module is further configured to present a special effect of successful matching on the live streaming interface when the motion characteristics of the viewer match the motion characteristics of the live streamer.
[0106] Based on one or more embodiments of the present disclosure, Example 11 provides the apparatus of Example 10, and specifically, the acquisition module is configured to present candidate operations to the viewer and acquire an interactive image when the viewer performs the interactive operation based on the candidate operations.
[0107] Based on one or more embodiments of the present disclosure, Example 12 provides the apparatus of Example 10 or 11, and the motion characteristics include body motion characteristics and / or facial expression characteristics.
[0108] Based on one or more embodiments of the present disclosure, Example 13 provides the apparatus of Examples 10 to 12, and the acquisition module is further configured to acquire the viewer's motion characteristics based on the interactive image, and the display module is further configured to present a special effect that matches the viewer's motion characteristics based on the viewer's motion characteristics.
[0109] Based on one or more embodiments of the present disclosure, Example 14 provides the apparatus of Examples 10 to 13, and the display module is further configured to present a special effect of failed matching on the live streaming interface when the motion characteristics of the viewer do not match the motion characteristics of the live streamer.
[0110] Based on one or more embodiments of the present disclosure, Example 15 provides the apparatus of Examples 10 to 13, wherein the display module is further configured to present winning prompt information on the live streaming interface, and the acquisition module is further configured to acquire the award information input by the viewer based on the winning prompt information.
[0111] Based on one or more embodiments of the present disclosure, Example 16 provides a live streaming interactive apparatus, an acquisition module configured to acquire the operation characteristics of the viewer and the operation characteristics of the live streamer, wherein the operation characteristics of the viewer are obtained based on the interactive images when the viewer performs interactive operations, a matching module configured to match the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, Based on the matching result, a special effect command for instructing to present a special effect corresponding to the matching result on the viewer's terminal is sent to the viewer's terminal.
[0112] Based on one or more embodiments of the present disclosure, Example 17 provides the apparatus of Example 16, wherein the operation characteristics include body movement characteristics and / or facial expression characteristics.
[0113] The above description is only an explanation of the preferred embodiments of the present disclosure and the technical principles used. As those skilled in the art will understand, the disclosure scope of the embodiments of the present disclosure is not limited to the technical solutions formed by specific combinations of the above technical features. At the same time, without departing from the above disclosure idea, other technical solutions formed by arbitrarily combining the above technical features or their equivalent features should be included. For example, the above features are technical solutions formed by replacing each other with technical features having similar functions (not limited thereto) disclosed in the embodiments of the present disclosure.
[0114] Also, although the operations have been described in a particular order, it should not be understood that these operations are required to be performed in the particular order or sequence shown. In some cases, multitasking and parallel processing may be advantageous. Similarly, although the above description contains several specific implementation details, these should not be construed as limiting the scope of the present disclosure. Some of the features described in the context of each embodiment may be implemented in combination in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.
[0115] Although the subject matter has been described in terms of structural features and / or methodological logic operations in a language specific to them, it should be understood that the subject matter defined by the appended claims is not necessarily limited to the specific features or operations described above. On the contrary, the specific features and operations described above are merely exemplary for implementing the claims. Regarding the apparatus in the above embodiments, the specific manner in which each module performs operations has already been described in detail in the embodiments related to the method, and the detailed description is omitted here.
Claims
1. A live streaming interactive method applied to a terminal, comprising: presenting a live streaming interface including an interactive control for supporting interaction; when a viewer triggers an interactive operation via the interactive control, acquiring an interactive image including the operation characteristics of the viewer when the viewer executes the interactive operation; when the operation characteristics of the viewer match the operation characteristics of the live streamer, presenting a special effect of successful matching on the live streaming interface. Among them, the step of acquiring an interactive image when the viewer executes the interactive operation includes: presenting candidate operations to the viewer; acquiring an interactive image when the viewer executes the interactive operation based on the candidate operations. A live streaming interactive method.
2. The method according to claim 1, wherein the operation characteristics include body movement characteristics and / or facial expression characteristics.
3. The method further includes: acquiring the operation characteristics of the viewer based on the interactive image; presenting a special effect that matches the operation characteristics of the viewer based on the operation characteristics of the viewer. The method according to claim 1 or 2.
4. The method further includes: when the operation characteristics of the viewer do not match the operation characteristics of the live streamer, presenting a special effect of failed matching on the live streaming interface. The method according to claim 1 or 2.
5. The method further includes: presenting winning prompt information on the live streaming interface; acquiring award information input by the viewer based on the winning prompt information. The method according to claim 1 or 2.
6. A live streaming interactive method applied to a server, comprising: acquiring the operation characteristics of the viewer and the operation characteristics of the live streamer, wherein the operation characteristics of the viewer are obtained based on an interactive image when the viewer executes an interactive operation. Matching the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, and based on the matching result, sending a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer. Among them, the interactive image when the viewer executes the interactive operation is Presenting candidate operations to the viewer; Obtained by the viewer obtaining an interactive image when executing the interactive operation based on the candidate operation. Live streaming interactive method.
7. The method according to claim 6, wherein the operation characteristics include body movement characteristics and / or expression characteristics.
8. A live streaming interactive system including a viewer's terminal, a live streamer's terminal, and a server, The viewer's terminal presents a live streaming interface including an interactive control for supporting interaction. When the viewer triggers an interactive operation through the interactive control, it is configured to obtain an interactive image including the operation characteristics of the viewer when the viewer executes the interactive operation. The live streamer's terminal is configured to send the operation characteristics of the live streamer to the server. The server is configured to obtain the operation characteristics of the viewer, match the operation characteristics of the viewer and the operation characteristics of the live streamer to obtain a matching result, and based on the matching result, send a special effect command for instructing to present a special effect corresponding to the matching result to the terminal of the viewer. The viewer's terminal is further configured to present a special effect corresponding to the matching result based on the special effect command. Among them, obtaining the interactive image when the viewer executes the interactive operation includes Presenting candidate operations to the viewer; The viewer obtaining an interactive image when executing the interactive operation based on the candidate operation. Live streaming interactive system.
9. A live streaming interactive device, A display module configured to present a live streaming interface including an interactive control for supporting interactions; An acquisition module configured to acquire an interactive image including the viewer's motion characteristics when the viewer performs the interactive operation when the viewer triggers an interactive operation via the interactive control; and The display module is further configured to present a special effect of successful matching on the live streaming interface when the viewer's motion characteristics match the live streamer's motion characteristics; Among them, the acquisition module Is used to present candidate actions to the viewer; And to acquire an interactive image when the viewer performs the interactive operation based on the candidate action; A live streaming interactive device.
10. A live streaming interactive device, comprising: An acquisition module configured to acquire the viewer's motion characteristics and the live streamer's motion characteristics, wherein the viewer's motion characteristics are obtained based on an interactive image when the viewer performs an interactive operation; A matching module configured to match the viewer's motion characteristics with the live streamer's motion characteristics to obtain a matching result; and Based on the matching result, a special effect command is sent to the viewer's terminal, and the special effect command is configured to instruct the viewer's terminal to present a special effect corresponding to the matching result; Among them, the interactive image when the viewer performs the interactive operation Is used to present candidate actions to the viewer; And to acquire an interactive image when the viewer performs the interactive operation based on the candidate action; A live streaming interactive device.
11. An electronic device, comprising: A storage device storing a computer program; A processing device configured to execute the computer program in the storage device to implement the steps of the method according to claim 1 or 2, or to implement the steps of the method according to claim 6 or 7.
12. A computer-readable storage medium storing a computer program, wherein when the program is executed by a processing device, the steps of the method according to claim 1 or 2 are realized, or when the program is executed by a processing device, the steps of the method according to claim 6 or 7 are realized, the computer-readable storage medium.
13. A computer program product, wherein when the computer program product is executed on a computer, the computer is caused to execute the method according to claim 1 or 2, or the method according to claim 6 or 7, the computer program product.
Citation Information
Patent Citations
Live video interaction method and device and computer equipment
CN113038174A
Live video stream sharing
US20160277802A1
System and interfaces for providing an interactive system
US20190253761A1