Information display and processing method, apparatus, device, medium
The information display and processing method addresses the issue of users missing key events in non-immersive playback modes by displaying event prompts for multimedia resources, thereby improving user experience.
Patent Information
- Application Number
- JP2023534933
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-12-08
- Filing Date
- 2021-12-07
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2041-12-07
AI Technical Summary
In non-immersive playback modes, users may miss exciting segments of multimedia resources due to their focus on other content, leading to a reduced user experience.
An information display and processing method that receives key event information for multimedia resources in non-immersive playback mode and displays event prompt information on the playback screen, ensuring users are alerted to key events.
This solution effectively prevents users from missing resource content related to key events, thereby enhancing the user experience by keeping them informed and engaged during multimedia playback.
Smart Images

Figure 0007698046000001 
Figure 0007698046000002 
Figure 0007698046000003
Abstract
Description
Technical Field
[0001] This disclosure claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 8, 2020, with the application number 202011441733.0 and the invention title "Information Display and Processing Method, Apparatus, Device, Medium", and all of its content is incorporated herein by reference.
[0002] This disclosure relates to the technical field of information processing, and in particular, to an information display and processing method, apparatus, device, and medium.
Background Art
[0003] With the rapid development of computer technology and mobile communication technology, various multimedia playback platforms by electronic devices are widely applied, enriching people's daily lives. Users can conveniently play multimedia resources through various multimedia playback platforms.
[0004] In the process of playing multimedia resources, when a user wants to view other content resources simultaneously, by playing the media resource in a non-immersive playback mode (for example, floating window playback mode), the user can pay attention to the multimedia resource while viewing other content resources. However, when the user becomes engrossed in viewing other content resources, it is easy to miss exciting segments in the multimedia resource in the non-immersive playback mode, reducing the user experience.
Summary of the Invention
Problems to be Solved by the Invention
[0005] To solve the above technical problems or at least a part of them, this disclosure provides an information display and processing method, apparatus, device, and medium.
Means for Solving the Problems
[0006] According to a first aspect, the present disclosure provides an information display method, when the playback mode of the target multimedia resource is a non-immersive playback mode, receiving key event information from a server, the key event information being for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource; displaying, on the playback screen of the target multimedia resource, event prompt information corresponding to the key event.
[0007] According to a second aspect, the present disclosure provides an information processing method, acquiring resource data of a target multimedia resource; when it is detected that the resource data satisfies a preset event trigger condition, determining that a key event corresponding to the event trigger condition has occurred; transmitting, to an electronic device associated with the target multimedia resource, key event information corresponding to the key event, the key event information being for instructing the electronic device to display, on the playback screen of the target multimedia resource, event prompt information corresponding to the key event when the playback mode of the target multimedia resource is a non-immersive playback mode.
[0008] According to a third aspect, the present disclosure provides an information display device, an event receiving unit arranged to receive key event information from a server when the playback mode of the target multimedia resource is a non-immersive playback mode, the key event information being for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource; an information display unit arranged to display, on the playback screen of the target multimedia resource, event prompt information corresponding to the key event.
[0009] According to a fourth aspect, the present disclosure provides an information processing apparatus, a data acquisition unit arranged to acquire resource data of a target multimedia resource, an event determination unit arranged to determine that a key event corresponding to an event trigger condition has occurred when it is detected that the resource data satisfies the event trigger condition preset, an event transmission unit arranged to transmit key event information corresponding to the key event to an electronic device associated with the target multimedia resource, where the key event information is for instructing the electronic device to display event prompt information corresponding to the key event on a playback screen of the target multimedia resource when the playback mode of the target multimedia resource is a non-immersive playback mode.
[0010] According to a fifth aspect, the present disclosure provides a computing device, a processor, a memory storing executable instructions, and includes the processor reads the executable instructions from the memory and executes the executable instructions to implement the information display method according to the first aspect or the information processing method according to the second aspect.
[0011] According to a sixth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor of a computing device, the processor is caused to implement the information display method according to the first aspect or the information processing method according to the second aspect.
Advantages of the Invention
[0012] Compared with the prior art, the technical solutions provided in the embodiments of the present disclosure have the following advantages: According to the information display and processing method, apparatus, device, and medium of the embodiments of the present disclosure, when the playback mode of the target multimedia resource is the non-immersive playback mode, key event information for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource is received, and in response to the key event information, event prompt information corresponding to the key event is displayed on the playback screen of the target multimedia resource, so as to prompt the user of the occurred key event, further avoid the user missing the resource content corresponding to the key event played on the target multimedia resource in the non-immersive playback mode, and improve the user experience.
Brief Description of the Drawings
[0013] Combined with the drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of each embodiment of the present disclosure will become clearer. In the drawings, like or similar reference numerals indicate like or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.
[0014]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Embodiments for Carrying Out the Invention
[0015] Hereinafter, with reference to the drawings, embodiments of the present disclosure will be described in more detail. The drawings show some embodiments of the present disclosure, but the present disclosure is not limited to the embodiments described herein and may be implemented in various forms. These embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood here that the drawings and embodiments of the present disclosure do not limit the protection scope of the present disclosure and are merely illustrative.
[0016] It should be understood that each step described in the method embodiments of the present disclosure may be executed in a different order and / or in parallel. Also, the method embodiments may include additional steps and / or may omit the execution of the steps shown. In this regard, the scope of the present disclosure is not limited.
[0017] As used herein, the term "comprising" and its variations are open-ended, i.e., "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment", the term "another embodiment" means "at least one another embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms are given from the following description.
[0018] Note that the concepts such as "first", "second", etc. mentioned in the present disclosure are only for distinguishing different devices, modules or units, and do not limit the order or interdependence of the functions executed by these devices, modules or units.
[0019] Note that the modifications of "one" and "a plurality" mentioned in the present disclosure are not limiting but general. As can be understood by those skilled in the art, in the specification, unless specifically indicated otherwise, it is understood as "one or a plurality".
[0020] The names of messages or information that interact between multiple devices in the embodiments of the present disclosure do not limit the scope of these messages or information, but are only for the purpose of explanation.
[0021] In the process of a user playing a multimedia resource, if the user wants to view other content resources simultaneously, since the multimedia resource can be played in a non-immersive playback mode, the user can focus on the multimedia resource and view other content resources at the same time.
[0022] The non-immersive playback mode can include at least a floating window playback mode and a screen split playback mode. Hereinafter, the non-immersive playback mode will be specifically described in detail by combining FIGS. 1 to 4.
[0023] FIG. 1 is a schematic diagram of one non-immersive playback interface in the related art. As shown in FIG. 1, the non-immersive playback interface may be a floating window display interface 101, and the floating window display interface 101 may display a stream screen of a live multimedia resource (a stream screen of a live video).
[0024] The floating window display interface 101 may be floatingly displayed on any interface of the electronic device. For example, the floating window display interface 101 may be floatingly displayed on the main screen interface of the electronic device. Also, for example, the floating window display interface 101 may be floatingly displayed on any application program interface of the electronic device.
[0025] The user can drag the floating window display interface 101, place the floating window display interface 101 at any position, and change the display position of the floating window display interface 101. The user can also click the close button 103 in the floating window display interface 101 to close the floating window display interface 101. The user can also control the volume of the live multimedia resource in the floating window display interface 101 through the volume control 104 in the floating window display interface 101.
[0026] FIG. 2 is a schematic diagram of another non-immersive playback interface in the related art. As shown in FIG. 2, the non-immersive playback interface may be a floating window display interface 201, and the floating window display interface 201 may display a stream screen of video multimedia resources (for example, a stream screen of network video).
[0027] The floating window display interface 201 can be floatingly displayed on any interface of the electronic device. For example, the floating window display interface 201 can be floatingly displayed on the main screen interface of the electronic device. Also, for example, the floating window display interface 201 can be floatingly displayed on any application program interface of the electronic device.
[0028] The user can drag the floating window display interface 201 and place it at any position to change the display position of the floating window display interface 201. The user can also click the close button 203 in the floating window display interface 201 to close the floating window display interface 201. The user can control the volume of the video multimedia resources in the floating window display interface 201 through the volume control 204 in the floating window display interface 201. The user can position the video multimedia resources in the floating window display interface 201 in the playing state or the paused state through the playback control 205 in the floating window display interface 201. The user can further change the playback progress of the video multimedia resources in the floating window display interface 201 through the progress bar 206 in the floating window display interface 201.
[0029] FIG. 3 is a schematic diagram of yet another non-intrusive playback interface in the related art. As shown in FIG. 3, the non-intrusive playback interface may be a floating window display interface 301, and the floating window display interface 301 can display a stream screen of an audio multimedia resource (for example, a stream screen of network audio).
[0030] Since the display method and control method of the floating window display interface 301 are similar to the example in FIG. 1, they will not be elaborated here.
[0031] FIG. 4 is a schematic diagram of still another non-intrusive playback interface in the related art. As shown in FIG. 4, the non-intrusive playback interface is a screen split display interface 401, and the screen split display interface 401 can display a stream screen of a multimedia resource. The media resource may include at least a live distribution multimedia resource, a video multimedia resource, and an audio multimedia resource.
[0032] The screen split display interface 401 can be displayed in a split screen with any interface of the electronic device. For example, the screen split display interface 401 can be displayed in a split screen with the main screen interface of the electronic device, and the screen split display interface 401 can be displayed at the upper or lower part of the display of the electronic device. Also, for example, the screen split display interface 401 can be displayed in a split screen with any application program interface of the electronic device, and the screen split display interface 401 can be displayed at the top or bottom of the display of the electronic device.
[0033] The user can control the volume of the media resource within the split-screen display interface 401 via the volume control 403 within the split-screen display interface 401. The user can drag the screen-to-body ratio adjustment control 404 of the split-screen display interface 401 to change the position of the boundary 405 of the split-screen display interface 401 and further adjust the screen-to-body ratio of the split-screen display interface 401.
[0034] As can be seen from the above various non-immersive playback interfaces, the non-immersive playback mode can support the user to play multimedia resources within the screen of the electronic device in an accompanying manner. Due to the nature of the accompaniment of the non-immersive playback mode, it is necessary to consider the compatibility with other interface contents. For full-screen display, since the display space of the non-immersive playback mode is limited, the display of the non-immersive playback mode is often a stream screen display, that is, the user interaction data of the multimedia resource (such as like data, comment data, gift data, barrage data, etc.) is removed, resulting in the lack of user interaction information.
[0035] Also, during the period when the user uses the non-immersive playback mode to play a multimedia resource, the playback of the multimedia resource is held, but the user's attention is not always held on the screen or sound of the multimedia resource, and there is still a delay in information perception. If an exciting segment is missed, one can only review it through playback. However, a certain multimedia resource, such as a live multimedia resource, has certain real-time characteristics. Taking an e-commerce live broadcast as an example, if the product being focused on is sold out, there will be no chance to snap it up, and the cost due to such information loss directly affects the user's content consumption experience. In particular, during the period when the user uses the non-immersive playback mode to play a live multimedia resource in mute, since the live video is played only with a pure screen, the user is more likely to miss more information.
[0036] Thus, in the non-intrusive playback mode in the related art, it is easy for users to miss exciting resource content snippets in multimedia resources in the non-intrusive playback mode, reducing the user experience.
[0037] In the related art, generally, by displaying user interaction information of multimedia resources on the stream screen, it is equivalent to directly reducing the area of the playback interface of multimedia resources. However, due to this, too much user interaction information covers the playback screen of multimedia resources, reducing the playback effect of media resources. At the same time, since the display size of the user interaction information also becomes smaller, users cannot clearly see the interaction content. Thus, this method does not conform to the lightweight content carrier characteristics of the non-intrusive playback mode and is disadvantageous for users to effectively receive and understand information.
[0038] To solve the above problems, the present disclosure provides an information display and processing method, and the information display and processing method is applied to the architecture of FIG. 5 and will be specifically described in detail in conjunction with FIG. 5.
[0039] FIG. 5 is an architecture diagram of information processing provided in an embodiment of the present disclosure.
[0040] As shown in FIG. 5, the architecture diagram may include at least one electronic device 501 of a client and at least one server 502 of a server terminal. The electronic device 501 may use a network protocol, such as the Hyper Text Transfer Protocol over Secure Socket It can establish a connection with the server 502 via a layer (e.g., HTTPS) and perform information exchange. The electronic device 501 may be a device having a communication function such as a mobile phone, a tablet, a desktop computer, a laptop computer, an in-vehicle terminal, a wearable device, a multifunctional printer, a smart home device, etc., or may be a device simulated by a virtual machine or a simulator. The server 502 may be a device having storage and computing functions such as a cloud server or a server cluster.
[0041] Based on the above architecture, the user plays multimedia resources on the electronic device 501 in a non-immersive playback mode. The multimedia resources may be at least one of video multimedia resources, audio multimedia resources, and live distribution multimedia resources.
[0042] Thus, when the user plays a target multimedia resource in the non-immersive playback mode, event prompt information may be displayed on the playback screen of the target multimedia resource to prompt the user of the key event that occurred in the resource content of the target multimedia resource. Here, taking the case where the multimedia resource is a live distribution multimedia resource as an example. The server 502 of the video live distribution platform to which the live distribution multimedia resource belongs acquires the resource data of the live distribution multimedia resource (e.g., live distribution data), and when it detects that the live distribution data meets the preset event trigger condition, it determines that a key event corresponding to the satisfied event trigger condition has occurred. Further, it transmits the key event information corresponding to the key event to the electronic device associated with the multimedia resource, for example, the electronic device that is playing the live distribution multimedia resource in the non-immersive playback mode.
[0043] The user can play the live multimedia resource through the video live distribution platform of the electronic device 501 and set the playback mode of the live multimedia resource to a non-intrusive playback mode (for example, floating window playback mode). When the playback mode of the live multimedia resource of the electronic device 501 is the non-intrusive playback mode, the electronic device receives the key event information sent from the server, and in response to the key event information, displays the event prompt information corresponding to the key event on the playback screen of the target multimedia resource, so as to prompt the user that the key event has occurred. Furthermore, the user can timely view the live distribution resource content snippet corresponding to the key event.
[0044] Therefore, according to the architecture of FIG. 5, it is possible to avoid the user missing the resource content corresponding to the key event during the playback of the target multimedia resource in the non-intrusive playback mode, and improve the user experience.
[0045] Based on the above architecture, hereinafter, FIGS. 6 to 14 will be combined to describe the information display and processing method provided in the embodiments of the present disclosure. In some embodiments, the information display method may be executed by an electronic device, and the electronic device may be the electronic device 501 in the client shown in FIG. 5. In some other embodiments, the information processing method may be executed by a server, and the server may be the server 502 in the server shown in FIG. 5. The electronic device may be a device having a communication function such as a mobile phone, a tablet, a desktop computer, a notebook computer, an in-vehicle terminal, a wearable device, a multifunctional device, a smart home device, etc., or a device simulated by a virtual machine or a simulator. The server may be a device having storage and computing functions such as a cloud server or a server cluster.
[0046] First, the process of an electronic device prompting key events of target multimedia resources will be described in detail by combining FIGS. 6 to 12 as follows.
[0047] FIG. 6 shows a schematic flowchart of an information display method provided in an embodiment of the present disclosure.
[0048] As shown in FIG. 6, the information display method may include the following steps. S610: When the playback mode of the target multimedia resource is a non-immersive playback mode, receive key event information from the server.
[0049] In some embodiments of the present disclosure, when the electronic device detects that the playback mode of the target multimedia resource is a non-immersive playback mode, it sends a key event acquisition request to the server, and the server responds to the key event acquisition request and sends the key event information of the target multimedia resource to the electronic device, so that the electronic device can receive the key event information of the target multimedia resource from the server.
[0050] The server may be a server that provides the target multimedia resource, for example, the server 502 shown in FIG. 5.
[0051] Optionally, the non-immersive playback mode may include at least one of at least a floating window playback mode and a screen split playback mode, and is not limited herein.
[0052] In an embodiment of the present disclosure, the key event information may be for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource.
[0053] Specifically, the occurrence of the key event may be determined by the server based on the resource data of the target multimedia resource, and this will be described in detail below.
[0054] In an embodiment of the present disclosure, the target multimedia resource may include at least one of a video multimedia resource, an audio multimedia resource, and a live broadcast multimedia resource.
[0055] The video multimedia resource may include network videos, such as videos of dramas, movies, variety shows, etc. on a video playback website. The audio multimedia resource may include network audio, such as music on an audio playback website, or broadcasts on an audio broadcast website, etc. The live broadcast multimedia resource may include live broadcast videos and live broadcast audio, etc.
[0056] In some embodiments, when the target multimedia resource includes a live broadcast multimedia resource, the live broadcast multimedia resource may include live broadcast videos and live broadcast audio, and the resource data may include live broadcast data.
[0057] Optionally, the key event may include at least one of a live broadcast content key event and a live broadcast interaction key event.
[0058] In one example, the live broadcast content key event may include at least one of a key event related to the live broadcast content, such as a live broadcast content change event and a live broadcast highlight event.
[0059] Optionally, the live streaming data may include live streaming content data, and the live streaming content data may include at least one of video frame data and audio frame data. Specifically, when the live streaming multimedia resource includes a live streaming video, the live streaming content data may include video frame data and / or audio frame data; when the live streaming multimedia resource includes a live streaming audio, the live streaming content data may include audio frame data.
[0060] Optionally, in the embodiments of the present disclosure, based on the resource content within a certain period of time of the live streaming multimedia resource, for example, the live streaming content, the live streaming multimedia resource within that time period is divided into corresponding live streaming vertical categories.
[0061] For example, if the live streaming content within 0 to 15 minutes of the live streaming multimedia resource is that the streamer sings, the live streaming multimedia resource within 0 to 15 minutes is divided into the singing vertical category. Also, for example, if the live streaming content within 16 to 20 minutes of the live streaming multimedia resource is that the streamer chats with the live streaming viewers, the live streaming multimedia resource within 16 to 20 minutes is divided into the chat vertical category. Also, for example, if the live streaming content within 21 to 30 minutes of the live streaming multimedia resource is that the streamer dances, the live streaming multimedia resource within 21 to 30 minutes is divided into the dance vertical category.
[0062] In this way, within different time periods, as the live streaming content of the streamer changes, the live streaming vertical category to which the live streaming multimedia resource belongs also changes. Therefore, by including the live streaming content change event in the key event, users watching the live streaming multimedia resource are prompted that the live streaming content of the streamer has changed.
[0063] Optionally, in the embodiments of the present disclosure, since different resource contents in different live streaming vertical categories, for example, highlights of live streaming content are different, different live streaming highlight events may be set for different live streaming contents in different live streaming vertical categories.
[0064] When the live streaming vertical category is the game vertical category, if the live streaming content is a first-person shooting game, the live streaming highlight events may be events such as "the last 5 players", "entered the final battle", and "killed 3 consecutive players". If the live streaming content is a multiplayer online battle arena, the live streaming highlight events are events such as "3 kills / 4 kills / 5 kills", "team fight time", and "crystal attack" events. If the live streaming content is an asymmetric battle game, the live streaming highlight events are events such as "release successful", "escape successful", and "1-on-1 time" events. If the live streaming content is a casual competitive game, the live streaming highlight events are events such as "10s countdown", "key game", and "game point" events.
[0065] When the live streaming vertical category is the e-commerce vertical category, the live streaming highlight events may be "product exchange" events, "red envelope distribution" events, and "lucky bag distribution" events.
[0066] When the live streaming vertical category is the outdoor vertical category, if the live streaming content is outdoor fishing, the live streaming highlight event may be the event of "caught a fish".
[0067] In another example, the live streaming interaction key event may include a key event related to the user's interaction situation. For example, the live streaming interaction key event may include at least one of the key interaction events between the user and the liver and the key interaction events related to the user's shopping.
[0068] Optionally, the live streaming data may include live streaming interaction data, and the live streaming interaction data may include user interaction data and streamer interaction data. Specifically, the user interaction data may include at least one of interaction information sent by the user and the user's interface operation actions. The streamer interaction data may include at least one of interaction information sent by the streamer and the streamer's interface operation actions.
[0069] Optionally, in the embodiments of the present disclosure, the interaction between the user and the streamer may include comments, likes, and tipping, etc.
[0070] In this case, the key interaction events between the user and the streamer may include events such as "more than 10,000 user comments", "more than 10,000 user likes", "large-amount user tipping" event, "large-amount user gift" event, "rapid increase in user comments" event, and "rapid increase in user likes" event, etc.
[0071] Optionally, in the embodiments of the present disclosure, the interaction related to the user's shopping includes the user's click on the product link, etc.
[0072] In this case, the key interaction events related to the user's shopping may include events such as "rapid increase in the number of hits of the product link", "the number of hits of the product link reaches the threshold", and "the growth rate of the number of hits of the product link reaches the threshold", etc.
[0073] In some other embodiments, when the target multimedia resource includes a video multimedia resource, the video multimedia resource may include a network video, and the resource data may include video data.
[0074] Optionally, the key event may include at least one of a video content key event and a video interaction key event.
[0075] In one example, the video content key event may include a key event related to video content. For example, the video content key event may include playing a classic segment of a drama, playing a highlight moment of the main character in a movie, playing an efficient time of a variety show, etc.
[0076] Optionally, the video data may include video content data, such as video frame data.
[0077] In another example, the video interaction key event may include a key event related to the user interaction situation. For example, the video interaction key event may include a sudden increase in user comments event, an event where the user comments reach a threshold, a sudden increase in user likes event, an event where the user likes reach a threshold, etc.
[0078] Optionally, the video data may include user interaction data. Specifically, the user interaction data may include at least one of interaction information sent from the user and the user's interface operation actions.
[0079] In some other embodiments, when the target multimedia resource includes an audio multimedia resource, the audio multimedia resource may include network audio, and the resource data may include audio data.
[0080] Optionally, the key event may include at least one of an audio content key event and an audio interaction key event.
[0081] In one example, the audio content key event may include a key event related to the audio content. For example, the audio content key event may include a refrain playback event, a chorus snippet playback event, etc.
[0082] Optionally, the audio data may include audio content data, such as audio frame data.
[0083] In another example, the audio interaction key event may include a key event related to the user interaction situation, such as a sudden increase in user comments event, an event where the user comments reach a threshold, a sudden increase in user likes event, an event where the user likes reach a threshold, etc.
[0084] Optionally, the audio data may include user interaction data. Specifically, the user interaction data may include at least one of the interaction information sent from the user and the user's interface operation actions.
[0085] S620: Display event prompt information corresponding to the key event on the playback screen of the target multimedia resource.
[0086] In the embodiments of the present disclosure, after receiving the key event information of the target multimedia resource sent from the server, the electronic device generates event prompt information corresponding to the key event in response to the key event information, and displays the event prompt information on the playback screen of the target multimedia resource, so that the user can know that the key event has occurred through the event prompt information.
[0087] Optionally, the electronic device displays the event prompt information corresponding to the key event on the playback screen of the target multimedia resource in an overlay manner.
[0088] For example, an electronic device can set up a floating layer on the playback screen of a target multimedia resource. The floating layer can at least partially cover the playback screen of the target multimedia resource, and event prompt information corresponding to a key event can be displayed within the floating layer.
[0089] Furthermore, the event prompt information can be displayed at any position on the playback screen of the target multimedia resource, such as the upper, middle, or lower part of the playback screen of the target multimedia resource, without limitation here.
[0090] In some embodiments of the present disclosure, the event prompt information may include character information.
[0091] Optionally, the key event information may include text having a specified text format. The electronic device can generate event prompt information corresponding to the key event based on the text, or select event prompt information corresponding to the key event from pre-stored prompt information based on the text.
[0092] For example, if the text of the key event information is "Change the live broadcast content to singing", event prompt information "Start singing" corresponding to the key event can be selected from pre-stored prompt information based on the text.
[0093] Optionally, the key event information may be text that can be directly displayed to implement the key event prompt function. In this way, the electronic device can directly use the text as event prompt information.
[0094] For example, if the key event information is the text "Start singing", "Start singing" can be directly used as event prompt information.
[0095] FIG. 7 is a schematic diagram of an information display interface provided in an embodiment of the present disclosure. As shown in FIG. 7, taking the non-immersive playback mode as the floating window playback mode as an example, the information display interface may be a floating window display interface 701, and a live video screen 702 is displayed in the floating window display interface 701. When the key event is a live content change event, since the live content changes from the streamer chatting with the live viewing users to the streamer singing, if the live content changes to the streamer singing, the event prompt information 703 may include the character "start singing", and the event prompt information 703 may be displayed at the lower part of the live video screen 702 so as to be superimposed.
[0096] FIG. 8 is a schematic diagram of another information display interface provided in an embodiment of the present disclosure. As shown in FIG. 8, taking the non-immersive playback mode as the floating window playback mode as an example, the information display interface may be a floating window display interface 701, and a live video screen 702 may be displayed in the floating window display interface 701. When the key event is a live highlight event, if the live vertical category is a game vertical category, the live content is a first-person shooting game, and the live highlight event is an event of "entering the final", the event prompt information 704 may include the character "final", and the event prompt information 704 may be displayed at the lower part of the live video screen 702 so as to be superimposed.
[0097] FIG. 9 shows a schematic diagram of yet another information display interface provided in an embodiment of the present disclosure. As shown in FIG. 9, taking the non-immersive playback mode as the floating window playback mode as an example, the information display interface may be the floating window display interface 701, and a live video screen 702 may be displayed in the floating window display interface 701. When the key event is a live highlight event, if the live vertical category is the e-commerce vertical category and the live highlight event is a "red envelope distribution" event, the event prompt information 705 may include the character "red envelope has arrived", and the event prompt information 705 may be displayed at the lower part of the live video screen 702 in an overlapping manner.
[0098] In this way, when the target multimedia resource includes a live multimedia resource, the live content key event may include both strong perception of highlights and strong reach of live content changes in the live room, so that the user can perceive the replacement of the content in the live room in a non-immersive viewing scene.
[0099] FIG. 10 shows a schematic diagram of still another information display interface provided in an embodiment of the present disclosure. As shown in FIG. 10, taking the non-immersive playback mode as the floating window playback mode as an example, the information display interface may be the floating window display interface 701, and a live video screen 702 may be displayed in the floating window display interface 701. When the key event is a live interaction key event, if it is detected that the generated live interaction key event is an event of "more than 10,000 user comments" according to the interaction information sent by the user, the event prompt information 706 may include the character "more than 10,000 comments", and the event prompt information 706 may be displayed at the lower part of the live video screen 702 in an overlapping manner.
[0100] FIG. 11 shows a schematic diagram of yet another information display interface provided in an embodiment of the present disclosure. As shown in FIG. 11, taking the case where the non-immersive playback mode is the floating window playback mode as an example, the information display interface may be the floating window display interface 701, and a live video screen 702 may be displayed in the floating window display interface 701. When the key event is a live interaction key event and the vertical category of the live broadcast is the shopping vertical category, if it is detected by the user's interface operation that the generated live interaction key event is an event of "a sharp increase in the number of hits of the product link", the event prompt information 707 may include the character "A super-popular product has arrived", and the event prompt information 707 may be displayed at the lower part of the live video screen 702 in an overlapping manner.
[0101] Thus, when the target multimedia resource includes a live multimedia resource, the live interaction key event may include the construction of the field atmosphere by the anchor and the live viewing users based on the interaction operation in the live broadcast room, and the real-time arrival of the profit-related information represented by the e-commerce transaction scene. In the one-way information arrival carrier deviating from the interaction operations such as comments, likes, and gifts, the user can be made to perceive the interaction atmosphere and interaction behavior in the live broadcast room.
[0102] In an embodiment of the present disclosure, when the playback mode of the target multimedia resource is the non-immersive playback mode, key event information is received for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource. In response to the key event information, event prompt information corresponding to the key event is displayed on the playback screen of the target multimedia resource, thereby prompting the user of the generated key event, further avoiding the user from missing the resource content corresponding to the key event played by the target multimedia resource in the non-immersive playback mode, and improving the user experience.
[0103] In some other embodiments of the present disclosure, the event prompt information may further include an icon.
[0104] Optionally, the electronic device may extract the keyword in the key event information and determine the icon corresponding to the key event based on the correspondence between the keyword and the pre-stored icon.
[0105] For example, if the key event information includes the keyword "sing", the icon "microphone" corresponding to the key event can be selected from the pre-stored icons based on the keyword.
[0106] Thereby, in the form of text and icons, clear and concise live broadcast room condensed information is transmitted without affecting the viewing experience.
[0107] In these embodiments, optionally, after S620, the information display method is as follows: receiving a trigger operation of the user on the playback interface or icon of the target multimedia resource; In response to the trigger operation, a step of playing a target multimedia resource in an immersive playback mode, where the immersive playback mode includes a full-screen playback mode, for example, a step of displaying the playback screen of the target multimedia resource in full screen, may be included. The trigger operation may be at least one of a click operation, a long-press operation, a double-click operation, etc., and is not limited here.
[0108] In this way, when the target multimedia resource includes a live distribution multimedia resource, the user can return to the live distribution room by clicking on the playback interface or the icon area of the target multimedia resource, and play the live distribution video in the form of a full-screen immersive experience in a timely manner. Furthermore, information delivery and recall are performed in a timely manner so that live distribution viewers do not miss exciting segments.
[0109] In some other embodiments of the present disclosure, before S620, the information display method may include a step of generating a moving image corresponding to the event prompt information based on a preset moving image generation method.
[0110] Correspondingly, S620 may specifically include a step of displaying the moving image by superimposing it on the playback screen. Regarding the moving image generation method, it may be set in advance as needed and is not limited here.
[0111] Optionally, the moving image corresponding to the event prompt information may include an "entry" moving image, a "dynamic effect display" moving image, and an "exit" moving image of the event prompt information. Correspondingly, the moving image generation method may include an "entry" moving image generation method, a "dynamic effect display" moving image generation method, and an "exit" moving image generation method. Different event prompt information may have the same moving image generation method or different moving image generation methods, and is not limited here.
[0112] In this way, considering that the display immersion of the non-immersive playback mode is weak during the information transmission and display process, the user's attention is attracted through dynamic information arrival.
[0113] In another embodiment of the present disclosure, in order to further improve the user experience, the display period of the event prompt information may be restricted.
[0114] FIG. 12 shows a schematic flowchart of the information display method provided in the embodiment of the present disclosure.
[0115] As shown in FIG. 12, the information display method may include the following steps. S1210: When the playback mode of the target multimedia resource is the non-immersive playback mode, receive key event information from the server. The key event information is for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource. S1220: Display event prompt information corresponding to the key event on the playback screen of the target multimedia resource. Note that since S1210 to S1220 are similar to S610 to S620 in the embodiment of FIG. 6, no further elaboration will be provided here. S1230: When the display period of the event prompt information reaches the target period, display the event prompt information in a hidden manner.
[0116] Specifically, after the electronic device displays the event prompt information, it measures the display period of the event prompt information, and when the display period of the event prompt information reaches the target period, the event prompt information is displayed in a hidden manner.
[0117] Regarding the target period, it may be set as needed. Optionally, the target period may be the period of a preset display cycle. For example, if the period of the display cycle is 5 s, the target period may be set to 5 s.
[0118] Optionally, hiding and displaying event prompt information may include any one of the following methods: stopping the display of event prompt information, tidying up the event prompt information and continuing to display it in the background, or shielding it on the playback screen.
[0119] In some embodiments of the present disclosure, when the event prompt information has "entry" video images, "dynamic effect display" video images, and "exit" video images, the total display period of the "entry" video images, "dynamic effect display" video images, and "exit" video images of the event prompt information is the target period.
[0120] In this way, when the event prompt information achieves the purpose of attention, the event prompt information can be hidden, the shielding of the playback screen of the target multimedia resource can be reduced, and the display of the event prompt information corresponding to the key event newly detected by the server is not affected.
[0121] In the present disclosure, in order to timely detect that a key event has occurred in the resource content of the target multimedia resource, a server that provides the target multimedia resource is used to determine that a key event has occurred based on the resource data of the target multimedia resource. Hereinafter, based on FIGS. 13 to 14, the server will explain in detail the process of determining that a key event has occurred in the resource content of the target multimedia resource.
[0122] FIG. 13 shows a schematic flowchart of an information processing method provided in an embodiment of the present disclosure.
[0123] As shown in FIG. 13, the information processing method may include the following steps. S1310: Obtain the resource data of the target multimedia resource.
[0124] In an embodiment of the present disclosure, a server that provides a target multimedia resource can obtain the resource data of the target multimedia resource in real time.
[0125] In an embodiment of the present disclosure, the target multimedia resource may include any one of a video multimedia resource, an audio multimedia resource, and a live broadcast multimedia resource.
[0126] The video multimedia resource may include network videos, such as videos of dramas, movies, variety shows, etc. on a video playback website. The audio multimedia resource may include network audio, such as music on an audio playback website, or broadcasts on an audio broadcast website. The live broadcast multimedia resource may include live broadcast videos and live broadcast audio.
[0127] In some embodiments, when the target multimedia resource includes a live broadcast multimedia resource, the live broadcast multimedia resource may include live broadcast videos and live broadcast audio, and the resource data may include live broadcast data.
[0128] In still some other embodiments, when the target multimedia resource includes a video multimedia resource, the video multimedia resource may include network videos, and the resource data may include video data.
[0129] In still some other embodiments, when the target multimedia resource includes an audio multimedia resource, the audio multimedia resource may include network audio, and the resource data may include audio data.
[0130] Note that the resource data has already been described in detail in the embodiment shown in FIG. 6, so no further elaboration will be provided here.
[0131] S1320: When it is detected that the resource data satisfies the preset event trigger condition, it is determined that the key event corresponding to the event trigger condition has occurred.
[0132] In an embodiment of the present disclosure, after the server obtains the resource data of the target multimedia resource, it detects the resource data of the target multimedia resource, determines whether the resource data of the target multimedia resource satisfies the preset event trigger condition, and when it is detected that the resource data of the target multimedia resource satisfies the preset event trigger condition, it is determined that the key event corresponding to the event trigger condition has occurred, and when it is detected that the resource data of the target multimedia resource does not satisfy the preset event trigger condition, it is determined that the key event corresponding to the event trigger condition has not occurred.
[0133] Specifically, when the resource data includes resource content data, it may be detected by content recognition technology whether the resource data satisfies the preset event trigger condition. When the resource data includes interface operation data, it may be detected by interface detection technology whether the resource data satisfies the preset event trigger condition. When the resource data includes interaction information data, it may be detected by data statistics technology whether the resource data satisfies the preset event trigger condition.
[0134] When the target multimedia resource includes a video multimedia resource, the resource content data may include video content data; when the target multimedia resource includes an audio multimedia resource, the resource content data may include audio content data; when the target multimedia resource includes a live streaming multimedia resource, the resource content data may include live streaming content data.
[0135] Taking the case where the target multimedia resource is a live streaming multimedia resource as an example, the resource data may include live streaming content data, interaction information data, and interface operation data. The live streaming content data may include video frame data and / or audio frame data. The interaction information data may include interaction information sent by the user and interaction information sent by the liver. The interface operation data may include the user's interface operation actions and the liver's interface operation actions.
[0136] When the live streaming content data includes video frame data, the server may detect whether the video frame data meets the preset event trigger conditions by performing video frame content recognition on the video frame data. The server may further detect whether the video frame data meets the preset event trigger conditions by performing interface detection on the interface operation data, and may further capture and judge the key events in the live streaming room in real time. By capturing and judging the key events in the live streaming room in real time and transmitting them to the live streaming viewing users in real time, the live streaming viewing users can timely perceive the content changes in the live streaming room and capture exciting information in a timely manner.
[0137] The server uses the interaction information data to perform data statistics and trend calculations on the number of interactions, so as to detect whether the video frame data meets the preset event trigger conditions, and further objectively measure the interaction (such as like, comment, tip, shopping) situation in the live broadcast room, and transmit it to the live broadcast viewing users in real time. In this way, non-immersive live broadcast viewing users who deviate from the interaction scene can still perceive the interaction atmosphere in the live broadcast room through highly condensed interaction information.
[0138] In some embodiments of the present disclosure, when the target multimedia resource includes a live broadcast multimedia resource, the key event may include at least one of a live broadcast content key event and a live broadcast interaction key event.
[0139] In some other embodiments of the present disclosure, when the target multimedia resource includes a video multimedia resource, the key event may include at least one of a video content key event and a video interaction key event.
[0140] In still some other embodiments of the present disclosure, when the target multimedia resource includes an audio multimedia resource, the key event may include at least one of an audio content key event and an audio interaction key event.
[0141] Note that the key event has been described in detail in the embodiment shown in FIG. 6, so no redundant description will be given here.
[0142] S1330: Transmit key event information corresponding to the key event to the electronic device associated with the target multimedia resource.
[0143] In some embodiments, the electronic device associated with the target multimedia resource may be the electronic device that acquires the target multimedia resource, i.e., the electronic device that needs to play the target multimedia resource.
[0144] In some other embodiments, the electronic device associated with the target multimedia resource may be the electronic device that acquires the target multimedia resource and plays the target multimedia resource in a non-intrusive playback mode.
[0145] In the embodiments of the present disclosure, before S1330, the information processing method may further include the step of generating key event information corresponding to the key event.
[0146] Specifically, the server may generate key event information corresponding to the key event according to the event content of the generated key event based on a preset key event information generation rule.
[0147] Furthermore, when the playback mode of the target multimedia resource is the non-intrusive playback mode, the key event information instructs the electronic device to display event prompt information corresponding to the key event on the playback screen of the target multimedia resource. Since this has already been described in the embodiment shown in FIG. 6, no further elaboration will be provided here.
[0148] Specifically, the server receives a key event acquisition request sent from an electronic device that detects that the playback mode of the target multimedia resource is the non-intrusive playback mode, and in response to the key event acquisition request, associates the electronic device with the electronic device associated with the target multimedia resource, and sends the key event information corresponding to the target multimedia resource to the electronic device associated with the target multimedia resource. Furthermore, the specified electronic device can display the event prompt information corresponding to the key event on the playback screen of the target multimedia resource.
[0149] In an embodiment of the present disclosure, when the playback mode of the target multimedia resource is the non-immersive playback mode, after receiving key event information for instructing the electronic device to determine that a key event has occurred based on the resource data of the target multimedia resource, the electronic device displays event prompt information corresponding to the key event on the playback screen of the target multimedia resource, thereby prompting the user of the occurred key event, further avoiding the user missing the resource content corresponding to the key event for which the target multimedia resource in the non-immersive playback mode plays, and improving the user experience.
[0150] In another embodiment of the present disclosure, for different resource data, it is detected that different resource data meet the preset event trigger conditions, and this will be described in detail below.
[0151] In some embodiments, when the target multimedia resource includes a live broadcast multimedia resource and the live broadcast data includes video frame data, the step of detecting that the resource data meets the preset event trigger conditions includes: acquiring video frame content information corresponding to the current time slice by performing video frame content recognition on the video frame data in the current time slice; and when the video frame content information meets the preset content trigger conditions, determining that the video frame data is detected to meet the event trigger conditions. The key event includes a live broadcast content key event.
[0152] Specifically, the video frame data may include at least one video frame. The server uses artificial intelligence technology (such as image recognition technology) to perform video frame content recognition on at least one video frame in the current time slice, obtains video frame content information corresponding to the current time slice, and determines whether the video frame content information meets the preset content trigger conditions. If it is satisfied, it is determined that the video frame data (i.e., resource data) is detected to meet the event trigger conditions; otherwise, it is determined that the video frame data is not detected to meet the event trigger conditions.
[0153] Optionally, the period of the time slice may be set as needed and is not limited here.
[0154] In one example, the video frame content information may include a live broadcast vertical category label, and the content trigger condition may include that the live broadcast vertical category label in the current time slice is different from the live broadcast vertical category label in the previous time slice.
[0155] Specifically, video frame content recognition is performed on at least one video frame in the current time slice by image recognition technology, the live broadcast vertical category label of the live broadcast vertical category to which the target multimedia resource belongs in the current time slice is determined, and it is determined whether the live broadcast vertical category label in the current time slice is the same as the live broadcast vertical category label in the previous time slice. If they are the same, it is determined that the preset content trigger conditions are not met; otherwise, it is determined that the preset content trigger conditions are met.
[0156] In this case, the live broadcast content key event may be a live broadcast content change event.
[0157] For example, the time slice period may be 2 minutes. Every 2 minutes, the server assigns one live broadcast vertical category label (such as singing vertical category, chat vertical category, dance vertical category, outdoor vertical category, game vertical category, sports vertical category, shopping vertical category, etc.) to the live broadcast content in the live broadcast room. If the live broadcast vertical category label assigned within the current 2 minutes in the live broadcast room changes compared to the live broadcast vertical category label assigned within the previous 2 minutes, it is determined that the video frame content information meets the preset content trigger conditions. Furthermore, if it is determined that the resource data meets the event trigger conditions, the key event corresponding to the event trigger conditions is a live broadcast content change event.
[0158] In another example, the video frame content information may include character information, and the content trigger conditions may include that the preset keyword is included in the character information.
[0159] Specifically, video frame content recognition is performed on at least one video frame in the current time slice by image recognition technology. All the character information included in the video frames in the current time slice of the target multimedia resource is determined, and it is judged whether the preset keyword is included in the character information in the current time slice. If it is included, it is determined that the preset content trigger conditions are met; otherwise, it is determined that the preset content trigger conditions are not met.
[0160] The preset keyword can be set as needed and is not limited here.
[0161] In this case, the live broadcast content key event may be a live broadcast highlight event.
[0162] For example, the time slice period may be 30 seconds, the resource content, such as live broadcast content, may be a first-person shooting game, taking the preset keyword being "final battle" as an example, the server detects every 30 seconds whether the keyword "final battle" is included in the video frame content information, and if it is included, determines that the video frame content information meets the preset content trigger condition, and further determines that it is detected that the video frame data meets the event trigger condition, and the key event corresponding to the event trigger condition may be a live broadcast highlight event. Thereby, the highlight moment of the live streamer can be prompted to the live broadcast viewing users.
[0163] In another example, the video frame content information may include image information, and the content trigger condition may include that the preset image content is included in the image information.
[0164] Specifically, using image recognition technology, perform video frame content recognition on at least one video frame in the current time slice, determine all the image information included in the video frame in the current time slice of the target multimedia resource, and determine whether the preset image content is included in the image information in the current time slice. If it is included, determine that the preset content trigger condition is met; otherwise, determine that the preset content trigger condition is not met.
[0165] The preset image content may be installed as needed and is not limited here.
[0166] In this case, the live broadcast content key event may be a live broadcast highlight event.
[0167] For example, the time slice period may be 30 seconds, the live broadcast content may be outdoor fishing, taking the preset image content being "fish caught" as an example, the server checks every 30 seconds whether the live broadcast video content includes a live broadcast video screen with the "fish caught" image content. If it is included, it is determined that the video frame content information meets the preset content trigger condition, and further it is determined that the video frame data is detected to meet the event trigger condition. The key event corresponding to the event trigger condition may be a live broadcast highlight event. In this way, the highlight moment of the fisherman can be prompted to the live broadcast viewing users.
[0168] Note that when the target multimedia resource includes a video multimedia resource and the video data includes video frame data, the method for detecting that the resource data meets the preset event trigger condition is similar to the above method, so it will not be elaborated here.
[0169] In some other embodiments, when the target multimedia resource includes an audio multimedia resource and the audio data includes audio frame data, the steps for detecting that the resource data meets the preset event trigger condition are: Performing audio frame content recognition on the audio frame data in the current time slice to obtain the audio frame content information corresponding to the current time slice; When the audio frame content information meets the preset content trigger condition, determining that the audio frame data is detected to meet the event trigger condition, and may include. The key event includes an audio content key event.
[0170] Specifically, the audio frame data may include at least one audio frame. The server uses artificial intelligence technology (e.g., speech recognition technology) to perform audio frame content recognition on at least one audio frame in the current time slice, obtain audio frame content information corresponding to the current time slice, and determine whether the audio frame content information meets the preset content trigger conditions. If it is satisfied, it is determined that the audio frame data is detected to meet the event trigger conditions; otherwise, it is determined that the audio frame data is not detected to meet the event trigger conditions.
[0171] For example, the audio frame content information may include background music, and the preset content trigger condition may be that the preset music segment is included in the background music. Also, for example, the audio frame content information may include character information, and the preset content trigger condition may be that the preset keyword is included in the character information.
[0172] The preset music segment and the preset keyword may be set as needed and are not limited here.
[0173] In some other embodiments, when the target multimedia resource includes a live streaming multimedia resource and the live streaming data includes interface operation data, the step of detecting that the resource data meets the preset event trigger conditions is When the interface operation data includes the preset interface call information, it includes the step of determining that the interface operation data is detected to meet the event trigger conditions. The key event includes the live streaming content key event.
[0174] Note that the preset interface call information may be installed as necessary and is not limited here.
[0175] Specifically, the server obtains interface operation data for the current time slice, and the interface operation data may include at least one interface call information. The server matches the interface call information in the interface operation data with the preset interface call information. If the interface operation data for the current time slice includes the preset interface call information, it is determined that the interface operation data meets the event trigger condition; otherwise, it is determined that the interface operation data does not meet the event trigger condition.
[0176] For example, the period of the time slice may be 30 seconds, the live broadcast content may be e-commerce transactions, and when the preset interface call information is "product addition" interface call information, the server detects every 30 seconds whether the "product addition" interface call information is included in the interface call information of the live broadcast room. If it is included, it is determined that the interface operation data meets the preset content trigger condition, and further it is determined that the interface operation data meets the event trigger condition. The key event corresponding to the event trigger condition may be a live broadcast highlight event.
[0177] Also, for example, the time slice period may be 30 seconds. When the preset interface call information is the "red envelope sending" interface call information, the server checks every 30 seconds whether the "red envelope sending" interface call information is included in the interface call information of the live broadcast room. If it is included, it is determined that the interface operation data meets the preset content trigger conditions, and further it is determined that the interface operation data is detected to meet the event trigger conditions. The key event corresponding to the event trigger conditions may be a live broadcast highlight event.
[0178] In some other embodiments, when the target multimedia resource includes a live broadcast multimedia resource and the live broadcast data includes interaction information data, for example, the number of interactions of a target interaction type, the step of detecting that the resource data meets the preset event trigger conditions is including the step of determining that it is detected that the number of interactions in the current time slice is greater than the interaction number threshold corresponding to the target interaction type, and it is detected that the number of interactions meets the preset event trigger conditions. The key event includes a live broadcast interaction key event.
[0179] Note that the target interaction type may be any interaction type and is not limited here. Optionally, the interaction type may include general interaction behavior types that perform reverse direction information feedback to the live broadcast, such as comments, likes, tipping, gifts, etc., and may also include other interaction behavior types of users in the live broadcast room in a specific vertical category, such as coupon receiving, consultation, purchase, click on a product link, etc. in an e-commerce transaction scenario.
[0180] Specifically, the server counts the number of interactions in the current time slice, compares the statistical result with the interaction number threshold corresponding to the target interaction type corresponding to the number of interactions based on the statistical result, and the comparison result is that if the number of interactions in the current time slice is greater than the interaction number threshold corresponding to the target interaction type, it is determined that the number of interactions is detected to meet the preset event trigger condition, otherwise, it is determined that the number of interactions is not detected to meet the preset event trigger condition.
[0181] Optionally, the interaction number threshold may include a first number threshold, and the first number threshold is the product of the target average interaction number and the preset ratio, and the target average interaction number may be the average interaction number of the target interaction type in all time slices before the current time slice.
[0182] The preset ratio is one or more numerical values set as required and is not limited here. For example, the preset ratio may be 130%, 150% or 170%.
[0183] Specifically, the server counts the number of interactions in the current time slice, and determines whether the number of interactions is greater than the product of the average interaction number of the target interaction type in all time slices before the current time slice and the preset ratio. If it is greater, it is determined that the number of interactions is detected to meet the preset event trigger condition, otherwise, it is determined that the number of interactions is not detected to meet the preset event trigger condition.
[0184] Furthermore, to improve the recognition accuracy, the current time slice may be a time slice after the preset time slice.
[0185] For example, the time slice period may be 5 seconds. After the live broadcast room is formally established, the server records, once every 5 seconds, the number of interactions in the live broadcast room in the current time slice, such as the number of likes, comments, tip amounts, gift amounts, and the number of hits of each product link. Before 30 seconds before the start of the live broadcast, that is, before the 7th time slice, no comparison is made. Therefore, the preset time slice may be the 7th time slice. Subsequently, taking the preset ratio of 130% as an example, 30 seconds after the start of the live broadcast room, the server compares the number of interactions within every 5 seconds with the product of the average number of interactions in all previous time slices and 130%. If the number of interactions is greater than the product of the average number of interactions and 130%, it is determined that the number of interactions is detected to meet the preset event trigger condition; otherwise, it is determined that the number of interactions is not detected to meet the preset event trigger condition.
[0186] Optionally, the interaction number threshold may include a second number threshold, and the second number threshold may be a threshold determined based on the distribution of the number of interactions within a preset time period of the target group to which the live broadcast multimedia resource belongs.
[0187] Specifically, the server counts the number of interactions in the current time slice and determines whether the number of interactions is greater than a threshold determined based on the distribution of the number of interactions within a preset time period of the target group to which the target multimedia resource, such as the live broadcast multimedia resource, belongs. If it is greater, it is determined that the number of interactions is detected to meet the preset event trigger condition; otherwise, it is determined that the number of interactions is not detected to meet the preset event trigger condition.
[0188] The target group to which the live streaming multimedia resource belongs may be the fan level group to which the liver of the live streaming multimedia resource belongs, may be the live streaming vertical category group to which the live streaming multimedia resource belongs, or may further be a group classified based on other methods, without limitation here.
[0189] For the preset time period, it may be installed as needed, without limitation here. For example, the preset time period may be one day, one week, or one month.
[0190] In one example, the method for determining the second numerical threshold is to count the average number of interactions of each live streaming multimedia resource in each time slice within the target group within the preset time period, count the distribution of the number of interactions of the average number of interactions, and then determine the second numerical threshold based on the preset selection rule (such as Pareto's law).
[0191] Taking the example that the target group to which the live streaming multimedia resource belongs is the fan level group to which the liver of the live streaming multimedia resource belongs, the preset time period is one week, and the preset selection rule is Pareto's law, the server first calculates the distribution of the number of interactions within one week of the fan level group to which the liver belongs, and then, based on Pareto's law, sets the top 20% of the number of interactions as the second numerical threshold.
[0192] For example, the time slice period may be 5 seconds. After the live broadcast room is formally established, the server records the number of interactions in the live broadcast room in the current time slice once every 5 seconds, and compares the number of interactions every 5 seconds with the second numerical threshold of the fan level group to which the liver of the live broadcast room belongs. If the number of interactions is greater than the second numerical threshold, it is determined that the number of interactions meets the preset event trigger condition; otherwise, it is determined that the number of interactions does not meet the preset event trigger condition.
[0193] In this case, when the interaction type includes the comment and like types, the key event may specifically be that the number of user comments exceeds the interaction number threshold, for example, "more than 10,000 user comments", and the number of user likes exceeds the interaction number threshold, for example, "more than 10,000 user likes".
[0194] It should be noted that when the target multimedia resource includes a video multimedia resource, the video data includes interaction information data, and the target multimedia resource includes an audio multimedia resource, and the audio data includes interaction information data, the method for detecting that the resource data meets the preset event trigger condition is similar to the above method, so it will not be elaborated here.
[0195] In still another embodiment of the present disclosure, in order to further improve the user experience, when a plurality of key events are detected, the key event information transmitted to the electronic device may be selected to prompt the event content that the user is interested in.
[0196] Optionally, when the number of key events is plural, before S1320, the information processing method includes: determining the event priority corresponding to each key event; It may further include a step of determining a target key event from a plurality of key events based on the event priority.
[0197] Correspondingly, specifically, S1320 It may include a step of transmitting key event information corresponding to the target key event to an electronic device associated with the target multimedia resource.
[0198] Hereinafter, with reference to FIG. 14, another information processing method provided in the embodiments of the present disclosure will be described in detail.
[0199] FIG. 14 shows a schematic flowchart of another information processing method provided in the embodiments of the present disclosure.
[0200] As shown in FIG. 14, the information processing method may include the following steps. S1410: Obtain resource data of the target multimedia resource. S1420: When it is detected that the resource data satisfies a preset event trigger condition, determine that a key event corresponding to the event trigger condition has occurred. Note that since S1410 to S1420 are similar to S1310 to S1320 in the embodiment of FIG. 13, no redundant description will be given here. S1430: Determine the event priority corresponding to each key event.
[0201] In the embodiments of the present disclosure, when the server detects that a plurality of key events occur simultaneously, it may determine the event priority corresponding to each key event based on a preset event priority judgment rule.
[0202] In some embodiments, the server may pre-set weights for event type priorities for various event types, and may also pre-set priority levels for various key events within various event types. The server may multiply the weight of the event type priority corresponding to the event type to which each key event belongs by the priority level within the event type to which each key event belongs to obtain the event priority of each key event. In this case, the event priority may be the priority of the key event in all events.
[0203] Optionally, when the target multimedia resource includes a live delivery multimedia resource, the key event may include at least one of a live delivery content key event and a live delivery interaction key event. Correspondingly, the event type may include a live delivery content type and a live delivery interaction type.
[0204] In some other embodiments, the server may pre-set event type priorities for various event types, and may also pre-set priority levels for various key events within various event types. The server may directly use the event type priority in the event type to which each key event belongs and the priority level within the event type to which each key event belongs as the event priority of each key event. In this case, the event priority may be the priority within the event type to which the key event belongs.
[0205] Optionally, when the target multimedia resource includes a live delivery multimedia resource, the key event may include at least one of a live delivery content key event and a live delivery interaction key event. Correspondingly, the event type may include a live delivery content type and a live delivery interaction type.
[0206] An example will be used below to explain the pre-established event type priorities and priority levels within the event types when the target multimedia resources include live streaming multimedia resources.
[0207] The pre-set event type priorities are such that the live streaming content type has the first priority, and the live streaming interaction type has the second priority.
[0208] Priority levels within pre-defined event types may be arranged based on factors such as importance, rarity, and viewability of content according to different live streaming vertical categories.
[0209] Take the live streaming vertical category as an example, the priority levels within the event type may include: First-person shooter games: A "last 5" event is the first priority level, a "made it to the finals" event is the second priority level, and a "killed 3 in a row" event is the third priority level. Multiplayer Online Battle Arena: "3 Kills / 4 Kills / 5 Kills" events are the first priority level, "Team Fight Point" events are the second priority level, and "Crystal Attack" events are the third priority level. Asymmetrical competitive games: The "successful release" event is the first priority level, the "successful escape" event is the second priority level, and the "one-on-one moment" event is the third priority level. Light competitive gaming: the "10s countdown" event is the first priority level, the "key game" event is the second priority level, and the "game point" event is the third priority level.
[0210] Taking the live streaming vertical category as an example of the shopping vertical category, the priority levels within the event type are as follows: the event of "a sharp increase in the number of hits on the shopping cart" is the first priority level, the event of "a large amount of user gifts" is the second priority level, the event of "a large amount of user tips" is the third priority level, the event of "more than 10,000 user likes" is the fourth priority level, and the event of "more than 10,000 user comments" is the fifth priority level.
[0211] S1440: Based on the event priority, determine the target key event from multiple key events.
[0212] In some embodiments of the present disclosure, when the event priority is the priority in all events of the key event, the server may select the key event with the highest event priority from multiple key events, and use the selected key event as the target key event.
[0213] In some other embodiments of the present disclosure, when the event priority is the priority within the event type to which the key event belongs, the server may first select at least one key event with the highest event type priority from multiple key events. If the number of selected key events is one, use the key event as the target key event; if the number of selected key events is two or more, select the key event with the highest priority level within the event type from the selected key events, and use the finally selected key event as the target key event.
[0214] Specifically, the server determines the target key event from multiple key events within each display period based on the event priority, so that the electronic device displays the event prompt information corresponding to the target key event in the next display period, and further preferentially prompts the user that the target key event has occurred.
[0215] S1450: Transmit key event information corresponding to the target key event to the electronic device associated with the target multimedia resource.
[0216] In some embodiments of the present disclosure, after determining the target key event, the server transmits the key event information corresponding to the target key event to the electronic device associated with the target multimedia resource, so that the electronic device can display the event prompt information corresponding to the target key event.
[0217] Since the detection period of the key event may be different from the detection rule, there may be a situation where the event prompt information corresponding to the key event is displayed overlapping within the same display period. In the embodiments of the present disclosure, by transmitting the target key event determined based on the event priority to the electronic device associated with the target multimedia resource, the electronic device can obtain only one key event within one display period, and further solve the problem that the event prompt information is displayed overlapping.
[0218] Optionally, the key event information is for instructing the electronic device to display the event prompt information corresponding to the key event on the playback screen of the target multimedia resource when the playback mode of the target multimedia resource is the non-immersive playback mode.
[0219] Note that the step of transmitting the key event information corresponding to the target key event to the electronic device associated with the target multimedia resource is similar to S1330 of the embodiment shown in FIG. 13, so no further elaboration is provided here.
[0220] Thus, according to the information display and processing method provided in the embodiments of the present disclosure, by capturing key events for the resource content of multimedia resources and disclosing the information of key events in a non-immersive playback mode, even in the experience of non-immersive live video viewing, the key events that still occur can be effectively obtained, and the content changes, highlights, and interaction rhythms of the media resources can be grasped. Furthermore, according to the essence of lightweight information propagation in the non-immersive playback mode, the event prompt information of key events is effectively and concisely processed and then displayed, improving the user experience, establishing the user's attention relationship, and prompting the user stickiness of the platform.
[0221] FIG. 15 shows a schematic structural diagram of an information display device provided in an embodiment of the present disclosure.
[0222] In some embodiments, the information display device 1500 may be installed in the above electronic device, and the electronic device may be the electronic device 501 in the client shown in FIG. 5. The electronic device may be a device with a communication function such as a mobile phone, a tablet, a desktop computer, a notebook computer, an in-vehicle terminal, a wearable device, a multifunction printer, a smart home device, etc., or may be a device simulated by a virtual machine or a simulator.
[0223] As shown in FIG. 15, the information display device 1500 may include an event receiving unit 1510 and an information display unit 1520. When the playback mode of the target multimedia resource is a non-immersive playback mode, the event receiving unit 1510 may be arranged to receive key event information from the server, and the key event information is for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource. The information display unit 1520 may be arranged to display event prompt information corresponding to the key event on the playback screen of the target multimedia resource.
[0224] In some embodiments of the present disclosure, when the playback mode of the target multimedia resource is the non-immersive playback mode, key event information for instructing to determine that a key event has occurred based on the resource data of the target multimedia resource is received, and in response to the key event information, event prompt information corresponding to the key event is displayed on the playback screen of the target multimedia resource, so as to prompt the user of the generated key event, avoid the user missing the resource content corresponding to the key event for which the target multimedia resource in the non-immersive playback mode plays, and improve the user experience.
[0225] In some embodiments of the present disclosure, the target multimedia resource may include a live broadcast multimedia resource, and the resource data may include live broadcast data.
[0226] In some embodiments of the present disclosure, the key event may include at least one of a live broadcast content key event and a live broadcast interaction key event.
[0227] In some embodiments of the present disclosure, the information display device 1500 may further include a video generation unit, and the video generation unit may be arranged to generate a video image corresponding to the event prompt information based on a preset video generation method.
[0228] Correspondingly, the information display unit 1520 may further be arranged to display the video image superimposed on the playback screen.
[0229] In some embodiments of the present disclosure, the information display device 1500 may further include an information hiding unit, and the information hiding unit may be arranged to hide and display the event prompt information when the display period of the event prompt information reaches a target period.
[0230] Note that the information display device 1500 shown in FIG. 15 executes each step in the method embodiments of FIGS. 6 to 12 and can realize each process and effect in the method embodiments of FIGS. 6 to 12, and thus will not be elaborated here.
[0231] FIG. 16 is a schematic structural diagram of an information processing device provided in an embodiment of the present disclosure.
[0232] In some embodiments, the information processing device 1600 may be installed on a server, and the server may be the server 502 in the server terminal shown in FIG. 5. The server may be a device having storage and computing functions such as a cloud server or a server cluster.
[0233] As shown in FIG. 16, the information processing device 1600 includes a data acquisition unit 1610, an event determination unit 1620, and an event transmission unit 1630. The data acquisition unit 1610 may be arranged to acquire resource data of target multimedia resources. When the event determination unit 1620 detects that the resource data meets the preset event trigger condition, it may be arranged to determine that a key event corresponding to the event trigger condition has occurred. The event transmission unit 1630 may be arranged to transmit key event information corresponding to the key event to an electronic device associated with the target multimedia resource. The key event information is for instructing the electronic device to display event prompt information corresponding to the key event on the playback screen of the target multimedia resource when the playback mode of the target multimedia resource is a non-immersive playback mode.
[0234] In an embodiment of the present disclosure, when the playback mode of the target multimedia resource is the non-immersive playback mode, after receiving key event information for instructing the electronic device to determine that a key event has occurred based on the resource data of the target multimedia resource, the electronic device displays event prompt information corresponding to the key event on the playback screen of the target multimedia resource, thereby prompting the user of the occurred key event, further avoiding the user missing the resource content corresponding to the key event played by the target multimedia resource in the non-immersive playback mode, and improving the user experience.
[0235] In some embodiments of the present disclosure, the target multimedia resource may include a live streaming multimedia resource, and the resource data may include live streaming data.
[0236] In some embodiments of the present disclosure, the key event may include at least one of a live streaming content key event and a live streaming interaction key event.
[0237] In some embodiments of the present disclosure, the live streaming data may include video frame data.
[0238] Correspondingly, the information processing apparatus 1600 may further include a content recognition unit and a first detection unit. The content recognition unit may be arranged to obtain video frame content information corresponding to the current time slice by performing video frame content recognition on the video frame data in the current time slice. When the video frame content information meets the preset content trigger condition, it may be arranged to determine that the video frame data meets the event trigger condition.
[0239] Correspondingly, the key event may include a live delivery content key event.
[0240] Optionally, the video frame content information may include a live delivery vertical category label, and the content trigger condition may include that the live delivery vertical category label in the current time slice is different from the live delivery vertical category label in the previous time slice.
[0241] Optionally, the video frame content information may include character information, and the content trigger condition may include that a keyword preset in the character information is included.
[0242] Optionally, the video frame content information may include image information, and the content trigger condition may include that preset image content in the image information is included.
[0243] In some other embodiments of the present disclosure, the live delivery data may include interface operation data.
[0244] Correspondingly, the information processing apparatus 1600 may further include a second detection unit, and when the second detection unit includes interface call information preset with interface operation data, it may be arranged to determine that the interface operation data satisfies the event trigger condition.
[0245] Correspondingly, the key event may include a live delivery content key event.
[0246] In some other embodiments of the present disclosure, the live delivery data may include the number of interactions of the target interaction type.
[0247] Correspondingly, the information processing apparatus 1600 may further include a third detection unit, and when the third detection unit detects that the number of interactions in the current time slice is greater than an interaction number threshold corresponding to the target interaction type, it may be arranged to determine that it detects that the number of interactions satisfies a preset event trigger condition.
[0248] Correspondingly, the key event may include a live distribution interaction key event.
[0249] Optionally, the target interaction number may include any one of a first number threshold and a second number threshold. The first number threshold is the product of the target average interaction number and a preset ratio, and the target average interaction number is the average interaction number of the target interaction type in all time slices before the current time slice. The second number threshold is a threshold determined based on the distribution of the number of interactions within a preset time period of the target group to which the live distribution multimedia resource belongs.
[0250] In some embodiments of the present disclosure, the information processing apparatus 1600 may include a priority determination unit and an event selection unit. The priority determination unit may be arranged to determine an event priority corresponding to each key event. The event selection unit may be arranged to determine a target key event from a plurality of key events based on the event priority.
[0251] Correspondingly, the event transmission unit 1630 may further be arranged to transmit key event information corresponding to the target key event to an electronic device associated with the target multimedia resource.
[0252] Note that the information processing apparatus 1600 in FIG. 16 executes each step in the method embodiments of FIGS. 13 to 14 and realizes each process and effect in the method embodiments of FIGS. 13 to 14, and thus will not be elaborated here.
[0253] Embodiments of the present disclosure further provide a computing device, which includes a processor and a memory, and the memory stores executable instructions. The processor may read the executable instructions from the memory and execute the executable instructions to implement the information display method or the information processing method in the above embodiments.
[0254] FIG. 17 shows a schematic structural diagram of a computing device provided by an embodiment of the present disclosure. Hereinafter, with specific reference to FIG. 17, a schematic structural diagram suitable for realizing the computing device 1700 in the embodiment of the present disclosure is shown.
[0255] The computing device 1700 in the embodiment of the present disclosure may be an electronic device that executes an information display method or a server that executes an information processing method. The electronic device may include, for example, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (tablets), PMPs (Portable Multimedia Players), in-vehicle terminals (for example, in-vehicle navigation terminals), wearable devices, etc., and fixed terminals such as digital TVs, desktop computers, smart home devices, etc., but is not limited thereto. The server may be a cloud server or a device having storage and computing functions such as a server cluster.
[0256] Note that the computing device 1700 in FIG. 17 is only an example and does not limit the functions and usage ranges of the embodiments of the present disclosure.
[0257] As shown in FIG. 17, the computing device 1700 can include a processing device (e.g., a central processor, a graphics processor, etc.) 1701, and this processing device can execute various appropriate operations and processes according to a program stored in a read-only memory (ROM) 1702 or a program loaded from a storage device 1708 into a random access memory (RAM) 1703. Various programs and data necessary for the operation of the computing device 1700 are further stored in the RAM 1703. The processing device 1701, the ROM 1702, and the RAM 1703 are connected to each other via a communication line 1704. An input / output (I / O) interface 1705 is also connected to the communication line 1704.
[0258] Typically, an input device 1706 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyro, etc., an output device 1707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc., a storage device 1708 including, for example, a magnetic tape, a hard disk, etc., and a communication device 1709 may be connected to the I / O interface 1705. The communication device 1709 enables the computing device 1700 to perform wireless or wired communication with other devices to exchange data. FIG. 17 shows a computing device 1700 having various devices, but it should be understood that it is not required to implement or include all the shown devices. Instead, more or fewer devices may be implemented or included.
[0259] Embodiments of the present disclosure further provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the processor realizes the information display method or the information processing method in the above embodiments.
[0260] In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product, the computer program product includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program code for executing the method of the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication device 1709, or installed from the storage device 1708, or installed from the ROM 1702. When the computer program is executed by the processing device 1701, the above functions defined by the information display method or the information processing method of the embodiments of the present disclosure are executed.
[0261] Note that the computer-readable medium described in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that includes or stores a program, and the program can be used by or combined with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, and the data signal carries computer-readable program code. The data signal propagated in this way can adopt various forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can transmit, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code included in the computer-readable medium can be transmitted by any suitable medium, including, but not limited to, electric wires, optical fiber cables, RF (radio frequency), etc., or any suitable combination of the above.
[0262] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol, such as HTTP, and can be interconnected with digital data communication of any form or medium (e.g., communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the World Wide Web (e.g., the Internet), end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-developed network.
[0263] The computer-readable medium may be included in the information display device, or may exist individually and may not be attached to the computing device.
[0264] One or more programs are carried on the computer-readable medium, and when the one or more programs are executed by the computing device, the computing device is caused to When the playback mode of the target multimedia resource is the non-immersive playback mode, receiving key event information from the server, the key event information being indicative of determining that a key event has occurred based on the resource data of the target multimedia resource, and displaying event prompt information corresponding to the key event on the playback screen of the target multimedia resource. Or, when acquiring the resource data of the target multimedia resource and detecting that the resource data meets the preset event trigger conditions, determining that a key event corresponding to the event trigger conditions has occurred, and transmitting key event information corresponding to the key event to an electronic device associated with the target multimedia resource, where the key event information is for instructing the electronic device to display event attention information corresponding to the key event on the playback screen of the target multimedia resource when the playback mode of the target multimedia resource is a non-immersive playback mode, execute the step of causing the electronic device to perform such an operation.
[0265] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure can be created in one or more programming languages, or combinations thereof, where the programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and further include conventional procedural programming languages such as the "C" language or similar programming languages, but are not limited thereto. The program code can be executed entirely on the user's computer, partially on the user's computer, as a single stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, connected via the Internet using an Internet service provider).
[0266] Flowcharts and block diagrams in the drawings illustrate the system architecture, functions, and operations achievable by the systems, methods, and computer program products of various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram represents one module, program segment, or part of the code, and the module, program segment, or part of the code includes one or more executable instructions that implement a preset logical function. Also, in some alternative implementations, the functions described in the blocks may occur in an order different from that shown in the drawings. For example, in fact, two blocks shown consecutively may be basically executed in parallel, or may be executed in the reverse order, which is determined according to the relevant functions. Note that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, may be implemented by a dedicated system using hardware that executes a preset function or operation, or may be implemented by a combination of dedicated hardware and computer instructions.
[0267] The units according to the embodiments of the present disclosure may be implemented in the form of software or in the form of hardware. In some cases, the name of the unit does not limit the unit itself.
[0268] In this specification, the functions described above may be executed at least partially by one or more hardware logic components. For example, but not limited to, the types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0269] In the present disclosure, a machine-readable medium is a tangible medium that includes or stores a program used by or in conjunction with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium include electrical connections by one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0270] The above description is only an explanation of the preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art should understand that the disclosure scope of the present disclosure is not limited to the technical solutions composed of specific combinations of the above technical features, and other technical solutions formed by arbitrarily combining the above technical features or their equivalent features without departing from the concept of the above disclosure are also included. For example, a technical solution formed by replacing the above features with technical features having similar functions (not limited) disclosed in the present disclosure.
[0271] Also, although the operations are described in a specific sequential order, these operations are not required to be executed in sequence according to the specific sequential or order shown. In certain environments, multitasking and parallel processing are advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be understood as limitations on the scope of the present disclosure. Some of the features described in individual embodiments may be combined and implemented in a single embodiment. Also, the various features described in a single embodiment may be implemented in multiple embodiments alone or in any suitable sub-combination form.
[0272] Although the subject matter has been described in terms of structural features and / or methodological logic operations, the subject matter defined by the appended claims is not limited to the specific features or operations described above. Rather, the specific features and operations described above are only exemplary forms for implementing the claims.
Claims
1. An information display method executed by an information display device, comprising: detecting that a playback mode of a target multimedia resource is a non-intrusive playback mode, the non-intrusive playback mode including at least one of at least a floating window playback mode and a screen split playback mode; when the playback mode of the target multimedia resource is the non-intrusive playback mode, sending a key event acquisition request to a server; receiving key event information sent from the server in response to the key event acquisition request, the key event information being for instructing to determine that a key event has occurred based on resource data of the target multimedia resource, the key event including a live distribution interaction key event; displaying event prompt information corresponding to the key event on a playback screen of the target multimedia resource.
2. The method according to claim 1, wherein the target multimedia resource includes a live distribution multimedia resource, and the resource data includes live distribution data.
3. The method according to claim 2, wherein the key event further includes a live distribution content key event.
4. Before the step of displaying event prompt information corresponding to the key event on a playback screen of the target multimedia resource, the method further includes: generating a moving picture image corresponding to the event prompt information based on a preset moving picture generation method; the step of displaying event prompt information corresponding to the key event on a playback screen of the target multimedia resource includes: displaying the moving picture image on the playback screen. The method according to claim 1.
5. After the step of displaying event prompt information corresponding to the key event on a playback screen of the target multimedia resource, the method further includes: when a display period of the event prompt information reaches a target period, hiding and displaying the event prompt information. The method according to claim 1.
6. An information processing method executed by an information processing device, comprising: The step of obtaining resource data of the target multimedia resource; When it is detected that the resource data satisfies a preset event trigger condition, the step of determining that a key event corresponding to the event trigger condition has occurred; The step of receiving a key event acquisition request, wherein the key event acquisition request is transmitted from an electronic device associated with the target multimedia resource in response to the playback mode of the target multimedia resource being a non-immersive playback mode, and the non-immersive playback mode includes at least one of at least a floating window playback mode and a screen split playback mode; In response to the key event acquisition request, the step of transmitting key event information corresponding to the key event to an electronic device associated with the target multimedia resource, wherein the key event information is for instructing the electronic device to display event prompt information corresponding to the key event on a playback screen of the target multimedia resource when the playback mode of the target multimedia resource is a non-immersive playback mode, and the key event includes a live distribution interaction key event. The method includes the above steps.
7. The method according to claim 6, wherein the target multimedia resource includes a live distribution multimedia resource, and the resource data includes live distribution data.
8. The method according to claim 7, wherein the key event further includes a live distribution content key event.
9. The live distribution data includes video frame data. The step of detecting that the resource data satisfies a preset event trigger condition includes: Performing video frame content recognition on the video frame data in the current time slice, and obtaining video frame content information corresponding to the current time slice; When the video frame content information satisfies a preset content trigger condition, determining that the video frame data is detected to satisfy the event trigger condition. The method includes the above steps. The method according to claim 7, wherein the key event includes a live distribution content key event.
10. The video frame content information includes a live delivery vertical category label, and the content trigger condition includes that the live delivery vertical category label in the current time slice is different from the live delivery vertical category label in the previous time slice. Or, the video frame content information includes character information, and the content trigger condition includes that the keyword preset in the character information is included. Or, the video frame content information includes image information, and the content trigger condition includes that the image content preset in the image information is included. The method according to claim 9.
11. The live delivery data includes interface operation data. The step of detecting that the resource data meets the preset event trigger condition. When the interface operation data includes preset interface call information, the step of determining that the interface operation data meets the event trigger condition. The key event includes a live delivery content key event. The method according to claim 7.
12. The live delivery data includes the number of interactions of a target interaction type. The step of detecting that the resource data meets the preset event trigger condition. When it is detected that the number of interactions in the current time slice is greater than the interaction number threshold corresponding to the target interaction type, the step of determining that the number of interactions meets the preset event trigger condition. The method according to claim 7.
13. The interaction number threshold includes either one of a first number threshold and a second number threshold. The first number threshold is the product of the target average interaction number and a preset ratio, and the target average interaction number is the average interaction number of the target interaction type in all previous time slices of the current time slice. The second number threshold is a threshold determined based on the distribution of the number of interactions within a preset time period of the target group to which the live delivery multimedia resource belongs. The method according to claim 12.
14. The number of the key events is plural, before the step of transmitting key event information corresponding to the key event to an electronic device associated with the target multimedia resource, the method includes a step of determining an event priority corresponding to each of the key events, and a step of determining a target key event from the plurality of key events based on the event priority. The step of transmitting key event information corresponding to the key event to an electronic device associated with the target multimedia resource includes a step of transmitting key event information corresponding to the target key event to an electronic device associated with the target multimedia resource, according to claim 6.
15. An information display device, including an event receiving unit configured to detect that a playback mode of a target multimedia resource is a non-intrusive playback mode, and when the playback mode of the target multimedia resource is the non-intrusive playback mode, transmit a key event acquisition request to a server, and receive key event information transmitted from the server in response to the key event acquisition request, wherein the non-intrusive playback mode includes at least one of at least a floating window playback mode and a screen split playback mode, the key event information is for instructing to determine that a key event has occurred based on resource data of the target multimedia resource, and the key event includes a live distribution interaction key event, and an information display unit configured to display event prompt information corresponding to the key event on a playback screen of the target multimedia resource.
16. An information processing device, including a data acquisition unit configured to acquire resource data of a target multimedia resource, and an event determination unit configured to determine that a key event corresponding to the event trigger condition has occurred when detecting that the resource data satisfies a preset event trigger condition. An event transmission unit that receives a key event acquisition request and, in response to the key event acquisition request, is arranged to transmit key event information corresponding to the key event to an electronic device associated with the target multimedia resource, wherein the key event acquisition request is transmitted from an electronic device associated with the target multimedia resource in response to the reproduction mode of the target multimedia resource being a non-immersive reproduction mode, the non-immersive reproduction mode includes at least one of at least a floating window reproduction mode and a screen split reproduction mode, the key event information is for instructing the electronic device to display event prompt information corresponding to the key event on the reproduction screen of the target multimedia resource when the reproduction mode of the target multimedia resource is a non-immersive reproduction mode, the key event includes a live distribution interaction key event, and the apparatus includes the event transmission unit.
17. A computing device, comprising: a processor; a memory storing executable instructions, and the processor reads the executable instructions from the memory and executes the executable instructions to implement the information display method according to any one of claims 1 to 5 or the information processing method according to any one of claims 6 to 14.
18. A computer-readable storage medium, having a computer program stored thereon, wherein when the computer program is executed by a processor of a computing device, the processor is caused to implement the information display method according to any one of claims 1 to 5 or the information processing method according to any one of claims 6 to 14.
Citation Information
Patent Citations
Live broadcast list display method and device, and electronic equipment
CN109547819A
Method, system and apparatus for obtaining information related to broadcast information
JP2007116717A
Signaling mechanism, templates, and system for creating and distributing interactive events on mobile devices in mobile broadcasting communication systems.
JP2013517702A
Lot notification device, method and program
JP2018067078A
METHOD, DEVICE, SERVER AND MEDIUM FOR GENERATING TARGET VIDEO - Patent application
JP2023535989A