Information playback method and apparatus, device, and storage medium

Abstract

Provided in the present disclosure are an information playback method and apparatus, a device, and a storage medium. The method comprises: acquiring multimedia information and associated reference information corresponding to the multimedia information (410); for each piece of the multimedia information, generating linking information corresponding to the multimedia information on the basis of content attributes of the multimedia information and the associated reference information corresponding to the multimedia information, the content attributes being associated with content of the multimedia information (420); on the basis of the linking information corresponding to the plurality of pieces of multimedia information, obtaining a linking information set, the linking information in the linking information set having a playback sequence (430); and, on the basis of the linking information set, playing back the linking information in the linking information set and the plurality of pieces of multimedia information according to the playback sequence (440). Thus, the present disclosure can improve interactivity and experience of users listening / viewing multimedia information.

Description

Method, device, equipment and storage medium for information playback

[0001] This application claims priority to the Chinese invention patent application entitled “Method, device, equipment and storage medium for information playback” and application number 202410140186.4, filed on January 31, 2024. The entire contents of that application are incorporated herein by reference. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computer technology, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for information playback. Background Art

[0003] With the rapid development of computer technology, more and more applications and platforms are being designed to provide various services to users. For example, users can publish, browse, and view various types of multimedia information within applications. Multimedia information can include various types of content, such as videos, images, image collections, text, and audio. Multiple multimedia information is often provided to users in the form of multimedia information streams, allowing users to browse and view these multimedia information in sequence. Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for information playback is provided. The method includes: obtaining multimedia information and associated reference information corresponding to the multimedia information; for each multimedia information, generating connection information corresponding to the multimedia information based on content attributes of the multimedia information and the associated reference information corresponding to the multimedia information, wherein the content attributes are associated with the content of the multimedia information; obtaining a connection information set based on the connection information corresponding to multiple multimedia information, wherein the connection information in the connection information set has a playback order; and playing the connection information in the connection information set and the multiple multimedia information in the playback order based on the connection information set.

[0005] In a second aspect of the present disclosure, a device for information playback is provided. The device includes: a content and information acquisition module configured to acquire multimedia information and associated reference information corresponding to the multimedia information; a connection information generation module configured to generate connection information corresponding to each multimedia information based on content attributes of the multimedia information and associated reference information corresponding to the multimedia information, wherein the content attributes are associated with the content of the multimedia information; an information set determination module configured to obtain a connection information set based on connection information corresponding to multiple multimedia information, wherein the connection information in the connection information set has a playback order; and an information playback module configured to play the connection information in the connection information set and the multiple multimedia information in the playback order based on the connection information set.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the computer program is executed by a processor, the method of the first aspect is implemented.

[0008] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0011] FIG2 is a schematic diagram showing an example process of information playback according to some embodiments of the present disclosure;

[0012] FIG3 shows a schematic diagram of an example according to some embodiments of the present disclosure;

[0013] FIG4 shows a flow chart of a process for information playback according to some embodiments of the present disclosure;

[0014] FIG5 shows a schematic structural block diagram of an apparatus for information playback according to some embodiments of the present disclosure; and

[0015] FIG6 illustrates an electronic device in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0016] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0017] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0018] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0019] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0020] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to the electronic device, application, server or storage medium and other software or hardware that performs the operation of the technical solution of the present disclosure based on the prompt message.

[0021] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0022] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0023] As used herein, the term "model" can learn the association between corresponding inputs and outputs from training data, so that after training is completed, corresponding outputs can be generated for given inputs. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0024] A "neural network" is a machine learning network based on deep learning. A neural network is capable of processing inputs and providing corresponding outputs. It typically includes an input layer, an output layer, and one or more hidden layers between the input and output layers. Neural networks used in deep learning applications typically include many hidden layers, thereby increasing the depth of the network. The layers of a neural network are connected in sequence so that the output of the previous layer is provided as input to the next layer, where the input layer receives the input of the neural network and the output of the output layer serves as the final output of the neural network. Each layer of a neural network includes one or more nodes (also called processing nodes or neurons), each of which processes the input from the previous layer.

[0025] Generally speaking, machine learning can be roughly divided into three stages, namely the training stage, the testing stage, and the application stage (also called the inference stage). In the training stage, a given model can be trained using a large amount of training data, and the parameter values ​​are continuously updated iteratively until the model can obtain consistent inferences that meet the expected goals from the training data. Through training, the model can be considered to be able to learn the association between input and output (also called input-to-output mapping) from the training data. The parameter values ​​of the trained model are determined. In the testing stage, the test input is applied to the trained model to test whether the model can provide the correct output, thereby determining the performance of the model. The testing stage can sometimes be integrated into the training stage. In the application or inference stage, the trained model can be used to process the actual model input based on the parameter values ​​obtained through training to determine the corresponding model output.

[0026] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the environment 100 may include an electronic device 110 .

[0027] The electronic device 110 may obtain at least one multimedia information 102 (for example, including multimedia information 102-1, 102-2, ..., 102-N, where N is a positive integer. For ease of description, one or more multimedia information may be collectively referred to as multimedia information 102). Multimedia information 102 may also be referred to as multimedia items, multimedia data, multimedia content, etc. Multimedia information 102 may include, for example, but is not limited to, one or more of audio, video, images, image collections, text, etc. The present disclosure is not limited to specific multimedia information.

[0028] The following description uses the example of at least one multimedia message 102 including multiple multimedia messages as an example. Electronic device 110 can determine a multimedia message stream 112 (also referred to as a feed stream) to be played to user 120 based on the multiple multimedia messages 102. Multimedia message stream 112 includes at least some of the multimedia messages in the multiple multimedia messages 102. For example, if the multiple multimedia messages 102 include 10 multimedia messages, multimedia message stream 112 may include only 5 multimedia messages.

[0029] Taking the multimedia information stream 112 as an example, the multiple multimedia information in the multimedia information stream 112 have a predetermined play order and / or play mode. The predetermined play order may include, but is not limited to, the order of the names of the multimedia information (such as song names), the order of the user names of the users corresponding to the multimedia information (such as singers corresponding to the songs), the order in which the electronic device 110 obtains the multiple multimedia information, and so on. The present disclosure does not limit the specific play order and play mode. In some embodiments, the electronic device 110 can also adjust the multimedia information stream 112 in response to receiving user input from the user 120. For example, the electronic device 110 can adjust the play order of the multiple multimedia information in the multimedia information stream 112 in response to receiving user input.

[0030] The electronic device 110 may include any computing system with computing capabilities, such as various computing devices / systems, terminal devices, server devices, etc. The terminal device may be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. The server device may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server-side device may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like.

[0031] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0032] Traditionally, manual commentary is often inserted between multiple multimedia messages to introduce the next multimedia message to users. While this can provide users with additional information related to the multimedia message (such as the background and story behind the multimedia message), allowing users to better understand the multimedia message they are currently viewing or about to view, it relies on a live host to provide manual commentary, which requires significant labor costs. Furthermore, the manual commentary is often fixed and cannot be interrupted or modified by users, which affects the user's interactive experience with multiple multimedia messages.

[0033] In view of this, according to an embodiment of the present disclosure, an improved scheme for information playback is proposed. In this scheme, multimedia information and associated reference information corresponding to the multimedia information are obtained. For each multimedia information, connection information corresponding to the multimedia information is generated based on the content attributes of the multimedia information and the associated reference information corresponding to the multimedia information, where the content attributes are associated with the content of the multimedia information. Based on the connection information corresponding to multiple multimedia information, a connection information set is obtained. The connection information in the connection information set has a playback order. Based on the connection information set, the connection information and multiple multimedia information in the connection information set are played according to the playback order.

[0034] In this way, corresponding connection information can be generated for multiple multimedia messages to be played, and then the multimedia messages and the connection information can be played in sequence, which helps to improve the interactivity and experience of users listening to / viewing multiple multimedia messages.

[0035] Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0036] FIG2 illustrates a schematic diagram of an example process 200 for information playback according to some embodiments of the present disclosure. Process 200 may be implemented on electronic device 110. For ease of discussion, process 200 will be described with reference to environment 100 of FIG1 . It should be noted that the operations performed by electronic device 110 described above, as well as those performed by electronic device 110 described subsequently, may be performed by related applications installed on electronic device 110.

[0037] In box 210, the electronic device 110 can obtain multiple multimedia information and, for each multimedia information, obtain the corresponding associated reference information 211 and content attributes 212. The associated reference information 211 may include any appropriate reference content associated with the multimedia information. The reference content may include, but is not limited to, the creation background of the multimedia information, comments on the multimedia information, a profile of the creator of the multimedia information, awards received by the multimedia information, and the like. The associated reference information may have any appropriate source, such as an introduction text to the multimedia information provided by the creator of the multimedia information, an introduction text provided by a multimedia information playback application or platform, an evaluation or introduction provided by a commentator, and the like. The embodiments of the present disclosure are not limited in this respect.

[0038] The content attributes 212 herein may also be referred to as content attribute information, which may be associated with the content of the multimedia information itself. For example, if the multimedia information is a song, the song's content attributes 212 may include the song's lyrics, arrangement, mix, genre, rhythm, harmony, style, and so on. For ease of description, the following description will be based on the example of a song.

[0039] In block 220, the electronic device 110 may generate corresponding connection information for each of the plurality of multimedia messages based on the associated reference information 211 and the content attributes 212 of each of the plurality of multimedia messages. The connection information may also be referred to as a connecting word.

[0040] The electronic device 110 can use any appropriate method to generate the connection information corresponding to each multimedia message. For example, the electronic device 110 can use any appropriate rule or algorithm to generate the connection information corresponding to each multimedia message. For another example, the electronic device 110 can also use a target model to generate the connection information corresponding to each multimedia message. The target model here may include one or more models, and may include but is not limited to any appropriate model such as a Transformer model, a convolutional neural network (CNN), a recurrent neural network (RNN), a deep neural network (DNN), etc. The target model can be a model local to the electronic device 110, or it can be a model installed in other electronic devices (for example, installed in a remote device). In some embodiments, the target model can be a language model (LM) or a large language model (LLM).

[0041] For each multimedia information, the electronic device 110 can, for example, obtain guidance information (prompt) for the target model based on the associated reference information 211 and content attributes 212 of the multimedia information. Guidance information can also be referred to as prompt word information, prompt word input, etc. In some embodiments, the electronic device 110 can also obtain a guidance information template. The guidance information template can, for example, be used to instruct the target model to generate connection information. The guidance information template can also, for example, be used to indicate the format of the guidance information, the format of the model output of the target model, etc. The electronic device 110 can provide the guidance information to the target model. The target model can generate a model output for the guidance information based on the guidance information. The electronic device 110 can obtain the model output from the target model and, based on the model output, determine the connection information corresponding to the multimedia information.

[0042] Regarding the specific method by which the target model generates the connection information, in block 221, the electronic device 110 and / or the target model may determine the correspondence between the associated reference information 211 and the content attributes 212. The correspondence between the associated reference information 211 and the content attributes 212 can be one-to-one, many-to-one, one-to-many, or many-to-many, and this disclosure does not limit the specific correspondence. The correspondence here can be determined by the target model itself, or it can be determined by the electronic device 110 and then provided to the target model. If the correspondence is provided to the target model by the electronic device 110, the guidance information may be generated by the electronic device 110 based on the associated reference information 211, the content attributes 212, and the correspondence between the associated reference information 211 and the content attributes 212. For example, if the associated reference information 211 includes a comment and the content attributes 212 include lyrics and arrangement, the electronic device 110 and / or the target model may determine, based on the content of the comment, whether the content attribute corresponding to the comment is lyrics or genre. If the content attribute is determined to be lyrics, the electronic device 110 and / or the target model may also determine which line of the song's lyrics the comment corresponds to.

[0043] At block 222, for each multimedia message, the target model may generate corresponding connection information for the multimedia message based on the content attributes 212 of the multimedia message and the associated reference information 211 corresponding to the multimedia message. For example, the target model may also generate corresponding connection information for the multimedia message based on the correspondence between the associated reference information 211 and the content attributes 212 of the multimedia message.

[0044] The electronic device 110 can obtain the connection information corresponding to each of the multiple multimedia messages in the above manner. Based on the multiple connection information corresponding to the multiple multimedia messages, the electronic device 110 can obtain a set of connection information with a playback order. Since each multimedia message corresponds to a connection information, and the multiple multimedia messages have a corresponding playback order, the playback order of the multimedia messages and the connection information is also the playback order of the multiple multimedia message-connection information pairs, that is, the playback order of the multiple multimedia messages.

[0045] In some embodiments, the electronic device 110 may also determine the quality of multiple connection information corresponding to multiple multimedia information. The quality of the connection information may, for example, reflect the accuracy and / or correlation of the multimedia information corresponding to the connection information description. That is, the higher the correlation between the connection information and the corresponding multimedia information, the higher the quality of the connection information. If the connection information is generated by a target model, the quality of the connection information may be output by the target model, or the connection information may be scored by other models. The embodiments of the present disclosure are not limited in how to generate the quality of the connection information. For example, in response to the quality of a certain connection information among the multiple connection information being lower than a threshold, the electronic device 110 may remove the connection information from the connection information set to update the connection information set. The updated connection information set may include other connection information other than the connection information among the multiple connection information.

[0046] In some embodiments, the electronic device 110 may further detect the connection information in the connection information set. If it is detected that at least two multimedia information satisfy a preset condition, the electronic device 110 may generate combined connection information based on the connection information corresponding to the at least two multimedia information to update the connection information set. Exemplarily, the multiple multimedia information have an arrangement order, and the preset condition may include, for example, that at least two multimedia information are adjacent in the arrangement order. The preset condition may also include, for example, that at least two multimedia information correspond to the same user (for example, at least two songs correspond to the same singer), at least two multimedia information have the same source (for example, at least two songs are from the same album), at least two multimedia information have the same attributes (for example, at least two songs are songs of the same type), the lengths of at least two connection information corresponding to at least two multimedia information are both lower than a threshold length (for example, the number of words in the running words corresponding to at least two songs are both less than a threshold number of words), etc. The combined connection information is used to be played before at least two multimedia information.

[0047] The electronic device 110 can generate combined connection information based on the connection information corresponding to at least two multimedia information in any appropriate manner. For example, the electronic device 110 can generate a simple transition statement and use the transition statement to connect the connection information corresponding to at least two multimedia information to generate combined connection information. For another example, the electronic device 110 can also provide the connection information corresponding to at least two multimedia information to a model to use the model to generate combined connection information. Exemplarily, referring to Figure 3, Figure 3 shows a schematic diagram of example 300 according to some embodiments of the present disclosure. In example 300, the electronic device 110 can generate combined connection information 313 based on the two connection information corresponding to multimedia information 314 and multimedia information 315 in response to detecting that multimedia information 314 and multimedia information 315 meet a preset condition. The combined connection information 313 is played before multimedia information 314 and multimedia information 315.

[0048] For example, the electronic device 110 may execute box 240 in response to obtaining the connection information set. In box 240, the electronic device 110 may perform an information playback operation. Before executing box 240 and during the execution of box 240, the electronic device 110 may also detect whether a playback adjustment instruction has been received. If it is determined that no playback adjustment instruction has been received, the electronic device 110 may execute box 241. In box 241, the electronic device 110 may play the connection information and multiple multimedia information in the connection information set in accordance with the playback order based on the connection information set. For example, with reference to Figure 3, if the playback order is the order in which multiple multimedia information and multiple connection information are presented from top to bottom as shown in Figure 3, the electronic device 110 may play the connection information 311, multimedia information 312, connection information 313, multimedia information 314, multimedia information 315, connection information 316, and so on in sequence based on this order.

[0049] In some embodiments, if it is determined that a play adjustment instruction is received, the electronic device 110 may execute box 230. The play adjustment instruction may come from user input, such as a user's voice input. In box 230, the electronic device 110 may receive the play adjustment instruction. The play adjustment instruction may, for example, indicate an adjustment action associated with a play connection information set. Exemplarily, the adjustment action may be used to adjust at least one of the play modes (231) of multiple multimedia information, multiple multimedia information (232), or a connection information set (233). The electronic device 110 may determine the adjustment action indicated by the play adjustment instruction and execute the adjustment action. In this way, real-time interactivity with the user may be achieved during the playback of multimedia information and connection information.

[0050] If the playback adjustment instruction indicates to stop playing the transition information (i.e., the adjustment action indicated by the playback adjustment instruction is to adjust the playback mode of the multiple multimedia messages), the electronic device 110 may execute block 242. In block 242, the electronic device 110 may stop playing the transition information in the transition information set and play the multiple multimedia messages according to the preset playback mode. In other words, in this case, the electronic device 110 may only play the multiple multimedia messages without playing the transition information.

[0051] If the play adjustment instruction includes a multimedia information update request (i.e., the adjustment action indicated by the play adjustment instruction is for adjusting multiple multimedia information), the electronic device 110 may execute box 243. In box 243, if the connection information set currently being played or to be played is referred to as the first connection information set, and the multiple multimedia information included therein is referred to as the first group of multimedia information, the electronic device 110 may update the first group of multimedia information based on the multimedia information update request in response to the play adjustment instruction including the multimedia information update request for the first group of multimedia information. The electronic device 110 may obtain multiple updated multimedia information. The multiple updated multimedia information may also be referred to as the second group of multimedia information. The multiple multimedia information included in the second group of multimedia information here is at least partially different from the multiple multimedia information in the first group of multimedia information. The electronic device 110 may generate an updated connection information set based on the multiple updated multimedia information, and play the connection information and corresponding multimedia information in the updated connection information set.

[0052] Specifically, the electronic device 110 may obtain multiple updated multimedia information and multiple associated reference information corresponding to the multiple updated multimedia information. For each updated multimedia information in the multiple updated multimedia information, the electronic device 110 may generate connection information corresponding to the updated multimedia information based on the content attributes of the updated multimedia information and the associated reference information corresponding to the updated multimedia information. The electronic device 110 may obtain an updated connection information set based on the multiple updated multimedia information and the multiple connection information corresponding to the multiple updated multimedia information. The multiple connection information in the updated connection information set have an updated playback order. If the playback order of the first connection information set is referred to as the first playback order, and the updated playback order is referred to as the second playback order, the second playback order may be different from the first playback order or the same as the first playback order (for example, both may be the order of song titles). Based on the updated connection information set, the electronic device 110 may play the multiple connection information and the multiple updated multimedia information in the updated connection information set according to the updated playback order.

[0053] If the playback adjustment instruction includes an update request for the first connection information in the connection information set (where the first connection information is the connection information to be updated as indicated by the update request), the electronic device 110 may determine that a playback adjustment instruction instructing adjustment of the connection information set has been received. The electronic device 110 may execute block 244. In block 244, the electronic device 110 may, in response to the playback adjustment instruction including the update request for the first connection information, determine the target multimedia information corresponding to the first connection information, where the target multimedia information is one of the multiple multimedia information in the connection information set. The electronic device 110 may update the first connection information based on the content attributes and associated reference information of the target multimedia information. For example, the electronic device 110 may regenerate second connection information corresponding to the first multimedia information based on the content attributes and associated reference information of the target multimedia information. The second connection information is different from the first connection information. The electronic device 110 may update the first connection information with the second connection information. For example, the electronic device 110 may replace the first connection information in the connection information set with the second connection information.

[0054] Regarding the specific method of playing the connection information set, in some embodiments, before playing the connection information and multiple multimedia messages in the connection information set, the electronic device 110 may also play pilot information for the multiple multimedia messages. Pilot information may also be referred to as an opening statement. Pilot information may also include content such as audio, video, images, image collections, and text. For example, referring to FIG3 , the electronic device 110 may play pilot information 301 before playing the connection information and multimedia messages. This pilot information may be a preset pilot information or a pilot information generated by the electronic device 110 based on the multiple multimedia messages.

[0055] If the preamble is a preset preamble, it can be a preamble for any set of transition information. That is, electronic device 110 can play the preset preamble regardless of which transition information set is being played, and regardless of the multimedia information included in the transition information set. In some embodiments, the preset preamble may include multiple preambles, and electronic device 110 may determine a preamble from the multiple preset preambles and play the preamble. This disclosure does not limit the specific method for determining the preset preamble.

[0056] If the pilot information is pilot information generated by the electronic device 110 based on multiple multimedia information, it can be pilot information generated by the electronic device 110 based on any appropriate method. For example, it can be pilot information generated by the electronic device 110 based on any template. For another example, it can also be pilot information generated by the electronic device 110 using a model. For example, the electronic device 110 can generate first pilot information for the model based on multiple multimedia information. The electronic device 110 can provide the first pilot information to the model used to generate the pilot information and obtain a model output from the model. The electronic device 110 can determine the pilot information for the multiple multimedia information based on the obtained model output.

[0057] In some embodiments, the electronic device 110 may also convert the transition information in the transition information set into at least one audio track, and play the at least one audio track and the multiple multimedia messages in a playback order. The electronic device 110 may use any appropriate method to convert the transition information into the at least one audio track. For example, the electronic device 110 may use a TTS algorithm to convert the transition information into the at least one audio track. In some embodiments, the at least one audio track converted by the electronic device 110 may have a specific timbre. That is, the electronic device 110 may convert the transition information in the transition information set into the at least one audio track having the specific timbre based on the specific timbre. The specific timbre here may be a default timbre or a user-specified target timbre. The electronic device 110 may play the at least one audio track and the multiple multimedia messages in the playback order specified in the transition information set. It is understood that if the electronic device 110 also plays a pilot message, the electronic device 110 may also convert the pilot message into the audio track having the specific timbre based on the specific timbre. For example, the electronic device 110 may first play the audio track corresponding to the pilot message, and then play the at least one audio track and the multiple multimedia messages corresponding to the pilot message in the playback order specified in the transition information set.

[0058] In summary, in the embodiments of the present disclosure, corresponding connection information can be generated for multiple multimedia messages to be played, and then the multimedia messages and the connection information can be played in sequence, which helps to improve the interactivity and user experience of users listening to / viewing multiple multimedia messages.

[0059] FIG4 shows a flow chart of a process 400 for information playback according to some embodiments of the present disclosure. The process 400 may be implemented at the electronic device 110. The process 400 is described below with reference to FIG1.

[0060] In block 410 , the electronic device 110 obtains multimedia information and associated reference information corresponding to the multimedia information.

[0061] In block 420 , the electronic device 110 generates, for each piece of multimedia information, connection information corresponding to the multimedia information based on content attributes of the multimedia information and associated reference information corresponding to the multimedia information, where the content attributes are associated with the content of the multimedia information.

[0062] In block 430 , the electronic device 110 obtains a connection information set based on the connection information corresponding to the plurality of multimedia information, wherein the connection information in the connection information set has a play order.

[0063] In block 440 , the electronic device 110 plays the connection information and the plurality of multimedia information in the connection information set in a play order based on the connection information set.

[0064] In some embodiments, before the step of playing the connection information and multiple multimedia information in the connection information set in the playback order, process 400 also includes: receiving a playback adjustment instruction; and executing an adjustment action indicated by the playback adjustment instruction, the adjustment action being used to adjust the playback mode of the multiple multimedia information, the multiple multimedia information or at least one of the connection information sets.

[0065] In some embodiments, executing the adjustment action indicated by the play adjustment instruction includes: stopping playing the connection information in the connection information set in response to the play adjustment instruction, and playing the plurality of multimedia information in a preset play mode.

[0066] In some embodiments, executing the adjustment action indicated by the playback adjustment instruction includes: in response to the playback adjustment instruction including an update request and the update request is for the first connection information in the connection information set, based on the content attributes of the target multimedia information and the associated reference information corresponding to the target multimedia information, updating the first connection information, wherein the first connection information is the connection information to be updated indicated by the update request, and the target multimedia information is one of multiple multimedia information and corresponds to the first connection information.

[0067] In some embodiments, executing the adjustment action indicated by the playback adjustment instruction includes: in response to the playback adjustment instruction including a multimedia information update request, updating the multimedia information based on the multimedia information update request to obtain updated multimedia information and associated reference information corresponding to the updated multimedia information; for each updated multimedia information, generating connection information corresponding to the updated multimedia information based on the content attributes of the updated multimedia information and the associated reference information corresponding to the updated multimedia information; based on the connection information corresponding to multiple updated multimedia information, obtaining an updated connection information set, wherein the connection information in the updated connection information set has an updated playback order; and based on the updated connection information set, playing the connection information in the updated connection information set and multiple updated multimedia information according to the updated playback order.

[0068] In some embodiments, generating connection information corresponding to the multimedia information includes: obtaining guidance information for the target model based on the content attributes of the multimedia information and the associated reference information corresponding to the multimedia information; and inputting the guidance information into the target model to obtain connection information output by the target model.

[0069] In some embodiments, playing the connection information and the plurality of multimedia information in the connection information set includes: converting the connection information in the connection information set into at least one audio; and playing the at least one audio and the plurality of multimedia information in a playing order.

[0070] In some embodiments, before playing the connection information and the multiple multimedia messages in the connection information set in the play order, process 400 further includes: playing leading information for the multiple multimedia messages, wherein the leading information is preset or generated based on the multiple multimedia messages.

[0071] In some embodiments, after the step of obtaining the connection information set, process 400 further includes: if it is detected that at least two multimedia information meet a preset condition, based on the connection information corresponding to the at least two multimedia information, generating combined connection information to update the connection information set, the combined connection information is used to be played before the at least two multimedia information, the multiple multimedia information have an arrangement order, and the preset condition includes that the at least two multimedia information are adjacent in the arrangement order, and / or if it is detected that the connection information set contains second connection information, removing the second connection information from the connection information set to update the connection information set, wherein the quality of the second connection information is lower than a threshold, and the quality of the connection information reflects the degree of association between the multimedia information corresponding to the connection information description.

[0072] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG5 shows a schematic structural block diagram of an apparatus 500 for information playback according to some embodiments of the present disclosure. Apparatus 500 may be implemented as or included in electronic device 110 of FIG1 . Each module / component in apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0073] As shown in the figure, the device 500 includes a content and information acquisition module 510, which is configured to acquire multimedia information and associated reference information corresponding to the multimedia information. The device 500 also includes a connection information generation module 520, which is configured to generate connection information corresponding to each multimedia information based on the content attributes of the multimedia information and the associated reference information corresponding to the multimedia information, wherein the content attributes are associated with the content of the multimedia information. The device 500 also includes an information set determination module 530, which is configured to obtain a connection information set based on the connection information corresponding to multiple multimedia information, wherein the connection information in the connection information set has a playback order. The device 500 also includes an information playback module 540, which is configured to play the connection information and multiple multimedia information in the connection information set according to the playback order based on the connection information set.

[0074] In some embodiments, the device 500 also includes: an instruction receiving module, configured to receive a playback adjustment instruction; and an action execution module, configured to execute an adjustment action indicated by the playback adjustment instruction, the adjustment action being used to adjust the playback mode of the multiple multimedia information, multiple multimedia information or at least one of the connection information sets.

[0075] In some embodiments, the action execution module is specifically configured to: in response to the playback adjustment instruction indicating to stop playing the connection information, stop playing the connection information in the connection information set and play the multiple multimedia information according to a preset playback mode.

[0076] In some embodiments, the action execution module is specifically configured to: in response to the playback adjustment instruction including an update request and the update request is for the first connection information in the connection information set, update the first connection information based on the content attributes of the target multimedia information and the associated reference information corresponding to the target multimedia information, wherein the first connection information is the connection information to be updated indicated by the update request, and the target multimedia information is one of multiple multimedia information and corresponds to the first connection information.

[0077] In some embodiments, the action execution module is specifically configured to: respond to a playback adjustment instruction including a multimedia information update request, update the multimedia information based on the multimedia information update request, and obtain updated multimedia information and associated reference information corresponding to the updated multimedia information; for each updated multimedia information, generate connection information corresponding to the updated multimedia information based on the content attributes of the updated multimedia information and the associated reference information corresponding to the updated multimedia information; obtain an updated connection information set based on the connection information corresponding to multiple updated multimedia information, wherein the connection information in the updated connection information set has an updated playback order; and based on the updated connection information set, play the connection information in the updated connection information set and multiple updated multimedia information in accordance with the updated playback order.

[0078] In some embodiments, the connection information generation module 520 includes: a guidance information generation module, configured to obtain guidance information for the target model based on the content attributes of the multimedia information and the associated reference information corresponding to the multimedia information; and a connection information determination module, configured to input the guidance information into the target model to obtain the connection information output by the target model.

[0079] In some embodiments, the information playing module 540 includes: an audio conversion module configured to convert the connection information in the connection information set into at least one audio; and an audio playing module configured to play at least one audio and multiple multimedia information in a playing order.

[0080] In some embodiments, the apparatus 500 further includes: a pilot information playing module configured to play pilot information for a plurality of multimedia information, wherein the pilot information is preset or generated based on the plurality of multimedia information.

[0081] In some embodiments, the device 500 also includes: a combined connection information generation module, configured to generate combined connection information to update the connection information set based on the connection information corresponding to the at least two multimedia information if it is detected that at least two multimedia information meet a preset condition, the combined connection information is used to be played before the at least two multimedia information, the multiple multimedia information have an arrangement order, and the preset condition includes that at least two multimedia information are adjacent in the arrangement order, and / or a connection information removal module, configured to remove the second connection information from the connection information set to update the connection information set if it is detected that the connection information set contains second connection information, wherein the quality of the second connection information is lower than a threshold, and the quality of the connection information reflects the degree of association between the multimedia information corresponding to the connection information description.

[0082] The units and / or modules included in the device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 500 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0083] FIG6 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 600 shown in FIG6 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 600 shown in FIG6 may be used to implement the electronic device 110 of FIG1 or the apparatus 500 of FIG5.

[0084] As shown in FIG6 , electronic device 600 is in the form of a general-purpose computing device. Components of electronic device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit 610 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 620. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 600.

[0085] The electronic device 600 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 600.

[0086] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG6 , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0087] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0088] The input device 650 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 660 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 600, or with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0089] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0090] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0091] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0092] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0093] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0094] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for playing information, comprising: Acquiring multimedia information and associated reference information corresponding to the multimedia information; For each multimedia message, generating connection information corresponding to the multimedia message based on content attributes of the multimedia message and associated reference information corresponding to the multimedia message, wherein the content attributes are associated with the content of the multimedia message; Obtaining a connection information set based on connection information corresponding to the plurality of multimedia information, wherein the connection information in the connection information set has a playback order; as well as Based on the connection information set, the connection information and the plurality of multimedia information in the connection information set are played in the playing order.

2. The method according to claim 1, wherein before the step of playing the connection information in the connection information set and the plurality of multimedia messages in the playing order, the method further comprises: Receive playback adjustment instructions; as well as An adjustment action indicated by the play adjustment instruction is executed, where the adjustment action is used to adjust the play modes of the plurality of multimedia information, the plurality of multimedia information, or at least one of the connection information set.

3. The method according to claim 2, wherein executing the adjustment action indicated by the playback adjustment instruction comprises: In response to the playback adjustment instruction indicating to stop playing the connection information, the playback of the connection information in the connection information set is stopped and the plurality of multimedia information are played according to a preset playback mode.

4. The method according to claim 2, wherein executing the adjustment action indicated by the playback adjustment instruction comprises: In response to the playback adjustment instruction including an update request and the update request being for the first connection information in the connection information set, the first connection information is updated based on the content attributes of the target multimedia information and the associated reference information corresponding to the target multimedia information, wherein the first connection information is the connection information to be updated indicated by the update request, and the target multimedia information is one of the multiple multimedia information and corresponds to the first connection information.

5. The method according to claim 2, wherein executing the adjustment action indicated by the playback adjustment instruction comprises: In response to the playback adjustment instruction including a multimedia information update request, updating the multimedia information based on the multimedia information update request to obtain updated multimedia information and associated reference information corresponding to the updated multimedia information; For each updated multimedia information, generating connection information corresponding to the updated multimedia information based on content attributes of the updated multimedia information and associated reference information corresponding to the updated multimedia information; Obtaining an updated set of connection information based on the connection information corresponding to the plurality of updated multimedia information, wherein the connection information in the updated set of connection information has an updated playback order; as well as Based on the updated connection information set, the connection information in the updated connection information set and the multiple updated multimedia information are played according to the updated playing order.

6. The method according to claim 1, wherein generating connection information corresponding to the multimedia information comprises: Obtaining guidance information for a target model based on content attributes of the multimedia information and associated reference information corresponding to the multimedia information; as well as The guide information is input into the target model to obtain connection information output by the target model.

7. The method according to claim 1, wherein playing the connection information in the connection information set and the plurality of multimedia messages comprises: Converting the connection information in the connection information set into at least one audio; as well as The at least one audio and the plurality of multimedia information are played in the play order.

8. The method according to claim 1, wherein before the step of playing the connection information in the connection information set and the plurality of multimedia messages in the playing order, the method further comprises: Playing the leading information for the plurality of multimedia information, wherein the leading information is preset or generated based on the plurality of multimedia information.

9. The method according to claim 1, wherein after the step of obtaining the connection information set, the method further comprises: If it is detected that at least two multimedia messages meet a preset condition, based on the connection information corresponding to the at least two multimedia messages, combined connection information is generated to update the connection information set, the combined connection information is used to be played before the at least two multimedia messages, the multiple multimedia messages have an arrangement order, and the preset condition includes that the at least two multimedia messages are adjacent in the arrangement order, and / or If it is detected that the connection information set contains second connection information, the second connection information is removed from the connection information set to update the connection information set, wherein the quality of the second connection information is lower than a threshold, and the quality of the connection information reflects the degree of association of the multimedia information corresponding to the connection information description.

10. A device for information playback, comprising: a content and information acquisition module configured to acquire multimedia information and associated reference information corresponding to the multimedia information; a connection information generating module configured to generate connection information corresponding to each multimedia message based on content attributes of the multimedia message and associated reference information corresponding to the multimedia message, wherein the content attributes are associated with the content of the multimedia message; An information set determining module is configured to obtain a connection information set based on connection information corresponding to a plurality of multimedia information, wherein the connection information in the connection information set has a playback order; as well as The information playing module is configured to play the connection information in the connection information set and the plurality of multimedia information in the play order based on the connection information set.

11. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 9 when executed by the at least one processing unit.

12. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 9.

Images