A multimedia information processing method and device, electronic equipment and storage medium

Abstract

The application provides a multimedia information processing method and device, electronic equipment and storage medium, the method comprises the following steps: obtaining corresponding playing configuration information in a multimedia information playing environment; based on the playing configuration information, configuring a corresponding test interface for a playing strategy adjustment process of the multimedia information, and configuring a matching topology file for the playing strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playing configuration information through the topology file; and dynamically adjusting the playing strategy of the multimedia information through the playing strategy adjustment process according to the playing effect parameter and the playing configuration information of the multimedia information. The application can reduce the repeated exposure of the already exposed multimedia information to the user in a short time, reduce the delivery cost of the multimedia information, improve the effectiveness of the freshness strategy, improve the user experience, diversify the playing form of the multimedia information, and meet the use requirements of different users.

Description

Technical Field

[0001] This invention relates to multimedia information generation technology, and more particularly to a multimedia information processing method, apparatus, electronic device, and storage medium. Background Technology

[0002] In related technologies, advertisements can be inserted at the beginning or end of a video during ad delivery. Ad freshness strategy is a control strategy to prevent users from repeatedly exposing the same or similar ads in a short period, thus protecting user experience. Currently, manual traffic allocation is generally used. This involves manually observing the performance metrics of each sub-traffic item under the current traffic allocation ratio within a certain time period, then selecting the best-performing sub-traffic item and increasing its traffic ratio in the next observation period. The drawbacks are high labor costs, low allocation efficiency, and susceptibility to subjective factors. Alternatively, dynamic adjustment based on batch processing can be used. This involves sampling and accumulating traffic in batches; then, based on the performance data of each sub-traffic item in the current time period, the Thompson sampling method in the MAB algorithm is applied to determine the proportion allocation of each sub-traffic item in the next time period. The drawbacks of this approach are that the allocation results are prone to fluctuations, the allocation differences may be insignificant, and the algorithm has poor transferability. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a multimedia information processing method, apparatus, electronic device, and storage medium, which can reduce the labor costs in the traffic allocation process, improve the efficiency of traffic allocation, reduce allocation fluctuations, make the traffic allocation after the adjustment of the multimedia information playback strategy more significant, reduce the delivery cost of multimedia information, improve the effectiveness of the freshness strategy, enhance the user experience, diversify the playback forms of multimedia information, and meet the usage needs of different users.

[0004] The technical solution of this invention is implemented as follows:

[0005] This invention provides a multimedia information processing method, including:

[0006] Obtain the corresponding playback configuration information in the multimedia information playback environment;

[0007] Based on the playback configuration information, configure a corresponding test interface for the multimedia information playback strategy adjustment process;

[0008] In response to the configured test interface, a matching topology file is configured for the playback strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playback configuration information through the topology file;

[0009] The playback effect parameters of the multimedia information are obtained by adjusting the playback strategy process.

[0010] Based on the playback effect parameters and playback configuration information of the multimedia information, the playback strategy adjustment process is used to determine the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information.

[0011] Based on the traffic parameters matched to the playback strategy of the multimedia information and the iterative experimental parameters, the playback strategy of the multimedia information is dynamically adjusted.

[0012] This invention also provides a multimedia information processing device, the device comprising:

[0013] The information transmission module is used to transmit corresponding playback configuration information in the multimedia information playback environment.

[0014] The information processing module is used to configure a corresponding test interface for the playback strategy adjustment process of the multimedia information based on the playback configuration information.

[0015] The information processing module is used to respond to the configured test interface and configure a matching topology file for the playback strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playback configuration information through the topology file.

[0016] The information processing module is used to obtain the playback effect parameters of the multimedia information through the playback strategy adjustment process.

[0017] The information processing module is used to determine the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information by adjusting the process according to the playback effect parameters and playback configuration information of the multimedia information and the playback strategy adjustment process.

[0018] Based on the traffic parameters matched to the playback strategy of the multimedia information and the iterative experimental parameters, the playback strategy of the multimedia information is dynamically adjusted.

[0019] In the above scheme,

[0020] The information transmission module is used to monitor the operation information in the playback configuration display interface;

[0021] The information transmission module is used to determine the triggering state of different control components in the display interface in response to the monitored operation information. The different control components in the display interface include: a strategy indicator component, a strategy type component, a strategy name component, and an iteration time component.

[0022] In the above scheme,

[0023] The information processing module is used to determine the version information of the topology file;

[0024] The information processing module is used to obtain multimedia information playback effect data corresponding to the version information of the topology file;

[0025] The information processing module is used to perform accumulation processing on different types of playback effect data when the playback effect data of the multimedia information is playback effect data with an accumulative dimension, and obtain the playback effect parameters of the multimedia information.

[0026] The information processing module is used to determine a calculation factor that matches the non-accumulative dimension of the playback effect data when the playback effect data of the multimedia information is non-accumulative dimension playback effect data, and to perform accumulation processing on the calculation factor to obtain the playback effect parameters of the multimedia information.

[0027] In the above scheme,

[0028] The information processing module is used to determine the playback strategy of the corresponding multimedia information based on the version information of the topology file;

[0029] The information processing module is used to determine the optimization target data of the multimedia information based on the playback effect parameters and playback strategy of the multimedia information.

[0030] The information processing module is used to determine the traffic parameters and iterative experimental parameters that match the playback strategy of the multimedia information by adjusting the process through the playback strategy and the optimization target data of the multimedia information, wherein the experimental parameters match the corresponding playback strategy.

[0031] In the above scheme,

[0032] The information processing module is used to dynamically adjust the range of traffic parameters of the multimedia information playback environment through the test interface, based on the exposure count matched by the determined multimedia information playback strategy and the iterative experimental parameters.

[0033] In the above scheme,

[0034] The information processing module is used to send the determined traffic parameters, iterative experiment parameters, and historical adjustment information of the range of the determined multimedia information playback strategy to the corresponding server.

[0035] The information processing module is used to display the playback strategy matching flow parameters, iterative experiment parameters, and historical adjustment information of the range of the flow parameters in the display interface when a playback strategy query instruction is received.

[0036] In the above scheme,

[0037] The information processing module is used to monitor the exposure parameters of the short video when the multimedia information is embedded advertising information in the short video.

[0038] The information processing module is used to determine the Manron visual effect index corresponding to the embedded advertising information based on the exposure parameters of the short video.

[0039] The information processing module is used to adjust the playback configuration information corresponding to the embedded advertising information in the short video through the topology file based on the Manron visual effect index corresponding to the embedded advertising information.

[0040] In the above scheme,

[0041] The information processing module is used to send the exposure parameters of the short video during playback to the monitoring server, so that the monitoring server can monitor the exposure of the short video.

[0042] The information processing module is used to use the exposure parameters of short video playback stored on the monitoring server as the data source for the playback effect parameters of multimedia information.

[0043] In the above scheme,

[0044] The information processing module is used to determine the usage environment of the terminal display interface;

[0045] The information processing module is used to determine the category of multimedia information to be played based on the usage environment of the terminal display interface.

[0046] The information processing module is used to respond to the category of the multimedia information to be played, trigger a matching multimedia information data source, so as to adjust the multimedia information to be played by a multimedia information data source that matches the category of the multimedia information to be played.

[0047] In the above scheme,

[0048] The information processing module is used to send multimedia information identifiers, playback configuration information, and playback strategies to the blockchain network, so that...

[0049] The nodes of the blockchain network fill the multimedia information identifier, playback configuration information, and playback strategy into a new block, and when there is consensus on the new block, the new block is appended to the end of the blockchain.

[0050] In the above scheme,

[0051] The information processing module is used to receive data synchronization requests from other nodes in the blockchain network;

[0052] The information processing module is used to verify the permissions of the other nodes in response to the data synchronization request.

[0053] The information processing module is used to control the current node to synchronize data with the other nodes when the permissions of the other nodes are verified, so that the other nodes can obtain multimedia information identifiers, playback configuration information and playback strategies.

[0054] In the above scheme,

[0055] The information processing module is used to respond to a query request and parse the query request to obtain the corresponding object identifier;

[0056] The information processing module is used to obtain permission information within the target block in the blockchain network based on the object identifier.

[0057] The information processing module is used to verify the matching between the permission information and the object identifier;

[0058] The information processing module is used to obtain the corresponding multimedia information identifier, playback configuration information and playback strategy in the blockchain network when the permission information matches the object identifier.

[0059] The information processing module is used to respond to the query command by pushing the obtained multimedia information identifier, playback configuration information and playback strategy to the corresponding client, so as to enable the client to obtain the corresponding multimedia information identifier, playback configuration information and playback strategy stored in the blockchain network.

[0060] This invention also provides an electronic device, the electronic device comprising:

[0061] Memory, used to store executable instructions;

[0062] A processor, when executing executable instructions stored in the memory, implements a preceding multimedia information processing method.

[0063] This invention also provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implement a preceding multimedia information processing method.

[0064] The embodiments of the present invention have the following beneficial effects:

[0065] This invention obtains corresponding playback configuration information in a multimedia information playback environment; based on the playback configuration information, it configures a corresponding test interface for the multimedia information playback strategy adjustment process; responding to the configured test interface, it configures a matching topology file for the multimedia information playback strategy adjustment process, thereby obtaining dynamically adjusted playback configuration information through the topology file; it obtains playback effect parameters of the multimedia information through the playback strategy adjustment process; based on the playback effect parameters and playback configuration information of the multimedia information, it determines the traffic parameters and iterative experimental parameters matching the multimedia information playback strategy through the playback strategy adjustment process; and it dynamically adjusts the playback strategy of the multimedia information based on the traffic parameters matching the multimedia information playback strategy and the iterative experimental parameters. This reduces manpower costs in the traffic allocation process, improves the efficiency of traffic allocation, reduces allocation fluctuations, makes the traffic allocation after the multimedia information playback strategy adjustment more significant, reduces the cost of multimedia information delivery, improves the effectiveness of the freshness strategy, enhances the user experience, diversifies the playback format of multimedia information, and meets the needs of different users. Attached Figure Description

[0066] Figure 1 This is a schematic diagram illustrating a usage scenario of the multimedia information processing method provided in an embodiment of the present invention;

[0067] Figure 2 This is a schematic diagram of the composition structure of the multimedia information processing device provided in an embodiment of the present invention;

[0068] Figure 3 An optional flowchart illustrating the multimedia information processing method provided in an embodiment of the present invention;

[0069] Figure 4 An optional flowchart illustrating the multimedia information processing method provided in an embodiment of the present invention;

[0070] Figure 5 This is a schematic diagram of the topology of the multimedia information processing process provided in the embodiments of the present invention;

[0071] Figure 6A A schematic flowchart of an optional multimedia information processing method provided in an embodiment of the present invention;

[0072] Figure 6B A schematic diagram illustrating an optional display effect of the multimedia information processing method provided in an embodiment of the present invention;

[0073] Figure 7 A schematic flowchart of an optional multimedia information processing method provided in an embodiment of the present invention;

[0074] Figure 8 This is a schematic diagram of the architecture of the multimedia information processing device 100 provided in an embodiment of the present invention;

[0075] Figure 9 This is a schematic diagram of the blockchain structure in the blockchain network 700 provided in this embodiment of the invention;

[0076] Figure 10 This is a functional architecture diagram of the blockchain network 700 provided in an embodiment of the present invention;

[0077] Figure 11 This is a schematic diagram of an optional multimedia information playback in an embodiment of the present invention;

[0078] Figure 12 A schematic flowchart of an optional multimedia information processing method provided in an embodiment of the present invention;

[0079] Figure 13 This is a schematic diagram of an optional multimedia information playback in an embodiment of the present invention;

[0080] Figure 14 This is a schematic diagram of an optional multimedia information playback in an embodiment of the present invention. Detailed Implementation

[0081] To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on the present invention. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0082] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0083] Before providing a further detailed description of the embodiments of the present invention, the nouns and terms involved in the embodiments of the present invention will be explained, and the nouns and terms involved in the embodiments of the present invention shall be interpreted as follows.

[0084] In the implementation of this application, the collection and processing of relevant data should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.

[0085] 1) The Manron Visual Effect Index (VIS) specifically includes: 1. Minimum Exposure: The exposure time must be longer than 1 second. 2. Visibility of Multimedia Information: The proportion of embedded multimedia information displayed on the screen must be higher than a preset threshold. This threshold consists of the threshold values ​​for the initial exposure and subsequent exposures. 3. Sharpness: The sharpness must be higher than a preset threshold (sharpness threshold). Different screen sizes will have different preset values. Specifically, the Visual Effect Index (VIS) of the corresponding multimedia information can be calculated based on the following parameters:

[0086] The parameters include the proportion of the exposure size to the screen, the salience parameter (the visibility of the embedded brand in the scene and environment), and the proximity parameter (the proximity of the brand to the main activity / object in the scene).

[0087] 2) In response, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0088] 3) "Product placement" involves embedding product or brand information into video content in the form of a physical object, an image, or a video clip to leave a brand impression on the audience and achieve marketing objectives. The "advertisement" is presented as multimedia information, including but not limited to images, text, video, and audio. Product placement is hidden within and integrated with the medium, while the advertising information is carefully encoded using non-advertising methods, allowing the audience to unconsciously perceive the product and brand information, thus receiving the advertising stimulus. Because the audience receives the advertisement in a non-confrontational state, this advertising effect cannot be achieved by ordinary advertising.

[0089] 4) Terminals, including but not limited to: ordinary terminals and dedicated terminals, wherein the ordinary terminals maintain a long connection and / or a short connection with the transmission channel, and the dedicated terminals maintain a long connection with the transmission channel.

[0090] 5) Transaction, equivalent to the computer term "transaction", includes operations that need to be submitted to the blockchain network for execution. It does not refer solely to transactions in a business context. Given that the term "transaction" is conventionally used in blockchain technology, this embodiment of the invention follows this convention.

[0091] 6) Blockchain is an encrypted, chain-like storage structure for transactions formed by blocks.

[0092] 7) A blockchain network is a collection of nodes that incorporate new blocks into a blockchain through consensus.

[0093] 8) Ledger is a collective term for blockchain (also known as ledger data) and the state database synchronized with the blockchain.

[0094] 9) Smart Contracts, also known as chaincode or application code, are programs deployed in nodes of a blockchain network. Nodes execute smart contracts called in received transactions to update or query key-value pairs in the state database.

[0095] 10) Consensus is a process in a blockchain network used to reach an agreement on transactions in a block among multiple involved nodes. A block that reaches an agreement is appended to the end of the blockchain. Mechanisms for achieving consensus include Proof of Work (PoW), Proof of Stake (PoS), Delegated Proof-of-Stake (DPoS), and Proof of Elapsed Time (PoET).

[0096] 11) Client: A carrier in a terminal that implements specific functions. For example, a mobile client (APP) is a carrier of specific functions in a mobile terminal, such as performing online live streaming or playing online videos.

[0097] 12) Exposure: When the valid conditions are met, push the corresponding multimedia information to the user, or let the user choose to watch it. For example, when the conditions for pushing videos are met, push different videos to the user for the user to watch.

[0098] 13) MAB: Multi-armed Bandit. A classic problem in statistics: A gambler wants to play a slot machine. There is a row of slot machines that look exactly the same, but each machine has a different probability of paying out money. The gambler does not know the probability distribution of each machine. So how should he choose which machine to play each time to maximize his winnings? This is the multi-armed bandit problem, and the corresponding algorithm is the multi-armed bandit algorithm.

[0099] 14) A / B Testing: A method for testing the difference in effectiveness before and after applying a new strategy to a target group. In recommendation advertising scenarios, the target group can be a set of requests, users, or ads, etc., and the effectiveness can be statistical metrics that the system and platform focus on, including impressions, clicks, and spend. The target group is randomly sampled into mutually exclusive experimental and control groups. The control group remains unchanged, while the experimental group is given the new strategy. Finally, the differences in effectiveness metrics between the experimental and control groups are compared.

[0100] 15) Traffic: In this invention, traffic refers to a collection of elements with common characteristics that are continuously generated over time. In the context of recommendation advertising, request sets, user sets, and ad sets can all be considered as traffic because they continuously generate new elements over time.

[0101] 16) Traffic Allocation: Allocation refers to dividing traffic into several sub-traffic segments according to certain rules and for a specific purpose, so that different strategies or other processing can be applied to different sub-traffic segments in subsequent stages. In recommendation advertising scenarios, the purpose of traffic allocation is generally twofold: one is to test the differences between different strategies applied to different sub-traffic segments; the other is to maximize the overall effectiveness of the traffic, which may include common advertising performance metrics such as click-through rate and conversion rate.

[0102] 17) Dynamic traffic adjustment: Dynamic adjustment refers to the automatic allocation of traffic based on a certain algorithm without human intervention, for the purpose of traffic allocation.

[0103] Figure 1 This is a schematic diagram illustrating a usage scenario of the multimedia information processing method provided in an embodiment of the present invention. (See attached diagram.) Figure 1 The terminals (including terminals 10-1 and 10-2) are equipped with corresponding clients capable of playing embedded multimedia information. The terminals connect to server 200 via network 300, which can be a wide area network (WAN), a local area network (LAN), or a combination of both. Data transmission is achieved using a wireless link. The multimedia information includes, but is not limited to, videos, images, GIF animations, and advertising information. The types of multimedia information obtained by the terminals (including terminals 10-1 and 10-2) from the corresponding server 200 via network 300 can be the same or different. For example, the terminals (including terminals 10-1 and 10-2) can obtain video advertisements or image advertisements placed by advertisers from the corresponding server 200 via network 300. The specific types are not limited in this application. Server 200 can store different multimedia information, including advertising multimedia information in different dynamic formats, such as GIF, MP4, and MOV.

[0104] During the process of the terminal (terminal 10-1 and / or terminal 10-2) obtaining and displaying the corresponding service with embedded multimedia information from the server 200 via the network 300, the user can perform different operations on the multimedia information presented in the multimedia information playback window through the terminal (terminal 10-1 and / or terminal 10-2), resulting in different user behaviors. For example, when the multimedia information is a video advertisement, the user can share and / or like the exposed short video while watching the information, or click on it. When the multimedia information is a dynamic GIF advertisement, during the exposure of the advertisement through the terminal (terminal 10-1 and / or terminal 10-2), the user can forward and / or comment on the advertisement, or jump to the corresponding product purchase link page through the GIF advertisement.

[0105] As an example, when server 200 determines which multimedia information to recommend for playback to user's terminal 10-1 or 10-2, it needs to adjust the multimedia information to be played in a timely manner. For example, it may replace any multimedia information in the set to be played to adapt to the viewing needs of different target users. This could be achieved by obtaining the corresponding playback configuration information in the multimedia information playback environment. Based on the playback configuration information, a corresponding test interface is configured for the multimedia information playback strategy adjustment process. In response to the configured test interface, a matching topology file is configured for the multimedia information playback strategy adjustment process to obtain dynamically adjusted playback configuration information through the topology file. The playback effect parameters of the multimedia information are obtained through the playback strategy adjustment process. Based on the playback effect parameters and playback configuration information, the traffic parameters and iterative experimental parameters matching the multimedia information playback strategy are determined through the playback strategy adjustment process. Based on the traffic parameters and iterative experimental parameters matching the multimedia information playback strategy, the playback strategy of the multimedia information is dynamically adjusted.

[0106] The structure of the multimedia information processing device according to an embodiment of the present invention will be described in detail below. The multimedia information processing device can be implemented in various forms, such as a dedicated terminal with multimedia information processing function, or a server equipped with multimedia information processing function, for example, the preceding... Figure 1 Server 200 in the middle. Figure 2 This is a schematic diagram of the composition structure of the multimedia information processing device provided in the embodiments of the present invention. It can be understood that... Figure 2 The diagram shows only an exemplary structure of the multimedia information processing device, not the entire structure; implementation is possible as needed. Figure 2 The structure shown may be part or all of the structure.

[0107] The multimedia information processing apparatus provided in this embodiment of the invention includes at least one processor 201, a memory 202, a user interface 203, and at least one network interface 204. The various components in the multimedia information processing apparatus are coupled together via a bus system 205. It can be understood that the bus system 205 is used to realize the connection and communication between these components. In addition to a data bus, the bus system 205 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 2 The general labeled all buses as Bus System 205.

[0108] The user interface 203 may include a monitor, keyboard, mouse, trackball, click wheel, buttons, touchpad, or touch screen.

[0109] It is understood that memory 202 can be volatile memory or non-volatile memory, or both. In this embodiment of the invention, memory 202 is capable of storing data to support the operation of a terminal (such as 10-1). Examples of this data include any computer programs used to operate on the terminal (such as 10-1), such as operating systems and applications. The operating system includes various system programs, such as process layers, core library layers, driver layers, etc., used to implement various basic services and handle hardware-based tasks. Applications can include various applications.

[0110] In some embodiments, the multimedia information processing apparatus provided in this invention can be implemented using a combination of hardware and software. For example, the multimedia information processing method apparatus provided in this invention can be a processor in the form of a hardware decoding processor, which is programmed to execute the multimedia information processing method provided in this invention. For instance, the processor in the form of a hardware decoding processor can employ one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0111] As an example of the multimedia information processing device provided in this embodiment of the invention, which is implemented by combining software and hardware, the multimedia information processing device provided in this embodiment of the invention can be directly embodied as a combination of software modules executed by processor 201. The software modules can be located in a storage medium, which is located in memory 202. Processor 201 reads the executable instructions included in the software modules in memory 202 and combines them with necessary hardware (e.g., including processor 201 and other components connected to bus system 205) to complete the multimedia information processing method provided in this embodiment of the invention.

[0112] As an example, processor 201 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., wherein the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0113] As an example of the hardware implementation of the multimedia information processing device provided in the embodiments of the present invention, the device provided in the embodiments of the present invention can be directly executed by a processor 201 in the form of a hardware decoding processor. For example, it can be executed by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components to implement the multimedia information processing method provided in the embodiments of the present invention.

[0114] The memory 202 in this embodiment of the invention is used to store various types of data to support the operation of the multimedia information processing device. Examples of such data include: any executable instructions for operation on the multimedia information processing device, such as executable instructions that can be included in a program implementing the multimedia information processing method of this embodiment of the invention.

[0115] In other embodiments, the multimedia information processing apparatus provided in this invention can be implemented in software. Figure 2A multimedia information processing device stored in memory 202 is shown. This device can be software in the form of programs and plugins, and includes a series of modules. As an example of a program stored in memory 202, it may include the multimedia information processing device itself. The multimedia information processing device includes the following software modules: an information transmission module 2081 and an information processing module 2082. When the software modules in the multimedia information processing device are read into RAM and executed by processor 201, the multimedia information processing method provided in this embodiment of the invention will be implemented. The functions of each software module in the multimedia information processing device will be further described below.

[0116] The information transmission module 2081 is used for the corresponding playback configuration information in the multimedia information playback environment.

[0117] The information processing module 2082 is used to configure a corresponding test interface for the playback strategy adjustment process of the multimedia information based on the playback configuration information.

[0118] The information processing module 2082 is used to respond to the configured test interface and configure a matching topology file for the playback strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playback configuration information through the topology file.

[0119] The information processing module 2082 is used to obtain the playback effect parameters of the multimedia information through the playback strategy adjustment process.

[0120] The information processing module 2082 is used to determine the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information by adjusting the process through the playback strategy, based on the playback effect parameters and playback configuration information of the multimedia information.

[0121] The information processing module 2082 is used to dynamically adjust the playback strategy of the multimedia information based on the traffic parameters and iterative experimental parameters of the playback strategy matching of the multimedia information.

[0122] according to Figure 2 In one aspect of this application, the multimedia information processing apparatus also provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. The processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform various embodiments and combinations of embodiments provided in the various optional implementations of the multimedia information processing method described above.

[0123] The server in this embodiment of the invention can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal and server can be directly or indirectly connected via wired or wireless communication, and this application does not impose any limitations on this.

[0124] In some embodiments of the present invention, terminal 110, traffic terminal 120, multimedia information system 130 and distributed cloud storage system 140 can all be node devices in the blockchain system, which can share the acquired and generated information with other node devices in the blockchain system, thereby realizing information sharing among multiple node devices.

[0125] This invention can also achieve multimedia information exposure control based on cloud technology. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form a resource pool, be used on demand, and is flexible and convenient. Cloud computing technology will become an important support. Cloud computing refers to the delivery and use model of IT infrastructure, which means obtaining the required resources through the network in an on-demand and easily scalable manner; in a broader sense, cloud computing refers to the delivery and use model of services, which means obtaining the required services through the network in an on-demand and easily scalable manner. Such services can be IT and software, Internet-related, or other services. Cloud computing is a product of the development and integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balancing. With the development of the Internet, real-time data streams, and the diversification of connected devices, as well as the demand for search services, social networks, mobile commerce, and open collaboration, cloud computing has developed rapidly. Unlike previous parallel and distributed computing, the emergence of cloud computing will drive a revolutionary change in the entire Internet model and enterprise management model from a conceptual perspective.

[0126] Cloud storage is a new concept that extends and develops from cloud computing. A distributed cloud storage system (hereinafter referred to as a storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to aggregate a large number of storage devices of various types (storage devices are also called storage nodes) in a network to work together through application software or application interfaces to provide data storage and business access functions. Currently, the storage method of a storage system is as follows: create logical volumes. When creating a logical volume, physical storage space is allocated to each logical volume. This physical storage space may be composed of disks from one or several storage devices. When a client stores data on a logical volume, it stores the data on the file system. The file system divides the data into many parts, each part being an object. The object contains not only data but also additional information such as data identifiers (ID, ID entity). The file system writes each object to the physical storage space of the logical volume and records the storage location information of each object. Therefore, when a client requests access to data, the file system can allow the client to access the data based on the storage location information of each object. The process by which a storage system allocates physical storage space to a logical volume is as follows: the physical storage space is pre-divided into strips according to the capacity estimate of the objects stored in the logical volume (this estimate often has a large margin relative to the actual capacity of the objects to be stored) and the grouping of Redundant Array of Independent Disks (RAID). A logical volume can be understood as a strip, thus allocating physical storage space to the logical volume.

[0127] When multimedia information is an advertisement, server 200 sends the corresponding advertising information to terminals (terminal 10-1 and / or terminal 10-2) via network 300 to enable users of terminals (terminal 10-1 and / or terminal 10-2) to browse this multimedia information. In this process, feed advertising, due to its advantages such as being embedded in the information stream and allowing for unlimited scrolling with content, has become the mainstream form of mobile advertising. However, in the advertising process, the advertiser is the initiator of the advertising campaign, a merchant selling or promoting their products and services online. Any merchant promoting or selling their products or services can act as an advertiser. The advertiser publishes the advertising campaign and pays the website owner according to the total number of marketing results and the unit price per result as stipulated in the advertising campaign completed by the advertising platform. Advertisers can set optimization goals in the advertising campaign, such as mobile application downloads, activations, or payments, as well as the conversion cost they are willing to pay for the optimization goals. The advertising platform automatically bids when exposure opportunities exist, making the actual conversion cost of the advertisement close to the advertiser's expected conversion cost.

[0128] When configuring playback strategies to allocate traffic, manual traffic allocation is generally used. This involves manually observing the performance metrics of each sub-traffic stream under the current traffic allocation ratio within a certain time period, then selecting the best-performing sub-traffic stream and increasing its traffic ratio in the next observation period. The drawbacks are high labor costs, low allocation efficiency, and susceptibility to subjective factors. Alternatively, dynamic adjustment based on batch processing can be used. This involves sampling and accumulating traffic in batches; then, based on the performance data of each sub-traffic stream in the current time period, the Thompson sampling method in the MAB algorithm is applied to determine the proportion allocation of each sub-traffic stream in the next time period. The drawbacks of this approach are that the allocation results are prone to fluctuations, the allocation differences may be insignificant, and the algorithm has poor transferability.

[0129] To solve the above problems, combined with Figure 2 The server 200 shown illustrates the multimedia information processing method provided in this embodiment of the invention. See also: Figure 3 , Figure 3 This is an optional flowchart illustrating a multimedia information processing method provided in an embodiment of the present invention. It can be understood that... Figure 3 The steps shown can be performed by various electronic devices running multimedia information processing devices, such as dedicated terminals, electronic devices, or clusters of electronic devices with multimedia information processing capabilities. The following section addresses... Figure 3 The steps shown are explained.

[0130] Step 301: The multimedia information processing device obtains the corresponding playback configuration information in the multimedia information playback environment.

[0131] Among them, at least one multimedia information playback window can be set in the multimedia information display interface of the terminal to play various types of multimedia information, such as playing advertising information from different advertisers at the same time.

[0132] refer to Figure 4 , Figure 4 This is a schematic diagram illustrating multimedia information playback adjustment in an embodiment of the present invention. In some embodiments of the present invention, obtaining the corresponding playback configuration information in the multimedia information playback environment can be achieved in the following ways:

[0133] The system monitors operation information displayed in the playback configuration interface; in response to the monitored operation information, it determines the triggering state of different control components in the display interface, including: a strategy indicator component, a strategy type component, a strategy name component, and an iteration time component. Taking multimedia information as an example, when configuring ad traffic offline, the ad experiment system is an evaluation system built for ad recommendation platforms based on A / B testing and applying statistical principles to examine the effect and impact of new strategies on the platform. The ad experiment system is primarily aimed at ad platform developers. Developers configure experimental information through the front end of the experiment system, setting several experimental groups and parameters, and simultaneously develop experimental logic for each parameter value in the ad platform system (such as using different algorithms or strategies for different parameter values). The experiment system then groups experiments based on certain elements (such as requests, users, or ads), applies different parameter values ​​to different experimental groups, and triggers the experimental logic to operate online. Finally, the impact of the strategy on the platform is evaluated and analyzed by offline statistical analysis of the effects of each experimental group. In the ad experiment system, classic A / B testing is typically used to evaluate and analyze the effectiveness of the strategy. This method is characterized by its simplicity and ease of implementation; however, its disadvantages include a long experimental cycle, typically requiring a considerable amount of data accumulation to determine the effectiveness of each experimental group; and a fixed allocation ratio for experimental traffic, necessitating manual adjustment of the traffic range when increasing traffic for experiments with better performance. In the experiment information configuration page, an "Auto-Adjustment" switch is added. When enabled, four options are available: "Strategy Indicator," "Strategy Type," "Strategy Name," and "Iteration Time," which specify the effectiveness indicator of the algorithm optimization, the object of automatic adjustment, the specific algorithm applied, and the algorithm iteration cycle, respectively. By acquiring this configuration information, the dynamic adjustment process of the multimedia information processing server can initiate the dynamic adjustment process to dynamically adjust the experimental traffic for the experiment.

[0134] Step 302: Based on the playback configuration information, the multimedia information processing device configures a corresponding test interface for the multimedia information playback strategy adjustment process.

[0135] To dynamically adjust the playback strategy to adapt to different playback environments based on the traffic parameters matched to the multimedia information playback strategy and the iterative experimental parameters, the system can obtain information on whether the corresponding interface and component information in the query information of the program framework supports the test programs in the playback strategy adjustment process set (where the test programs in the playback strategy adjustment process can perform corresponding traffic allocation tests through the multi-armed gambling machine algorithm). This allows the system to obtain the adaptation status of the interface and component information, so that when generating the adaptation parameter list later, the corresponding interface and component information can be added to obtain a more comprehensive adaptation parameter list for easier use. When configuring the test interface, it can include UI automation test information and listening interface parameters. The UI automation test information includes the name, path, or method information of the UI automation project (or script) being called; the listening interface parameters include: the interface address to be monitored (such as the packet capture domain name / IP path), the interface parameter assignment and its assignment code, and the value range, etc.

[0136] Therefore, after determining the program framework information of the playback strategy adjustment process, a corresponding set of test programs is determined, and the playback strategy of multimedia information is iteratively tested using this set of test programs. The test results are obtained, an adaptation parameter list is generated, and finally, an adaptation parameter list containing program framework information is output. This allows for the determination of the adaptability of the dynamically adjusted multimedia information playback strategy to different playback environments based on the adaptation parameter list. This not only improves the efficiency of multimedia information processing but also allows for flexible adjustment of the triggered interfaces according to the playback environment, enabling the multimedia information processing method provided in this application to adapt to more types of playback environments.

[0137] In some embodiments of the present invention, the usage environment of the terminal display interface can be determined; based on the usage environment of the terminal display interface, the category of multimedia information to be played can be determined; in response to the category of the multimedia information to be played, a matching multimedia information data source is triggered, so as to adjust the multimedia information to be played by using a multimedia information data source that matches the category of the multimedia information to be played. Thus, taking multimedia information as an example of advertising, game advertisements can be selected in a game video playback interface, and product advertisements can be selected in a TV series playback environment, making advertising exposure more targeted.

[0138] Step 303: The multimedia information processing device responds to the configured test interface and configures a matching topology file for the multimedia information playback strategy adjustment process.

[0139] The topology file matching the multimedia information playback strategy adjustment process configuration may include at least: topology structure information, topology data, and topology structure version information. The topology encapsulates the dynamic adjustment process logic of the multimedia information playback strategy. The topology structure information describes the node configuration status in any topology structure version. When dynamically adjusting the playback strategy, the dynamic adjustment experimental strategy framework can construct an experimental configuration topology from the experimental system database based on the topology structure version, and periodically save the topology data as a structured topology file. This allows the strategy framework to periodically obtain all experimental configuration information and filter out the dynamic adjustment experimental information, thereby achieving dynamic adjustment of the playback strategy. In some embodiments of the present invention… Figure 5 This is a schematic diagram of the topology of the multimedia information processing process provided in the embodiments of the present invention, such as... Figure 5 As shown, the nodes in the topology are divided into two categories: source nodes for playback data and worker nodes. Source nodes are the origin of the data streams in the topology. During dynamic adjustments within the dynamic adjustment experimental strategy framework, the source node reads a data stream from an external data source (the transmitted data stream may include topology version information and playback effect information) and then transmits the acquired topology data to the relevant nodes. A single source node can send multiple data streams. Worker nodes are responsible for data processing and other tasks. A version of the topology can consist of one or more source nodes and worker nodes. A source node can simultaneously send data to multiple worker nodes, and a worker node can also receive data from multiple source nodes or multiple worker nodes, ultimately forming multiple processed data streams. In addition to the connection relationships between the service nodes, the topology can also include port identifiers for the data read and sent by the dynamic adjustment experimental strategy framework. By reading the corresponding key-value pairs, the initial topology configured when creating the dynamic adjustment experimental strategy framework and the corresponding topology file can be rewritten, facilitating flexible adjustments based on different video playback environments.

[0140] Continue to refer to Figure 5 In some embodiments of the present invention, the playback effect parameters of the multimedia information are obtained through the playback strategy adjustment process, which can be achieved in the following ways:

[0141] The process involves determining the version information of the topology file; acquiring the playback effect data of multimedia information corresponding to the version information of the topology file; when the playback effect data of the multimedia information has an accumulative dimension, accumulating different types of playback effect data to obtain the playback effect parameters of the multimedia information; when the playback effect data of the multimedia information has a non-accumulative dimension, determining the calculation factor matching the non-accumulative dimension of the playback effect data, and accumulating the calculation factor to obtain the playback effect parameters of the multimedia information. Specifically, accumulative effect metrics (such as impressions, clicks, etc.) are directly accumulated, while non-accumulative effect metrics (such as click-through rate (CTR), conversion rate (CVR), etc.) are accumulated according to their calculation methods (e.g., conversion rate can be accumulated by adding clicks and conversions separately). In the dynamic adjustment strategy framework, Spark Streaming checkpoints record the cumulative effect value of the previous period, avoiding duplicate calculations through incremental accumulation.

[0142] When the multimedia information is an advertisement, given the diverse advertising scenarios, taking the WeChat Reading mini-program as an example, specifically, in response to the playback strategy adjustment process, at least one set of test interfaces can be triggered, forming multiple versions of test scenarios. The version information of the topology file in the WeChat Reading mini-program for the playback strategy adjustment process can be determined, and the version information of the corresponding topology file can be obtained according to different versions of the WeChat Reading mini-program. The order of the different test scenarios can then be adjusted to adapt to the test user attribute information. The WeChat Reading advertising environment includes H5 projects with a large number of e-books (e.g., e-books, e-novels). Each e-book in these H5 projects can correspond to a URL (Uniform Resource Locator) address. Each URL address can be used to access the target page (i.e., the H5 page) of a specific e-book. In the development and testing of the WeChat Reading mini-program, to test the compatibility of the target pages corresponding to these URLs on different devices, it is necessary to test the ad playback strategy in the WeChat Reading mini-program. In response to the mini-program testing process, at least one set of interfaces is triggered to simulate a test scenario where the user is a new reader. The WeChat Reading mini-program is then tested using corresponding test cases to obtain ad playback effect data. Alternatively, at least two interfaces can be triggered to form different test scenarios, respectively simulating the ad delivery test scenario for new readers, the ad delivery test scenario for existing users (ad exposure rate is adjusted based on a calculation factor matched with the user's historical data), and the test scenario for guest users.

[0143] Therefore, it is possible to obtain dynamically adjusted playback configuration information through the topology file.

[0144] Step 304: The multimedia information processing device obtains the playback effect parameters of the multimedia information through the playback strategy adjustment process.

[0145] Step 305: The multimedia information processing device determines the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information by adjusting the playback process according to the playback effect parameters and playback configuration information of the multimedia information.

[0146] Step 306: The multimedia information processing device dynamically adjusts the playback strategy of the multimedia information based on the traffic parameters matched by the playback strategy of the multimedia information and the iterative experimental parameters.

[0147] During adjustments, transitional multimedia information corresponding to the target user's browsing history can be identified. When the multimedia information to be played is not displayed on the terminal display interface, the transitional multimedia information is displayed on the terminal display interface. This transitional multimedia information can be keyframe animation or lottie animation, allowing users to interact with the information on the terminal display interface while simultaneously enjoying animated presentations to enhance engagement.

[0148] Continue to refer to Figure 6A See Figure 6A , Figure 6A This is an optional flowchart illustrating the multimedia information processing method provided in an embodiment of the present invention. It can be understood that... Figure 6A The steps shown can be performed by various terminals running multimedia information processing devices, such as dedicated terminals with multimedia information processing capabilities, electronic devices (mobile phones or tablets). The following steps are for... Figure 6A The steps shown are explained.

[0149] Step 601: Determine the playback strategy for the corresponding multimedia information based on the version information of the topology file.

[0150] Among them, reference Figure 6B Figure 6B This is a schematic diagram illustrating an optional display effect of the multimedia information processing method provided in an embodiment of the present invention, such as... Figure 6BAs shown, video advertisements can be played sequentially in windows 1, 2, and 3 according to the playback order of the multimedia information, using the index information of the multimedia information playback windows. Alternatively, the image frames of the same video advertisement can be divided into three parts and presented in windows 1, 2, and 3 respectively, so that the user can obtain complete multimedia information by viewing windows 1, 2, and 3. Furthermore, when the multimedia information is an advertisement, the terminal can obtain the video advertisement placed by the advertiser from the corresponding server 200 through network 30, or it can obtain the image advertisement placed by the advertiser from the corresponding server 200 through network 300. The specific type is not limited in this application. Server 200 can store different multimedia information, among which the multimedia information used as advertisement can be content in different dynamic formats, such as gif, mp4, mov, etc. By segmenting and adjusting the image frames of different dynamic format advertisement content, the number of advertisement content and multimedia information playback windows can be matched.

[0151] In some embodiments of the present invention, when the multimedia information played in the multimedia information playback window of a short video is a video advertisement, a trigger operation is received for the multimedia information playback window; in response to the trigger operation, the business processing interface is presented and jumps to the product display interface indicated by the multimedia information. As a result, users can more conveniently purchase the products presented in the multimedia information playback window. Through the multimedia information processing method provided in this application, when advertising is carried out, the traffic allocation after the adjustment of the multimedia information playback strategy can be more significant, while reducing the cost of multimedia information delivery and increasing the number of times users trigger the advertisements they watch.

[0152] Step 602: Based on the playback effect parameters and playback strategy of the multimedia information, determine the optimization target data of the multimedia information.

[0153] Step 603: Based on the playback strategy of the multimedia information and the optimized target data of the multimedia information, the process is adjusted through the playback strategy to trigger the multi-armed gambling machine algorithm.

[0154] In recommendation advertising scenarios, the goal is typically to select the most effective traffic through traffic comparison. Common advertising performance metrics include CTR, CVR, and actual spend, which can all be viewed as cumulative values ​​of basic metrics (impressions, clicks, conversions, etc.) or ratios of basic metrics. For ratio-based performance metrics, and considering the MAB algorithm, this paper creatively models the business meaning of the metrics in relation to "trial" and "return" in the MAB scenario. Taking multimedia information ads as an example, only after a user triggers the displayed ad will they be guided to browse or purchase a product, and only then can the advertiser obtain the ad's playback effect. Therefore, the use case of this test ad playback strategy can be transformed into "trial" and "return" in the MAB scenario.

[0155] Taking CTR as an example, it is defined as the number of clicks divided by the number of impressions, representing the probability of a click that an impression may generate. We can consider each sub-traffic under a given traffic flow as corresponding to multiple "playback strategies." An impression within a particular traffic flow is an "attempt" of that "playback strategy," and this attempt will yield a "reward" with a certain probability—this reward is a click. Impressions across multiple traffic flows represent attempts at multiple playback strategies. From this perspective, finding the traffic flow with the highest click-through rate while maximizing the overall click-through rate of all traffic flows during the search process is essentially the same as finding the playback strategy with the highest return on investment while maximizing the total return during the search process in the MAB (Multi-Advanced Marketing) scenario. The modeling process for ratio-based performance metrics such as CPM and CVR is also similar to that of CTR. Therefore, the relevant algorithms of MAB can be fully applied to these types of metrics.

[0156] In a live video streaming scenario, when multimedia information is played (e.g., advertising is displayed during a live video stream), the terminal can upload monitored advertising content and playback effects to the application programming interface (API) in real time via the client. This monitored content can include user-related information and monitoring data. For example, the user-related information could include user identifier, terminal IP address, terminal ISP, and network type. The monitored content can also include video quality data during live stream content generation and video quality data during live stream viewing. For example, the monitored content could also include the "attempt" and "benefit" of advertising playback as described in the previous embodiment. During the resolution of the live video's real server address, the multiple terminals can send content retrieval requests to the target service provider's node devices in the content delivery network via this API to obtain the specific URL (Uniform Resource Locator) webpage address.

[0157] However, automatic traffic adjustment also has its own unique characteristics. It typically doesn't select just one "playback strategy" (i.e., sub-traffic), but rather chooses multiple playback strategies based on probability, or allocates each sub-traffic according to a certain proportion. This differs somewhat from the general MAB algorithm. Therefore, the Soft Max function is used to transform the MAB algorithm. That is, for a given MAB algorithm, such as the upper bound confidence interval method, assuming the scores of each "playback strategy" output are xi, i=1,2,…N, then the probability (or allocation proportion) of selecting each playback strategy is referenced in Formula 1:

[0158] Formula 1

[0159] For some MAB algorithms, such as Soft Max MAB and Thompson sampling, different sample distributions can be obtained to adapt to different advertising environments. Since the output is the probability value of selecting each playback strategy, no further conversion is needed.

[0160] Step 604: Determine the traffic parameters and iterative experimental parameters that match the playback strategy of the multimedia information, wherein the experimental parameters are matched with the corresponding playback strategy.

[0161] Among them, the traffic parameters and iterative experiment parameters that match the playback strategy can come from different video recommendation systems, such as short video recommendation systems, to dynamically adjust the playback strategy so that the playback strategy is adapted to the short video playback environment. The traffic parameters and iterative experiment parameters can also come from advertising recommendation systems, so that advertisers can obtain the maximum advertising revenue through dynamic adjustment of advertising playback strategies.

[0162] In some embodiments of the present invention, the range of traffic parameters of the multimedia information playback environment can be dynamically adjusted through the test interface based on the exposure count matched by the determined multimedia information playback strategy and the iterative experimental parameters.

[0163] Commonly used MAB algorithms, including the upper bound of the confidence interval and Thompson sampling, all have a limitation: the return (or effect) must be within the interval [0, 1]. Some improved methods can also extend these methods to [a, b] (a, b are real numbers).

[0164] Soft Max MAB is a method applicable to the entire real number domain, and its calculation method is shown in formula (2). However, it has the following two problems: First, the output probability is affected by the absolute difference in effect, and the order of magnitude of the absolute difference in effect between different types of indicators is not consistent. For example, for CPM, a difference of 0.01 is not significant, while for CTR, a difference of 0.01 is already very large. Second, in advertising experiment scenarios, since the effect indicators of different playback strategies (sub-traffic) are usually very small, the probability difference of each playback strategy calculated by Soft Max MAB is also very small, resulting in the proportion of each sub-traffic being basically the same, making it difficult to eventually converge to a certain sub-traffic, as shown in formula 2.

[0165] Formula 2

[0166] Therefore, the Soft Max MAB was modified in two parts. First, the logarithm of the performance metrics was taken before being substituted into the Soft Max MAB to ensure that the output probability remained constant for metrics of different orders of magnitude with the same relative difference. Second, a convergence coefficient was introduced. Under the same relative difference, as the convergence coefficient increases, the output probability becomes more uneven, and the probability of a better playback strategy increases. The specific calculation method is shown in Formula 3.

[0167] Formula 3

[0168] refer to Figure 7 , Figure 7 This is an optional flowchart of the multimedia information processing method provided in this embodiment of the invention. The determined traffic parameters matching the playback strategy of the multimedia information, the iterative experimental parameters, and the historical adjustment information of the range of the traffic parameters can also be sent to the corresponding server. When a playback strategy query command is received, the traffic parameters matching the playback strategy of the multimedia information, the iterative experimental parameters, and the historical adjustment information of the range of the traffic parameters are displayed on the interface.

[0169] After adjusting the multimedia information to be played, when the multimedia information is embedded advertising information in a short video, the exposure parameters of the short video are monitored; the Manron visual effect index corresponding to the embedded advertising information is determined based on the exposure parameters of the short video; and the playback configuration information corresponding to the embedded advertising information in the short video is adjusted through the topology file based on the Manron visual effect index corresponding to the embedded advertising information. Specifically, if any parameter in the Manron visual effect index corresponding to the embedded multimedia information does not reach the corresponding parameter threshold, the playback of the target video can be adjusted, for example, by replacing the video to be embedded. For example, if the proportion of the embedded multimedia information displayed on the screen is lower than a preset proportion threshold of 0.1 (the ratio of multimedia information to the screen's surface value), the video to be embedded is replaced, and the corresponding multimedia information is re-embedded to ensure that the user to whom the multimedia information belongs can promptly push their multimedia information to the audience, thus ensuring the effectiveness of the multimedia information delivery.

[0170] In some embodiments of the present invention, the multimedia information processing method further includes:

[0171] The multimedia information identifier, playback configuration information, and playback strategy are sent to the blockchain network so that...

[0172] The nodes of the blockchain network fill the new block with multimedia information identifiers, playback configuration information, and playback strategies. When there is a consensus on the new block, the new block is appended to the end of the blockchain so that the terminal in different usage environments of the same user can obtain the information in the block. The identifier information is used to represent the multimedia information delivered by the advertiser.

[0173] See Figure 8 , Figure 8 This is a schematic diagram of the architecture of the multimedia information processing device 100 provided in the embodiment of the present invention, including a blockchain network 700 (consensus nodes 710-1, 710-2, and 710-3 are shown as examples), an authentication center 800, a business entity 400, and a business entity 500, which will be described below.

[0174] The types of blockchain networks 700 are flexible and diverse, including public, private, and consortium blockchains. For example, with a public blockchain, any business entity's electronic devices, such as user terminals and servers, can access the blockchain network 700 without authorization. With a consortium blockchain, after obtaining authorization, the electronic devices (such as terminals / servers) under a business entity can access the blockchain network 700, becoming client nodes within it.

[0175] In some embodiments, client nodes may act solely as observers of the blockchain network 700, providing support for business entities to initiate transactions (e.g., for storing data on-chain or querying on-chain data). For the consensus node functions of the blockchain network 700, such as sorting, consensus services, and ledger functions, client nodes may implement them by default or selectively (e.g., depending on the specific business needs of the business entity). This allows for the maximum migration of business entity data and business processing logic to the blockchain network 700, achieving trustworthiness and traceability of data and business processing through the blockchain network 700.

[0176] Consensus nodes in blockchain network 700 receive data from different business entities (e.g.) Figure 8 The client nodes of business entities 400 and 500 shown in the figure (e.g., Figure 8 The client node 410 belonging to the business entity 400 and the client node 510 belonging to the corresponding server (shown in the figure) submit transactions, execute transactions to update the ledger or query the ledger, and various intermediate or final results of the execution of transactions can be returned to the client node of the business entity for display.

[0177] For example, client nodes 410 / 510 can subscribe to events of interest in the blockchain network 700, such as transactions occurring in a specific organization / channel within the blockchain network 700. The consensus node then pushes the corresponding transaction notification to client nodes 410 / 510, thereby triggering the corresponding business logic in client nodes 410 / 510.

[0178] The following example illustrates an exemplary application of blockchain networks, using the scenario of multiple business entities accessing a blockchain network to manage and process multimedia information.

[0179] See Figure 8 The management process involves multiple business entities, such as business entity 400 (which may be a multimedia information processing device) and business entity 500 (which may be a display system with multimedia information display (operation) functions). Each entity registers with the certification center 800 to obtain its own digital certificate. The digital certificate includes the business entity's public key and a digital signature from the certification center 800 on the business entity's public key and identity information. This digital signature, along with the business entity's digital signature for the transaction, is attached to the transaction and sent to the blockchain network. The blockchain network retrieves the digital certificate and signature from the transaction to verify the message's reliability (i.e., whether it has been tampered with) and the identity information of the business entity that sent the message. The blockchain network verifies the identity, such as whether the entity has the authority to initiate the transaction. Clients running on electronic devices (e.g., terminals or servers) under the business entity can request access to the blockchain network 700 and become client nodes.

[0180] The client node 410 of the business entity 400 obtains the corresponding playback configuration information in the multimedia information playback environment; based on the playback configuration information, it configures a corresponding test interface for the multimedia information playback strategy adjustment process; in response to the configured test interface, it configures a matching topology file for the multimedia information playback strategy adjustment process to obtain dynamically adjusted playback configuration information through the topology file; it obtains the playback effect parameters of the multimedia information through the playback strategy adjustment process; based on the playback effect parameters and playback configuration information of the multimedia information, it determines the traffic parameters and iterative experiment parameters matching the playback strategy of the multimedia information through the playback strategy adjustment process; based on the traffic parameters and iterative experiment parameters matching the playback strategy of the multimedia information, it dynamically adjusts the playback strategy of the multimedia information; and it presents the corresponding multimedia information through the terminal display interface, sending the multimedia information identifier, playback configuration information, and playback strategy to the blockchain network 700.

[0181] The process of sending multimedia information identifiers, playback configuration information, and playback strategies to the blockchain network 700 can be pre-configured on the client node 410 using business logic. When corresponding multimedia information is generated, the client node 410 will automatically send the multimedia information identifiers, playback configuration information, and playback strategies to the blockchain network 700. Alternatively, business personnel from the business entity 400 can log in to the client node 410, manually package new multimedia information matching the usage environment, and send it to the blockchain network 700. During transmission, the client node 410 generates a corresponding update operation transaction based on the new multimedia information matching the usage environment. The transaction specifies the smart contract to be invoked to implement the update operation and the parameters to be passed to the smart contract. The transaction also carries the client node 410's digital certificate and a signed digital signature (e.g., obtained by encrypting the transaction digest using the private key in the client node 410's digital certificate), and broadcasts the transaction to the consensus nodes in the blockchain network 700.

[0182] When a consensus node in blockchain network 700 receives a transaction, it verifies the digital certificate and digital signature carried in the transaction. If verification is successful, it checks whether the business entity 400, as indicated in the transaction, has the authority to conduct the transaction. Any verification check, whether for the digital signature or the authority, will result in transaction failure. After successful verification, the consensus node signs its own digital signature (e.g., by encrypting the transaction digest using the private key of consensus node 710-1) and continues broadcasting it within blockchain network 700.

[0183] After receiving a successfully verified transaction, the consensus nodes in blockchain network 700 populate the transaction into a new block and broadcast it. When broadcasting a new block, the consensus nodes in blockchain network 700 perform a consensus process on the new block. If the consensus is successful, the new block is appended to the end of the blockchain they store, and the state database is updated according to the transaction results. The transactions in the new block are then executed: for transactions that submit updates to multimedia information, the identification information of the target user, and the control component information, key-value pairs including multimedia information identification, playback configuration information, and playback strategy are added to the state database.

[0184] Business personnel of business entity 500 log in to client node 510 and enter multimedia information or multimedia information query requests. Client node 510 generates corresponding update / query transactions based on the multimedia information or multimedia information query requests. The transaction specifies the smart contract to be called to implement the update / query operation and the parameters to be passed to the smart contract. The transaction also carries the digital certificate of client node 510, the signed digital signature (for example, obtained by encrypting the transaction digest using the private key in the digital certificate of client node 510), and broadcasts the transaction to the consensus nodes in blockchain network 700.

[0185] When a consensus node in the blockchain network 700 receives a transaction, it verifies the transaction, fills in the block, and reaches consensus. Then, it appends the new block to the end of its stored blockchain and updates the state database according to the transaction result. It then executes the transactions in the new block: for a transaction that updates the human identification result corresponding to a certain multimedia information, it updates the key-value pair corresponding to the multimedia information in the state database according to the human identification result; for a transaction that queries a certain multimedia information, it queries the key-value pair corresponding to the multimedia information in the state database and returns the transaction result.

[0186] It is worth noting that, in Figure 8 The example illustrates the process of linking multimedia information identifiers, playback configuration information, and playback strategies to the blockchain. However, in other embodiments, when the amount of multimedia information is large, client node 410 can link the hash of the multimedia information and the corresponding hash of the corresponding multimedia information to the blockchain, storing the original multimedia information and the corresponding multimedia information in a distributed file system or database. After client node 510 obtains the multimedia information and the corresponding multimedia information from the distributed file system or database, it can verify them by combining the corresponding hash in the blockchain network 700, thereby reducing the workload of the on-chain operation.

[0187] As an example of blockchain, see Figure 9 , Figure 9This is a schematic diagram of the blockchain structure in the blockchain network 700 provided in this embodiment of the invention. The header of each block can include the hash values ​​of all transactions in the block, as well as the hash values ​​of all transactions in the previous block. Newly generated transaction records are filled into the block and, after consensus among the nodes in the blockchain network, are appended to the tail of the blockchain, thus forming a chain-like growth. The chain structure between blocks based on hash values ​​ensures the tamper-proof and anti-forgery properties of transactions within the block. The multimedia information stored in the blockchain network can be a single multimedia message placed by an advertiser (e.g., an image, a poster, or a video placed by the advertiser). By storing this multimedia information in the blockchain network, different nodes can share it.

[0188] The following describes an exemplary functional architecture of the blockchain network provided in the embodiments of the present invention. See also... Figure 10 , Figure 10 This is a functional architecture diagram of the blockchain network 700 provided in an embodiment of the present invention, including an application layer 701, a consensus layer 702, a network layer 703, a data layer 704, and a resource layer 705, which will be described below.

[0189] Resource layer 705 encapsulates the computing, storage, and communication resources required to implement various consensus nodes in a blockchain network.

[0190] The data layer 704 encapsulates various data structures that implement ledgers, including blockchains implemented as files in a file system, key-value state databases, and proof of existence (such as hash trees of transactions in blocks).

[0191] The network layer 703 encapsulates the functions of point-to-point (P2P) network protocols, data propagation and verification mechanisms, access authentication mechanisms, and business entity identity management.

[0192] Among them, the P2P network protocol enables communication between consensus nodes in the blockchain network 700, the data propagation mechanism ensures the propagation of transactions in the blockchain network 700, the data verification mechanism is used to ensure the reliability of data transmission between consensus nodes based on cryptographic methods (such as digital certificates, digital signatures, public / private key pairs), the access authentication mechanism is used to authenticate the identity of business entities joining the blockchain network 700 according to the actual business scenario, and grant the business entities access to the blockchain network 700 when the authentication is successful, and the business entity identity management is used to store the identity and permissions (such as the types of transactions that can be initiated) of the business entities allowed to access the blockchain network 700.

[0193] The consensus layer 702 encapsulates the mechanisms by which consensus nodes in the blockchain network 700 reach consensus on blocks (i.e., the consensus mechanism), as well as transaction management and ledger management functions. The consensus mechanisms include consensus algorithms such as Proof-of-Stake (PoS), Proof-of-Work (PoW), and Delegated Proof-of-Stake (DPoS), and support pluggable consensus algorithms.

[0194] Transaction management is used to verify the digital signature carried in the transaction received by the consensus node, verify the identity information of the business entity, and determine whether it has the authority to conduct the transaction based on the identity information (reading relevant information from the business entity identity management); for business entities that have been authorized to access the blockchain network 700, they all have digital certificates issued by the certification center. The business entity uses the private key in its digital certificate to sign the submitted transaction, thereby declaring its legitimate identity.

[0195] Ledger management is used to maintain the blockchain and state database. For blocks that have reached consensus, they are appended to the end of the blockchain; transactions within consensus-reaching blocks are executed. When a transaction includes an update operation, the key-value pairs in the state database are updated; when a transaction includes a query operation, the key-value pairs in the state database are queried, and the query results are returned to the client nodes of the business entity. Multiple query operations on the state database are supported, including: querying blocks based on block vector numbers (e.g., transaction hashes); querying blocks based on block hashes; querying blocks based on transaction vector numbers; querying transactions based on transaction vector numbers; querying account data of the business entity based on its account (vector number); and querying the blockchain within a channel based on its channel name.

[0196] The application layer 701 encapsulates various business functions that a blockchain network can implement, including transaction tracing, notarization, and verification.

[0197] The following uses multimedia information as an example of product advertising to illustrate the multimedia information processing method provided by this invention. (Refer to...) Figure 11 , Figure 11This is a schematic diagram of an optional multimedia information playback in an embodiment of the present invention. In some embodiments of the present invention, when the multimedia information played in the multimedia information playback window of a short video is a video advertisement, a trigger operation is received for the multimedia information playback window; in response to the trigger operation, the business processing interface is presented and jumps to the product display interface indicated by the multimedia information, thereby allowing users to more conveniently purchase the products presented in the multimedia information playback window. During advertisement playback, manual traffic allocation is generally used, that is, within a certain period of time, the effect indicators of each sub-traffic under the current traffic ratio allocation are manually observed, and then the sub-traffic with the best effect is selected, and its traffic ratio is increased in the next observation period. The drawbacks are high labor costs, low allocation efficiency, and susceptibility to subjective factors. Alternatively, dynamic adjustment based on batch processing can be used, that is, traffic is sampled and accumulated in batches; then, based on the effect data of each sub-traffic in the current period, the Thompson sampling method in the MAB algorithm is applied to give the proportion allocation of each sub-traffic in the next period. The drawbacks are that the allocation results are prone to fluctuation, the allocation difference may not be significant, and the algorithm has poor transferability.

[0198] Continue to refer to Figure 12 See Figure 12 , Figure 12 This is an optional flowchart illustrating the multimedia information processing method provided in an embodiment of the present invention. It can be understood that... Figure 12 The steps shown can be performed by various terminals running multimedia information processing devices, such as dedicated terminals with multimedia information processing capabilities, electronic devices (mobile phones or tablets). The following steps are for... Figure 12 The steps shown are explained.

[0199] Step 1201: Obtain the raw data of the ad playback effect corresponding to the version information of the topology file.

[0200] Step 1202: Accumulate the playback effect data of the summable dimensions in the ad playback effect data, and determine the matching calculation factors for the playback effect data of the non-accumulable dimensions and perform accumulation processing.

[0201] Step 1203: Obtain full experimental configuration information for advertising testing.

[0202] Step 1204: Adjust the convergence coefficient to match the advertising information.

[0203] Referring to Table 1, for the same ad mix, by configuring different convergence coefficients to determine the output allocation results, it can be determined that as the convergence coefficient increases, the difference in traffic allocation results becomes greater. That is, the better the playback strategy, the higher the proportion of traffic allocated, and the worse the playback strategy, the lower the proportion of traffic allocated.

[0204]

[0205] Table 1

[0206] Step 1205: Dynamically adjust the ad playback strategy through the playback strategy adjustment process.

[0207] Step 1206: Play the ads based on the adjusted ad playback strategy and record the playback performance data.

[0208] Referring to Table 2, the advertising playback strategy configured using the multimedia information processing method provided in this application can obtain a more suitable advertising playback strategy for different advertisements, obtain more appropriate traffic, improve advertising delivery efficiency, and enhance the user experience for advertisers.

[0209]

[0210] Table 2

[0211] See Figure 13 , Figure 13 This is a schematic diagram of an optional multimedia information playback embodiment of the present invention. Figure 12 The multimedia information processing method provided in this invention can replace the advertising information played in the advertising slots of a multimedia information playback environment, replacing advertising A with advertising B, thereby allocating more playback traffic to advertising B and providing users with a better viewing experience. Specifically, based on the traffic parameters matched with the advertising information playback strategy and the iterative experimental parameters, when the playback strategy of the advertising information is dynamically adjusted, the advertising exposure rate can be increased. In some embodiments of this invention, the exposure channel of advertising A can also be adjusted from the current exposure in the short video client to the contact status information of the instant messaging client. Of course, when adjusting the exposure position of advertising A, it can be changed from the Moments ad in the instant messaging client to the splash screen ad to conform to different dynamically adjusted playback strategies.

[0212] When dynamically adjusting the playback strategy of the multimedia information, the historical browsing information of the target user can be obtained; based on the historical browsing information of the target user, the exposure history of the multimedia information corresponding to the historical browsing information is determined; and based on the exposure history of the multimedia information corresponding to the historical browsing information, the playback strategy of the multimedia information is dynamically adjusted to... Figure 13For example, if it is determined that target user 1 has previously blocked ad B in their browsing history, the playback strategy can be dynamically adjusted to replace ad A with other ad information (such as ad C). Similarly, if it is determined that target user 2 has previously blocked ad C in their browsing history, the playback strategy can be dynamically adjusted to replace ad A with other ad information (such as ad D) to align with the target user's usage habits and provide a better user experience.

[0213] See Figure 14 , Figure 14 This is a schematic diagram of an optional multimedia information playback method in an embodiment of the present invention. When the target resource includes different advertisements from the same advertiser, the advertisement information included in different resource groups can be played sequentially in the multimedia information playback window. When all multimedia information playback areas in the display interface are occupied by the advertiser, after the advertisement playback ends, the advertisement information of the same advertiser can be displayed in a loop in the multimedia information playback window of the advertisement display interface. Simultaneously, when the advertiser's multimedia information is a video advertisement, the video advertisement information of the same advertiser can be displayed in a loop, and the audio volume carried by the video can be adjusted to the maximum to prompt the user to watch the played video advertisement. Therefore, by dynamically adjusting the playback strategy of the advertisement information based on the traffic parameters matched with the multimedia information playback strategy and the iterative experimental parameters, the advertiser's total cost per mille (ecpm) can be reduced, resulting in better advertisement playback performance.

[0214] The embodiments of the present invention have the following beneficial effects:

[0215] This invention obtains corresponding playback configuration information in a multimedia information playback environment; based on the playback configuration information, it configures a corresponding test interface for the multimedia information playback strategy adjustment process; responding to the configured test interface, it configures a matching topology file for the multimedia information playback strategy adjustment process, thereby obtaining dynamically adjusted playback configuration information through the topology file; it obtains playback effect parameters of the multimedia information through the playback strategy adjustment process; based on the playback effect parameters and playback configuration information of the multimedia information, it determines the traffic parameters and iterative experimental parameters matching the multimedia information playback strategy through the playback strategy adjustment process; and it dynamically adjusts the playback strategy of the multimedia information based on the traffic parameters matching the multimedia information playback strategy and the iterative experimental parameters. This reduces manpower costs in the traffic allocation process, improves the efficiency of traffic allocation, reduces allocation fluctuations, makes the traffic allocation after the multimedia information playback strategy adjustment more significant, reduces the cost of multimedia information delivery, improves the effectiveness of the freshness strategy, enhances the user experience, diversifies the playback format of multimedia information, and meets the needs of different users.

[0216] The above description is merely an embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A multimedia information processing method, characterized in that, The method includes: Obtain the corresponding playback configuration information in the multimedia information playback environment; Based on the playback configuration information, configure a corresponding test interface for the multimedia information playback strategy adjustment process; In response to the configured test interface, a matching topology file is configured for the playback strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playback configuration information through the topology file; Obtain the playback effect data of the multimedia information corresponding to the version information of the topology file; When the playback effect data of the multimedia information is an accumulative dimension of playback effect data, the playback effect data of different types are accumulated separately to obtain the playback effect parameters of the multimedia information. When the playback effect data of the multimedia information is a non-accumulative dimension of playback effect data, a calculation factor that matches the non-accumulative dimension of playback effect data is determined, and the calculation factor is accumulated to obtain the playback effect parameters of the multimedia information. Based on the playback effect parameters and playback configuration information of the multimedia information, the playback strategy adjustment process is used to determine the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information. Based on the traffic parameters and iterative experimental parameters matched with the playback strategy of the multimedia information, the playback strategy of the multimedia information is dynamically adjusted to achieve an exposure strategy adapted to the configuration of the multimedia information.

2. The method according to claim 1, characterized in that, The step of obtaining the corresponding playback configuration information in the multimedia information playback environment includes: Monitor the operation information displayed in the playback configuration interface; In response to the monitored operation information, the triggering state of different control components in the display interface is determined, wherein the different control components in the display interface include: a strategy indicator component, a strategy type component, a strategy name component, and an iteration time component.

3. The method according to claim 1, characterized in that, The step of determining the traffic parameters and iterative experiment parameters matching the playback strategy of the multimedia information based on the playback effect parameters and playback configuration information, through the playback strategy adjustment process, includes: The playback strategy for the corresponding multimedia information is determined based on the version information of the topology file. Based on the playback effect parameters and playback strategy of the multimedia information, the optimization target data of the multimedia information is determined. Based on the playback strategy of the multimedia information and the optimization target data of the multimedia information, the traffic parameters matching the playback strategy of the multimedia information and the iterative experimental parameters are determined, wherein the experimental parameters are matched with the corresponding playback strategy.

4. The method according to claim 3, characterized in that, The playback strategy for the multimedia information is dynamically adjusted based on the traffic parameters matched by the playback strategy and the iterative experimental parameters, in order to achieve an exposure strategy adapted to the configuration of the multimedia information, including: The exposure rate corresponding to the multimedia information is dynamically adjusted; or Adjust the exposure channels corresponding to the multimedia information; or The exposure position corresponding to the multimedia information is adjusted.

5. The method according to claim 3, characterized in that, The method further includes: Based on the exposure count matched by the determined multimedia information playback strategy and the iterative experimental parameters, the range of traffic parameters of the multimedia information playback environment is dynamically adjusted through the test interface.

6. The method according to claim 3, characterized in that, The method further includes: The determined traffic parameters, iterative experiment parameters, and historical adjustment information of the range of the determined multimedia information playback strategy are sent to the corresponding server. When a playback strategy query command is received, the display interface presents the playback strategy matching traffic parameters, iterative experiment parameters, and historical adjustment information of the range of the traffic parameters for multimedia information.

7. The method according to claim 1, characterized in that, The method further includes: When the multimedia information is embedded advertising information in a short video, the exposure parameters of the short video are monitored; The visual effect index of the embedded advertising information is determined based on the exposure parameters of the short video. Based on the Manron visual effect index corresponding to the embedded advertising information, the playback configuration information corresponding to the embedded advertising information in the short video is adjusted through the topology file.

8. The method according to claim 7, characterized in that, The method further includes: The exposure parameters of the short video during playback are sent to the monitoring server so that the monitoring server can monitor the exposure of the short video. The exposure parameters of short videos stored on the monitoring server are used as the data source for the playback effect parameters of multimedia information.

9. The method according to claim 1, characterized in that, The method further includes: Obtain the target user's browsing history; Based on the target user's historical browsing information, determine the multimedia information exposure history corresponding to the historical browsing information; Based on the exposure history of the multimedia information corresponding to the historical browsing information, the playback strategy of the multimedia information is dynamically adjusted.

10. The method according to claim 1, characterized in that, The method further includes: Determine the usage environment of the terminal display interface; Based on the usage environment of the terminal display interface, determine the category of the multimedia information to be played; In response to the category of the multimedia information to be played, a matching multimedia information data source is triggered to adjust the multimedia information to be played by using a multimedia information data source that matches the category of the multimedia information to be played.

11. The method according to any one of claims 1-9, characterized in that, The method further includes: The multimedia information identifier, playback configuration information, and playback strategy are sent to the blockchain network to enable... The nodes of the blockchain network fill the multimedia information identifier, playback configuration information, and playback strategy into a new block, and when there is consensus on the new block, the new block is appended to the end of the blockchain.

12. A multimedia information processing device, characterized in that, The device includes: The information transmission module is used to obtain the corresponding playback configuration information in the multimedia information playback environment; The information processing module is used to configure a corresponding test interface for the playback strategy adjustment process of the multimedia information based on the playback configuration information. The information processing module is used to respond to the configured test interface and configure a matching topology file for the playback strategy adjustment process of the multimedia information, so as to obtain dynamically adjusted playback configuration information through the topology file. The information processing module is used to acquire playback effect data of the multimedia information corresponding to the version information of the topology file; when the playback effect data of the multimedia information is playback effect data with an accumulative dimension, the different types of playback effect data are accumulated separately to obtain the playback effect parameters of the multimedia information; when the playback effect data of the multimedia information is playback effect data with a non-accumulative dimension, a calculation factor matching the non-accumulative dimension playback effect data is determined, and the calculation factor is accumulated to obtain the playback effect parameters of the multimedia information. The information processing module is used to determine the traffic parameters and iterative experiment parameters that match the playback strategy of the multimedia information by adjusting the process according to the playback effect parameters and playback configuration information of the multimedia information and the playback strategy adjustment process. Based on the traffic parameters matched to the playback strategy of the multimedia information and the iterative experimental parameters, the playback strategy of the multimedia information is dynamically adjusted.

13. The apparatus according to claim 12, characterized in that, The information transmission module is used to monitor the operation information in the playback configuration display interface; in response to the monitored operation information, it determines the trigger status of different control components in the display interface, wherein the different control components in the display interface include: strategy indicator component, strategy type component, strategy name component, and iteration time component.

14. The apparatus according to claim 12, characterized in that, The information processing module is used to determine the playback strategy of the corresponding multimedia information based on the version information of the topology file; determine the optimization target data of the multimedia information based on the playback effect parameters and the playback strategy of the multimedia information; and determine the traffic parameters and iterative experimental parameters that match the playback strategy of the multimedia information through the playback strategy and the optimization target data of the multimedia information, wherein the experimental parameters match the corresponding playback strategy.

15. An electronic device, characterized in that, The electronic device includes: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the multimedia information processing method according to any one of claims 1 to 11.

16. A computer-readable storage medium storing executable instructions, characterized in that, When the executable instructions are executed by the processor, they implement the multimedia information processing method according to any one of claims 1 to 11.

17. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the multimedia information processing method according to any one of claims 1 to 11.

Images