Multimedia information processing method, device, electronic device and storage medium
By responding to interactive operations in the terminal display interface and dynamically adjusting the display method of multimedia information, the problem of single display form of information flow advertisements is solved, and the user experience and advertising interaction is improved.
Patent Information
- Application Number
- CN202111101782.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-30
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-12-30
AI Technical Summary
In the prior art, the display form of information flow advertisements is relatively single, and it is difficult to adapt to the user's interaction, resulting in poor user experience.
By receiving interactive operations in the terminal's display interface, dynamically adjusting the display mode of multimedia information, including sliding, waiting and observation modes in response to the operation's displacement, waiting time and condition judgment parameters, to ensure that the multimedia information in the information flow interacts with the user. match.
It enriches the display method of multimedia information, adapts to user interaction, improves user experience, and improves the interactiveness and click-through rate of advertising.
Smart Images

Figure CN113741774B_ABST
Abstract
Description
[0001] This application is a divisional application of Chinese patent application No. 201911394912.0, filed on December 30, 2019, and entitled “A multimedia information processing method, device, electronic device and storage medium”. Technical Field
[0002] The present invention relates to multimedia information generation technology, and in particular to a multimedia information processing method, device, electronic device, storage medium and computer program product. Background Art
[0003] In related technologies, dynamic layout can realize information interaction. In this process, information flow advertising has become the mainstream form of mobile advertising because of its advantages such as being embedded in the information flow and being infinitely refreshed with the content. However, in the process of advertising delivery, except for changes in the static UI layout, the form is still relatively simple and is limited to adjustments through static layout. Summary of the invention
[0004] In view of this, the embodiments of the present invention provide a multimedia information processing method, device, electronic device, storage medium and computer program product, which can adapt the display mode of multimedia information in the information flow to the user's interactive operation and improve the user experience.
[0005] The technical solution of the embodiment of the present invention is achieved as follows:
[0006] An embodiment of the present invention provides a multimedia information processing method, the method comprising:
[0007] In the display interface of the terminal, multimedia information is presented through information streams;
[0008] Receiving an interactive operation triggered based on the display interface;
[0009] In response to the interactive operation, the multimedia information presented by the information stream is displayed in at least one of the following ways:
[0010] A method adapted to the displacement of the interactive operation, a method adapted to the waiting time corresponding to the interactive operation, and a method adapted to the condition judgment parameter corresponding to the interactive operation.
[0011] In the above solution, after receiving the interactive operation triggered by the display interface, the method further includes:
[0012] determining operating parameters of the interactive operation;
[0013] According to the operating parameters, determining a state feature that matches the operating parameters;
[0014] In response to the state feature, triggering a control component corresponding to the state feature, and determining multimedia information matching the state feature through the control component;
[0015] The multimedia information presented is updated through the display interface of the terminal.
[0016] In the above solution, the interactive operation is a sliding operation, and the playback mode adopted is a playback mode adapted to the displacement of the interactive operation;
[0017] The playing of the multimedia information presented by the information stream includes:
[0018] The multimedia information presented by the information stream is played at a playback speed that matches the displacement of the sliding operation.
[0019] In the above scheme, the playing mode adopted is a playing mode adapted to the waiting time corresponding to the interactive operation;
[0020] The playing of the multimedia information presented by the information stream includes:
[0021] Controlling the display interface of the terminal to enter a waiting mode;
[0022] While the display interface is in the waiting mode, the multimedia information presented by the information stream is played using a playing duration that matches the waiting duration.
[0023] In the above scheme, the playing mode adopted is a playing mode adapted to the conditional judgment parameter corresponding to the interactive operation;
[0024] The playing of the multimedia information presented by the information stream includes:
[0025] Controlling the display interface of the terminal to enter an observation mode;
[0026] While the display interface is in the observation mode, the multimedia information presented by the information stream is played at a display position that matches the conditional judgment parameter, or with a playback duration that matches the conditional judgment parameter.
[0027] In the above scheme, the method further includes:
[0028] During the process of playing the multimedia information, the display form of the multimedia information is controlled to be embedded in the information stream or to cover the information stream.
[0029] An embodiment of the present invention further provides a multimedia information processing device, the device comprising:
[0030] A display module, used to present multimedia information through information streams in a display interface of a terminal;
[0031] A receiving module, configured to receive an interactive operation triggered based on the display interface;
[0032] A playback module is configured to display the multimedia information presented by the information stream in response to the interactive operation by adopting at least one of the following methods:
[0033] A method adapted to the displacement of the interactive operation, a method adapted to the waiting time corresponding to the interactive operation, and a method adapted to the condition judgment parameter corresponding to the interactive operation.
[0034] An embodiment of the present invention further provides an electronic device, the electronic device comprising:
[0035] A memory for storing executable instructions;
[0036] The processor is used to implement the multimedia information processing method provided in the embodiment of the present application when running the executable instructions stored in the memory.
[0037] An embodiment of the present invention further provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implements the multimedia information processing method provided in the embodiment of the present application.
[0038] An embodiment of the present invention further provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements the multimedia information processing method provided in the embodiment of the present application.
[0039] The embodiments of the present invention have the following beneficial effects:
[0040] The present invention presents multimedia information through an information stream in a display interface of a terminal; receives an interactive operation triggered based on the display interface; and in response to the interactive operation, displays the multimedia information presented through the information stream in at least one of the following ways: a way that is adapted to the displacement of the interactive operation, a way that is adapted to the waiting time corresponding to the interactive operation, and a way that is adapted to the conditional judgment parameter corresponding to the interactive operation; in this way, the display method of the multimedia information is enriched, so that the display method of the multimedia information in the information stream is adapted to the user's interactive operation, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 A schematic diagram of a use scenario of the multimedia information processing method provided by an embodiment of the present invention;
[0042] Figure 2 A schematic diagram of the structure of a multimedia information processing device provided by an embodiment of the present invention;
[0043] Figure 3 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention;
[0044] Figure 4 A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;
[0045] Figure 5 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention;
[0046] Figure 6 A schematic diagram of the structure of a multimedia information processing device provided by an embodiment of the present invention;
[0047] Figure 7 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention;
[0048] Fig. 8A A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;
[0049] Figure 8B A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;
[0050] Figure 8C A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;
[0051] Fig. 9 is a schematic diagram of the architecture of a multimedia information processing device 100 provided in an embodiment of the present invention;
[0052] Fig.10 It is a schematic diagram of the structure of a blockchain in a blockchain network 200 provided in an embodiment of the present invention;
[0053] Fig.11 It is a functional architecture diagram of the blockchain network 200 provided in an embodiment of the present invention;
[0054] Fig.12 A schematic diagram of a use environment of the multimedia information processing method according to an embodiment of the present invention;
[0055] Fig.13 A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;
[0056] Fig.14 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention;
[0057] Fig.15 A schematic diagram of an optional data structure of the multimedia information processing method provided by an embodiment of the present invention;
[0058] Fig.16 A schematic diagram of an optional component structure of a multimedia information processing method provided in an embodiment of the present invention;
[0059] Fig.17 A schematic diagram of packaging components in a multimedia information processing method provided by an embodiment of the present invention;
[0060] Fig.18 A schematic diagram of communication status in a multimedia information processing method provided by an embodiment of the present invention;
[0061] Fig.19 A schematic diagram of a rendering process in a multimedia information processing method provided by an embodiment of the present invention;
[0062] Fig. 20 Schematic diagram of the thermal power of multimedia information in an embodiment of the present invention. DETAILED DESCRIPTION
[0063] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present invention. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present invention.
[0064] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0065] Before further describing the embodiments of the present invention in detail, the nouns and terms involved in the embodiments of the present invention are described. The nouns and terms involved in the embodiments of the present invention are subject to the following interpretations.
[0066] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.
[0067] 2) Terminals, including but not limited to: ordinary terminals and dedicated terminals, wherein the ordinary terminals maintain a long connection and / or a short connection with the sending channel, and the dedicated terminals maintain a long connection with the sending channel.
[0068] 3) Client: The carrier that implements specific functions in the terminal. For example, the mobile client (APP) is the carrier of specific functions in the mobile terminal, such as executing the function of online live broadcast or online video playback.
[0069] 4) API: The full name is Application Programming Interface, which can be understood semantically as an application program interface, which is a set of predefined functions or an agreement for connecting different components of a software system. The purpose is to provide applications and developers with the ability to access a set of routines based on a certain software or hardware without having to access the original code or understand the details of the internal working mechanism.
[0070] 5) Transaction is equivalent to the computer term "transaction". Transaction includes operations that need to be submitted to the blockchain network for execution, and does not refer only to transactions in a business context. In view of the conventional use of the term "transaction" in blockchain technology, the embodiments of the present invention follow this convention.
[0071] 6) Blockchain is an encrypted, chained transaction storage structure formed by blocks.
[0072] 7) Blockchain Network: A collection of nodes that incorporate new blocks into the blockchain through consensus.
[0073] 8) Ledger is a general term for blockchain (also called ledger data) and the state database synchronized with the blockchain.
[0074] 9) Smart Contracts, also known as chaincode or application code, are programs deployed in the nodes of the blockchain network. The nodes execute the smart contracts called in the received transactions to update or query the key-value data in the state database.
[0075] 10) Consensus is a process in a blockchain network used to reach agreement on transactions in a block among multiple nodes involved. The agreed blocks will be appended to the end of the blockchain. The mechanisms for achieving consensus include Proof of Work (PoW), Proof of Stake (PoS), Delegated Proof-of-Stake (DPoS), Proof of Elapsed Time (PoET), etc.
[0076] Figure 1A schematic diagram of a use scenario of the multimedia information processing method provided by an embodiment of the present invention, see Figure 1 , a client of multimedia information display function software is set on the terminal (including terminal 10-11 and terminal 10-21), wherein, in the present application, the definition of multimedia information includes but is not limited to: music, video, article, commodity, such as a client or plug-in for video playback, or a client for shopping function, the user can obtain the target video through the corresponding client, and can also browse different commodity information; the terminal is connected to the server 20-1 through the network 30-1, the network 30-1 can be a wide area network or a local area network, or a combination of the two, and a wireless link is used to realize data transmission.
[0077] As an example, server 20-1 is used to deploy the multimedia information and generate new multimedia information matching the usage environment through the multimedia information, and display the new multimedia information generated by the multimedia information matching the usage environment through the terminal (terminal 10-11 and / or terminal 10-21).
[0078] Specifically, the multimedia information processing method includes: determining operation parameters that match the information flow displayed on the terminal display interface, wherein the operation parameters are used to characterize the parameters generated by different operations during the interaction with the information flow displayed on the terminal display interface; determining state characteristics that match the operation parameters based on the operation parameters; in response to the state characteristics, triggering a control component corresponding to the state characteristics, and determining multimedia information that matches the state characteristics through the control component; and presenting the corresponding multimedia information through the terminal display interface.
[0079] The structure of the multimedia information processing device of the embodiment of the present invention is described in detail below. The multimedia information processing device can be implemented in various forms, such as a dedicated terminal with a multimedia information processing function, or a server provided with a multimedia information processing function, such as the preceding Figure 1 Server 20-1 in. Figure 2 The schematic diagram of the structure of the multimedia information processing device provided by the embodiment of the present invention can be understood as follows: Figure 2 Only an exemplary structure of the multimedia information processing device is shown, not all structures, and can be implemented as needed. Figure 2 Partial or complete structure shown.
[0080] The multimedia information processing device provided in the embodiment of the present invention includes: at least one processor 201, a memory 202, a user interface 203 and at least one network interface 204. The various components in the multimedia information processing device are coupled together through a bus system 205. It can be understood that the bus system 205 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 205 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 205 is not used in the following examples. Figure 2 Various buses are labeled as bus system 205 .
[0081] The user interface 203 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.
[0082] It is understood that the memory 202 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The memory 202 in the embodiment of the present invention is capable of storing data to support the operation of the terminal (such as 10-11). Examples of these data include: any computer program for operating on the terminal (such as 10-11), such as an operating system and an application program. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application program may include various applications.
[0083] In some embodiments, the multimedia information processing device provided by the embodiment of the present invention may be implemented in a combination of software and hardware. As an example, the multimedia information processing method device provided by the embodiment of the present invention may be a processor in the form of a hardware decoding processor, which is programmed to execute the multimedia information processing method provided by the embodiment of the present invention. For example, the processor in the form of a hardware decoding processor may be one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.
[0084] As an example of a multimedia information processing device provided by an embodiment of the present invention being implemented by a combination of software and hardware, the multimedia information processing device provided by an embodiment of the present invention can be directly embodied as a combination of software modules executed by a processor 201. The software module can be located in a storage medium, and the storage medium is located in a memory 202. The processor 201 reads the executable instructions included in the software module in the memory 202, and combines with necessary hardware (for example, including the processor 201 and other components connected to the bus system 205) to complete the multimedia information processing method provided by an embodiment of the present invention.
[0085] As an example, the processor 201 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0086] As an example of a multimedia information processing device provided in an embodiment of the present invention being implemented by hardware, the device provided in an embodiment of the present invention can be directly executed by a processor 201 in the form of a hardware decoding processor, for example, being executed by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), or other electronic components to implement the multimedia information processing method provided in an embodiment of the present invention.
[0087] The memory 202 in the embodiment of the present invention is used to store various types of data to support the operation of the multimedia information processing device. Examples of such data include: any executable instructions for operating on the multimedia information processing device, such as executable instructions, and the program for implementing the multimedia information processing method of the embodiment of the present invention can be included in the executable instructions.
[0088] In other embodiments, the multimedia information processing device provided by the embodiments of the present invention may be implemented in software. Figure 2The multimedia information processing device stored in the memory 202 is shown, which may be software in the form of a program and a plug-in, and includes a series of modules. As an example of a program stored in the memory 202, a multimedia information processing device may be included, and the multimedia information processing device includes the following software modules: an information transmission module 2081 and an information processing module 2082. When the software modules in the multimedia information processing device are read into the RAM by the processor 201 and executed, the multimedia information processing method provided by the embodiment of the present invention will be implemented. The functions of each software module in the multimedia information processing device will be described below, wherein:
[0089] The information transmission module 2081 is used to determine the operation parameters that match the information flow displayed on the terminal display interface, wherein the operation parameters are used to characterize the parameters generated by different operations in the process of interacting with the information flow displayed on the terminal display interface;
[0090] An information processing module 2082, configured to determine, based on the operating parameters, a state feature that matches the operating parameters;
[0091] The information processing module 2082 is used to trigger a control component corresponding to the state feature in response to the state feature, and determine multimedia information matching the state feature through the control component;
[0092] The information transmission module 2081 is used to present corresponding multimedia information through the terminal display interface.
[0093] Combination Figure 2 The multimedia information processing device shown illustrates the multimedia information processing method provided by the embodiment of the present invention, see Figure 3 , Figure 3 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention is provided. It can be understood that: Figure 3 The steps shown can be performed by various servers running multimedia information processing devices, such as dedicated terminals, servers, cloud servers or server clusters with multimedia information processing functions. Figure 3 The steps shown are explained.
[0094] Step 301: The multimedia information processing device determines operation parameters that match the information flow displayed in the terminal display interface.
[0095] The operation parameters are used to characterize the parameters generated by different operations during the interaction with the information flow displayed on the terminal display interface. Figure 4 , Figure 4 The front-end display diagram of the multimedia information processing method according to the embodiment of the present invention is shown in step 301. Figure 4 When interacting with the information in the display interface shown (such as selecting an operation, sharing an operation, or saving an operation), the user's operation parameters can be obtained.
[0096] In some embodiments of the present invention, determining the operation parameters that match the information flow displayed in the terminal display interface may be achieved in the following manner:
[0097] The tracking mark corresponding to the target user is triggered in the terminal display interface, and the interactive element set matching the display interface is loaded in the terminal display interface; the trigger state of the interactive element set and the position change of the tracking mark are detected to determine the operation parameters matching the information flow. In particular, due to the uncertainty of user operation, by detecting the trigger state of the interactive element set and the position change of the tracking mark, the user's operation parameters can be identified more accurately and timely to avoid missing the user's operation.
[0098] Step 302: The multimedia information processing device determines, based on the operating parameters, a state feature that matches the operating parameters.
[0099] Step 303: The multimedia information processing device triggers a control component corresponding to the state feature in response to the state feature, and determines multimedia information matching the state feature through the control component.
[0100] In some embodiments of the present invention, determining the state characteristics matching the operating parameters according to the operating parameters may be achieved in the following manner:
[0101] Determining, according to a displacement parameter in the operation parameter, a first state feature that matches the displacement parameter, so as to achieve matching of the first state feature with the interactive operation;
[0102] According to the waiting time parameter in the operation parameter, determining a second state feature that matches the waiting time parameter, so as to achieve matching of the second state feature with the waiting mode of the terminal display interface;
[0103] According to the condition judgment parameter in the operation parameter, a third state feature matching the condition judgment parameter is determined to achieve matching of the third state feature with the observation mode of the terminal display interface.
[0104] Continue to refer Figure 5 , see Figure 5 , Figure 5 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention is provided. It can be understood that: Figure 5The steps shown can be performed by various servers running multimedia information processing devices, such as dedicated terminals, servers, cloud servers or server clusters with multimedia information processing functions. Figure 5 The steps shown are explained.
[0105] Step 501: The multimedia information processing apparatus triggers a style feature component corresponding to the first state feature according to the first state feature, and determines multimedia information matching the first state feature through the style feature component.
[0106] Thereby, the multimedia information can be matched with the displacement parameter in the operation parameter.
[0107] The structure of the multimedia information processing device of the embodiment of the present invention is described in detail below. The multimedia information processing device can be implemented in various forms, such as a dedicated terminal with a multimedia information processing function, or a server provided with a multimedia information processing function, such as the preceding Figure 1 Terminal 10-11 or terminal 10-21 in. Figure 6 The schematic diagram of the structure of the multimedia information processing device provided by the embodiment of the present invention can be understood as follows: Figure 6 Only an exemplary structure of the multimedia information processing device is shown, not all structures, and can be implemented as needed. Figure 6 Partial or complete structure shown.
[0108] The multimedia information processing device provided in the embodiment of the present invention includes: at least one processor 601, a memory 602, a user interface 603 and at least one network interface 604. The various components in the multimedia information processing device are coupled together through a bus system 605. It can be understood that the bus system 605 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 605 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 605 is not used in the following examples. Figure 6 Various buses are labeled as bus system 605 .
[0109] The user interface 603 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.
[0110] It is understood that the memory 602 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The memory 602 in the embodiment of the present invention can store data to support the operation of the terminal (such as 10-11). Examples of these data include: any computer program for operating on the terminal (such as 10-11), such as an operating system and an application. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application may include various applications.
[0111] In some embodiments, the multimedia information processing device provided by the embodiment of the present invention may be implemented in a combination of software and hardware. As an example, the multimedia information processing method device provided by the embodiment of the present invention may be a processor in the form of a hardware decoding processor, which is programmed to execute the multimedia information processing method provided by the embodiment of the present invention. For example, the processor in the form of a hardware decoding processor may be one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.
[0112] As an example of a multimedia information processing device provided by an embodiment of the present invention being implemented by a combination of software and hardware, the multimedia information processing device provided by an embodiment of the present invention can be directly embodied as a combination of software modules executed by a processor 601. The software module can be located in a storage medium, and the storage medium is located in a memory 602. The processor 601 reads the executable instructions included in the software module in the memory 602, and combines with necessary hardware (for example, including a processor 601 and other components connected to a bus system 605) to complete the multimedia information processing method provided by an embodiment of the present invention.
[0113] As an example, the processor 601 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0114] As an example of a multimedia information processing device provided in an embodiment of the present invention being implemented by hardware, the device provided in an embodiment of the present invention can be directly executed by a processor 601 in the form of a hardware decoding processor, for example, one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), or other electronic components to implement the multimedia information processing method provided in an embodiment of the present invention.
[0115] The memory 602 in the embodiment of the present invention is used to store various types of data to support the operation of the multimedia information processing device. Examples of such data include: any executable instructions for operating on the multimedia information processing device, such as executable instructions, and the program for implementing the multimedia information processing method of the embodiment of the present invention can be included in the executable instructions.
[0116] In other embodiments, the multimedia information processing device provided by the embodiments of the present invention may be implemented in software. Figure 6 The multimedia information processing device stored in the memory 602 is shown, which may be software in the form of a program and a plug-in, and includes a series of modules. As an example of a program stored in the memory 602, a multimedia information processing device may be included, and the multimedia information processing device includes the following software modules: a first presentation module 6081 and a second presentation module 6082. When the software modules in the multimedia information processing device are read into the RAM by the processor 601 and executed, the multimedia information processing method provided by the embodiment of the present invention will be implemented. The functions of each software module in the multimedia information processing device will be further described below, wherein:
[0117] A first presentation module 6081, configured to present multiple media information via an information stream in a display interface of a terminal;
[0118] A second presentation module 6082, configured to receive an interactive operation corresponding to the information flow triggered based on the display interface;
[0119] The second presentation module 6082 is used to follow the interactive operation, slide the information stream presented in the display interface, and update the multiple media information presented by the information stream;
[0120] The second presentation module 6082 is used to synchronize the multimedia information corresponding to the presented information stream in a form of being embedded in the information stream or covering the information stream and adopting a playback method adapted to the interactive operation.
[0121] Continue to refer Figure 7 , see Figure 7 , Figure 7 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention is provided. It can be understood that: Figure 7 The steps shown in the figure can be performed by various terminals running the multimedia information processing device, for example, a dedicated terminal with multimedia information processing function, an electronic device (a mobile phone or a tablet computer). Figure 7 The steps shown are explained.
[0122] Step 701: In a display interface of a terminal, a plurality of media information are presented via an information stream.
[0123] Step 702: receiving an interactive operation corresponding to the information flow triggered based on the display interface.
[0124] Step 703: Following the interactive operation, slide the information stream presented in the display interface to update the multiple media information presented by the information stream.
[0125] Step 704: Synchronize the multimedia information corresponding to the presented information stream in a form of being embedded in the information stream or covering the information stream and using a playback method that is compatible with the interactive operation.
[0126] Continue to refer Fig. 8A , Fig. 8A The front-end display diagram of the multimedia information processing method according to the embodiment of the present invention is shown in step 501. Fig. 8A When interacting with the information in the display interface shown, as the displacement amount of the user's operation changes, multimedia information (advertising information) matching the displacement amount parameters can be achieved and played as the user slides. The faster the sliding, the faster the playing of the advertising information, and the slower the sliding, the slower the playing, so as to match the user's reading speed and enhance interactivity.
[0127] Step 502: The multimedia information processing apparatus triggers a style feature component corresponding to the second state feature according to the second state feature, and determines multimedia information matching the second state feature through the style feature component.
[0128] Thus, the display time of the multimedia information can be matched with the waiting time parameter. Figure 8B , Figure 8BThe front-end display diagram of the multimedia information processing method according to the embodiment of the present invention is shown in step 502. Figure 8B When interacting with the information in the display interface shown, the terminal display interface can enter a waiting mode. As the user operates, when the user stays on the display page of the current terminal for a period of time, the style feature component can be used to determine the multimedia information matching the second state feature, so as to match the display time of the multimedia information with the waiting time parameter, and realize the timed push of the corresponding multimedia information to the display interface through a fixed display format.
[0129] Step 503: The multimedia information processing device triggers the style feature component corresponding to the third state feature according to the third state feature, and determines the multimedia information matching the third state feature through the style feature component.
[0130] Thus, the display mode of the multimedia information can be matched with the condition judgment parameter. Figure 8C , Figure 8C The front-end display diagram of the multimedia information processing method according to the embodiment of the present invention is shown in step 503. Figure 8C When interacting with the information in the display interface shown, the terminal display interface is in observation mode. As the user operation reaches a match with the corresponding conditional judgment parameter, the multimedia information matching the third state feature is determined through the style feature component, so that the display method of the multimedia information (including but not limited to: display position, display duration) matches the conditional judgment parameter.
[0131] Step 304: presenting corresponding multimedia information through the terminal display interface.
[0132] In some embodiments of the present invention, the method further comprises:
[0133] Determine transition multimedia information corresponding to the state feature; when the state feature matching the operation parameter is adjusted, present the transition multimedia information through the terminal display interface. The transition multimedia information may be a key frame animation or a lottie animation, so that the user can interact with the information in the terminal display interface while operating it, and the information can be presented in an animation form to enhance the fun.
[0134] In some embodiments of the present invention, the multimedia information processing method further includes:
[0135] The identification information, the control component information and the multimedia information are sent to the blockchain network so that
[0136] The nodes of the blockchain network fill the identification information, the control component information and the multimedia information into a new block, and when a consensus is reached on the new block, the new block is appended to the end of the blockchain, so that the terminals in different usage environments of the same user can obtain the information in the block, wherein the identification information is used to characterize the user who views the corresponding multimedia information.
[0137] See also Fig. 9 , Fig. 9 It is a schematic diagram of the architecture of the multimedia information processing device 100 provided in an embodiment of the present invention, including a blockchain network 200 (consensus nodes 210-1 to consensus nodes 210-3 are exemplarily shown), an authentication center 300, a business entity 400 and a business entity 500, which are described below respectively.
[0138] The types of blockchain network 200 are flexible and diverse, for example, it can be any one of public chain, private chain or alliance chain. Taking the public chain as an example, any electronic device of any business subject, such as user terminal and server, can access the blockchain network 200 without authorization; taking the alliance chain as an example, after the business subject obtains authorization, its electronic device (such as terminal / server) can access the blockchain network 200, and at this time, it becomes a client node in the blockchain network 200.
[0139] In some embodiments, the client node can only be used as an observer of the blockchain network 200, that is, to provide support for business entities to initiate transactions (for example, for storing data on the chain or querying data on the chain). For the functions of the consensus node 210 of the blockchain network 200, such as sorting function, consensus service and account book function, the client node can implement them by default or selectively (for example, depending on the specific business needs of the business entity). Thus, the data and business processing logic of the business entity can be migrated to the blockchain network 200 to the greatest extent, and the credibility and traceability of the data and business processing process can be achieved through the blockchain network 200.
[0140] The consensus nodes in the blockchain network 200 receive information from different business entities (e.g. Fig. 9 The client nodes (eg, Fig. 9 The client node 410 belonging to the business entity 400 and the client node 510 belonging to the business entity 500 shown in the figure) submit transactions, execute transactions to update the ledger or query the ledger, and various intermediate results or final results of the transaction can be returned to the client node of the business entity for display.
[0141] For example, the client node 410 / 510 can subscribe to events of interest in the blockchain network 200, such as transactions occurring in a specific organization / channel in the blockchain network 200, and the consensus node 210 pushes the corresponding transaction notification to the client node 410 / 510, thereby triggering the corresponding business logic in the client node 410 / 510.
[0142] The following uses the example of multiple business entities accessing the blockchain network to achieve the management and processing of multimedia information to illustrate the exemplary application of the blockchain network.
[0143] See also Fig. 9 , multiple business entities involved in the management link, such as business entity 400, which can be a multimedia information processing device, and business entity 500, which can be a display system with multimedia information display (operation) function, register with the authentication center 300 to obtain their respective digital certificates. The digital certificate includes the public key of the business entity and the digital signature signed by the authentication center 300 on the public key and identity information of the business entity, which is used to attach to the transaction together with the digital signature of the business entity for the transaction, and is sent to the blockchain network for the blockchain network to extract the digital certificate and signature from the transaction, verify the reliability of the message (i.e., whether it has not been tampered with) and the identity information of the business entity that sent the message. The blockchain network will verify according to the identity, such as whether it has the authority to initiate a transaction. The client running on the electronic device (such as a terminal or server) under the jurisdiction of the business entity can request access to the blockchain network 200 and become a client node.
[0144] The client node 410 of the business entity 400 is used to determine the operation parameters that match the information flow displayed in the terminal display interface, wherein the operation parameters are used to characterize the parameters generated by different operations during the interaction with the information flow displayed on the terminal display interface; according to the operation parameters, determine the state characteristics that match the operation parameters; in response to the state characteristics, trigger the control component corresponding to the state characteristics, and determine the multimedia information that matches the state characteristics through the control component; present the corresponding multimedia information through the terminal display interface, and send the identification information, the control component information and the multimedia information to the blockchain network 200.
[0145] Among them, the identification information, the control component information and the multimedia information are sent to the blockchain network 200. The business logic can be set in advance in the client node 410. When the corresponding multimedia information is formed, the client node 410 will automatically send the identification information, the control component information and the multimedia information to the blockchain network 200. The business personnel of the business subject 400 can also log in to the client node 410, manually pack the new multimedia information that matches the use environment, and send it to the blockchain network 200. When sending, the client node 410 generates a transaction corresponding to the update operation according to the new multimedia information that matches the use environment. The transaction specifies the smart contract that needs to be called to implement the update operation and the parameters passed to the smart contract. The transaction also carries the digital certificate of the client node 410, the signed digital signature (for example, the summary of the transaction is encrypted using the private key in the digital certificate of the client node 410), and the transaction is broadcast to the consensus node 210 in the blockchain network 200.
[0146] When the consensus node 210 in the blockchain network 200 receives a transaction, it verifies the digital certificate and digital signature carried in the transaction. After successful verification, it confirms whether the business subject 400 has transaction authority based on the identity of the business subject 400 carried in the transaction. Any verification judgment in the digital signature and authority verification will cause the transaction to fail. After successful verification, the node 210 signs its own digital signature (for example, using the private key of node 210-1 to encrypt the summary of the transaction) and continues to broadcast in the blockchain network 200.
[0147] After receiving the successfully verified transaction, the consensus node 210 in the blockchain network 200 fills the transaction into a new block and broadcasts it. When the consensus node 210 in the blockchain network 200 broadcasts a new block, it will perform a consensus process on the new block. If the consensus is successful, the new block will be appended to the end of the blockchain stored by itself, and the state database will be updated according to the result of the transaction, and the transaction in the new block will be executed: for transactions that submit updated multimedia information, the identification information of the target user, and the control component information, a key-value pair including the identification information, the control component information, and the multimedia information will be added to the state database.
[0148] The business personnel of the business entity 500 log in to the client node 510 and input multimedia information or multimedia information query request. The client node 510 generates a transaction corresponding to the update operation / query operation according to the multimedia information or multimedia information query request. The transaction specifies the smart contract to be called to implement the update operation / query operation and the parameters to be passed to the smart contract. The transaction also carries the digital certificate of the client node 510, the signed digital signature (for example, the summary of the transaction is encrypted using the private key in the digital certificate of the client node 510), and broadcasts the transaction to the consensus node 210 in the blockchain network 200.
[0149] The consensus node 210 in the blockchain network 200 receives the transaction, verifies the transaction, fills the block and reaches consensus, then appends the filled new block to the end of the blockchain stored in itself, updates the status database according to the transaction result, and executes the transaction in the new block: for a transaction submitted to update the manual recognition result corresponding to a certain multimedia information, the key-value pair corresponding to the multimedia information in the status database is updated according to the manual recognition result; for a transaction submitted to query a certain multimedia information, the key-value pair corresponding to the multimedia information is queried from the status database, and the transaction result is returned.
[0150] It is worth noting that in Fig. 9 The process of linking the identification information, the control component information and the multimedia information to the chain is exemplarily shown in FIG. 4 , but in other embodiments, when the amount of multimedia information is large, the client node 410 may link the hash of the multimedia information and the hash of the corresponding multimedia information in pairs, and store the original multimedia information and the corresponding multimedia information in a distributed file system or database. After the client node 510 obtains the multimedia information and the corresponding multimedia information from the distributed file system or database, it may be verified in combination with the corresponding hash in the blockchain network 200, thereby reducing the workload of the linking operation.
[0151] As an example of blockchain, see Fig.10 , Fig.10It is a schematic diagram of the structure of the blockchain in the blockchain network 200 provided by the embodiment of the present invention. The header of each block can include the hash values of all transactions in the block, and also includes the hash values of all transactions in the previous block. The newly generated transaction records are filled into the block and after the consensus of the nodes in the blockchain network, they will be appended to the end of the blockchain to form a chain growth. The chain structure based on the hash value between blocks ensures the anti-tampering and anti-forgery of the transactions in the block. Among them, the multimedia information stored in the blockchain network can be a single multimedia information placed by a certain advertiser (for example, a picture or a poster placed by the advertiser, or a video), and these multimedia information can be shared between different nodes by storing them in the blockchain network.
[0152] The following describes an exemplary functional architecture of a blockchain network provided by an embodiment of the present invention. Fig.11 , Fig.11 It is a functional architecture diagram of the blockchain network 200 provided in an embodiment of the present invention, including an application layer 2001, a consensus layer 2002, a network layer 2003, a data layer 2004 and a resource layer 2005, which are described below respectively.
[0153] The resource layer 2005 encapsulates the computing resources, storage resources, and communication resources of each node 210 in the blockchain network 200.
[0154] The data layer 2004 encapsulates various data structures for implementing the ledger, including the blockchain implemented as files in the file system, the key-value state database, and the existence proof (such as the hash tree of transactions in the block).
[0155] The network layer 2003 encapsulates the functions of point-to-point (P2P) network protocol, data transmission mechanism and data verification mechanism, access authentication mechanism and business subject identity management.
[0156] Among them, the P2P network protocol realizes the communication between the nodes 210 in the blockchain network 200, the data propagation mechanism ensures the propagation of transactions in the blockchain network 200, and the data verification mechanism is used to realize the reliability of data transmission between the nodes 210 based on cryptographic methods (such as digital certificates, digital signatures, public / private key pairs); the access authentication mechanism is used to authenticate the identity of the business subject joining the blockchain network 200 according to the actual business scenario, and grant the business subject the right to access the blockchain network 200 when the authentication is passed; the business subject identity management is used to store the identity of the business subject allowed to access the blockchain network 200, and the authority (such as the type of transaction that can be initiated).
[0157] The consensus layer 2002 encapsulates the mechanism (i.e., consensus mechanism) for the nodes 210 in the blockchain network 200 to reach a consensus on the blocks, as well as the functions of transaction management and account book management. The consensus mechanism includes consensus algorithms such as POS, POW, and DPOS, and supports pluggable consensus algorithms.
[0158] Transaction management is used to verify the digital signature carried in the transaction received by the verification node 210, verify the identity information of the business subject, and determine whether it has the authority to conduct transactions based on the identity information (read relevant information from the business subject identity management); for business subjects that have obtained authorization to access the blockchain network 200, they all have digital certificates issued by the certification center. The business subject uses the private key in its own digital certificate to sign the submitted transaction, thereby declaring its legal identity.
[0159] Ledger management is used to maintain the blockchain and state database. For the blocks that have reached consensus, they are appended to the end of the blockchain; the transactions in the blocks that have reached consensus are executed, and when the transaction includes an update operation, the key-value pairs in the state database are updated; when the transaction includes a query operation, the key-value pairs in the state database are queried and the query results are returned to the client node of the business subject. Supports query operations on the state database in multiple dimensions, including: querying blocks based on block vector numbers (such as the hash value of transactions); querying blocks based on block hash values; querying blocks based on transaction vector numbers; querying transactions based on transaction vector numbers; querying the account data of business subjects based on the account number (vector number) of the business subject; querying the blockchain in the channel based on the channel name.
[0160] The application layer 2001 encapsulates various services that can be implemented in the blockchain network, including transaction traceability, evidence storage and verification.
[0161] The multimedia information processing method provided by the present invention is described below by taking the multimedia information as an advertisement placed by the user as an example, wherein: Fig.12 A schematic diagram of a use environment of the multimedia information processing method according to an embodiment of the present invention; Fig.13 The front-end display diagram of the multimedia information processing method according to the embodiment of the present invention is shown in FIG. Fig.13 The display interface shown can display different advertising information to the user. Fig.12, the terminal (including the terminal 10-12 and the terminal 10-22) is provided with a corresponding client that can execute different functions, wherein the client is the terminal (including the terminal 10-12 and the terminal 10-22) obtaining different multimedia information from the corresponding server 20-2 through the network 30-2 for browsing, the terminal is connected to the server 20-2 through the network 30-2, the network 30-2 can be a wide area network or a local area network, or a combination of the two, using a wireless link to realize data transmission, wherein the types of multimedia information obtained by the terminal (including the terminal 10-12 and the terminal 10-22) from the corresponding server 20-2 through the network 30-2 can be the same or different, for example: the terminal (including the terminal 10-12 and the terminal 10-22) can obtain the video advertisement placed by the advertiser from the corresponding server 20-2 through the network 30-2, and can also obtain the image advertisement placed by the advertiser from the corresponding server 20-2 through the network 30-2. The specific type is not limited in this application, and different multimedia information can be stored in the server 20-2.
[0162] The server 20-2 sends the corresponding advertising information to the terminal (terminal 10-12 and / or terminal 10-22) through the network 30-2 to enable the user of the terminal (terminal 10-12 and / or terminal 10-22) to browse the advertising information. In this process, information flow advertising has become the mainstream form of mobile advertising because of its advantages such as being embedded in the information flow and being infinitely refreshed with the content. However, in the process of advertising delivery, except for the changes in the static UI layout, the form is still relatively simple, and it is limited to adjustment through static layout. Of course, there are also video information flow advertising and embedded H5 advertising, which are no longer limited to static images, but the production cost is relatively high, and there is no rich native interactive capability. Furthermore, at present, RN can control the style and interaction of the native page of the application software by issuing js scripts. In terms of describing the style, in theory, it can achieve the same effect as the native development of the application software, but there are still certain limitations in describing the interaction method, because it needs to expose the capabilities to RN in advance in the application software, and then the RN framework can use these capabilities to complete the user's click interaction. The Weex solution is similar to RN, both of which use js scripts to control the native pages of the application software, but the front-end framework is replaced by Vue instead of React. The principles are similar. Both solutions are very flexible and can meet most dynamic layout requirements. However, the framework is relatively complex, has high memory usage, is less efficient than native development, and has a certain learning cost for client development. In many businesses, it is necessary to dynamically change the style or interactive behavior of specific pages.
[0163] Fig.14An optional flow chart of a multimedia information processing method provided by an embodiment of the present invention, wherein the target user is an operating user of the current terminal, specifically includes the following steps:
[0164] Step 1401: Obtain the operation parameters of the target user in the current terminal.
[0165] The operation parameters are used to characterize the parameters generated by different operations during the interaction with the information flow displayed on the terminal display interface;
[0166] Step 1402: According to the user's current operating parameters, determine the state characteristics that match the operating parameters.
[0167] Step 1403: In response to the state feature, trigger a control component corresponding to the state feature, and determine the advertisement information matching the state feature and the display method of the advertisement information through the control component.
[0168] Step 1404: Push the advertisement information to the terminal display interface, and monitor trigger parameters of the advertisement information.
[0169] Thereby, it is possible to present the advertisement information matching the operation parameters of the target user through the terminal display interface.
[0170] Fig.15 The present invention provides an optional data structure diagram of the multimedia information processing method according to an embodiment of the present invention, wherein Json JavaScript Object Notation is used as a unified protocol description content, which is simple and universal in form and does not require front-end development to achieve cross-platform effects like RN and Weex. Fig.16 An optional component structure diagram of the multimedia information processing method provided by the embodiment of the present invention, wherein, in order to achieve the problem of describing the interactive logic with Json, it is necessary to be able to present certain logic, respond to changes, and be able to be flexibly displayed. Fig.16 The interactions (actions) shown are used to control the switching of state features (state).
[0171] Among them, actions are usually triggered by users. For example, you can monitor the sliding events of the information flow and control the change of the state according to the sliding offset. In addition, you can also add several actions, such as the wait mode action can be triggered after a certain period of time, and the observer mode action can be triggered when the attribute value of the component reaches a specified value.
[0172] Furthermore, state is composed of several style features (style), which controls the layout and display style of the specific component view, so different states can be displayed in different forms on the user interface. Of course, state, action, style, etc. are all defined in Json, with no limit on the number. In order to achieve a certain smooth effect, the switching between states can be transitioned through attribute animation.
[0173] Continue to refer Fig.17 , Fig.17 A schematic diagram of encapsulated components in a multimedia information processing method provided in an embodiment of the present invention, wherein, in order to realize the cross-platform application of the multimedia information provided in this application, components may need to be encapsulated separately on IOS and Android platforms, which may specify a variety of different states, in which multiple styles may be combined, and different states may trigger different actions, thereby achieving the purpose of flexible combination.
[0174] Continue to refer Fig.18 , Fig.18 A schematic diagram of the communication status in the multimedia information processing method provided in an embodiment of the present invention, wherein the multimedia information processing method provided in an embodiment of the present invention can adopt a bus communication mechanism, and all interactive events, state changes, and monitoring callbacks are transmitted through the event bus to avoid mutual coupling between components, and a single state notification can be implemented to allow components at different levels to generate state changes at the same time.
[0175] Continue to refer Fig.19 , Fig.19 A schematic diagram of the rendering process in the multimedia information processing method provided in the embodiment of the present invention, wherein the ability to dynamically update can be achieved by placing the Json description file on the server side and sending it to the client side in real time. Different description files can reference different materials and specify different interaction forms, thus providing the possibility for AB testing (ABTest) and the like. Furthermore, in order to achieve capabilities such as native preloading, for video resources, the material that will be visible soon can be preloaded to achieve a smoother experience.
[0176] Further, referring to Table 1, the number of times the advertising information pushed to the terminal by the multimedia information processing method provided by the present application is triggered is shown in Table 1, and its unique click rate increases from 1.173% in the traditional technology to 3.938% and 2.065%. Fig. 20 , Fig. 20 The heat diagram of multimedia information in the embodiment of the present invention is shown in FIG. By monitoring the trigger parameters of the advertising information, a Fig. 20The heat map shown is used to intuitively display parameters such as the click area, interactive effect, and interactive duration of the advertising information pushed to the terminal by the multimedia information processing method provided in this application.
[0177] Table 1
[0178] Referring to Table 2, for the H5 solution, the multimedia information processing method provided by this application has a native experience, and in advertising applications, through the implementation of Json templates, the advertiser's material production cost is greatly reduced. Only a few pictures are needed to achieve interactive effects, and there is no need for a third-party development company to produce H5; in addition, all reports can be specified in the Json template and are no longer a black box; at the same time, compared with React Native, Weex and Flutter, the secondary development complexity of the multimedia information processing method provided by this application is greatly reduced. Only Json needs to be written, and no Web development such as JS is required.
[0179] Table 2
[0180] The present invention has the following beneficial technical effects:
[0181] The present invention determines operation parameters that match the information flow displayed in the terminal display interface, wherein the operation parameters are used to characterize parameters generated by different operations in the process of interacting with the information flow displayed on the terminal display interface; determines state characteristics that match the operation parameters according to the operation parameters; triggers a control component corresponding to the state characteristics in response to the state characteristics, and determines multimedia information that matches the state characteristics through the control component; and presents the corresponding multimedia information through the terminal display interface. As a result, not only is it possible to present the multimedia information that matches the operation parameters of the target user through the terminal display interface, but the structural complexity is lower than the framework structure, the memory occupancy is low, the efficiency is higher than native development, and the learning cost in the process of determining the multimedia information is reduced.
[0182] The above descriptions are merely embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A multimedia information processing method, It is characterized in that The method comprises: In the display interface of the terminal, multimedia information is presented through information streams; Receiving an interactive operation triggered based on the display interface; In response to the interactive operation, when the interactive operation is a sliding operation and the adopted playing mode is a playing mode adapted to the displacement of the interactive operation, the multimedia information presented by the information stream is played at a playing speed adapted to the displacement of the sliding operation; When the playback mode adopted is a playback mode adapted to the waiting time length corresponding to the interactive operation, controlling the display interface of the terminal to enter a waiting mode; while the display interface is in the waiting mode, using a playback time length adapted to the waiting time length to play the multimedia information presented through the information stream; When the playback mode adopted is a playback mode adapted to the conditional judgment parameters corresponding to the interactive operation, the display interface of the terminal is controlled to enter the observation mode; while the display interface is in the observation mode, the multimedia information presented through the information stream is played at a display position adapted to the conditional judgment parameters, or with a playback duration adapted to the conditional judgment parameters.
2. The method according to claim 1, It is characterized in that After receiving the interactive operation triggered by the display interface, the method further includes: determining operating parameters of the interactive operation; According to the operating parameters, determining a state feature that matches the operating parameters; In response to the state feature, triggering a control component corresponding to the state feature, and determining multimedia information matching the state feature through the control component; The multimedia information presented is updated through the display interface of the terminal.
3. The method according to claim 2, It is characterized in that The determining of the operation parameters of the interactive operation includes: triggering a tracking identifier corresponding to the target user in the terminal display interface, and, Loading a set of interactive elements matching the display interface in the terminal display interface; Based on the trigger state of the interactive element set and the position change of the tracking identifier, an operation parameter matching the information flow is determined.
4. The method according to claim 2, It is characterized in that The determining, according to the operating parameter, a state feature that matches the operating parameter comprises: Determining, according to a displacement parameter in the operation parameter, a first state feature that matches the displacement parameter, so as to achieve matching of the first state feature with the interactive operation; According to the waiting time parameter in the operation parameter, determining a second state feature that matches the waiting time parameter, so as to achieve matching of the second state feature with the waiting mode of the terminal display interface; According to the condition judgment parameter in the operation parameter, a third state feature matching the condition judgment parameter is determined to achieve matching of the third state feature with the observation mode of the terminal display interface.
5. The method according to claim 2, It is characterized in that The method further comprises: Determining transition multimedia information corresponding to the state feature; When the state feature matching the operation parameter is adjusted, the transition multimedia information is presented through the terminal display interface.
6. The method according to claim 2, It is characterized in that The method further comprises: Determining a usage environment of the terminal display interface; Determining a corresponding state feature set according to a usage environment of the terminal display interface; Based on the determined state feature set, the corresponding control components are encapsulated into a control component set, so that the control component set matches the usage environment.
7. The method according to claim 1, It is characterized in that The method further comprises: During the process of playing the multimedia information, the display form of the multimedia information is controlled to be embedded in the information stream or to cover the information stream.
8. A multimedia information processing device, It is characterized in that The device comprises: A display module, used to present multimedia information through information streams in a display interface of a terminal; A receiving module, configured to receive an interactive operation triggered based on the display interface; a playing module, configured to play the multimedia information presented by the information stream at a playing speed adapted to the displacement amount of the sliding operation when the interactive operation is a sliding operation and the adopted playing mode is a playing mode adapted to the displacement amount of the interactive operation; When the playback mode adopted is a playback mode adapted to the waiting time length corresponding to the interactive operation, controlling the display interface of the terminal to enter a waiting mode; while the display interface is in the waiting mode, using a playback time length adapted to the waiting time length to play the multimedia information presented through the information stream; When the playback mode adopted is a playback mode adapted to the conditional judgment parameters corresponding to the interactive operation, the display interface of the terminal is controlled to enter the observation mode; while the display interface is in the observation mode, the multimedia information presented through the information stream is played at a display position adapted to the conditional judgment parameters, or with a playback duration adapted to the conditional judgment parameters.
9. An electronic device, It is characterized in that The electronic device comprises: A memory for storing executable instructions; A processor, configured to implement the multimedia information processing method according to any one of claims 1 to 7 when running the executable instructions stored in the memory.
10. A computer-readable storage medium storing executable instructions, It is characterized in that When the executable instructions are executed by the processor, the multimedia information processing method according to any one of claims 1 to 7 is implemented.
11. A computer program product comprising a computer program or instructions, It is characterized in that When the computer program or instruction is executed by a processor, the multimedia information processing method according to any one of claims 1 to 7 is implemented.
