Multimedia information processing method, device, electronic device and storage medium

By obtaining and displaying the parameter information of the multimedia information playback window in the business processing interface, the dynamic display of multimedia information in multiple windows is achieved, which solves the limitations of the playback time and format of existing video advertisements, and improves the display effect of the advertisements and flexibility.

CN114630172BActive Publication Date: 2024-11-01TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202011459691.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-11
Publication Date
2024-11-01
Estimated Expiration
2040-12-11

AI Technical Summary

Technical Problem

Existing video ads can only be inserted at the beginning or end of the credits, and the playback time is inflexible. They only support a single Gif frame-by-frame animation display. They cannot play content in multiple dynamic formats. The advertising effect is limited and single, so they cannot be flexibly replaced as needed.

Method used

In the service processing interface, the resource group in the server is obtained, including parameter information and multimedia information of the multimedia information playback window, to realize the dynamic display of multimedia information in at least two playback windows, and support multiple dynamic formats Content configuration and playback.

Benefits of technology

It realizes the diversified playback form of multimedia information, meets the needs of different users, supports the display of dynamic creative content and advertising space, and improves the playback effect and flexibility of advertisements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114630172B_ABST
    Figure CN114630172B_ABST
Patent Text Reader

Abstract

This invention provides a multimedia information processing method, apparatus, electronic device, and storage medium. The method includes: presenting business data and a multimedia information display interface in a business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; acquiring a resource group stored in a server, wherein the resource group includes parameter information and multimedia information of the multimedia information playback windows, and the multimedia information can be adapted to the at least two multimedia information playback windows; based on the acquired resource group, when presenting business information through the business processing interface, presenting multimedia information in the at least two multimedia information playback windows of the multimedia information display interface. This invention enables the presentation of multimedia information in the multimedia information playback windows of the multimedia information display interface when presenting business information through the business processing interface, thus diversifying the playback format of multimedia information and meeting the usage needs of different users.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to multimedia information generation technology, and in particular to a multimedia information processing method, device, electronic equipment and storage medium. Background Art

[0002] In the related art, advertisements can be inserted at the beginning or end of a video when they are released. This type of video advertisement is produced using ordinary advertisement editing methods and is pre-stored in the player. Before or after playing the video, the player extracts the stored advertisement for playback; this type of video advertisement can only be inserted at the beginning or end of a video, the playback time is not flexible enough, and only supports a single Gif frame-by-frame animation display, and does not support the display of dynamic creative content and advertising positions. The advertising effect is greatly limited, and the advertising effect is relatively single. It cannot be flexibly changed according to needs, nor can it play content configurations in multiple dynamic formats, and realize the playback of content configurations in multiple dynamic formats through different playback windows. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a multimedia information processing method, device, electronic device and storage medium, which can present multimedia information in a multimedia information playback window of a multimedia information display interface based on an acquired resource group when presenting business information through a business processing interface, thereby diversifying the playback format of multimedia information and meeting the usage needs of different users.

[0004] The technical solution of the embodiment of the present invention is achieved as follows:

[0005] An embodiment of the present invention provides a multimedia information processing method, including:

[0006] Presenting business data and a multimedia information display interface in the business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows;

[0007] Acquire a resource group stored in the server, wherein the resource group includes parameter information of the multimedia information playing window and multimedia information;

[0008] Based on the obtained resource group, when presenting the service information through the service processing interface, the multimedia information is presented in at least two multimedia information playing windows of the multimedia information display interface.

[0009] An embodiment of the present invention further provides a multimedia information processing device, the device comprising:

[0010] An information display module, used to present business data and a multimedia information display interface in the business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows;

[0011] An information processing module, used for acquiring a resource group stored in a server, wherein the resource group includes parameter information of a multimedia information playing window and multimedia information;

[0012] The information display module is used to present the multimedia information in at least two multimedia information playing windows of the multimedia information display interface when presenting the business information through the business processing interface based on the acquired resource group.

[0013] In the above scheme,

[0014] The information display module is used to determine parameter information of the multimedia information playback window based on the acquired resource group;

[0015] The information display module is used to determine the play order of multimedia information in different multimedia information play windows based on the parameter information of the multimedia information play window;

[0016] The information display module is used to present the business information through the business processing interface and, at the same time, present the corresponding multimedia information in at least two multimedia information playing windows of the multimedia information display interface according to the playing order of the multimedia information.

[0017] In the above scheme,

[0018] The information processing module is used to determine a multimedia information playback window that matches the parameter information of the multimedia information playback window through the resource group including the parameter information of the multimedia information playback window and the multimedia information;

[0019] The information display module is used to present an initial image frame through the multimedia information playback window when the multimedia information in the multimedia information playback window is not played;

[0020] The information processing module is used to identify the playing status of the multimedia information in the multimedia information playing window, and play the corresponding multimedia information in different multimedia information playing windows in sequence according to the playing order of the multimedia information and the index information of the multimedia information playing window;

[0021] The information display module is used to present an end image frame in the multimedia information playback window when the playback of the multimedia information in the multimedia information playback window is finished.

[0022] In the above scheme,

[0023] The information display module is used to present a window template selection interface, and present at least two multimedia information playback window templates in the window template selection interface, wherein the multimedia information playback window templates are used to represent the number and position of the playback windows;

[0024] The information display module is used to respond to a selection operation of a play window template and use the play window template corresponding to the selection operation as a multimedia information play window that matches the business processing interface.

[0025] In the above scheme,

[0026] The information display module is used for presenting the guide information in the first multimedia information playback window when the multimedia information playback in the first multimedia information playback window is finished when the number of the multimedia information playback windows is at least two;

[0027] The information display module is used to present the guide information outside the first multimedia information playback window, wherein the guide information is used to represent the second multimedia information playback window.

[0028] In the above scheme,

[0029] The information display module is used to receive a trigger operation for the multimedia information playback window;

[0030] The information display module is used to present the business processing interface and jump to the product display interface indicated by the multimedia information in response to the trigger operation.

[0031] In the above scheme,

[0032] The information display module is used to trigger the tracking mark corresponding to the multimedia information playback window in the business processing interface, and

[0033] The information display module is used to load a set of interactive elements matching the multimedia information in the business processing interface;

[0034] The information display module is used to detect the trigger state of the interactive element set and the position change of the tracking mark, and determine the operation parameters matching the information flow.

[0035] In the above scheme,

[0036] The information display module is used to determine the usage environment of the business processing interface;

[0037] The information display module is used to determine different status feature sets according to the usage environment of the business processing interface;

[0038] The information display module is used to encapsulate the corresponding control components into a control component set in response to the different state feature sets, so as to match the control component set with the usage environment and determine the multimedia information matching the state feature.

[0039] In the above scheme,

[0040] The information display module is used to send the number of multimedia information playback windows, the position of the multimedia information playback windows and the size information of the multimedia information playback windows to the corresponding server, so that the server can segment the multimedia information based on the number of multimedia information playback windows, the position of the multimedia information playback windows and the size information of the multimedia information playback windows to form interrelated segmented multimedia information.

[0041] In the above scheme,

[0042] The information display module is used to cyclically present the multimedia information in at least two multimedia information playback windows of the multimedia information display interface when the playback of the multimedia information ends;

[0043] The information display module is used to present new multimedia information in at least two multimedia information playback windows of the multimedia information display interface;

[0044] The information display module is used to present multimedia information included in different resource groups in the same target resource in at least two multimedia information play windows of the multimedia information display interface.

[0045] An embodiment of the present invention further provides an electronic device, characterized in that the electronic device comprises:

[0046] A memory for storing executable instructions;

[0047] The processor is used to implement the above-mentioned multimedia information processing method when running the executable instructions stored in the memory.

[0048] An embodiment of the present invention further provides a computer-readable storage medium storing executable instructions, wherein the executable instructions implement the preceding multimedia information processing method when executed by a processor.

[0049] The embodiments of the present invention have the following beneficial effects:

[0050] The present invention presents business data and a multimedia information display interface in a business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; obtains a resource group stored in a server, wherein the resource group includes parameter information and multimedia information of the multimedia information playback window; based on the obtained resource group, when presenting business information through the business processing interface, the multimedia information is presented in at least two multimedia information playback windows of the multimedia information display interface, thereby, when presenting business information through the business processing interface, the multimedia information is presented in the multimedia information playback window of the multimedia information display interface, so that the playback form of the multimedia information is diversified to meet the usage requirements of different users. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 A schematic diagram of a use scenario of the multimedia information processing method provided by an embodiment of the present invention;

[0052] Figure 2 A schematic diagram of the structure of a multimedia information processing device provided by an embodiment of the present invention;

[0053] Figure 3 An optional flowchart of a method for processing multimedia information provided by an embodiment of the present invention;

[0054] Figure 4 is a schematic diagram of an optional multimedia information playback window in an embodiment of the present invention;

[0055] Figure 5 is a schematic diagram of an optional multimedia information playback window in an embodiment of the present invention;

[0056] Figure 6 A schematic diagram of an optional data structure of a video provided by an embodiment of the present invention;

[0057] Figure 7 A front-end display schematic diagram of a multimedia information processing method according to an embodiment of the present invention;

[0058] Figure 8 An optional flowchart of a multimedia information processing method provided by an embodiment of the present invention;

[0059] Fig. 9 A schematic diagram of a multimedia information processing method according to an embodiment of the present invention;

[0060] Fig.10 A schematic diagram of a multimedia information processing method according to an embodiment of the present invention;

[0061] Fig.11 The figure is a process diagram of a multimedia information processing method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0062] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present invention. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present invention.

[0063] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0064] Before further describing the embodiments of the present invention in detail, the nouns and terms involved in the embodiments of the present invention are described. The nouns and terms involved in the embodiments of the present invention are subject to the following interpretations.

[0065] 1) Image frame refers to the smallest unit of video, which is a static image. For example, when playing video information, a picture frozen at any moment is an image frame.

[0066] 2) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0067] 3) "Product placement" is to place product or brand information in the form of a physical object, a picture or a video into the video content, leaving a brand impression on the audience to achieve marketing purposes. Among them, the expression form of "advertisement" is multimedia information, and the types of multimedia information include but are not limited to: pictures, text, video, and audio. "Product placement" is hidden in the carrier and integrated with the carrier. At the same time, the advertising information is carefully encoded using non-advertising expression methods, so that the audience can feel the product and brand information in an unconscious state, thereby being stimulated by the advertising information. Since the audience accepts the advertisement in a non-confrontational state, this advertising effect cannot be achieved by ordinary advertisements.

[0068] 4) Terminals, including but not limited to: ordinary terminals and dedicated terminals, wherein the ordinary terminals maintain a long connection and / or a short connection with the sending channel, and the dedicated terminals maintain a long connection with the sending channel.

[0069] 5) Client: a carrier that implements specific functions in a terminal. For example, a mobile client (APP) is a carrier of specific functions in a mobile terminal, such as executing an online live broadcast function or an online video playback function.

[0070] Figure 1 A schematic diagram of a use scenario of the multimedia information processing method provided by an embodiment of the present invention, see Figure 1 , the terminal (including the terminal 10-1 and the terminal 10-2) is provided with a corresponding client capable of playing the embedded multimedia information, and the terminal is connected to the computer server 200 via the network 300, and the network 300 can be a wide area network or a local area network, or a combination of the two, and a wireless link is used to realize data transmission, wherein the multimedia information includes but is not limited to videos, pictures, GIF animations and advertising information. Among them, the types of multimedia information obtained by the terminal (including the terminal 10-1 and the terminal 10-2) from the corresponding server 200 via the network 300 can be the same or different, for example: the terminal (including the terminal 10-1 and the terminal 10-2) can obtain the video advertisement placed by the advertiser from the corresponding server 200 via the network 300, and can also obtain the image advertisement placed by the advertiser from the corresponding server 200 via the network 300, and the specific type is not limited in this application. Different multimedia information can be stored in the server 200, wherein the multimedia information used as an advertisement can be content in different dynamic formats, such as gif, mp4, mov, etc.

[0071] In the process of the terminal (terminal 10-1 and / or terminal 10-2) acquiring and presenting services with embedded multimedia information to the server 200 through the network 300, the user can perform different operations on the multimedia information presented in the multimedia information playback window through the terminal (terminal 10-1 and / or terminal 10-2), generating different user behavior data. For example, when the multimedia information is a video advertisement, the user can share and / or like the exposed target video during the process of watching the information, or click on it. When the multimedia information is a dynamic GIF advertisement, during the exposure of the advertisement through the terminal (terminal 10-1 and / or terminal 10-2), the user can forward and / or comment on the advertisement, and can also jump to the corresponding product purchase link page through the GIF advertisement.

[0072] As an example, terminal 10-1 is used to present business data and a multimedia information display interface in a business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; obtain a resource group stored in a server, wherein the resource group includes parameter information and multimedia information of the multimedia information playback window; based on the acquired resource group, when presenting business information through the business processing interface, present the multimedia information in at least two multimedia information playback windows of the multimedia information display interface.

[0073] The structure of the multimedia information processing device of the embodiment of the present invention is described in detail below. The multimedia information processing device can be implemented in various forms, such as a dedicated terminal with a multimedia information processing function, or a server provided with a multimedia information processing function, such as the preceding Figure 1 Server 200 in. Figure 2 The schematic diagram of the structure of the multimedia information processing device provided by the embodiment of the present invention can be understood as follows: Figure 2 Only an exemplary structure of the multimedia information processing device is shown, not all structures, and can be implemented as needed. Figure 2 Partial or complete structure shown.

[0074] The multimedia information processing device provided in the embodiment of the present invention includes: at least one processor 201, a memory 202, a user interface 203 and at least one network interface 204. The various components in the multimedia information processing device are coupled together through a bus system 205. It can be understood that the bus system 205 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 205 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 205 is not used in the following examples. Figure 2 Various buses are labeled as bus system 205 .

[0075] The user interface 203 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.

[0076] It is understood that the memory 202 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. The memory 202 in the embodiment of the present invention can store data to support the operation of the terminal running the client (such as 10-1). Examples of these data include: any computer program for operating on the terminal, such as an operating system and an application. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application can include various applications.

[0077] In some embodiments, the multimedia information processing device provided by the embodiment of the present invention can be implemented in a combination of software and hardware. As an example, the multimedia information processing method device provided by the embodiment of the present invention can be a processor in the form of a hardware decoding processor, which is programmed to execute the multimedia information processing method provided by the embodiment of the present invention. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0078] As an example of a multimedia information processing device provided by an embodiment of the present invention being implemented by a combination of software and hardware, the multimedia information processing device provided by an embodiment of the present invention can be directly embodied as a combination of software modules executed by a processor 201. The software module can be located in a storage medium, and the storage medium is located in a memory 202. The processor 201 reads the executable instructions included in the software module in the memory 202, and combines with necessary hardware (for example, including the processor 201 and other components connected to the bus 205) to complete the multimedia information processing method provided by an embodiment of the present invention.

[0079] As an example, the processor 201 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0080] As an example of a multimedia information processing device provided in an embodiment of the present invention being implemented by hardware, the device provided in an embodiment of the present invention can be directly executed by a processor 201 in the form of a hardware decoding processor, for example, being executed by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), or other electronic components to implement the multimedia information processing method provided in an embodiment of the present invention.

[0081] The memory 202 in the embodiment of the present invention is used to store various types of data to support the operation of the multimedia information processing device. Examples of such data include: any executable instructions for operating on the multimedia information processing device, such as executable instructions, and the program for implementing the multimedia information processing method of the embodiment of the present invention can be included in the executable instructions.

[0082] In other embodiments, the multimedia information processing device provided by the embodiments of the present invention may be implemented in software. Figure 2 The multimedia information processing device stored in the memory 202 is shown, which may be software in the form of a program and a plug-in, and includes a series of modules. As an example of a program stored in the memory 202, a multimedia information processing device may be included, and the multimedia information processing device includes the following software modules: an information display module 2081 and an information processing module 2082. When the software modules in the multimedia information processing device are read into the RAM by the processor 201 and executed, the multimedia information processing method provided by the embodiment of the present invention will be implemented. The functions of each software module in the multimedia information processing device will be described below, wherein:

[0083] The information display module 2081 is used to present the business data and the multimedia information display interface in the business processing interface, wherein the multimedia information display interface includes at least two multimedia information playing windows;

[0084] The information processing module 2082 is used to obtain a resource group stored in the server, wherein the resource group includes parameter information of the multimedia information playing window and multimedia information;

[0085] The information display module 2081 is used to present the multimedia information in at least two multimedia information playing windows of the multimedia information display interface when presenting the business information through the business processing interface based on the acquired resource group.

[0086] according to Figure 2 The multimedia information processing device packaged in the electronic device shown, in one aspect of the present application, the present application also provides a computer program product or a computer program, the computer program product or the computer program includes a computer instruction, and the computer instruction is stored in a computer-readable storage medium. The processor of the electronic device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the electronic device executes the different embodiments and combinations of embodiments provided in various optional implementations of the above-mentioned multimedia information processing method.

[0087] In this process, the server 200 sends corresponding advertising information to the terminal (terminal 10-1 and / or terminal 10-2) through the network 300 to enable the user of the terminal (terminal 10-1 and / or terminal 10-2) to browse these advertising information. In this process, information flow advertising has become the mainstream form of mobile terminal advertising because of its advantages such as being embedded in the information flow and being infinitely refreshed with the content. However, in the process of advertising delivery, in the current advertising delivery, advertisements can be inserted at the beginning or end of the video. This video advertisement is produced using a common advertising editing method and is pre-stored in the player. Before or after playing the video, the player extracts the stored advertisement for playback; this video advertisement can only be inserted at the beginning or end, the playback time is not flexible enough, and only supports a single Gif frame-by-frame animation display, and does not support the display of dynamic creative content and advertising positions. The advertising effect is relatively limited, and the advertising effect is relatively single. It cannot be flexibly changed as needed, and it is also impossible to play a variety of dynamic formats of content configuration. Therefore, the current development urgently needs a high-efficiency multimedia information processing method to achieve the playback of a variety of dynamic formats of content configuration.

[0088] In order to solve the above problems, combined Figure 2 The multimedia information processing device shown illustrates the multimedia information processing method provided by the embodiment of the present invention, see Figure 3 , Figure 3 An optional flowchart of a method for processing multimedia information provided by an embodiment of the present invention is provided. It can be understood that: Figure 3 The steps shown can be performed by various electronic devices running the multimedia information processing device, such as a dedicated terminal, electronic device or electronic device cluster with multimedia information processing function. Figure 3 The steps shown are explained.

[0089] Step 301: The multimedia information processing device presents business data and a multimedia information display interface in the business processing interface.

[0090] The multimedia information display interface includes at least two multimedia information playback windows. Specifically, the multimedia information playback window can play corresponding multimedia information according to different usage environments. Taking the multimedia information as embedded advertisements as an example, the multimedia information playback window is a subject or object used to carry the advertisement information in the video to be embedded, such as a desktop, a wall, a photo frame, or a screen of an electronic device (such as a TV screen); before the multimedia information is displayed, a single shot multi-box detector (SSD) can be used to identify the position where the multimedia information playback window can be set, and the number of multimedia information playback windows can be flexibly adjusted according to the size of the terminal display area and the size of the multimedia information display interface.

[0091] Step 302: The multimedia information processing device obtains a resource group stored in the server.

[0092] The resource group includes parameter information of the multimedia information playing window and multimedia information.

[0093] Step 303: The multimedia information processing apparatus determines parameter information of the multimedia information playback window based on the acquired resource group.

[0094] Step 304: The multimedia information processing apparatus determines the play order of the multimedia information in different multimedia information play windows based on the parameter information of the multimedia information play window.

[0095] Step 305: while the multimedia information processing device presents the service information through the service processing interface, it presents corresponding multimedia information in at least two multimedia information playing windows of the multimedia information display interface according to the playing order of the multimedia information.

[0096] refer to Figure 4 , Figure 4 The following is a schematic diagram of an optional multimedia information playback window in an embodiment of the present invention. In some embodiments of the present invention, in the multimedia information playback window of the multimedia information display interface, corresponding multimedia information is presented according to the playback order of the multimedia information, which can be achieved in the following manner:

[0097] The resource group includes parameter information of the multimedia information playback window and multimedia information, and determines a multimedia information playback window that matches the parameter information of the multimedia information playback window; when the multimedia information in the multimedia information playback window is not played, presents an initial image frame through the multimedia information playback window; identifies the playback status of the multimedia information in the multimedia information playback window, and plays the corresponding multimedia information in different multimedia information playback windows in sequence according to the playback order of the multimedia information and the index information of the multimedia information playback window; when the playback of the multimedia information in the multimedia information playback window ends, presents an end image frame in the multimedia information playback window. Figure 4 As shown, video advertisements can be played in sequence in the multimedia information playback window 1, window 2 and window 3 according to the playback order of the multimedia information through the index information of the multimedia information playback window, or the image frame of the same video advertisement can be divided into three parts and presented in window 1, window 2 and window 3 respectively, so that the user can obtain the complete multimedia information by watching window 1, window 2 and window 3. Further, when the multimedia information is an advertisement, the terminal can obtain the video advertisement placed by the advertiser from the corresponding server 200 through the network 30, or obtain the image advertisement placed by the advertiser from the corresponding server 200 through the network 300. The specific type is not limited in this application. Different multimedia information can be stored in the server 200, wherein the multimedia information used as an advertisement can be content in different dynamic formats, such as gif, mp4, mov, etc. By dividing and adjusting the image frames of advertisement content in different dynamic formats, the advertisement content can be adapted to the number of multimedia information playback windows.

[0098] In the process of the terminal (terminal 10-1 and / or terminal 10-2) acquiring and displaying the corresponding service with embedded multimedia information from the server 200 through the network 300, the user can perform different operations on the multimedia information presented in the multimedia information playback window through the terminal (terminal 10-1 and / or terminal 10-2), generating different user behavior data. For example, when the multimedia information is a video advertisement, the user can share and / or like the exposed short video during the process of watching the information, or click. When the multimedia information is played in at least two multimedia information playback windows at the same time, the user can forward and / or comment on the advertisement, and can also jump to the corresponding product purchase link page by triggering any multimedia information playback window.

[0099] In some embodiments of the present invention, due to different usage habits of different users or different terminal display environments, the position and number of multimedia information playback windows in the business processing interface can be adjusted according to the user's usage habits or the terminal display environment, and can also be adaptively adjusted according to the size of the display screen of the terminal running the business process, wherein a window template selection interface can be presented, and at least two multimedia information playback window templates can be presented in the window template selection interface, wherein the multimedia information playback window template is used to characterize the number and position of the playback window; in response to a selection operation of the playback window template, the playback window template corresponding to the selection operation is used as the multimedia information playback window matching the business processing interface.

[0100] In some embodiments of the present invention, when the number of multimedia information playback windows is at least two, when the multimedia information in the first multimedia information playback window is finished playing, the guide information is presented in the first multimedia information playback window; or, the guide information is presented outside the first multimedia information playback window, wherein the guide information is used to characterize the second multimedia information playback window. The guide information may be a guide icon such as an arrow, and in some embodiments, the guide information may be an object in the multimedia information (for example, a visual object in a video played in the first multimedia information playback window), and the object moves from the first multimedia information playback window to the second multimedia information playback window on the service processing interface, and is used to naturally and conveniently instruct the user to look from the first multimedia information playback window to the second multimedia information playback window. In this embodiment, the resource group may include an object in the multimedia information as the guide information, and when the multimedia information in the first multimedia information playback window is finished playing, the object moving from the first multimedia information playback window to the second multimedia information playback window is played on the service processing interface. Further, the resource group may include a dynamic image frame as the guide information, the dynamic image frame is a dynamic picture of an object in the multimedia information, and when the multimedia information in the first multimedia information playback window is played, the dynamic image frame moving from the first multimedia information playback window to the second multimedia information playback window is played on the service processing interface, and the object in the multimedia information in the dynamic image frame can be matched with the movement process to make a corresponding picture change (for example, when the object in the multimedia information is an animal, the picture change matched with the movement process is a dynamic picture of the animal running) to improve the user experience, and in this embodiment, the movement speed and the playback speed of the dynamic image frame can be adjusted according to the position of the first multimedia information playback window and the second multimedia information playback window, for example, the closer the distance between the first multimedia information playback window and the second multimedia information playback window, the slower the movement speed and the playback speed of the dynamic image frame are for the user to watch. As an implementation, the display time of the guide information can be pre-set, and the movement speed is determined according to the display time and the distance between the first multimedia information playback window and the second multimedia information playback window, for example, the distance is divided by the display time to obtain the movement speed. In the above step 305, the corresponding multimedia information is presented according to the playback order of the multimedia information, and it also includes inserting the display of guide information between the end of playback in the first multimedia information playback window and the start of playback of the multimedia information in the second multimedia information playback window, that is, the guide information is displayed after the end of playback in the first multimedia information playback window, and the multimedia information starts to be played in the second multimedia information playback window after the display of the guide information ends.Therefore, when the multimedia information playback windows are scattered in different positions in the business processing interface, each multimedia information playback window can easily guide the user to watch the multimedia information to be played in other multimedia information playback windows after playing the corresponding multimedia information, thereby improving user stickiness and reducing the time users spend searching for multimedia information.

[0101] refer to Figure 5 , Figure 5 is a schematic diagram of an optional multimedia information playback window in an embodiment of the present invention, wherein: Figure 5 91 and 92 in the figure are the same multimedia information playback window, which can present different advertising information. In some embodiments of the present invention, when the multimedia information played in the multimedia information playback window is a video advertisement, a trigger operation for the multimedia information playback window is received; in response to the trigger operation, the business processing interface is presented to jump to the product display interface indicated by the multimedia information, thereby allowing users to more conveniently purchase the products presented in the multimedia information playback window.

[0102] In some embodiments of the present invention, the tracking mark corresponding to the multimedia information playback window can also be triggered in the business processing interface, and a set of interactive elements matching the multimedia information can be loaded in the business processing interface; the trigger state of the interactive element set and the position change of the tracking mark are detected to determine the operation parameters matching the information flow. Therefore, due to the uncertainty of user operation, by detecting the trigger state of the interactive element set and the position change of the tracking mark, the user's operation parameters can be identified more accurately and timely, avoiding the omission of user operations, and also avoiding the influence of user operations on the multimedia information playback window on the business processing interface.

[0103] In some embodiments of the present invention, the use environment of the business processing interface can also be determined; different sets of state characteristics can be determined according to the use environment of the business processing interface; in response to the different sets of state characteristics, the corresponding control components can be encapsulated into a control component set to match the control component set with the use environment and to determine multimedia information matching the state characteristics. Wherein, when the use environment of the business processing interface is a video playback environment, the number of control components in the control component set is less than the number of control components when the use environment of the business processing interface is a news recommendation playback environment, thereby preventing the user's operation of the multimedia information playback window through the control component from affecting the display of normal business information in the business processing interface.

[0104] In some embodiments of the present invention, before presenting multimedia information, the server needs to obtain the parameters of the corresponding multimedia information playback window to realize the processing of the multimedia information to be presented, wherein the number of the multimedia information playback windows, the position of the multimedia information playback window and the size information of the multimedia information playback window can be sent to the corresponding server, so that the server can segment the multimedia information based on the number of the multimedia information playback windows, the position of the multimedia information playback window and the size information of the multimedia information playback window to form interrelated segmented multimedia information. Taking the multimedia information as a video as an example, in actual application, different entity recognitions can be performed for different video segments, such as when the video is divided into 10 video segments, the desktop recognition is performed for the 1st to 3rd video segments, the photo frame recognition is performed for the 4th to 6th, and the wall recognition is performed for the 7th to 10th; of course, the same entity recognition can also be performed for different video segments, and still taking the video being divided into 10 video segments as an example, the desktop and photo frame entity recognition is performed for all 10 video segments.

[0105] Figure 6 A schematic diagram of an optional data structure of a video provided by an embodiment of the present invention, wherein, Figure 6 As shown, video data can be structurally divided into four levels: video, scene, shot and frame. Visually continuous video is formed by continuously projecting a series of still images onto a screen or display, and these still images are video frames. During the video shooting process, a video shot continuously and uninterruptedly by a camera is called a shot. A shot is the basic unit of video data. Several shots with similar content form a scene, which describe the same event from different angles, and a complete video is composed of many scenes. The optional exposure duration of different multimedia information units in the video is 10 seconds. There is no specific restriction on the number of video segments during the interval exposure process, which only needs to be adapted to the playback environment or adjusted according to the user's instructions.

[0106] In some embodiments of the present invention, when the multimedia information is played, the multimedia information is presented in a loop in at least two multimedia information playing windows of the multimedia information display interface; or, new multimedia information is presented in at least two multimedia information playing windows of the multimedia information display interface; or, multimedia information included in different resource groups in the same target resource is presented in at least two multimedia information playing windows of the multimedia information display interface. Wherein, when the target resource includes different resource groups, after the terminal obtains a target resource, the multimedia information included in the different resource groups can be played in sequence in the multimedia information playing window; when all multimedia information playing areas in the business processing interface are contracted by advertisers, when the multimedia information is played, the multimedia information of the same advertiser can be presented in a loop in the multimedia information playing window of the multimedia information display interface; and when the advertiser's multimedia information is a video, the multimedia information of the same advertiser can be presented in a loop, and the audio volume carried by the video can be adjusted to the maximum in sequence to prompt the user to watch the played video advertisement.

[0107] The multimedia information processing method provided by the present invention is described below by taking the multimedia information as an advertisement placed by the user as an example, wherein: Figure 7 This is a front-end display diagram of the multimedia information processing method of an embodiment of the present invention. When users browse advertising information, information flow advertising has become the mainstream form of mobile advertising because of its advantages such as being embedded in the information flow and being infinitely refreshed with the content. However, in the process of advertising delivery, except for the changes in the static UI layout, the form is still relatively simple and is limited to adjustment through the static layout. Of course, there are also video information flow advertising and embedded H5 advertising, which are no longer limited to static images, but the production cost is relatively high, and there is no rich native interactive ability, which is not conducive to the playback of various forms of advertising information.

[0108] Figure 8 An optional flow chart of a multimedia information processing method provided by an embodiment of the present invention, wherein the target user is a user of the current terminal viewing an advertisement, specifically comprising the following steps:

[0109] Step 801: Obtain parameter information of the advertisement display page and the corresponding target video to be displayed.

[0110] Among them, reference Fig. 9 , Fig. 9 This is a process diagram of the multimedia information processing method of an embodiment of the present invention. The parameter information of the advertising display page can be obtained in advance to determine several groups of videos for linked display, such as obtaining parameters such as the number of display windows, window positions and window size information of the advertising display page, and configuring the target video based on the parameter information to be divided into several groups of videos to present a linked display effect to the user.

[0111] Step 802: Process the target video to form different video groups, and configure corresponding initial image frames and end image frames for the video groups.

[0112] Step 803: Based on the parameter information of the advertisement display page and the video group, a corresponding resource group is configured.

[0113] Among them, the first frame and the last frame can be respectively intercepted as the image frames corresponding to the initial and end timestamps, and the selection of image frames can also be flexibly adjusted according to the implementation environment. Furthermore, the advertisements can be configured into resource groups according to the number, window position and size of the windows that will display the video advertisements in linkage, and the resource group includes several groups of videos and configuration information, wherein the configuration information includes the advertisement window identifiers corresponding to each group of videos and the video playback order, each group of videos is played in the view of the corresponding advertisement window position, and several groups of videos constitute a complete advertisement video. In the process of configuring the advertisements into resource groups according to the number, window position and size of the windows that will display the video advertisements in linkage, in order to adapt to the number and size of advertisements, the size of the advertisement video can be adjusted by cropping, compression, deformation, etc.

[0114] Furthermore, when the positions of several advertising windows used to present the target video are not adjacent, an animation effect can be displayed in the advertising window or in an area outside the advertising window when the sub-video of an advertising window ends. The animation effect points to the next advertising window that plays the sub-video, so that users watching the target video can notice the linked playback effects of each advertising window, thereby attracting users to continue watching.

[0115] Step 804: receiving an advertisement playing request, and transmitting a corresponding resource group to the terminal side in response to the playing request.

[0116] Step 805: The terminal presents the corresponding video group in the play window of the play interface according to the received resource group and configuration information, so as to play the target video.

[0117] Among them, reference Fig.10 and Fig.11 , Fig.10 is a process diagram of a multimedia information processing method according to an embodiment of the present invention, Fig.11The process diagram of the multimedia information processing method of an embodiment of the present invention is as follows. When the client for advertising playback is started, an advertising playback request can be sent to the background server to obtain the target video as the advertisement, and the corresponding target resource can be obtained from the background server, wherein at least one resource group can be configured in one target resource according to the playback environment, and one resource group has a video resource, an initial image frame, and an end image frame. After the terminal parses, it presents the corresponding playback positions in the playback interface to the user in sequence.

[0118] Furthermore, when the client receives a resource group, it can generate a corresponding number of view windows according to the several groups of videos and configuration information included in the resource group, and bind the information in the corresponding resource group to the view class. The view window first displays the initial image frame uniformly, and registers a callback to identify the completion of video playback. After the playback is completed, each view will issue a notification containing its own video number, and then display the termination image frame. When the notification is received and the view with the same video number as its own number is detected, the video resource will start to play. After the overall view window is drawn, the first view window with index 0 starts to play.

[0119] Through the multimedia information processing method provided in this application, it is possible to support the display of dynamic creative content and advertising positions, flexibly change the playback content according to different advertising playback requirements, realize the playback of content in multiple dynamic formats, improve the playback effect of advertisements, and attract users to watch advertising information.

[0120] The embodiments of the present invention have the following beneficial effects:

[0121] The present invention presents business data and a multimedia information display interface in a business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; obtains a resource group stored in a server, wherein the resource group includes parameter information and multimedia information of the multimedia information playback window; based on the obtained resource group, when presenting business information through the business processing interface, the multimedia information is presented in at least two multimedia information playback windows of the multimedia information display interface, thereby, when presenting business information through the business processing interface, the multimedia information is presented in the multimedia information playback window of the multimedia information display interface, so that the playback form of the multimedia information is diversified to meet the usage requirements of different users.

[0122] The above descriptions are merely embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multimedia information processing method, characterized in that: The method comprises: Presenting business information and a multimedia information display interface in the business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; Acquire a resource group stored in the server, wherein the resource group includes parameter information of a multimedia information playback window and multimedia information, and the multimedia information is adapted to the quantity, position, and size information of the at least two multimedia information playback windows; Determining parameter information of the multimedia information playback window based on the acquired resource group; Determining the play order of the multimedia information in different multimedia information play windows according to the parameter information of the multimedia information play window; When presenting the service information through the service processing interface, corresponding multimedia information is presented in at least two multimedia information playing windows of the multimedia information display interface according to the playing order of the multimedia information, wherein the at least two multimedia information playing windows include a first multimedia information playing window and a second multimedia information playing window; When the multimedia information in the first multimedia information playing window is finished, a dynamic image frame moving from the first multimedia information playing window to the second multimedia information playing window is played on the service processing interface, wherein the moving speed of the dynamic image frame is determined according to the distance between the first multimedia information playing window and the second multimedia information playing window; When the playback of the multimedia information ends, one of the following processes is performed: loopingly presenting the multimedia information in at least two multimedia information playback windows of the multimedia information display interface; presenting new multimedia information in at least two multimedia information playback windows of the multimedia information display interface; presenting multimedia information included in different resource groups in the same target resource in at least two multimedia information playback windows of the multimedia information display interface.

2. The method according to claim 1, characterized in that: Presenting corresponding multimedia information in at least two multimedia information playing windows of the multimedia information display interface according to the playing order of the multimedia information includes: Determine a multimedia information playback window that matches the parameter information of the multimedia information playback window through the resource group including the parameter information of the multimedia information playback window and the multimedia information; When the multimedia information in the multimedia information playing window is not played, presenting an initial image frame through the multimedia information playing window; Identify the playing status of the multimedia information in the multimedia information playing window, and play the corresponding multimedia information in different multimedia information playing windows in sequence according to the playing order of the multimedia information and through the index information of the multimedia information playing window; When the multimedia information in the multimedia information playing window is finished, an ending image frame is presented in the multimedia information playing window.

3. The method according to claim 1, characterized in that The method further comprises: Presenting a window template selection interface, and presenting at least two multimedia information playback window templates in the window template selection interface, wherein the multimedia information playback window templates are used to represent the number and position of the playback windows; In response to a selection operation of a play window template, the play window template corresponding to the selection operation is used as a multimedia information play window that matches the service processing interface.

4. The method according to claim 1, characterized in that: The method further comprises: Receiving a trigger operation for the multimedia information playback window; In response to the trigger operation, jump from the business processing interface to the product display interface indicated by the multimedia information.

5. The method according to claim 4, characterized in that The method further comprises: triggering a tracking identifier corresponding to the multimedia information playback window in the service processing interface, and loading a set of interactive elements matching the multimedia information in the service processing interface; The triggering state of the interactive element set and the position change of the tracking mark are detected to determine the operation parameters matching the information flow.

6. The method according to claim 1, characterized in that The method further comprises: Determining a usage environment of the business processing interface; Determining different sets of status characteristics according to the usage environment of the business processing interface; In response to the different sets of status characteristics, the corresponding control components are encapsulated into a control component set, so that the control component set matches the usage environment and can determine the multimedia information matching the status characteristics.

7. The method according to claim 1, characterized in that The method further comprises: The number of multimedia information playback windows, the positions of the multimedia information playback windows and the size information of the multimedia information playback windows are sent to the corresponding server, so that the server can segment the multimedia information based on the number of multimedia information playback windows, the positions of the multimedia information playback windows and the size information of the multimedia information playback windows to form interrelated segmented multimedia information.

8. A multimedia information processing device, characterized in that: The device comprises: An information display module, used to present business information and a multimedia information display interface in the business processing interface, wherein the multimedia information display interface includes at least two multimedia information playback windows; An information processing module, configured to obtain a resource group stored in a server, wherein the resource group includes parameter information of a multimedia information playback window and multimedia information, and the multimedia information is adapted to the number, position, and size information of the at least two multimedia information playback windows; The information display module is further used to determine parameter information of the multimedia information playback window based on the acquired resource group; determine the playback order of multimedia information in different multimedia information playback windows through the parameter information of the multimedia information playback window; when presenting business information through the business processing interface, present corresponding multimedia information in at least two multimedia information playback windows of the multimedia information display interface according to the playback order of the multimedia information, wherein the at least two multimedia information playback windows include a first multimedia information playback window and a second multimedia information playback window; The information display module is further configured to play a dynamic image frame moving from the first multimedia information playback window to the second multimedia information playback window on the service processing interface when the playback of the multimedia information in the first multimedia information playback window ends, wherein the movement speed of the dynamic image frame is determined according to the distance between the first multimedia information playback window and the second multimedia information playback window; The information display module is also used to perform one of the following processes when the playback of the multimedia information ends: loopingly presenting the multimedia information in at least two multimedia information playback windows of the multimedia information display interface; presenting new multimedia information in at least two multimedia information playback windows of the multimedia information display interface; presenting multimedia information included in different resource groups in the same target resource in at least two multimedia information playback windows of the multimedia information display interface.

9. The device according to claim 8, characterized in that The information processing module is further used to determine a multimedia information playback window that matches the parameter information of the multimedia information playback window through the resource group including the parameter information of the multimedia information playback window and the multimedia information; The information display module is further used to present an initial image frame through the multimedia information playback window when the multimedia information in the multimedia information playback window is not played; The information processing module is further used to identify the playing status of the multimedia information in the multimedia information playing window, and play the corresponding multimedia information in different multimedia information playing windows in sequence according to the playing order of the multimedia information and the index information of the multimedia information playing window; The information display module is further configured to present an end image frame in the multimedia information playback window when the playback of the multimedia information in the multimedia information playback window is finished.

10. An electronic device, characterized in that: The electronic device comprises: A memory for storing executable instructions; A processor, configured to implement the multimedia information processing method according to any one of claims 1 to 7 when running the executable instructions stored in the memory.

11. A computer-readable storage medium storing executable instructions, characterized in that: When the executable instructions are executed by the processor, the multimedia information processing method according to any one of claims 1 to 7 is implemented.

12. A computer program product comprising computer executable instructions or a computer program, characterized in that: When the computer executable instructions or computer programs are executed by a processor, the multimedia information processing method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Picture check device, system and method

    CN106028060A

  • Multimedia file playing method and device, electronic device and storage medium

    CN110149539A

  • Desktop wallpaper display method and device and computer readable storage medium

    CN111290822A

  • Multimedia information processing method and device, electronic equipment and storage medium

    CN111324271A

  • Android platform-based multimedia resource playing method and device, and terminal device

    WO2017101415A1