A method for processing multimedia data

CN119450145BActive Publication Date: 2026-08-11冠县融媒体中心
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-18
Publication Date
2026-08-11

AI Technical Summary

Technical Problem

[0003]本发明针对现有技术中存在的技术问题,提供一种多媒体数据的处理方法来解决现有处理方法不便于实现对直播多媒体数据的处理,并结合直播发生用户的IP结合式预审核和直播观看用户的IP结合式再审核,降低直播时不同IP地址下的文化冲突、地域矛盾、观点矛盾、情感矛盾的问题

Benefits of technology

[0029] 1) This invention, through the combined pre-verification of the IP of the user who initiates the live broadcast and the combined re-verification of the IP of the user who watches the live broadcast in step SS02, can effectively reduce cultural conflicts, regional conflicts, viewpoint conflicts, and emotional conflicts under different IP addresses during the live broadcast, and improve the viewing experience of the audience in the region to which the IP belongs. It can also reduce the discomfort or displeasure rate of the user watching the multimedia data, thereby contributing to the creation of a harmonious live broadcast environment and atmosphere.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119450145B_ABST
    Figure CN119450145B_ABST
Patent Text Reader

Abstract

This invention relates to the field of multimedia data processing technology, specifically a method for processing multimedia data. It includes the following steps: SS01, First Multimedia Data Acquisition: A cloud server collects and acquires the first multimedia data generated during a live stream by a user; SS02, Second Multimedia Data Storage: After the first multimedia data acquisition, the cloud server collects the identity ID of the user initiating the live stream, the IP address of the user transmitting multimedia data, and the standard time of the region where that IP address is located during the multimedia data transmission. The beneficial effects of this invention are: By combining the IP address of the user initiating the live stream for pre-verification and the IP address of the user watching the live stream for re-verification in step SS02, this invention can effectively reduce cultural conflicts, regional contradictions, viewpoint conflicts, and emotional conflicts arising from different IP addresses during a live stream, and improve the viewing experience for audiences in the region where the IP address belongs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of multimedia data processing technology, specifically to a method for processing multimedia data. Background Technology

[0002] In the prior art, patent document CN110062163B discloses a method and apparatus for processing multimedia data, including acquiring first multimedia data, performing multi-dimensional analysis on the first multimedia data to obtain multimedia dimension information; capturing video based on the multimedia dimension information to obtain second multimedia data. Further, the multimedia data processing method further includes: detecting the number of scenes constituting the first multimedia data; when multiple scenes are detected, acquiring the switching effects between multiple scenes and the scene information corresponding to each scene. Further, the multimedia data processing method further includes: detecting the number of scenes constituting the first multimedia data; when only one scene is detected, acquiring the scene information corresponding to that scene. Further, the multimedia data processing method further includes: detecting the scene corresponding to each frame in the first multimedia data, and... The number of scenes constituting the first multimedia data is determined based on the matching degree of the scenes corresponding to two adjacent frames. The above processing method can obtain information such as filters, special effects, and transitions of the first multimedia data by parsing the first multimedia data. Then, the user uses the same multimedia dimension information as the first multimedia data to shoot a video and obtains second multimedia data with the same effect as the first multimedia data. The compliance and legality of the first multimedia data are improved by using the second multimedia data. However, the above processing method is not convenient for processing live multimedia data. In addition, it is necessary to combine the IP of the user who is live streaming for pre-screening and the IP of the user who is watching the live stream for re-screening to reduce cultural conflicts, regional conflicts, viewpoint conflicts, and emotional conflicts under different IP addresses during the live stream. Based on this, the present invention provides a multimedia data processing method to solve the problems mentioned in the background art. Summary of the Invention

[0003] This invention addresses the technical problems existing in the prior art by providing a multimedia data processing method to solve the problem that existing processing methods are not convenient for processing live multimedia data. It also combines the IP address of the user who is live streaming with the IP address of the user who is watching the live stream for pre-screening and the IP address of the user who is watching the live stream for re-screening, thereby reducing the problems of cultural conflicts, regional conflicts, conflicting opinions, and emotional conflicts caused by different IP addresses during live streaming.

[0004] The technical solution of the present invention to solve the above-mentioned technical problems is as follows: A method for processing multimedia data, comprising the following steps:

[0005] SS01, First multimedia data acquisition: The cloud server collects and acquires the first multimedia data generated during the live broadcast by the user.

[0006] SS02, Second Multimedia Data Storage: After the first multimedia data is collected, the cloud server collects the identity ID of the user who initiated the live broadcast, the IP address of the user whose multimedia data transmission occurred during the live broadcast, and the standard time of the region where the IP address is located when the multimedia data transmission occurred. The cloud server combines the live broadcast user identity ID and user IP address to match the multimedia data review rules and re-editing rules that match the data output IP address and identity ID. After the first multimedia data is reviewed and re-edited, the cloud service stores the second multimedia data corresponding to the first multimedia data. The second multimedia data is used to improve the compliance and legality of the first multimedia data.

[0007] SS03, Third Multimedia Data Output: When a live streaming user terminal inputs the identity ID of the live streaming initiator and initiates a live streaming viewing request under that ID, the cloud server reads the identity ID of the live streaming user and the IP request address of the live streaming initiator. The cloud server combines the identity ID and IP request address of the live streaming user to match the multimedia data review rules and re-editing rules of the live streaming user's identity ID and IP request address. After reviewing and re-editing the second multimedia data, the cloud server outputs the third multimedia data to the live streaming user terminal to improve the matching degree with the live streaming user based on the second multimedia data.

[0008] SS04. Interactive Data Feedback: When a user terminal views the video stream of the third multimedia data during a live broadcast, bullet comments and directory indexes that comply with the review rules can be added to the third multimedia data according to the user terminal's corresponding interactive permissions. When a user terminal views the video stream of the third multimedia data during a live broadcast, the cloud server divides the third multimedia data frame by frame and records the total number of views ∑1, the total number of bullet comments ∑2, the total number of likes ∑3, and the total number of shares ∑4 for each frame. After the live broadcast ends, the third multimedia data and the recorded auxiliary dataset are combined into fourth multimedia data. After the fourth multimedia data is generated, interactive parameters and interactive records are added to the third multimedia data to increase the data volume of the third multimedia data. After the fourth multimedia data is generated, it is input into the cloud server in real time and stored by the cloud server.

[0009] SS05, Query Request: When multiple users initiate a query request for the fourth multimedia data to the cloud server, the cloud server records the number of query requests for the fourth multimedia data in real time.

[0010] SS06, real-time ranking of popularity values. When the number of requests to view the fourth multimedia data is ≥ M, the cloud server divides the fourth multimedia data frame by frame and calculates the popularity value of the fourth multimedia data frame by frame. The popularity value corresponding to each frame is denoted as ∑.

[0011] ∑=(∑1+∑2+∑3+∑4)÷&×H

[0012] H is an additional value for the live streaming management platform or cloud server, where H ≥ 0;

[0013] SS07. Segmentation: Following steps SS06, the cloud server uses a built-in algorithm to define multiple popularity value ranges. These ranges are sequentially connected, and each range corresponds to a multimedia data set with a specified number of frames and duration. Ultimately, the fourth multimedia data is divided into multiple popularity segments. After these segments are established, the cloud server automatically generates an index ID matching each segment. Once the multiple segments and index IDs are established, the cloud server generates the fifth multimedia data set from the fourth multimedia data set. This generation of the fifth multimedia data set improves the indexability and readability of the fourth multimedia data set.

[0014] SS08, Multi-node storage: After step SS07, the fifth multimedia data is transmitted to the cloud server, and the cloud server performs multi-node classification, hierarchical compression and storage on the fifth multimedia data.

[0015] SS09, Data Request: When multiple requesting terminals send a request to the cloud server to read fifth media data, the cloud server reads the terminal parameters of the requesting terminals. The terminal parameters include the user ID value, peak network speed, storage space information, and the IP address of the requesting terminal. Based on the terminal parameters, the cloud server inputs sixth multimedia data, which is based on the fifth multimedia data and matches the terminal parameters, into each requesting terminal. The sixth multimedia data is used to improve the matching degree between the fifth multimedia data and the user ID permissions, network speed, and storage space or storage capacity. Finally, compliant and legal multimedia live broadcast data with high matching degree and high adaptability is generated on the first multimedia data, second multimedia data, third multimedia data, fourth multimedia data, and fifth multimedia data.

[0016] After the identity ID is collected, the cloud server obtains the live streaming permission corresponding to the user ID. After collecting the multimedia data, the cloud server collects it in real time and collects the standard time of the region where the data transmission IP is located. After collecting the multimedia data, the cloud server performs frame processing on the input multimedia data, and each frame of data corresponds to a standard timestamp of the region where the IP is located.

[0017] Based on the above technical solution, the present invention can be further improved as follows.

[0018] Furthermore, in step SS02, each IP address in the same region corresponds to a specific second multimedia data. The second multimedia data under multiple IP regions are different. In step SS09, the terminal parameters are different, so the multimedia data of the sixth multimedia data input request terminal are different.

[0019] Furthermore, in step SS02, after the cloud server reads the live stream user's identity ID, the cloud server automatically matches the live stream permissions of the user with that identity ID. The live stream permissions include the live stream duration, live stream type, live stream speech, and prohibited words or actions. In step SS03, after the cloud server reads the live stream viewer's identity ID, the cloud server automatically matches the view permissions of that user ID. The view permissions include the live stream viewing duration, the types of live streams that can be viewed, the live stream speech that can be viewed, and the live stream actions.

[0020] Furthermore, the multimedia data review rules and re-editing rules in steps SS02 and SS03 include prohibited quotes, prohibited emotional words and prohibited actions under each IP area, as well as prohibited quotes, prohibited emotional words and prohibited actions under publicly known conditions.

[0021] Furthermore, the cloud server outputs the third multimedia data and the first multimedia data is input into the cloud server at a set time difference T.

[0022] Furthermore, in step SS08, after the fifth multimedia data is transmitted to the cloud server, the cloud server performs distributed multi-node storage on the fifth multimedia data. During multi-node storage,

[0023] The higher the popularity level P corresponding to a certain index ID, the higher the number of nodes for storing multimedia data under that popularity level P, and the higher the resolution, bitrate, and frame rate of the multimedia data matched by that popularity value range, and vice versa.

[0024] Furthermore, in step SS09, the cloud server obtains the number of read requests P1 for the fifth media data in real time. When the terminal requests to view the sixth media data, the cloud server records the number of clicks P2 for the index ID corresponding to a certain popularity segment in the sixth media data in real time.

[0025] Furthermore, the following algorithm is used to calculate the popularity level corresponding to a certain index ID:

[0026] P = P2 ÷ P1.

[0027] Furthermore, in step SS08, when the cloud server performs multi-node classification and hierarchical compression storage of the fifth multimedia data, it performs different levels of compression ratio compression, resolution conversion, bitrate adjustment, and frame rate control on the hot segments matching different index IDs. In step SS09, when the cloud server processes the fifth multimedia data, it includes the following methods: resolution control, bitrate control, frame rate control, and encoding method control.

[0028] The beneficial effects of this invention are:

[0029] 1) This invention, through the combined pre-verification of the IP of the user who initiates the live broadcast and the combined re-verification of the IP of the user who watches the live broadcast in step SS02, can effectively reduce cultural conflicts, regional conflicts, viewpoint conflicts, and emotional conflicts under different IP addresses during the live broadcast, and improve the viewing experience of the audience in the region to which the IP belongs. It can also reduce the discomfort or displeasure rate of the user watching the multimedia data, thereby contributing to the creation of a harmonious live broadcast environment and atmosphere.

[0030] 2) This invention provides added value through a management platform or cloud server, which on the one hand can accurately control the popularity of fourth-party multimedia data and effectively control the spread of prohibited or illegal content, and on the other hand can control the trend of popularity and the impact on public opinion.

[0031] 3) By using multi-node storage and terminal-based output of data in the data processing method, this invention can effectively save the indexing time and load of cloud servers and reduce the space occupied by cloud servers. On the other hand, it can reduce the bandwidth load rate of cloud services, thereby reducing the cost of multimedia data processing. Attached Figure Description

[0032] Figure 1 This is a schematic diagram of the flow structure of a multimedia data processing method according to the present invention;

[0033] Figure 2 This is a flowchart illustrating the steps of a multimedia data processing method according to the present invention. Detailed Implementation

[0034] The principles and features of the present invention are described below with reference to the accompanying drawings. The examples given are only for explaining the present invention and are not intended to limit the scope of the present invention.

[0035] The present invention provides the following preferred embodiments.

[0036] like Figure 1 and Figure 2 As shown, a method for processing multimedia data includes the following steps:

[0037] SS01, First multimedia data acquisition: The cloud server collects and acquires the first multimedia data generated during the live broadcast by the user.

[0038] SS02, Second Multimedia Data Storage: After the first multimedia data is collected, the cloud server collects the identity ID of the user who initiated the live broadcast, the IP address of the user whose multimedia data transmission occurred during the live broadcast, and the standard time of the region where the IP address is located when the multimedia data transmission occurred. The cloud server combines the live broadcast user identity ID and user IP address to match the multimedia data review rules and re-editing rules that match the data output IP address and identity ID. After the first multimedia data is reviewed and re-edited, the cloud service stores the second multimedia data corresponding to the first multimedia data. The second multimedia data is used to improve the compliance and legality of the first multimedia data.

[0039] SS03, Third Multimedia Data Output: When a live streaming user terminal inputs the identity ID of the live streaming initiator and initiates a live streaming viewing request under that ID, the cloud server reads the identity ID of the live streaming user and the IP request address of the live streaming initiator. The cloud server combines the identity ID and IP request address of the live streaming user to match the multimedia data review rules and re-editing rules of the live streaming user's identity ID and IP request address. After reviewing and re-editing the second multimedia data, the cloud server outputs the third multimedia data to the live streaming user terminal to improve the matching degree with the live streaming user based on the second multimedia data.

[0040] By combining the IP of the live stream user for pre-screening and the IP of the live stream viewer for re-screening in step SS02, it is possible to effectively reduce cultural conflicts, regional conflicts, viewpoint conflicts, and emotional conflicts under different IP addresses during the live stream, improve the viewing experience of the audience in the IP's region, and reduce the discomfort or dissatisfaction rate of the viewer during multimedia data viewing, thereby contributing to the creation of a harmonious live stream environment and atmosphere.

[0041] In step SS02, after the cloud server reads the live stream user's identity ID, the cloud server automatically matches the live stream permissions of the user with that identity ID. The live stream permissions include the live stream duration, live stream type, live stream speech, and prohibited words or actions. In step SS03, after the cloud server reads the live stream viewer's identity ID, the cloud server automatically matches the view permissions of that user ID. The view permissions include the live stream viewing duration, the types of live streams that can be viewed, the live stream speech that can be viewed, and the live stream actions.

[0042] The multimedia data review and re-editing rules in steps SS02 and SS03 include prohibited quotes, prohibited emotional words and prohibited actions under each IP zone, as well as prohibited quotes, prohibited emotional words and prohibited actions under publicly known conditions;

[0043] SS04. Interactive Data Feedback: When a user terminal views the video stream of the third multimedia data during a live broadcast, bullet comments and directory indexes that comply with the review rules can be added to the third multimedia data according to the user terminal's corresponding interactive permissions. When a user terminal views the video stream of the third multimedia data during a live broadcast, the cloud server divides the third multimedia data frame by frame and records the total number of views ∑1, the total number of bullet comments ∑2, the total number of likes ∑3, and the total number of shares ∑4 for each frame. After the live broadcast ends, the third multimedia data and the recorded auxiliary dataset are combined into fourth multimedia data. After the fourth multimedia data is generated, interactive parameters and interactive records are added to the third multimedia data to increase the data volume of the third multimedia data. After the fourth multimedia data is generated, it is input into the cloud server in real time and stored by the cloud server.

[0044] By using interactive data feedback, the data in the first multimedia data is effectively enriched, and the responsiveness of the first multimedia data is recorded in real time when it is output to the live audience.

[0045] SS05, Query Request: When multiple users initiate a query request for the fourth multimedia data to the cloud server, the cloud server records the number of query requests for the fourth multimedia data in real time.

[0046] SS06, real-time ranking of popularity values. When the number of requests to view the fourth multimedia data is ≥ M, the cloud server divides the fourth multimedia data frame by frame and calculates the popularity value of the fourth multimedia data frame by frame. The popularity value corresponding to each frame is denoted as ∑.

[0047] ∑=(∑1+∑2+∑3+∑4)÷&×H

[0048] H is an additional value for the live streaming management platform or cloud server, where H ≥ 0;

[0049] By leveraging the added value of management platforms or cloud servers, it is possible to precisely control the popularity of fourth-party multimedia data and effectively control the spread of prohibited or illegal content. On the other hand, it is also possible to control the trend of popularity and the impact on public opinion.

[0050] SS07. Segmentation: Following steps SS06, the cloud server uses a built-in algorithm to define multiple popularity value ranges. These ranges are sequentially connected, and each range corresponds to a multimedia data set with a specified number of frames and duration. Ultimately, the fourth multimedia data is divided into multiple popularity segments. After these segments are established, the cloud server automatically generates an index ID matching each segment. Once the multiple segments and index IDs are established, the cloud server generates the fifth multimedia data set from the fourth multimedia data set. This generation of the fifth multimedia data set improves the indexability and readability of the fourth multimedia data set.

[0051] SS08, Multi-node storage: After step SS07, the fifth multimedia data is transmitted to the cloud server, and the cloud server performs multi-node classification, hierarchical compression and storage on the fifth multimedia data.

[0052] In step SS08, after the fifth multimedia data is transmitted to the cloud server, the cloud server performs distributed multi-node storage on the fifth multimedia data. During multi-node storage,

[0053] The higher the popularity level P corresponding to a certain index ID, the higher the number of nodes for storing multimedia data under that popularity level P, and the higher the resolution, bitrate, and frame rate of the multimedia data matched by that popularity value range; conversely, the lower the popularity level P, the lower the resolution, bitrate, and frame rate.

[0054] The following algorithm is used to calculate the popularity level corresponding to a certain index ID:

[0055] P = P² ÷ P¹

[0056] SS09, Data Request: When multiple requesting terminals send a request to the cloud server to read fifth media data, the cloud server reads the terminal parameters of the requesting terminals. The terminal parameters include the user ID value, peak network speed, storage space information, and the IP address of the requesting terminal. Based on the terminal parameters, the cloud server inputs sixth multimedia data, which is based on the fifth multimedia data and matches the terminal parameters, into each requesting terminal. The sixth multimedia data is used to improve the matching degree between the fifth multimedia data and the user ID permissions, network speed, and storage space or storage capacity. Finally, compliant and legal multimedia live broadcast data with high matching degree and high adaptability is generated on the first multimedia data, second multimedia data, third multimedia data, fourth multimedia data, and fifth multimedia data.

[0057] After the identity ID is collected, the cloud server obtains the live streaming permission corresponding to the user ID. After collecting the multimedia data, the cloud server collects it in real time and collects the standard time of the region where the data transmission IP is located. After collecting the multimedia data, the cloud server performs frame processing on the input multimedia data, and each frame of data corresponds to a standard timestamp of the region where the IP is located.

[0058] By providing the sixth multimedia data based on the terminal parameters, the load on the requesting terminal is effectively reduced, and the sixth multimedia data is output stably, continuously, and continuously in a streaming manner on the requesting terminal.

[0059] In step SS08, when the cloud server performs multi-node classification and hierarchical compression storage of the fifth multimedia data, it performs different levels of compression ratio compression, resolution conversion, bitrate adjustment and frame rate control on the hot segments matching different index IDs. In step SS09, when the cloud server processes the fifth multimedia data, it includes the following methods: resolution control, bitrate control, frame rate control and encoding method control.

[0060] By controlling the above methods, the smoothness of multimedia data transmission and reading can be guaranteed.

[0061] In step SS02, each IP address in the same region corresponds to a specific second multimedia data. The second multimedia data under multiple IP regions are different. In step SS09, the terminal parameters are different, so the multimedia data of the sixth multimedia data input request terminal are different.

[0062] The cloud server outputs third multimedia data, and the first multimedia data is input into the cloud server, maintaining a set time difference T.

[0063] In step SS09, the cloud server obtains the number of read requests P1 for the fifth media data in real time. When the terminal requests to view the sixth media data, the cloud server records the number of clicks P2 for the index ID corresponding to a certain popularity segment in the sixth media data.

[0064] By using multi-node storage and distributed terminal output in the data processing method, we can effectively save cloud server indexing time and load, reduce cloud server space usage, and reduce cloud service bandwidth load, thereby reducing the cost of multimedia data processing.

[0065] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method of processing multimedia data, characterized by, Includes the following steps: SS01, First multimedia data acquisition: The cloud server collects and acquires the first multimedia data generated during the live broadcast by the user. SS02, Second multimedia data storage: After the first multimedia data has been reviewed and re-edited, the cloud service stores the second multimedia data corresponding to the first multimedia data, thereby improving the compliance and legality of the first multimedia data. SS03, Third multimedia data output: After reviewing and re-editing the second multimedia data, the cloud server outputs the third multimedia data to the live streaming user terminal to improve the matching degree with the live streaming user based on the second multimedia data. SS04, Interactive Data Feedback: After the live stream ends, the third multimedia data and the recorded auxiliary dataset are converted into fourth multimedia data. After the fourth multimedia data is generated, interactive parameters and interactive records are added to the third multimedia data to increase the data volume of the third multimedia data. After the fourth multimedia data is generated, it is input into the cloud server in real time and stored by the cloud server. SS05, View Request: When multiple live stream viewers initiate a view request for the fourth multimedia data to the cloud server, the cloud server records the number of view requests for the fourth multimedia data in real time. SS06, real-time sorting of popularity values, dividing the fourth multimedia data frame by frame, and calculating the popularity value of the fourth multimedia data frame by frame; SS07. Segmentation and division: Generate fifth multimedia data based on fourth multimedia data. By generating fifth multimedia data, the indexability and readability of fourth multimedia data can be improved. SS08, Multi-node storage: After step SS07, the fifth multimedia data is transmitted to the cloud server, and the cloud server performs multi-node classification, hierarchical compression and storage on the fifth multimedia data. SS09, Data Request: Generate compliant and legal multimedia live streaming data with high matching and adaptability based on the first multimedia data, second multimedia data, third multimedia data, fourth multimedia data, and fifth multimedia data. In step SS02, after the first multimedia data collection, the cloud server collects the identity ID of the user who broadcast the live stream, the multimedia data transmission IP address of the user who broadcast the live stream, and the standard time of the region where the IP address is located when the multimedia data is transmitted. The cloud server combines the identity ID of the user who broadcast the live stream and the IP address of the user who broadcast the live stream to match the multimedia data review rules and re-editing rules that match the data output IP address and identity ID. In step SS03, when a live streaming user terminal inputs the identity ID of the user who initiated the live streaming and initiates a live streaming viewing request under that ID, the cloud server reads the identity ID of the live streaming user and the IP request address of the user who initiated the live streaming viewing. The cloud server combines the identity ID of the live streaming user and the IP request address to match the multimedia data review rules and re-editing rules of the live streaming user's identity ID and IP request address. The multimedia data review and re-editing rules in steps SS02 and SS03 include prohibited quotes, prohibited emotional words, and prohibited actions under each IP zone.

2. The multimedia data processing method according to claim 1, characterized in that, In step SS04, when the live streaming user terminal views the video stream of the third multimedia data, it can add bullet comments and directory indexes that comply with the review rules to the third multimedia data according to the interaction permissions corresponding to the live streaming user terminal. When the live streaming user terminal views the video stream of the third multimedia data, the cloud server divides the third multimedia data frame by frame and records the total number of user views ∑1, the total number of bullet comments ∑2, the total number of likes ∑3, and the total number of shares ∑4 for each frame of data. In step SS06, when the number of requests to view the fourth multimedia data is ≥ M, the cloud server divides the fourth multimedia data frame by frame and calculates the popularity value of the fourth multimedia data frame by frame. The popularity value corresponding to each frame is denoted as ∑. ∑=(∑1+∑2+∑3+∑4)÷&×H H is an additional value for the live streaming management platform or cloud server, where H ≥ 0; In step SS07, after step SS06, the cloud server uses a built-in algorithm to limit multiple heat value ranges. These heat value ranges are connected sequentially, and each heat value range corresponds to a multimedia data with a specified number of frames and a specified duration. Finally, the fourth multimedia data is divided into multiple heat segments. After the multiple heat segments are established, the cloud server automatically generates an index ID matching each heat segment. After the multiple heat segments and index IDs are established, the cloud server generates the fifth multimedia data generated from the fourth multimedia data. In step SS09, regarding data requests, when multiple live streaming users request terminals to send a request to the cloud server to read the fifth media data, the cloud server reads the terminal parameters of the requesting terminals. The terminal parameters include the identity ID value of the live streaming users, peak network speed, storage space information, and the IP address of the requesting terminals. Based on the terminal parameters, the cloud server inputs sixth multimedia data that is based on the fifth multimedia data processing and matches the terminal parameters into each requesting terminal. The sixth multimedia data is used to improve the matching degree between the fifth multimedia data and the identity ID permissions, network speed, and storage space or storage capacity of the live streaming users. After the user's identity ID is collected during the live broadcast, the cloud server obtains the live broadcast permission corresponding to the user's identity ID. After collecting multimedia data, the cloud server collects it in real time and collects the standard time of the region where the data transmission IP is located. After collecting multimedia data, the cloud server performs frame-by-frame processing on the input multimedia data, and each frame of data corresponds to a standard timestamp of the region where the IP is located.

3. The multimedia data processing method according to claim 2, characterized in that, In step SS02, each user IP address in the same region corresponds to a specific second multimedia data. The second multimedia data under multiple IP regions are different. In step SS09, if the terminal parameters are different, the multimedia data of the sixth multimedia data input request terminal will be different.

4. The multimedia data processing method according to claim 3, characterized in that, In step SS02, after the cloud server reads the user's identity ID for the live stream, the cloud server automatically matches the live stream permissions of the user with that identity ID. The live stream permissions include the live stream duration, live stream type, live stream speech, and prohibited words or actions. In step SS03, after the cloud server reads the identity ID of the live stream viewer, the cloud server automatically matches the viewing permissions of the live stream viewer's identity ID. The viewing permissions include the live stream viewing duration, the types of live streams that can be viewed, the live stream speech that can be viewed, and the live stream actions.

5. The multimedia data processing method according to claim 4, characterized in that, The cloud server outputs third multimedia data and the first multimedia data is input into the cloud server with a set time difference T.

6. The multimedia data processing method according to claim 2, characterized in that, In step SS08, after the fifth multimedia data is transmitted to the cloud server, the cloud server performs distributed multi-node storage on the fifth multimedia data. During multi-node storage, The higher the popularity level P corresponding to a certain index ID, the higher the number of nodes for storing multimedia data under that popularity level P, and the higher the resolution, bitrate, and frame rate of the multimedia data matched by that popularity value range, and vice versa.

7. A method for processing multimedia data according to claim 6, characterized in that, In step SS09, the cloud server obtains the number of read requests P1 for the fifth media data in real time. When the terminal requests to view the sixth media data, the cloud server records the number of clicks P2 for the index ID corresponding to a certain popularity segment in the sixth media data.

8. The multimedia data processing method according to claim 7, characterized in that, The following algorithm is used to calculate the popularity level corresponding to a certain index ID: P = P2 ÷ P1 Wherein, P1 represents the number of read requests for the cloud server to obtain the fifth media data in real time; P2 is the number of clicks on the index ID corresponding to a certain popularity segment in the sixth media data when the terminal requests to view the sixth media data; P represents the popularity level corresponding to a certain index ID.

9. A method for processing multimedia data according to claim 2, characterized in that, In step SS08, when the cloud server performs multi-node classification and hierarchical compression storage of the fifth multimedia data, it performs different levels of compression ratio compression, resolution conversion, bitrate adjustment and frame rate control on the hot segments matching different index IDs. In step SS09, when the cloud server processes the fifth multimedia data, it includes the following methods: resolution control, bitrate control, frame rate control and encoding method control.

Citation Information

Patent Citations

  • Multimedia data processing methods and devices

    CN110062163B

  • Method and system for monitoring video smoothness in live video streaming process

    CN106060663A

  • Media data processing method, device and system, and readable storage medium

    CN108965939A