Multimedia data processing method and device, computer equipment and storage medium

Abstract

The invention relates to a multimedia data processing method and device, equipment and a storage medium. The method relates to the cloud technology, and comprises the following steps: receiving a multimedia data access request, generating an index file corresponding to the multimedia data access request, and determining a signature file and a multimedia content file based on the index file. Target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file are obtained, the target signature data carry object identification information corresponding to the multimedia data access request, and the multimedia content file is obtained based on the target signature data and the multimedia content data. And obtaining target multimedia data corresponding to the multimedia data access request. By adopting the method, when data leakage or malicious propagation occurs, the object identification information carried by the leaked or propagated target multimedia data can be identified, so that a data leakage source and a data leakage path can be accurately determined, data security protection management and control are carried out in time, and the data security protection management and control processing efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of cloud technology, and in particular to a multimedia data processing method, apparatus, computer equipment, storage medium and computer program product. Background Art

[0002] With the development of cloud technology and the widespread application of various multimedia application platforms, the requirements for copyright protection and security protection of multimedia data content on various multimedia application platforms are increasing. In order to protect the legitimate rights and interests of the platform parties and multimedia data owners on the multimedia application platform for multimedia data content and avoid malicious transmission and illegal leakage of multimedia data, DRM technology (Digital Rights Management, understood as digital copyright management technology) is usually used to encrypt, license and digitally sign multimedia data content to control the use and dissemination of multimedia data content.

[0003] Traditionally used DRM technology can reduce the leakage of decryption keys during the entire playback process by configuring a DRM decryption module and setting up an independent encryption and decryption process. However, since DRM technology has not been fully popularized on different terminal devices that load various multimedia applications, and there is no matching DRM decryption module, multimedia data can still be downloaded on some terminals or platforms that do not support DRM technology, and then subsequently spread maliciously. Therefore, traditional DRM technology still has the problem of being unable to effectively determine the source and path of data leakage, and the security protection effect of multimedia data is poor. Summary of the invention

[0004] Based on this, it is necessary to provide a multimedia data processing method, device, computer equipment, computer-readable storage medium and computer program product that can accurately determine the source and path of data leakage when data leakage or malicious dissemination occurs, and promptly perform data security protection management and control to improve the security protection management and processing efficiency of multimedia data in response to the above-mentioned technical problems.

[0005] In a first aspect, the present application provides a method for processing multimedia data. The method comprises:

[0006] receiving a multimedia data access request, and generating an index file corresponding to the multimedia data access request;

[0007] Determining a signature file and a multimedia content file based on the index file;

[0008] Acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request;

[0009] Based on the target signature data and the multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained.

[0010] In a second aspect, the present application provides a multimedia data processing method. The method comprises:

[0011] If a multimedia data access request is detected, obtaining object identification information carried in the multimedia data access request and an index file matching the multimedia data access request;

[0012] Acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file;

[0013] Add watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, obtain the target multimedia data corresponding to the multimedia data access request.

[0014] In a third aspect, the present application also provides a multimedia data processing device. The device comprises:

[0015] An index file generating module, used for receiving a multimedia data access request and generating an index file corresponding to the multimedia data access request;

[0016] A signature file determination module, used to determine a signature file and a multimedia content file based on the index file;

[0017] A data acquisition module, used to acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request;

[0018] The target multimedia data generation module is used to obtain the target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data.

[0019] In a fourth aspect, the present application further provides a multimedia data processing device. The device comprises:

[0020] A multimedia data access request detection module, configured to, if a multimedia data access request is detected, obtain object identification information carried in the multimedia data access request and an index file matching the multimedia data access request;

[0021] A multimedia signature data acquisition module, used to acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file;

[0022] A watermark information adding module is used to add watermark information corresponding to the object identification information in the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, the target multimedia data corresponding to the multimedia data access request is obtained.

[0023] In a fifth aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0024] receiving a multimedia data access request, and generating an index file corresponding to the multimedia data access request;

[0025] Determining a signature file and a multimedia content file based on the index file;

[0026] Acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request;

[0027] Based on the target signature data and the multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained.

[0028] In a sixth aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0029] If a multimedia data access request is detected, obtaining object identification information carried in the multimedia data access request and an index file matching the multimedia data access request;

[0030] Acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file;

[0031] Add watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, obtain the target multimedia data corresponding to the multimedia data access request.

[0032] In a seventh aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0033] receiving a multimedia data access request, and generating an index file corresponding to the multimedia data access request;

[0034] Determining a signature file and a multimedia content file based on the index file;

[0035] Acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request;

[0036] Based on the target signature data and the multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained.

[0037] In an eighth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0038] If a multimedia data access request is detected, obtaining object identification information carried in the multimedia data access request and an index file matching the multimedia data access request;

[0039] Acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file;

[0040] Add watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, obtain the target multimedia data corresponding to the multimedia data access request.

[0041] In a ninth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0042] receiving a multimedia data access request, and generating an index file corresponding to the multimedia data access request;

[0043] Determining a signature file and a multimedia content file based on the index file;

[0044] Acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request;

[0045] Based on the target signature data and the multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained.

[0046] In a tenth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0047] If a multimedia data access request is detected, obtaining object identification information carried in the multimedia data access request and an index file matching the multimedia data access request;

[0048] Acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file;

[0049] Add watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, obtain the target multimedia data corresponding to the multimedia data access request.

[0050] In the above-mentioned multimedia data processing method, device, computer equipment, storage medium and computer program product, by receiving a multimedia data access request, an index file corresponding to the multimedia data access request is generated, and a signature file and a multimedia content file are determined based on the index file. Further, by obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file, the target multimedia data corresponding to the multimedia data access request is obtained based on the target signature data and the multimedia content data. Since the target signature data carries the object identification information corresponding to the multimedia data access request, the target multimedia data corresponding to the multimedia data access request obtained also carries the object identification information. Then, when data leakage or malicious dissemination occurs later, the target multimedia data that is leaked or disseminated can be further identified to determine the object identification information it carries, accurately determine the source and path of data leakage, and timely perform data security protection management and control, thereby improving the security protection management and processing efficiency of multimedia data. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1is an application environment diagram of a multimedia data processing method in an embodiment;

[0052] Figure 2 is a flowchart of a multimedia data processing method in one embodiment;

[0053] Figure 3 A schematic diagram of a process of acquiring target signature data corresponding to a signature file and multimedia content data corresponding to a multimedia content file in one embodiment;

[0054] Figure 4 A schematic diagram of a process of acquiring target signature data corresponding to a signature file and multimedia content data corresponding to a multimedia content file in another embodiment;

[0055] Figure 5 is a flowchart of a multimedia data processing method in another embodiment;

[0056] Figure 6 A schematic diagram of a process of adding watermark information in one embodiment;

[0057] Figure 7 A schematic diagram of target multimedia data obtained according to target signature data and multimedia content data in one embodiment;

[0058] Figure 8 A schematic diagram of a download process of a conventional common non-encrypted video file in one embodiment;

[0059] Fig. 9 A schematic diagram of a playback process of a traditional encrypted video file in one embodiment;

[0060] Fig.10 A schematic diagram of a playback process of target multimedia data in an embodiment;

[0061] Fig.11 is a flowchart of a multimedia data processing method in yet another embodiment;

[0062] Fig.12 is a timing diagram of a multimedia data processing method in one embodiment;

[0063] Fig.13 is a structural block diagram of a multimedia data processing device in one embodiment;

[0064] Fig.14 is a structural block diagram of a multimedia data processing device in one embodiment;

[0065] Fig.15 is an internal structure diagram of a computer device in one embodiment;

[0066] Fig.16FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0068] The multimedia data processing method provided in the embodiment of the present application is specifically related to cloud technology, which can be applied to the content distribution, data security protection and other scenarios of network media or application programs. Among them, cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize the calculation, storage, processing and sharing of data. Specifically, cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the application of cloud computing business model, which can form a resource pool, which is used on demand and is flexible and convenient. Among them, the background service of the technical network system requires a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. Cloud computing technology will become an important support in the actual application process of the technical network system. With the high development and application of the Internet industry, each item may have its own identification mark in the future, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately, and all kinds of industry data need strong system backing support, which can only be achieved through cloud technology.

[0069] Big data refers to a collection of data that cannot be captured, managed, and processed by conventional software tools within a certain time frame. It is a massive, high-growth, and diversified information asset that requires new processing models to have stronger decision-making power, insight discovery, and process optimization capabilities. With the advent of the cloud era, big data has also attracted more and more attention. Big data requires special technologies to effectively process large amounts of data within a tolerable time frame. Technologies applicable to big data include large-scale parallel processing databases, data mining, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems.

[0070] Cloud security refers to the general term for security software, hardware, users, institutions and security cloud platforms based on cloud computing business model applications. Cloud security integrates emerging technologies and concepts such as parallel processing, grid computing, and unknown virus behavior judgment. Through a large number of clients in a network, it monitors the abnormal behavior of software in the network, obtains the latest information of Trojans and malicious programs on the Internet, and sends it to the server for automatic analysis and processing, and then distributes virus and Trojan solutions to each client. Specifically, the main research directions of cloud security include: 1. Cloud computing security, mainly studying how to ensure the security of the cloud itself and various applications on the cloud, including cloud computer system security, secure storage and isolation of user data, user access authentication, information transmission security, network attack protection, compliance audit, etc.; 2. Cloudification of security infrastructure, mainly studying how to use cloud computing to build and integrate security infrastructure resources, optimize security protection mechanisms, including building a large-scale security event, information collection and processing platform through cloud computing technology, realizing the collection and correlation analysis of massive information, and improving the control and risk control capabilities of the entire network security events; 3. Cloud security services, mainly studying various security services provided to users based on cloud computing platforms, such as antivirus services.

[0071] With the development of the Internet, real-time data streams and diversified connected devices, as well as the promotion of demands for search services, social networks, mobile commerce and open collaboration, cloud technology has developed rapidly. At the same time, the emergence of cloud technology will drive tremendous changes in the entire Internet model and enterprise management model from a conceptual perspective.

[0072] The multimedia data processing method provided in the embodiment of the present application specifically relates to big data technology in cloud technology and cloud security technology. The multimedia data processing method provided in the embodiment of the present application can be applied to content distribution, data security protection and other scenarios such as network media or application programs, and can be specifically applied to the following scenarios: Figure 1In the application environment shown. Among them, the terminal 102 communicates with the broadcast control server 104 through the network. The data storage system can store the data that the broadcast control server 104 needs to process. The data storage system can be set up separately, can be integrated on the broadcast control server 104, or can be placed on the cloud or other network broadcast control servers. Among them, the terminal 102 can be but is not limited to various personal computers, laptops, smart phones, tablets, Internet of Things devices, portable wearable devices, and aircraft, etc. The Internet of Things device can be a smart speaker, a smart TV, a smart car-mounted device, etc. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc. The broadcast control server 104 can be an independent physical broadcast control server, or a broadcast control server cluster composed of multiple physical broadcast control servers. It can also be a cloud broadcast control server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, as well as big data and artificial intelligence platforms. The terminal 102 and the broadcast control server 104 can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.

[0073] Among them, the terminal 102 and the broadcast control server 104 can be used alone to execute the multimedia data processing method provided in the embodiment of the present application, and the terminal 102 and the broadcast control server 104 can also cooperate to execute the multimedia data processing method provided in the embodiment of the present application. For example, taking the terminal 102 and the broadcast control server 104 to cooperate to execute the multimedia data processing method provided in the embodiment of the present application as an example, the terminal 102 receives the multimedia data access request triggered by the use object, and generates an index file corresponding to the multimedia data access request, so as to determine the signature file and the multimedia content file based on the index file. Further, the terminal 102 obtains the target signature data corresponding to the signature file from the broadcast control server 104, and obtains the multimedia content data corresponding to the multimedia content file from the content distribution network, wherein the target signature data carries the object identification information corresponding to the multimedia data access request. Then, the terminal 102 can obtain the target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data, and the obtained target multimedia data is used to play at the terminal 102 for subsequent processing such as viewing and downloading using the object.

[0074] Similarly, taking the case where the terminal 102 and the broadcast control server 104 cooperate to execute the multimedia data processing method provided in the embodiment of the present application as an example, if the broadcast control server 104 detects a multimedia data access request triggered by the terminal 102, the object identification information carried by the multimedia data access request and the index file matching the multimedia data access request are obtained. Furthermore, the broadcast control server 104 obtains the target signature data by obtaining the signature file corresponding to the index file, and obtains the multimedia signature data corresponding to the signature file, and adds the watermark information corresponding to the object identification information to the multimedia signature data. The obtained target signature data is used to feed back to the terminal 102, and the terminal 102 receives the target signature data corresponding to the signature file fed back by the broadcast control server 104, and obtains the multimedia content data corresponding to the multimedia content file from the content distribution network, and can obtain the target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data.

[0075] In one embodiment, Figure 2 As shown, a multimedia data processing method is provided, which is applied to Figure 1 The terminal 102 in the example is used as an example to illustrate, and the following steps are included:

[0076] Step S202: receiving a multimedia data access request and generating an index file corresponding to the multimedia data access request.

[0077] The user object may trigger a multimedia data access request based on a terminal loaded with different applications, and the terminal may generate a corresponding index file based on the multimedia data access request. Specifically, the terminal may be a terminal device such as a smart phone, a tablet computer, a laptop, a personal computer, and an IoT device, and the application loaded on the terminal that can provide multimedia data access may be various multimedia data playback applications (such as video playback programs, short video sharing programs, etc.).

[0078] Specifically, the index file corresponding to the multimedia data access request can be an M3U8 file used for multimedia data playback (i.e., a text-based playlist file format, including a series of URL addresses, namely Uniform Resource Locator addresses, which are used to point to each segment file of the streaming media, and may also correspond to metadata information such as title, author, and duration), that is, it specifically receives a multimedia data access request triggered by a terminal based on a usage object, and generates a corresponding M3U8 file based on the multimedia data access request.

[0079] The index file, namely the M3U8 file, includes a signature file for obtaining signature data and a multimedia content file for obtaining multimedia content data.

[0080] Step S204: determining the signature file and the multimedia content file based on the index file.

[0081] Specifically, a signature identification process is performed based on the index file, a signature file carrying a signature identification is identified from the index file, and an index file not carrying a signature identification is determined as a multimedia content file.

[0082] Among them, the signature identifier is used to mark the signature data in the multimedia data, that is, by adding the signature identifier in advance, it is possible to determine which segment of multimedia data is used as the target signature data. At the same time, the URL address file in the index file used to obtain the target signature data can be used as the signature file carrying the signature identifier, so that the multimedia data used as the target signature data can be obtained later based on the signature file carrying the signature identifier (that is, the URL address file used to obtain the target signature data).

[0083] Furthermore, for the index file corresponding to the multimedia data access request, after the signature file carrying the signature identifier is determined, the index file without the signature identifier is further determined as the multimedia content file. The index file without the signature identifier, i.e., the URL address file without the signature identifier, is used to obtain the actual multimedia content data from the content distribution network.

[0084] Step S206, obtaining target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file, wherein the target signature data carries object identification information corresponding to the multimedia data access request.

[0085] Specifically, the signature file carrying the signature identifier corresponds to the signature data access address, that is, by obtaining the URL address file carrying the signature identifier, the signature data access address used to obtain the target signature data is determined according to the URL address file carrying the signature identifier, so as to download the corresponding target signature data from the broadcast control server according to the signature data access address.

[0086] Similarly, a multimedia content file that does not carry a signature identifier corresponds to a multimedia content data access address, that is, by obtaining a URL address file that does not carry a signature identifier (that is, a multimedia content file), a multimedia content data access address for obtaining multimedia content data is determined according to the URL address file that does not carry a signature identifier, so as to download the corresponding multimedia content data from the content distribution network based on the multimedia content data access address.

[0087] Among them, the target signature data carries the object identification information corresponding to the multimedia data access request, that is, the target signature data can be used to determine the user object that triggers the multimedia data access request, so as to perform subsequent multimedia security protection processing based on the user object and the terminal device where the user object is located. Among them, the multimedia security protection processing specifically includes: detection of malicious transmission and leakage of multimedia download data and multimedia recording data on various third-party platforms, and subsequent protection processing when malicious transmission or malicious leakage occurs (for example, for malicious leakage of multimedia download data or recording data, delisting processing, access prohibition processing, and secondary download prohibition processing, etc.).

[0088] Step S208: obtaining target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data.

[0089] Specifically, after downloading the target signature data and the multimedia content data, the target signature data and the multimedia content data are combined to obtain the target multimedia data corresponding to the multimedia data access request.

[0090] Furthermore, since the target signature data carries object identification information corresponding to the multimedia data access request, the target multimedia data corresponding to the multimedia data access request also carries object identification information. After the target multimedia data is played on the terminal, when data leakage or malicious dissemination occurs subsequently, the leaked or disseminated target multimedia data can be further identified to determine the object identification information it carries, and the source and path of the data leakage can be accurately determined.

[0091] Among them, the actual user of the leaked data and the terminal device where the actual user is located can be determined according to the object identification information, and then subsequent multimedia security protection processing can be performed based on the actual user and the terminal device where the user is located.

[0092] In the above multimedia data processing method, by receiving a multimedia data access request, an index file corresponding to the multimedia data access request is generated, and a signature file and a multimedia content file are determined based on the index file. Furthermore, by obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file, the target multimedia data corresponding to the multimedia data access request is obtained based on the target signature data and the multimedia content data. Since the target signature data carries the object identification information corresponding to the multimedia data access request, the target multimedia data corresponding to the multimedia data access request also carries the object identification information. In the event of data leakage or malicious dissemination, the target multimedia data that is leaked or disseminated can be further identified to determine the object identification information it carries, accurately determine the source and path of the data leakage, and timely perform data security protection management and control, thereby improving the security protection management and processing efficiency of multimedia data.

[0093] In one embodiment, Figure 3 As shown, the steps of obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file specifically include:

[0094] Step S302: Acquire a signature data access address corresponding to the signature file and a multimedia content data access address corresponding to the multimedia content file.

[0095] Specifically, the signature file carrying the signature identifier corresponds to the signature data access address, that is, by obtaining the URL address file carrying the signature identifier, the signature data access address used to obtain the target signature data is determined according to the URL address file carrying the signature identifier, so as to obtain the corresponding target signature data according to the signature data access address.

[0096] Similarly, a multimedia content file that does not carry a signature identifier corresponds to a multimedia content data access address, that is, by obtaining a URL address file that does not carry a signature identifier (that is, a multimedia content file), the multimedia content data access address for obtaining the multimedia content data is determined according to the URL address file that does not carry a signature identifier, so as to obtain the corresponding multimedia content data based on the multimedia content data access address.

[0097] Step S304, calling the signature data download thread, and downloading the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address.

[0098] Specifically, since the target signature data corresponding to the signature file needs to be downloaded from the broadcast control server, and the service resources of the broadcast control server are limited, and it is necessary to respond to different multimedia data access requests and provide services for different terminal devices, its data download speed is slow, and it is necessary to call a pre-set signature data download thread to execute the signature data download thread and download the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address.

[0099] Step S306: downloading multimedia content data corresponding to the multimedia content file from the content distribution network according to the multimedia content data access address.

[0100] Specifically, a large amount of multimedia content data is stored on the content distribution network, namely CDN (full name: Content Delivery Network, which can redirect the data access request of the user object to the service node closest to the user object in real time according to the network traffic and the connection status, load status of each service node, distance to the user object and response time, so that the required data can be obtained nearby and the response speed of data access can be improved), and then the multimedia content data corresponding to the multimedia content file can be downloaded from the content distribution network through the multimedia content data access address.

[0101] Among them, the target signature data corresponding to the signature file can be downloaded from the broadcast control server by calling the pre-set signature data download thread, and the corresponding data segments do not need to be obtained in sequence in strict accordance with the time sequence of each segment in the multimedia data, that is, the process of obtaining the target signature data and the process of obtaining the multimedia content data do not interfere with each other, and can be performed simultaneously, or the target signature data with a slower download speed can be obtained first, and the multimedia content data can be obtained after a preset time period. Among them, the preset time period can be adjusted and set according to the actual application scenario and needs, and is not specifically limited.

[0102] In this embodiment, by obtaining a signature data access address corresponding to the signature file and a multimedia content data access address corresponding to the multimedia content file, and calling a signature data download thread, the target signature data corresponding to the signature file is downloaded from the broadcast control server according to the signature data access address, and the multimedia content data corresponding to the multimedia content file is downloaded from the content distribution network according to the multimedia content data access address, without strictly obtaining the corresponding data segments in the time sequence of each segment in the multimedia data, the acquisition efficiency of different segments of the multimedia data can be improved, and the subsequent processing efficiency of the target multimedia data obtained based on the target signature data and multimedia content data can be further improved.

[0103] In one embodiment, Figure 4As shown, the steps of obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file specifically include:

[0104] Step S402: If the target signature data corresponding to the signature file fed back by the broadcast control server is not received, the device information corresponding to the object identification information and the log information associated with the device information are obtained.

[0105] Among them, since the service resources of the broadcast control server are limited and it needs to respond to different multimedia data access requests and provide services for different terminal devices, the broadcast control server is prone to excessive load, and the terminal may not receive the target signature data corresponding to the signature file fed back by the broadcast control server in time. Similarly, since there are still storage operation errors in the data storage process, the broadcast control server does not store the target signature data corresponding to the corresponding signature file. When the broadcast control server is overloaded or the broadcast control server does not store the target signature data corresponding to the corresponding signature file, it is necessary to jump to the content distribution network to download the target signature data corresponding to the signature file to avoid the problem of missing target signature data.

[0106] Specifically, if the broadcast control server is overloaded, or the target signature data corresponding to the corresponding signature file is not stored in the broadcast control server, the target signature data corresponding to the signature file fed back by the broadcast control server cannot be received, then the object identification information corresponding to the multimedia data access request is obtained, and the device information corresponding to the object identification information, as well as the log information associated with the device information, are obtained.

[0107] The object identification information is used to determine the actual user object that triggers the multimedia data access request. The object identification information also corresponds to the device information, and the terminal device where the user object is located can be further determined based on the device information. The device information is also associated with the log information of the multimedia application (or application platform) loaded on the terminal device, and the log information of a series of access operations, download operations, and sharing operations triggered by the multimedia application loaded on the terminal device can be obtained based on the device information.

[0108] Step S404, performing security level identification based on the object identification information, device information and log information to obtain a corresponding security level identification result.

[0109] Specifically, by obtaining object identification information, device information corresponding to the object identification information, and log information associated with the device information (including access operations, download operations, and sharing operations, etc.), and based on the object identification information, obtaining the membership level or membership validity period of the usage object on the multimedia application loaded on the terminal device, so as to perform security level identification based on the device information, log information and membership level (or membership validity period), and obtain a security level identification result corresponding to the object identification information.

[0110] Among them, the object identification information can be understood as the registered account of the object on the multimedia application. If the same registered account corresponds to multiple device information, that is, the same registered account triggers login operations, access operations, download operations and sharing operations on multimedia applications loaded on different terminal devices, it indicates that the corresponding terminal device of the registered account is not fixed, its security level is low, and there is a risk of malicious leakage.

[0111] Similarly, the log information associated with the device information, including the access operations, download operations, and sharing operations of a registered account (i.e., object identification information) on the multimedia application loaded on the same terminal device, can be used to determine the security level of the registered account based on the completeness of the log information. Specifically, if a registered account only has a large number of download operations or a large number of sharing operations on the multimedia application loaded on the terminal device, the log integrity is low, indicating that the security level of the registered account is low and there is a risk of malicious leakage.

[0112] Among them, the security level of a registered account can be determined based on the membership level or membership validity period of a registered account on the multimedia application loaded on the terminal device. Specifically, when the membership level of a registered account is higher or the membership validity period is longer, it indicates that the security level of the registered account is higher and the risk of malicious data leakage is lower.

[0113] Step S406: If it is determined that the security level identification result meets the jump request condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file.

[0114] Specifically, the security level identification results include high security level, medium security level and low security level. If it is determined that the security level of the object identification information (ie, the registered account) is high, then it is determined that the security level identification result meets the request jump condition.

[0115] Furthermore, when the security level identification result meets the jump request condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file. The jump operation can be implemented by means of a 302 proxy, that is, in the HTTP protocol, if an address changes (for example, the original accessed address cannot obtain the required data, and it is necessary to jump to a new address to obtain the required data), it directly jumps to the 302 proxy, and downloads the required data, that is, the target signature data, by accessing the address corresponding to the 302 proxy (that is, the content distribution network).

[0116] In this embodiment, if the target signature data corresponding to the signature file fed back by the broadcast control server is not received, the device information corresponding to the object identification information and the log information associated with the device information are obtained, and the security level identification is performed based on the object identification information, the device information and the log information to obtain the corresponding security level identification result. Further, if it is determined that the security level identification result meets the request jump condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file, so that different target signature data acquisition methods can be set according to the security level identification result, which can reduce the risk of malicious data leakage when the security level identification result is not met, and avoid the situation where the target signature data is missing, so as to ensure the integrity of the obtained target multimedia data, so that the security protection processing of the multimedia data can be implemented based on the complete target multimedia data in the future.

[0117] In one embodiment, Figure 5 As shown, a multimedia data processing method is provided, which is applied to Figure 1 Taking the broadcast control server 104 in the example as an example, the following steps are included:

[0118] Step S502: if a multimedia data access request is detected, obtain the object identification information carried in the multimedia data access request and the index file matching the multimedia data access request.

[0119] Specifically, if the broadcast control server detects a multimedia data access request, the object identification information carried in the multimedia data access request is obtained, wherein the object identification information can be understood as a registration account of the user object on the multimedia application.

[0120] Furthermore, when a multimedia data access request is detected, an index file matching the multimedia data access request needs to be obtained. The index file corresponding to the multimedia data access request may be an M3U8 file for multimedia data playback, that is, the multimedia data access request triggered by the terminal based on the receiving object is generated based on the multimedia data access request.

[0121] The index file, namely the M3U8 file, includes a signature file for obtaining signature data and a multimedia content file for obtaining multimedia content data.

[0122] Step S504, obtaining a signature file corresponding to the index file, and obtaining multimedia signature data corresponding to the signature file.

[0123] Specifically, the broadcast control server obtains the signature file carrying the signature identifier in the index file, that is, the URL address file carrying the signature identifier for obtaining signature data, and obtains the multimedia signature data corresponding to the signature file (that is, the URL address file carrying the signature identifier).

[0124] Furthermore, the signature identifier is used to mark the signature data in the multimedia data, that is, by adding the signature identifier in advance, it is possible to determine which segment of multimedia data is used as the multimedia signature data. At the same time, the URL address file in the index file used to obtain the multimedia signature data can be used as a signature file carrying the signature identifier, so that the multimedia data segment used as the multimedia signature data can be obtained subsequently based on the signature file carrying the signature identifier.

[0125] Among them, the multimedia signature data corresponds to the scene switching time node of the multimedia data. That is, by determining the multimedia data segment where the scene switching time point in the multimedia data is located as the multimedia signature data for adding watermark information, watermark information can be added when the scene switches, thereby reducing the impact of the watermark information on the actual multimedia content, such as reducing the occlusion and impact on the character dialogue scenes, key plot scenes, etc. in the multimedia data, thereby ensuring the content quality of the multimedia data.

[0126] Step S506, adding watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data, wherein based on the target signature data and the multimedia content data corresponding to the index file, the target multimedia data corresponding to the multimedia data access request is obtained.

[0127] Specifically, the watermark information to be added is generated according to the object identification information, and the watermark information is added to the multimedia signature data corresponding to the scene switching time node of the multimedia data to obtain the target signature data.

[0128] Among them, the watermark information to be added is generated according to the object identification information, and the watermark information carrying the object identification information can be added to the target multimedia data, so that when malicious leakage and transmission of the target multimedia data occur later, the corresponding object identification information can be identified according to the watermark information, and the source and path of the data leakage can be accurately determined, so as to carry out data security protection management and control in time.

[0129] Furthermore, after obtaining the target signature data from the broadcast control server and the multimedia content data from the content distribution network, the terminal can obtain the target multimedia data corresponding to the multimedia data access request by combining the target signature data and the multimedia content data corresponding to the index file.

[0130] In one embodiment, Figure 6 As shown, a schematic diagram of the process of adding watermark information is provided. Figure 6 It can be seen that the broadcast control server obtains the object identification information that triggers the multimedia data access request from the terminal, and generates the watermark information to be added according to the object identification information, so as to add the watermark information to the multimedia signature data.

[0131] Similarly, refer to Figure 6 It can be seen that the broadcast control server can also use ffmpeg commands (i.e. multimedia data processing commands, including different processing commands such as format conversion, information insertion, cropping and splicing) to add SEI information (i.e. Supplemental Enhancement Information, understood as supplementary enhancement information, which can include timestamp, scene information, color space information and object identification information, etc., which can be encoded into a Network Abstraction Layer Unit in the multimedia data stream, i.e. the network abstraction layer, which is usually placed in front of or behind the multimedia data frame) to the multimedia data information.

[0132] Among them, by adding SEI information to multimedia data information, after downloading the target multimedia data and disseminating it, the source and path of dissemination can be identified and judged according to the object identification information in the SEI information.

[0133] Furthermore, if the target multimedia data is recorded and then disseminated, the added SEI information cannot be directly obtained based on the recorded data. Therefore, it is necessary to add watermark information corresponding to the object identification information to the multimedia signature data. Then, after the target multimedia data is downloaded or recorded, the downloaded data or the recorded data can be disseminated based on the watermark information for identification, and the object identification information carried by the watermark information can be determined. The source and path of data leakage can be accurately determined based on the object identification information, and data security protection management and control can be performed in a timely manner.

[0134] In one embodiment, Figure 7 As shown, a schematic diagram of target multimedia data obtained according to target signature data and multimedia content data is provided, referring to Figure 7It can be seen that taking the target multimedia data with a duration of 31 seconds as an example, the multimedia data segment with a duration of 1 second is the target signature data, watermark information is added to the target signature data with a duration of 1 second, and the other 3 multimedia data segments with a duration of 10 seconds are all multimedia content data. Then, the 3 multimedia data segments with a duration of 10 seconds and the target signature data with a duration of 1 second can be combined in the playback order of the multimedia data to obtain the target multimedia data.

[0135] In one embodiment, Figure 8 As shown, a traditional common non-encrypted video file download process is provided. Figure 8 It can be seen that in the traditional video data security protection process, the client sends a video file acquisition request to the broadcast control server, and the broadcast control server sends a video resource identifier (i.e. vkey, used to obtain the address and playback information of the video file) and M3U8 file to the client. The client downloads the video file from the content distribution network, i.e. CDN, based on the video resource identifier (i.e. vkey).

[0136] Among them, on the content distribution network, i.e., CDN side, the video resource identifier is verified to determine whether the download video request triggered by the user based on the client is legal, which can avoid sending the video file to the client with an illegal request. However, the content distribution network, i.e., CDN side, cannot add watermarks to video files, nor can it predict the video files that each user needs to access, and generate watermarked video files in advance and upload them to the content distribution network. Therefore, if the video file is downloaded and then maliciously transmitted and leaked, it is also impossible to accurately determine the leakage path and source, and its security protection effect still needs to be improved.

[0137] Furthermore, if Fig. 9 As shown, a traditional encrypted video file playback process is provided. Fig. 9 It can be seen that for devices or platforms equipped with a DRM decryption module, the client can send a license acquisition application to the DRM licence Server (i.e., the DRM license server) to obtain the key of the video file from the DRM licence Server, and send the obtained video file key and the encrypted video file to the DRM decryption module. After the DRM decryption module decrypts the encrypted video file according to the key, it is fed back to the client for playback.

[0138] Specifically, during the playback of traditional encrypted video files, the leakage of keys during playback can be reduced by configuring a DRM decryption module and setting up an independent encryption and decryption process. However, since DRM technology has not been fully popularized on different terminal devices that load various multimedia applications, and a matching DRM decryption module has not been set up, video files can still be downloaded on some terminals or platforms that do not support DRM technology, and then subsequently spread maliciously. At the same time, if video files are recorded and then spread maliciously by using methods such as video memory recording and virtual machine recording, the restrictions of DRM recording can be bypassed, but the malicious leakage and spread of video files cannot be prevented.

[0139] In one embodiment, Fig.10 As shown, a target multimedia data playback process is provided, referring to Fig.10 It can be seen that during the playback of the target multimedia data, it is necessary to obtain the target signature data and the multimedia content data, and combine the target signature data and the multimedia content data to obtain the target multimedia data for playback. Among them, during the playback of the target multimedia data, several entities are involved, including the terminal, the broadcast control server, and the content distribution network (i.e., CDN).

[0140] Specifically, refer to Fig.10 It can be seen that the target signature data is TS3, and the multimedia content data includes TS1, TS2, and TS4. That is, the terminal downloads the multimedia content data TS1, TS2, and TS4 from the content distribution network, and downloads the target signature data TS3 from the broadcast control server by calling the pre-set signature data download thread.

[0141] The processes of downloading the target signature data TS3 and the multimedia content data TS1, TS2, and TS4 do not interfere with each other and can be performed simultaneously, or the acquisition operation of the target signature data with a slower download speed can be performed first, and the acquisition operation of the multimedia content data can be performed after a preset time period. The terminal can combine the multimedia content data TS1, TS2 and TS4 and the target signature data TS3 to obtain the complete target multimedia data corresponding to the multimedia data access request, and play the target multimedia data at the terminal.

[0142] It can be understood that by adding watermark information carrying object identification information to multimedia signature data, target signature data is obtained, and based on the target signature data and multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained, so that the target multimedia data can also carry watermark information. Regardless of whether the target multimedia data is downloaded or recorded, the downloaded data or recorded data obtained carries watermark information. In the event of data leakage or malicious dissemination, the leaked or disseminated target multimedia data can be further identified to determine the object identification information carried by its watermark information, accurately determine the source and path of the data leakage, and conduct timely data security protection management and control.

[0143] In the above multimedia data processing method, if a multimedia data access request is detected, the object identification information carried by the multimedia data access request and the index file matching the multimedia data access request are obtained, and the signature file corresponding to the index file and the multimedia signature data corresponding to the signature file are obtained. Furthermore, watermark information corresponding to the object identification information is added to the multimedia signature data to obtain the target signature data, so that the target signature data carrying the watermark information and the multimedia content data corresponding to the index file can be combined to obtain the target multimedia data carrying the watermark information, so that in the event of data leakage or malicious dissemination, the target multimedia data that is leaked or disseminated can be further identified, the object identification information carried by its watermark information can be determined, the source and path of the data leakage can be accurately determined, and data security protection management and control can be carried out in a timely manner to improve the security protection management and processing efficiency of multimedia data.

[0144] In one embodiment, Fig.11 As shown, a multimedia data processing method is provided, referring to Fig.11 It can be seen that the specific steps include:

[0145] Step S1102: the broadcast control server detects the downloading operation and recording operation triggered for the target multimedia data, and obtains the corresponding downloading data and recording data.

[0146] Specifically, after obtaining the target multimedia data and playing the target multimedia data, the broadcast control server further detects the download operation and the recording operation triggered for the target multimedia data to obtain the corresponding download data and the recording data.

[0147] Step S1104: the broadcast control server performs polling detection on the download data and recording data corresponding to the target multimedia data based on each third-party platform.

[0148] Specifically, the broadcast control server performs polling detection on various unauthorized third-party platforms other than the multimedia application loaded on the terminal, such as unauthorized third-party video websites, third-party video playback platforms, and third-party applications, for the download data and recording data corresponding to the target multimedia data to determine whether there is download data corresponding to the target multimedia data, as well as upload records, playback records, and sharing records of the recording data.

[0149] Step S1106: If download data or recording data is detected on the third-party platform, the broadcast control server performs watermark recognition based on the download data or recording data to obtain corresponding watermark information.

[0150] Specifically, if the broadcast control server detects the download data corresponding to the target multimedia data, and the upload record, playback record, and sharing record of the recorded data on an unauthorized third-party video website, third-party video playback platform, or third-party application, or detects that the download data or recorded data corresponding to the target multimedia data can be directly obtained on the third-party platform, watermark recognition is performed based on the download data or recorded data to obtain the corresponding watermark information. Among them, watermark recognition can be understood as extracting the watermark information carried by the download data or recorded data.

[0151] Step S1108: The broadcast control server performs object recognition based on the watermark information to obtain object identification information corresponding to the watermark information.

[0152] Specifically, the broadcast control server performs object recognition on the watermark information carried by the downloaded data or recorded data, determines the object identification information carried by the watermark information, that is, obtains the registered account corresponding to the watermark information, so as to determine the actual source and path of data leakage, that is, which registered account corresponds to the user object that caused the data leakage.

[0153] Step S1110: the broadcast control server obtains device information corresponding to the object identification information, and performs multimedia security protection processing based on the object identification information and the device information.

[0154] Specifically, after obtaining the object identification information corresponding to the watermark information, the broadcast control server further obtains the device information corresponding to the object identification information to determine the terminal device where the object identification information, i.e. the registered account, is located. This allows for double security protection based on the actual usage object corresponding to the object identification information and the terminal device where the object identification information, i.e. the registered account, to be able to perform access restrictions and download restrictions on the usage object, as well as access restrictions and download restrictions on the terminal device where the registered account is located.

[0155] Among them, multimedia security protection processing specifically includes: detection of malicious transmission and leakage of multimedia downloaded data and multimedia recorded data on various third-party platforms, and subsequent protection processing when malicious transmission or malicious leakage occurs (for example, removal from shelves, access prohibition, and secondary download prohibition of malicious leakage of multimedia downloaded data or recorded data, etc.).

[0156] In the above multimedia data processing method, the broadcast control server obtains the corresponding download data and recording data by detecting the download operation and recording operation triggered for the target multimedia data, and performs polling detection on the download data and recording data corresponding to the target multimedia data based on each third-party platform. If the download data or recording data is detected on the third-party platform, the broadcast control server performs watermark recognition based on the download data or recording data to obtain the corresponding watermark information, and performs object recognition based on the watermark information to obtain the object identification information corresponding to the watermark information, and obtains the device information corresponding to the object identification information, so as to perform multimedia security protection processing based on the object identification information and the device information, thereby realizing data security protection management and control from different angles such as the object identification information and the device information, and further improving the security protection management and control processing efficiency of multimedia data.

[0157] In one embodiment, Fig.12 As shown, a multimedia data processing method is provided, which specifically includes:

[0158] Step S1201: The terminal receives a multimedia data access request triggered by a usage object, and generates an index file corresponding to the multimedia data access request.

[0159] Specifically, the usage object may trigger a multimedia data access request based on a terminal loaded with different application programs, and the terminal may generate a corresponding index file based on the multimedia data access request.

[0160] Furthermore, the index file corresponding to the multimedia data access request may be an M3U8 file for multimedia data playback, that is, specifically, by receiving a multimedia data access request triggered by a terminal using an object, and generating a corresponding M3U8 file based on the multimedia data access request.

[0161] The index file, namely the M3U8 file, includes a signature file for obtaining signature data and a multimedia content file for obtaining multimedia content data.

[0162] Step S1202: The terminal performs signature identification processing based on the index file, identifies the signature file carrying the signature identifier from the index file, and determines the index file not carrying the signature identifier as a multimedia content file.

[0163] Specifically, the signature identifier is used to mark the signature data in the multimedia data. That is, by adding the signature identifier in advance, it is possible to determine which segment of multimedia data is used as the target signature data. At the same time, the URL address file in the index file used to obtain the target signature data can be used as the signature file carrying the signature identifier, so that the multimedia data segment used as the target signature data can be obtained subsequently based on the signature file carrying the signature identifier (that is, the URL address file used to obtain the target signature data).

[0164] Furthermore, for the index file corresponding to the multimedia data access request, after the signature file carrying the signature identifier is determined, the index file without the signature identifier is further determined as the multimedia content file. The index file without the signature identifier, i.e., the URL address file without the signature identifier, is used to obtain the actual multimedia content data from the content distribution network.

[0165] Step S1203: If the broadcast control server detects a multimedia data access request triggered by a terminal, the broadcast control server obtains the object identification information carried in the multimedia data access request and an index file matching the multimedia data access request.

[0166] Specifically, if the broadcast control server detects a multimedia data access request, the object identification information carried in the multimedia data access request is obtained, wherein the object identification information can be understood as a registration account of the user object on the multimedia application.

[0167] Furthermore, when a multimedia data access request is detected, an index file matching the multimedia data access request needs to be obtained. The index file corresponding to the multimedia data access request can be an M3U8 file for multimedia data playback, that is, the multimedia data access request triggered by the terminal based on the receiving object is generated based on the multimedia data access request. The M3U8 file includes a signature file for obtaining signature data and a multimedia content file for obtaining multimedia content data.

[0168] Step S1204: the broadcast control server obtains a signature file carrying a signature identifier in the index file, and obtains multimedia signature data corresponding to the signature file.

[0169] Specifically, the broadcast control server obtains the signature file carrying the signature identifier in the index file, that is, the URL address file carrying the signature identifier for obtaining signature data, and obtains the multimedia signature data corresponding to the signature file (that is, the URL address file carrying the signature identifier).

[0170] Furthermore, the signature identifier is used to mark the signature data in the multimedia data, that is, by adding the signature identifier in advance, it is possible to determine which segment of multimedia data is used as the multimedia signature data. At the same time, the URL address file in the index file used to obtain the multimedia signature data can be used as a signature file carrying the signature identifier, so that the multimedia data segment used as the multimedia signature data can be obtained subsequently based on the signature file carrying the signature identifier.

[0171] Among them, the multimedia signature data corresponds to the scene switching time node of the multimedia data. That is, by determining the multimedia data segment where the scene switching time point in the multimedia data is located as the multimedia signature data for adding watermark information, watermark information can be added when the scene switches, thereby reducing the impact of the watermark information on the actual multimedia content, such as reducing the occlusion and impact on the character dialogue scenes, key plot scenes, etc. in the multimedia data, thereby ensuring the content quality of the multimedia data.

[0172] Step S1205: the broadcast control server generates watermark information to be added according to the object identification information, and adds the watermark information to the multimedia signature data corresponding to the scene switching time node of the multimedia data to obtain target signature data.

[0173] Specifically, the broadcast control server generates watermark information to be added based on the object identification information, and can add the watermark information carrying the object identification information to the target multimedia data, so that when malicious leakage and transmission of the target multimedia data occur later, the corresponding object identification information can be identified based on the watermark information, and the source and path of the data leakage can be accurately determined, so as to timely perform data security protection management and control.

[0174] Furthermore, since the multimedia signature data corresponds to the scene switching time node of the multimedia data, the multimedia data segment where the scene switching time point in the multimedia data is located is determined as the multimedia signature data for adding watermark information, and the watermark information is added to the multimedia signature data corresponding to the scene switching time node of the multimedia data to obtain the target signature data.

[0175] Step S1206: The terminal obtains a signature data access address corresponding to the signature file and a multimedia content data access address corresponding to the multimedia content file.

[0176] Specifically, the signature file carrying the signature identifier corresponds to the signature data access address, that is, the terminal obtains the URL address file carrying the signature identifier, and determines the signature data access address for obtaining the target signature data according to the URL address file carrying the signature identifier, so as to obtain the corresponding target signature data according to the signature data access address.

[0177] Similarly, a multimedia content file that does not carry a signature identifier corresponds to a multimedia content data access address, that is, the terminal obtains a URL address file that does not carry a signature identifier (that is, the multimedia content file), and determines the multimedia content data access address for obtaining the multimedia content data according to the URL address file that does not carry a signature identifier, so as to obtain the corresponding multimedia content data based on the multimedia content data access address.

[0178] Step S1207: the terminal calls the signature data download thread, and downloads the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address.

[0179] Specifically, since the target signature data corresponding to the signature file needs to be downloaded from the broadcast control server, and the service resources of the broadcast control server are limited, and it needs to respond to different multimedia data access requests and provide services for different terminal devices, its data download speed is slow, and then the terminal needs to call a pre-set signature data download thread to execute the signature data download thread and download the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address.

[0180] Step S1208: the terminal downloads multimedia content data corresponding to the multimedia content file from the content distribution network according to the multimedia content data access address.

[0181] Specifically, a large amount of multimedia content data is stored on the content distribution network, namely CDN (full name: Content Delivery Network, which can redirect the data access request of the user object to the service node closest to the user object in real time according to the network traffic and the connection status, load status of each service node, distance to the user object and response time, so that the required data can be obtained nearby and the response speed of data access can be improved), and then the multimedia content data corresponding to the multimedia content file can be downloaded from the content distribution network through the multimedia content data access address.

[0182] Among them, the target signature data corresponding to the signature file can be downloaded from the broadcast control server by calling the pre-set signature data download thread, and the corresponding data segments do not need to be obtained in sequence in strict accordance with the time sequence of each segment in the multimedia data, that is, the process of obtaining the target signature data and the process of obtaining the multimedia content data do not interfere with each other, and can be performed simultaneously, or the target signature data with a slower download speed can be obtained first, and the multimedia content data can be obtained after a preset time period. Among them, the preset time period can be adjusted and set according to the actual application scenario and needs, and is not specifically limited.

[0183] Step S1209: If the terminal does not receive the target signature data corresponding to the signature file fed back by the broadcast control server, the terminal obtains the device information corresponding to the object identification information and the log information associated with the device information.

[0184] Among them, since the service resources of the broadcast control server are limited and it needs to respond to different multimedia data access requests and provide services for different terminal devices, the broadcast control server is prone to excessive load, and the terminal may not receive the target signature data corresponding to the signature file fed back by the broadcast control server in time. Similarly, since there are still storage operation errors in the data storage process, the broadcast control server does not store the target signature data corresponding to the corresponding signature file. When the broadcast control server is overloaded or the broadcast control server does not store the target signature data corresponding to the corresponding signature file, it is necessary to jump to the content distribution network to download the target signature data corresponding to the signature file to avoid the problem of missing target signature data.

[0185] Specifically, if the broadcast control server is overloaded, or the target signature data corresponding to the corresponding signature file is not stored in the broadcast control server, the target signature data corresponding to the signature file fed back by the broadcast control server cannot be received, then the object identification information corresponding to the multimedia data access request is obtained, and the device information corresponding to the object identification information, as well as the log information associated with the device information, are obtained.

[0186] Step S1210: The terminal performs security level identification based on the object identification information, device information, and log information to obtain a corresponding security level identification result.

[0187] The object identification information is used to determine the actual user object that triggers the multimedia data access request. The object identification information also corresponds to the device information, and the terminal device where the user object is located can be further determined based on the device information. The device information is also associated with the log information of the multimedia application (or application platform) loaded on the terminal device, and the log information of a series of access operations, download operations, and sharing operations triggered by the multimedia application loaded on the terminal device can be obtained based on the device information.

[0188] Specifically, by obtaining object identification information, device information corresponding to the object identification information, and log information associated with the device information (including access operations, download operations, and sharing operations, etc.), and based on the object identification information, obtaining the membership level or membership validity period of the usage object on the multimedia application loaded on the terminal device, so as to perform security level identification based on the device information, log information and membership level (or membership validity period), and obtain a security level identification result corresponding to the object identification information.

[0189] Among them, the object identification information can be understood as the registered account of the object on the multimedia application. If the same registered account corresponds to multiple device information, that is, the same registered account triggers login operations, access operations, download operations and sharing operations on multimedia applications loaded on different terminal devices, it indicates that the corresponding terminal device of the registered account is not fixed, its security level is low, and there is a risk of malicious leakage.

[0190] Similarly, the log information associated with the device information, including the access operations, download operations, and sharing operations of a registered account (i.e., object identification information) on the multimedia application loaded on the same terminal device, can be used to determine the security level of the registered account based on the completeness of the log information. Specifically, if a registered account only has a large number of download operations or a large number of sharing operations on the multimedia application loaded on the terminal device, the log integrity is low, indicating that the security level of the registered account is low and there is a risk of malicious leakage.

[0191] Among them, the security level of a registered account can be determined based on the membership level or membership validity period of a registered account on the multimedia application loaded on the terminal device. Specifically, when the membership level of a registered account is higher or the membership validity period is longer, it indicates that the security level of the registered account is higher and the risk of malicious data leakage is lower.

[0192] Step S1211: If the terminal determines that the security level identification result meets the jump request condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file.

[0193] Specifically, the security level identification results include high security level, medium security level and low security level. If it is determined that the security level of the object identification information (ie, the registered account) is high, then it is determined that the security level identification result meets the request jump condition.

[0194] Furthermore, when the security level identification result meets the jump request condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file. The jump operation can be implemented by means of a 302 proxy, that is, in the HTTP protocol, if an address changes (for example, the original accessed address cannot obtain the required data, and it is necessary to jump to a new address to obtain the required data), it directly jumps to the 302 proxy, and downloads the required data, that is, the target signature data, by accessing the address corresponding to the 302 proxy (that is, the content distribution network).

[0195] Step S1212: The terminal obtains target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data, and plays the target multimedia data.

[0196] Specifically, after the terminal obtains the target signature data from the broadcast control server and the multimedia content data from the content distribution network, it can obtain the target multimedia data corresponding to the multimedia data access request by combining the target signature data and the multimedia content data corresponding to the index file, and play the obtained target multimedia data.

[0197] Step S1213: the broadcast control server detects the downloading operation and the recording operation triggered by the target multimedia data played by the terminal, and obtains the corresponding downloading data and the recording data.

[0198] Specifically, after the terminal obtains the target multimedia data and plays the target multimedia data, the broadcast control server further detects the download operation and the recording operation triggered for the target multimedia data to obtain the corresponding download data and the recording data.

[0199] Step S1214: the broadcast control server performs polling detection on the download data and recording data corresponding to the target multimedia data based on each third-party platform.

[0200] Specifically, the broadcast control server performs polling detection on various unauthorized third-party platforms other than the multimedia application loaded on the terminal, such as unauthorized third-party video websites, third-party video playback platforms, and third-party applications, for the download data and recording data corresponding to the target multimedia data to determine whether there is download data corresponding to the target multimedia data, as well as upload records, playback records, and sharing records of the recording data.

[0201] Step S1215: If the broadcast control server detects downloaded data or recorded data on the third-party platform, watermark recognition is performed based on the downloaded data or recorded data to obtain corresponding watermark information.

[0202] Specifically, if the broadcast control server detects the download data corresponding to the target multimedia data, and the upload record, playback record, and sharing record of the recorded data on an unauthorized third-party video website, third-party video playback platform, or third-party application, or detects that the download data or recorded data corresponding to the target multimedia data can be directly obtained on the third-party platform, watermark recognition is performed based on the download data or recorded data to obtain the corresponding watermark information. Among them, watermark recognition can be understood as extracting the watermark information carried by the download data or recorded data.

[0203] Step S1216: The broadcast control server performs object recognition based on the watermark information to obtain object identification information corresponding to the watermark information.

[0204] Specifically, the broadcast control server performs object recognition on the watermark information carried by the downloaded data or recorded data, determines the object identification information carried by the watermark information, and obtains the registered account corresponding to the watermark information to determine the actual source and path of the data leakage, that is, which registered account corresponds to the user object that caused the data leakage.

[0205] Step S1217: the broadcast control server obtains device information corresponding to the object identification information, and performs multimedia security protection processing based on the object identification information and the device information.

[0206] Specifically, after obtaining the object identification information corresponding to the watermark information, the broadcast control server further obtains the device information corresponding to the object identification information to determine the terminal device where the object identification information, i.e. the registered account, is located. This allows for double security protection based on the actual usage object corresponding to the object identification information and the terminal device where the object identification information, i.e. the registered account, to be able to perform access restrictions and download restrictions on the usage object, as well as access restrictions and download restrictions on the terminal device where the registered account is located.

[0207] In the above-mentioned multimedia data processing method, by obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file, the target multimedia data corresponding to the multimedia data access request is obtained based on the target signature data and the multimedia content data. Since the target signature data carries the object identification information corresponding to the multimedia data access request, the obtained target multimedia data corresponding to the multimedia data access request also carries the object identification information. Therefore, when data leakage or malicious dissemination occurs for the downloaded data, recorded data, etc. corresponding to the target multimedia data, the leaked or disseminated target multimedia data can be further identified to determine the object identification information it carries and the device information corresponding to the object identification information, so as to accurately determine the source and path of the data leakage, and timely perform multimedia security protection processing on the object identification information and the device information, thereby improving the security protection management and processing efficiency of multimedia data.

[0208] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0209] Based on the same inventive concept, the embodiment of the present application also provides a multimedia data processing device for implementing the multimedia data processing method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in one or more multimedia data processing device embodiments provided below can refer to the limitations of the multimedia data processing method above, and will not be repeated here.

[0210] In one embodiment, Fig.13 As shown, a multimedia data processing device is provided, including: an index file generating module 1302, a signature file determining module 1304, a data acquiring module 1306 and a target multimedia data generating module 1308, wherein:

[0211] The index file generating module 1302 is used to receive a multimedia data access request and generate an index file corresponding to the multimedia data access request;

[0212] A signature file determination module 1304, configured to determine a signature file and a multimedia content file based on an index file;

[0213] The data acquisition module 1306 is used to acquire the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file; the target signature data carries the object identification information corresponding to the multimedia data access request;

[0214] The target multimedia data generation module 1308 is used to obtain the target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data.

[0215] In the above multimedia data processing device, by receiving a multimedia data access request, an index file corresponding to the multimedia data access request is generated, and a signature file and a multimedia content file are determined based on the index file. Furthermore, by obtaining the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file, the target multimedia data corresponding to the multimedia data access request is obtained based on the target signature data and the multimedia content data. Since the target signature data carries the object identification information corresponding to the multimedia data access request, the target multimedia data corresponding to the multimedia data access request also carries the object identification information. In the event of data leakage or malicious dissemination, the target multimedia data that is leaked or disseminated can be further identified to determine the object identification information it carries, accurately determine the source and path of the data leakage, and timely perform data security protection management and control, thereby improving the security protection management and processing efficiency of multimedia data.

[0216] In one embodiment, the data acquisition module is also used to: obtain a signature data access address corresponding to the signature file and a multimedia content data access address corresponding to the multimedia content file; call a signature data download thread to download the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address; and download the multimedia content data corresponding to the multimedia content file from the content distribution network according to the multimedia content data access address.

[0217] In one embodiment, the data acquisition module is also used for: if the target signature data corresponding to the signature file is not received from the broadcast control server, obtaining the device information corresponding to the object identification information and the log information associated with the device information; performing security level identification based on the object identification information, the device information and the log information to obtain the corresponding security level identification result; if it is determined that the security level identification result meets the request jump condition, calling the signature data download thread and jumping to the content distribution network to download the target signature data corresponding to the signature file.

[0218] In one embodiment, the signature file determination module is further used to: perform signature identification processing based on the index file, identify signature files carrying signature identifiers from the index file, and determine index files without signature identifiers as multimedia content files.

[0219] In one embodiment, Fig.14 As shown, a multimedia data processing device is provided, including: a multimedia data access request detection module 1402, a multimedia signature data acquisition module 1404 and a watermark information adding module 1406, wherein:

[0220] The multimedia data access request detection module 1402 is used to obtain the object identification information carried in the multimedia data access request and the index file matching the multimedia data access request if a multimedia data access request is detected;

[0221] The multimedia signature data acquisition module 1404 is used to acquire the signature file corresponding to the index file, and acquire the multimedia signature data corresponding to the signature file;

[0222] The watermark information adding module 1406 is used to add watermark information corresponding to the object identification information in the multimedia signature data to obtain the target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, the target multimedia data corresponding to the multimedia data access request is obtained.

[0223] In the above multimedia data processing device, if a multimedia data access request is detected, the object identification information carried by the multimedia data access request and the index file matching the multimedia data access request are obtained, and the signature file corresponding to the index file and the multimedia signature data corresponding to the signature file are obtained. Furthermore, watermark information corresponding to the object identification information is added to the multimedia signature data to obtain the target signature data, so that the target signature data carrying the watermark information and the multimedia content data corresponding to the index file can be combined to obtain the target multimedia data carrying the watermark information, so that in the event of data leakage or malicious dissemination, the target multimedia data that is leaked or disseminated can be further identified, the object identification information carried by its watermark information can be determined, the source and path of the data leakage can be accurately determined, and data security protection management and control can be carried out in a timely manner to improve the security protection management and control processing efficiency of multimedia data.

[0224] In one embodiment, the multimedia signature data acquisition module is further used to: acquire a signature file carrying a signature identifier in the index file, and acquire multimedia signature data corresponding to the signature file; wherein the multimedia signature data corresponds to a scene switching time node of the multimedia data;

[0225] The watermark information adding module is also used to: generate the watermark information to be added according to the object identification information, and add the watermark information to the multimedia signature data corresponding to the scene switching time node of the multimedia data to obtain the target signature data.

[0226] In one embodiment, a multimedia data processing device is provided, further comprising:

[0227] A download operation detection module, used to detect download operations and recording operations triggered on target multimedia data, and obtain corresponding download data and recording data;

[0228] A polling detection module, used for performing polling detection on the downloaded data and recorded data corresponding to the target multimedia data based on each third-party platform;

[0229] A watermark information acquisition module is used to perform watermark recognition based on the downloaded data or recorded data to obtain corresponding watermark information if downloaded data or recorded data is detected on a third-party platform;

[0230] An object identification information obtaining module is used to perform object recognition based on watermark information and obtain object identification information corresponding to the watermark information;

[0231] The security protection processing module is used to obtain device information corresponding to the object identification information and perform multimedia security protection processing based on the object identification information and the device information.

[0232] Each module in the above multimedia data processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0233] In one embodiment, a computer device is provided. The computer device may be a broadcast control server or a terminal. The computer device is taken as a broadcast control server as an example for description. The internal structure diagram of the computer device may be as follows: Fig.15 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as index files, signature files, multimedia content files, target signature data, multimedia content data, object identification information, and target multimedia data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a multimedia data processing method is implemented.

[0234] In one embodiment, a computer device is provided. The computer device may be a broadcast control server or a terminal. The computer device is taken as a terminal for example. The internal structure diagram of the computer device may be as follows: Fig.16 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a multimedia data processing method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0235] Those skilled in the art will understand that Fig.15 and Fig.16 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0236] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0237] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0238] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0239] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0240] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0241] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0242] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A multimedia data processing method, characterized in that: The method comprises: receiving a multimedia data access request, and generating an index file corresponding to the multimedia data access request; Determining a signature file and a multimedia content file based on the index file; Acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request; Based on the target signature data and the multimedia content data, target multimedia data corresponding to the multimedia data access request is obtained.

2. The method according to claim 1, characterized in that The acquiring the target signature data corresponding to the signature file and the multimedia content data corresponding to the multimedia content file comprises: Acquire a signature data access address corresponding to the signature file and a multimedia content data access address corresponding to the multimedia content file; Calling the signature data download thread, and downloading the target signature data corresponding to the signature file from the broadcast control server according to the signature data access address; The multimedia content data corresponding to the multimedia content file is downloaded from a content distribution network according to the multimedia content data access address.

3. The method according to claim 2, characterized in that The method further comprises: If the target signature data corresponding to the signature file fed back by the broadcast control server is not received, acquiring device information corresponding to the object identification information and log information associated with the device information; Perform security level identification based on the object identification information, device information and log information to obtain a corresponding security level identification result; If it is determined that the security level identification result meets the request jump condition, the signature data download thread is called to jump to the content distribution network to download the target signature data corresponding to the signature file.

4. The method according to any one of claims 1 to 3, characterized in that: The determining the signature file and the multimedia content file based on the index file comprises: A signature identification process is performed based on the index file, a signature file carrying the signature identifier is identified from the index file, and an index file not carrying the signature identifier is determined as a multimedia content file.

5. A multimedia data processing method, characterized in that: The method comprises: If a multimedia data access request is detected, obtaining object identification information carried in the multimedia data access request and an index file matching the multimedia data access request; Acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file; Add watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data; wherein, based on the target signature data and the multimedia content data corresponding to the index file, obtain the target multimedia data corresponding to the multimedia data access request.

6. The method according to claim 5, characterized in that The acquiring of the signature file corresponding to the index file and the acquisition of the multimedia signature data corresponding to the signature file comprises: acquiring the signature file carrying the signature identifier in the index file and acquiring the multimedia signature data corresponding to the signature file; wherein the multimedia signature data corresponds to the scene switching time node of the multimedia data; The step of adding watermark information corresponding to the object identification information to the multimedia signature data to obtain target signature data includes: The watermark information to be added is generated according to the object identification information, and the watermark information is added to the multimedia signature data corresponding to the scene switching time node of the multimedia data to obtain the target signature data.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: Detecting a download operation and a recording operation triggered for the target multimedia data, and acquiring corresponding download data and recording data; Based on each third-party platform, polling detection is performed on the downloaded data and recorded data corresponding to the target multimedia data; If the downloaded data or recorded data is detected on the third-party platform, watermark recognition is performed based on the downloaded data or recorded data to obtain corresponding watermark information; Performing object recognition based on the watermark information to obtain object identification information corresponding to the watermark information; The device information corresponding to the object identification information is obtained, and multimedia security protection processing is performed based on the object identification information and the device information.

8. A multimedia data processing device, characterized in that: The device comprises: An index file generating module, used for receiving a multimedia data access request and generating an index file corresponding to the multimedia data access request; A signature file determination module, used to determine a signature file and a multimedia content file based on the index file; A data acquisition module, used to acquire target signature data corresponding to the signature file and multimedia content data corresponding to the multimedia content file; the target signature data carries object identification information corresponding to the multimedia data access request; The target multimedia data generation module is used to obtain the target multimedia data corresponding to the multimedia data access request based on the target signature data and the multimedia content data.

9. A multimedia data processing device, characterized in that: The device comprises: A multimedia data access request detection module, configured to, if a multimedia data access request is detected, obtain object identification information carried in the multimedia data access request and an index file matching the multimedia data access request; A multimedia signature data acquisition module, used to acquire a signature file corresponding to the index file, and acquire multimedia signature data corresponding to the signature file; A watermark information adding module is used to add watermark information corresponding to the object identification information in the multimedia signature data to obtain target signature data; wherein, based on the target signature data and a combination of multimedia content data corresponding to the index file, the target multimedia data corresponding to the multimedia data access request is obtained.

10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images