Display device and streaming media processing method

Abstract

The invention discloses a display device and a streaming media processing method, and the method comprises the steps: responding to a playing request for a target streaming media in a target platform, transmitting the playing request to the target platform, carrying out the authority verification of the playing request through the target platform, and transmitting a dynamic key generation request to a cloud server under the condition that the verification is passed; the cloud server generates a dynamic key based on the random data, the receiving moment of the dynamic key generation request and the identifier of the target streaming media carried by the dynamic key generation request; a permission verification result and the dynamic key are received, and under the condition that verification is passed, the feature key and the dynamic key are synthesized into a target dynamic key, and the target platform encrypts the target streaming media based on the target dynamic key; obtaining the encrypted streaming media, and decrypting the encrypted streaming media by adopting the target dynamic key; and playing the decrypted streaming media. By adopting the display equipment, the security of the streaming media can be improved.

Description

Technical Field

[0001] This application relates to the technical field of display devices, and in particular, to a display device and a streaming media processing method. Background Art

[0002] With the rapid development of the functions of display devices, the security of streaming media during transmission, storage, and playback has received increasing attention. Currently, display devices include smart TVs, smart set-top boxes, smart boxes, and products with smart display screens, etc. Taking smart TVs as an example, smart TVs use audio-video encryption technology to protect the security of streaming media such as audio and video, preventing unauthorized access, copying, or tampering. However, traditional audio-video encryption technologies mostly use fixed keys or single-authority verification, resulting in relatively low security of the streaming media played by display devices. Summary of the Invention

[0003] This application provides a display device and a streaming media processing method to solve the problem of relatively low security of the streaming media played by display devices.

[0004] In a first aspect, some embodiments provide a display device, including: a display and at least one processor. Among them, the display is configured to display content from a broadcast system or network and / or a user interface; and at least one processor, which is connected to the display and is configured to execute instructions to cause the display device to:

[0005] In response to a playback request for a target streaming media in a target platform, send the playback request to the target platform. The playback request is used to instruct the target platform to perform permission verification on the playback request, and in the case where the permission verification result indicates that the verification is passed, send a dynamic key generation request to the cloud server; the dynamic key generation request is used to instruct the cloud server to generate a dynamic key based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried by the dynamic key generation request, and send it to the target platform;

[0006] Receive the permission verification result and the dynamic key sent by the target platform. In the case where the permission verification result indicates that the verification is passed, generate a feature key according to the device feature information, and synthesize the feature key and the dynamic key into a target dynamic key;

[0007] Send the target dynamic key to the target platform to instruct the target platform to encrypt the target streaming media based on the target dynamic key;

[0008] Obtain the encrypted streaming media sent by the target platform, decrypt the encrypted streaming media using the target dynamic key; play the decrypted streaming media.

[0009] In this embodiment, first, in response to a playback request for a target streaming media in a target platform, the display device performs permission verification on the playback request through the target platform. When the verification passes, a dynamic key is generated by the cloud server. Then, the display device synthesizes the dynamic key with a local feature key to form a target dynamic key. Subsequently, the target platform encrypts the target streaming media using the target dynamic key, and the display device decrypts the encrypted streaming media using the target dynamic key and plays the decrypted streaming media. In the above solution, multiple verifications are performed through permission verification and dynamic keys, effectively improving the security of the display device for playing streaming media. Since the dynamic key is generated based on a random number, the reception time of the dynamic key generation request, and the identifier of the target streaming media, the feature key generated from the local device feature information and the dynamic key generated by the cloud server are synthesized into a target dynamic key, increasing the difficulty of cracking the target dynamic key. The target streaming media is transmitted from the target platform to the display device in the form of encrypted data, improving the security of the target streaming media during transmission. This method of the display device implementing streaming media processing by interacting with the target platform and the cloud server improves the security of playing streaming media in the display device.

[0010] In a second aspect, some embodiments further provide a streaming media processing method, which is applied to the display device provided in the first aspect. The display device includes: a display and at least one processor. The method includes:

[0011] In response to a playback request for a target streaming media in a target platform, send the playback request to the target platform. The playback request is used to instruct the target platform to perform permission verification on the playback request, and when the permission verification result indicates that the verification passes, send a dynamic key generation request to the cloud server. The dynamic key generation request is used to instruct the cloud server to generate a dynamic key based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform.

[0012] Receive the permission verification result and the dynamic key sent by the target platform. When the permission verification result indicates that the verification passes, generate a feature key according to the device feature information, and synthesize the feature key and the dynamic key into a target dynamic key.

[0013] Send the target dynamic key to the target platform to instruct the target platform to encrypt the target streaming media based on the target dynamic key.

[0014] Obtain the encrypted streaming media sent by the target platform, decrypt the encrypted streaming media using the target dynamic key, and play the decrypted streaming media.

[0015] In this embodiment, first, in response to a play request for a target streaming media on a target platform, the display device performs permission verification on the play request through the target platform. If the verification is passed, a dynamic key is generated by the cloud server. Then, the display device synthesizes the dynamic key with the local feature key to form a target dynamic key. Subsequently, the target platform encrypts the target streaming media using the target dynamic key, and the display device decrypts the encrypted streaming media using the target dynamic key and plays the decrypted streaming media. In the above solution, multiple verifications are performed through permission verification and dynamic keys, effectively improving the security of the display device for playing streaming media. Since the dynamic key is generated based on a random number, the acceptance time of the dynamic key generation request, and the identifier of the target streaming media, the feature key generated from the local device feature information and the dynamic key generated by the cloud server are synthesized into the target dynamic key, increasing the difficulty of cracking the target dynamic key. The target streaming media is transmitted from the target platform to the display device in the form of encrypted data, improving the security of the target streaming media during transmission. This method for the display device to process streaming media by interacting with the target platform and the cloud server improves the security of playing streaming media on the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0017] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided in some embodiments of the present application;

[0018] Figure 2 It is a schematic diagram of the hardware configuration of the display device provided in some embodiments of the present application;

[0019] Figure 3 It is a schematic diagram of the hardware configuration of the control device provided in some embodiments of the present application;

[0020] Figure 4 It is a schematic diagram of the software configuration of the display device provided in some embodiments of the present application;

[0021] Figure 5 It is a schematic diagram of the flowchart of the method for processing streaming media provided in some embodiments of the present application;

[0022] Figure 6 It is a schematic diagram of the generation steps of the feature key provided in some embodiments of the present application;

[0023] Figure 7 Schematic diagram of dynamic key update provided by some embodiments of the present application;

[0024] Figure 8 Schematic diagram of dynamic key update provided by other embodiments of the present application;

[0025] Figure 9 Schematic diagram of the streaming media chunking process provided by some embodiments of the present application;

[0026] Figure 10 Schematic diagram of parallel decryption by multiple processing cores provided by some embodiments of the present application;

[0027] Figure 11 Schematic diagram of parallel decryption by multiple processing cores provided by other embodiments of the present application;

[0028] Figure 12 Schematic diagram of implanting watermark into streaming media of video type provided by some embodiments of the present application;

[0029] Figure 13 Schematic diagram of implanting watermark into streaming media of audio type provided by some embodiments of the present application;

[0030] Figure 14 Schematic diagram of extracting watermark implantation content from streaming media of video type provided by some embodiments of the present application;

[0031] Figure 15 Schematic diagram of extracting watermark implantation content from streaming media of audio type provided by some embodiments of the present application;

[0032] Figure 16 Schematic diagram of data interaction timing of the streaming media processing method provided by some embodiments of the present application;

[0033] Figure 17 Schematic diagram of the watermark implantation process provided by some embodiments of the present application;

[0034] Figure 18 Internal structure diagram of a computer device provided by some embodiments of the present application. Detailed implementation manners

[0035] Embodiments will be described in detail below, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are merely examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0036] It should be noted that the brief description of terms in this application is only for facilitating the understanding of the following described embodiments, rather than intending to limit the embodiments of this application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0037] In this application, terms such as "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0038] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclusively include. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0039] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that can perform functions related to that element.

[0040] In the embodiments of this application, the display device 200 generally refers to a device with the ability to display images and process data. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0041] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided for some embodiments of this application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. For example, the control device 100 can be a remote control, a stylus, a handle, etc.

[0042] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, the mobile terminal 300 and the display device 200 can install software applications and achieve connection communication through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0043] As Figure 1It is also shown that the display device 200 also communicates with the server 400 through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0044] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.

[0045] Figure 2 For some embodiments of this application Figure 1 The hardware configuration block diagram of the display device 200 in

[0046] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0047] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0048] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive the image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0049] In some embodiments, the communication device 220 is a component for communicating with external devices or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0050] The communication device 220 can enable the display device 200 to communicate with an external device or server 400 through a wireless or wired connection. Among them, for the wired connection, the display device 200 can be connected to the external device through components such as data lines and interfaces. For the wireless connection, the display device 200 can be connected to the external device through wireless signals or wireless networks. The display device 200 can directly establish a connection relationship with the external device, or can indirectly establish a connection relationship through a gateway, router, connection device, etc.

[0051] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and the first interface to the nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0052] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0053] In some embodiments, the user can input a user command on the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0054] In some embodiments, the audio output device 270 can be the built-in speaker of the display device 200, or can be an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 can also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0055] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0056] Figure 3 For some embodiments of the present application Figure 1 The hardware configuration block diagram of the control device. As Figure 3 shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0057] The control device 100 is configured to control the display device 200, receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, acting as an interaction intermediary between the user and the display device 200.

[0058] In some embodiments, the control device 100 can be an intelligent device. For example, the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0059] In some embodiments, as Figure 1 shown, the mobile terminal 300 or other intelligent electronic devices, after installing the application for controlling the display device 200, can perform functions similar to those of the control device 100.

[0060] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions between the external and internal.

[0061] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 can include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near-field communication modules.

[0062] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.

[0063] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The communication interface 130 is configured in the control device 100. For example, modules such as WiFi, Bluetooth, and NFC can encode the user input instructions through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol and send them to the display device 200.

[0064] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0065] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0066] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0067] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0068] The operating system can be divided into different modules or levels according to the functions implemented, such as Figure 4 As shown, Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0069] The application layer mainly includes commonly used applications on TV and the Application Framework. Common applications are mainly applications developed based on the browser, such as HTML5 APPs and native applications. The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0070] Native apps can support online or offline, message push or local resource access.

[0071] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0072] The hardware layer mainly includes the Hardware Abstraction Layer (HAL) interface, hardware, and drivers. Among them, the HAL interface is the unified interface for all TV chips to connect, and the specific logic is implemented by each chip. The drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0073] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0074] With the rapid development of the functions of display devices, the security of streaming media during transmission, storage, and playback has received increasing attention. Taking smart TVs as an example, smart TVs use audio and video encryption technologies to protect the security of streaming media such as audio and video, preventing unauthorized access, copying, or tampering. Among them, audio and video encryption technologies mostly use fixed keys or single-permission verification, which are easily cracked or cannot be traced after the key is leaked. Moreover, the decrypted content lacks secondary copyright protection, making it difficult to track illegal transmission behaviors of streaming media. Therefore, traditional audio and video encryption technologies have problems of being easily cracked and low security of streaming media.

[0075] Based on this, an embodiment of the present application proposes a display device and a streaming media processing method. The display device includes a display and at least one processor. Among them, the display is configured to display content from a broadcast system or a network and / or a user interface; and at least one processor, which is connected to the display and is configured to execute instructions. First, in response to a playback request for a target streaming media in a target platform, the display device performs permission verification on the playback request through the target platform. In the case where the verification passes, a dynamic key is generated by the cloud server. Then, the display device synthesizes the dynamic key with a local feature key to form a target dynamic key. Subsequently, the target platform encrypts the target streaming media using the target dynamic key, and the display device decrypts the encrypted streaming media using the target dynamic key and plays the decrypted streaming media. In the above solution, multiple verifications are performed through permission verification and dynamic keys, effectively improving the security of the display device for playing streaming media; since the dynamic key is generated based on a random number, the reception time of the dynamic key generation request, and the identifier of the target streaming media, therefore, the feature key generated from the local device feature information and the dynamic key generated by the cloud server are synthesized into a target dynamic key, increasing the difficulty of cracking the target dynamic key; the target streaming media is transmitted from the target platform to the display device in the form of encrypted data, improving the security of the target streaming media during the transmission process. This display device realizes the streaming media processing method by interacting with the target platform and the cloud server, improving the security of playing streaming media in the display device.

[0076] As Figure 5 shown, a streaming media processing method is provided. Taking the method applied to the display device 200 as an example for illustration, it includes the following steps 502 to step 508. Among them:

[0077] Step 502, in response to a playback request for a target streaming media in a target platform, send the playback request to the target platform. The playback request is used to instruct the target platform to perform permission verification on the playback request, and in the case where the permission verification result indicates that the verification passes, send a dynamic key generation request to the cloud server; the dynamic key generation request is used to instruct the cloud server to generate a dynamic key based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried by the dynamic key generation request, and send it to the target platform.

[0078] Among them, the target platform refers to a third-party application platform that provides functional extensions and rich streaming media resources for a display device. The target streaming media is the streaming media provided by the target platform to the display device, including multimedia types such as video and audio. The display device has an interface for accessing the streaming media provided by the target platform. Exemplarily, an icon of the target platform is displayed in the human-computer interaction interface of the display device. In response to a trigger operation on the icon of the target platform, playback controls for multiple streaming media provided by the target platform are displayed in the human-computer interaction interface. In response to a trigger operation on the playback control of the target streaming media, a playback request for the target streaming media is generated.

[0079] The display device sends the playback request to the target platform to obtain the target streaming media from the target platform, so as to play the target streaming media. In order to improve the security of the target streaming media, the embodiment of the present application proposes a method of first performing permission verification on the playback request and then generating a dynamic key.

[0080] Permission verification refers to a method of verifying whether the display device sending the playback request has the legal right to obtain the target streaming media through the target platform. The permission verification result refers to the result of the permission verification, including verification passed and verification failed.

[0081] In some embodiments, the playback request carries information such as the feature hash value sha of the display device, the sending timestamp time of the playback request, the identifier sessionId of the target streaming media, account information, and account validity period. The target platform verifies the playback request and determines an invalid playback request as verification failed. Invalid playback requests include playback requests where the sending timestamp time of the playback request is not within the playback validity period, playback requests where the account information does not exist in the whitelist, playback requests where the account information is not within the account validity period, playback requests where the account information has no binding relationship with the display device, etc.

[0082] When the permission verification result of the playback request determined by the target platform indicates verification passed, the target platform sends the permission verification result to the display device and sends a dynamic key generation request to the cloud server.

[0083] The cloud server is a server based on cloud computing technology. The dynamic key generation request is used to instruct the cloud server to generate a dynamic key and return it to the target platform.

[0084] Random data refers to the random data generated by the cloud server. The receiving moment is the moment when the cloud server receives the dynamic key generation request. The identifier of the target streaming media is the unique identifier information indicating the target streaming media, and the dynamic key generation request carries the identifier of the target streaming media. In some embodiments, the cloud server can also generate a dynamic key based on the random data, the sending moment of the playback request, and the identifier of the target streaming media.

[0085] Step 504: Receive the permission verification result and the dynamic key sent by the target platform. When the permission verification result indicates that the verification is passed, generate a feature key based on the device feature information, and synthesize the feature key and the dynamic key into a target dynamic key.

[0086] Among them, the device feature information refers to the multi-dimensional device features of the display device, including hardware feature information, software feature information, network feature information, and behavior feature information. Among them, the hardware feature information may include information such as the GPU model, the number of CPU cores, the screen resolution, and the battery capacity of the display device; the software feature information may include information such as the operating system version, the browser UserAgent, the time zone setting, and the installed fonts; the network feature information may include information such as the MAC address hash and the IP address segment; the behavior feature information may include information such as the touch sampling rate. Denote that the device feature information features = {hardware feature information, software feature information, network feature information, behavior feature information}.

[0087] The feature key is a key generated based on the device feature information. As Figure 6 shown is a schematic diagram of the generation steps of the feature key in some embodiments. Among them, step 601: Collect device feature information; step 602: Perform normalization processing on the device feature information, denoted as normalized{features}; step 603: Perform anti-permutation confusion processing on the normalized data, denoted as sorted{normalized}; step 604: Perform anti-value tampering hash processing on the permutation-confused data, denoted as sha{sorted}; step 605: Obtain the feature confusion hash value, denoted as sha.hexdigest(); step 606: The display device uses the feature confusion hash value as the feature key.

[0088] After receiving the dynamic key, the target platform sends the dynamic key to the display device. The display device receives the permission verification result and the dynamic key sent by the target platform, and synthesizes the feature key K1 and the dynamic key K2 into the target dynamic key key1. In some embodiments, the synthesis method may be splicing, denoted as Key1 = K1 + K2.

[0089] Step 506: Send the target dynamic key to the target platform to instruct the target platform to encrypt the target streaming media based on the target dynamic key.

[0090] Among them, the display device sends the target dynamic key to the target platform, and the target platform can encrypt the target streaming media based on the target dynamic key. After the target streaming media is encrypted by the target dynamic key, it is sent from the target platform to the display device. Since the target streaming media is transmitted between the target platform and the display device in the form of encrypted data, the security of the target streaming media during transmission is improved.

[0091] Step 508: Obtain the encrypted streaming media sent by the target platform, and decrypt the encrypted streaming media using the target dynamic key; play the decrypted streaming media.

[0092] Among them, after the display device obtains the encrypted streaming media sent by the target platform, it decrypts the encrypted streaming media using the target dynamic key, and then plays the decrypted streaming media through the display. Since the display device plays the target streaming media after passing the permission verification and multiple verifications of the dynamic key, the security of the display device playing the streaming media is improved.

[0093] For the above streaming media processing method, first, in response to a play request for the target streaming media in the target platform, the display device performs permission verification on the play request through the target platform. If the verification passes, a dynamic key is generated by the cloud server. Then, the display device synthesizes the dynamic key and the local feature key into the target dynamic key. Subsequently, the target platform encrypts the target streaming media using the target dynamic key, and the display device decrypts the encrypted streaming media using the target dynamic key and plays the decrypted streaming media. The above solution effectively improves the security of the display device playing the streaming media through permission verification and dynamic key multiple verifications; since the dynamic key is generated based on a random number, the acceptance time of the dynamic key generation request, and the identifier of the target streaming media, the feature key generated from the local device feature information and the dynamic key generated by the cloud server are synthesized into the target dynamic key, which increases the difficulty of cracking the target dynamic key; the target streaming media is transmitted from the target platform to the display device in the form of encrypted data, which improves the security of the target streaming media during transmission. This streaming media processing method implemented by the display device through interaction with the target platform and the cloud server improves the security of playing the streaming media in the display device.

[0094] In some embodiments, the processor is configured to send the play request to the target platform as follows: send the play request to the target platform, and the play request is used to instruct the target platform to determine the key update method according to the content type of the target streaming media when the permission verification result indicates that the verification passes, and send a dynamic key generation request matching the key update method to the cloud server.

[0095] Among them, to improve the real-time performance and security of the dynamic key, the present application proposes that the dynamic key generated by the cloud server can be updated. The key update method indicates the method for updating the dynamic key.

[0096] The key update method can be determined according to the content type of the target streaming media. In some embodiments, a mapping relationship between the content type of the target streaming media and the key update method is stored in the display device. By querying this mapping relationship, the key update method can be determined. Exemplarily, when the content type of the target streaming media is any one of the live video type or the real-time conference type, that is, the target streaming media is a content scenario with high real-time requirements, the key update method is determined to be updated at time intervals; when the content type of the target streaming media is any one of the on-demand type or the playback type, that is, the target streaming media is a content scenario with low real-time requirements, the key update method is determined to be updated according to the storage space occupied by the streaming media.

[0097] As Figure 7 shown is a schematic diagram of dynamic key update provided by some embodiments. Among them, the user sends a play request through the display device. In response to the play request, the display device applies to the cloud server to generate a dynamic key K2 through the target platform. The cloud server generates the dynamic key K2 based on a random number, the acceptance time of the dynamic key generation request, and the identifier of the target streaming media, and sends the dynamic key K2 to the display device through the target platform. The target platform can also dynamically update the dynamic key, and thus send the updated dynamic key to the display device.

[0098] After the display device sends the play request to the target platform, it determines the key update method and sends a dynamic key generation request that matches the key update method to the cloud server to instruct the cloud server to generate a dynamic key according to the key update method.

[0099] In this embodiment, in the case of successful verification, the target platform determines the key update method according to the content type of the target streaming media, and thus sends a dynamic key generation request that matches the key update method to the cloud server. In this way, for streaming media of different content types, corresponding key update methods can be used to update the dynamic key, ensuring that the update of the dynamic key is more in line with the content scenario of the streaming media, which is beneficial to improving the real-time performance and security of the dynamic key, and at the same time, beneficial to improving the user experience.

[0100] In some embodiments, the key update method includes updating at time intervals; the processor is configured to send a play request to a target platform, which is configured to: send the play request to the target platform, where the play request is used to instruct the target platform to send a dynamic key generation request to a cloud server when the permission verification result indicates successful verification and the key update method indicates updating at time intervals; the dynamic key generation request is used to instruct the cloud server to determine a key update moment based on the reception moment of the dynamic key generation request and a preset duration, and generate a dynamic key based on random data, the key update moment, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform.

[0101] Wherein, when the key update method indicates updating at time intervals, the dynamic key generation request is used to instruct the cloud server to determine a key update moment based on the reception moment of the dynamic key generation request and a preset duration. For example, the reception moment is summed with the preset duration to obtain the key update moment. The cloud server regenerates a dynamic key based on random data "random", the key update moment, and the identifier "sessionId" of the target streaming media carried in the dynamic key generation request, and sends it to the target platform. The target platform sends the updated dynamic key to the display device, and the display device combines the feature key with the updated dynamic key to form an updated target dynamic key.

[0102] The updated target dynamic key takes effect at the key update moment. That is, within a preset duration before the key update moment, the target platform and the display device encrypt or decrypt the target streaming media based on the dynamic key before the update; at the key update moment and within the subsequent preset duration, the target platform and the display device encrypt or decrypt the target streaming media based on the updated dynamic key. The dynamic key before the update will automatically become invalid within the key update moment and the subsequent preset duration.

[0103] As Figure 8 shown is a schematic diagram of dynamic key update provided for some other embodiments. The reception moment of the dynamic key generation request is Ts, the preset duration is △T, the key update moment time = Ts + △T. The cloud server regenerates a dynamic key K2'. The display device recombines the target dynamic key key1' = K1 + K2'. K2' is valid within △T. When the target platform encrypts the target streaming media using key', it detects whether the target dynamic key is valid. If the current moment Tc is less than the key update moment time, then K2' is valid; if the current moment Tc is not less than the key update moment time, then K2' automatically becomes invalid.

[0104] In some embodiments, after the target platform detects that the dynamic key becomes invalid, it uses the current moment Tc as Ts and executes the dynamic key update process.

[0105] In this embodiment, when the key update method indicates an update at time intervals, the dynamic key is updated at a preset time interval. In this way, the dynamic key is updated regularly, and the old key automatically expires after exceeding the preset duration, which helps prevent replay attacks and thus improves the security of the streaming media.

[0106] In some embodiments, the key update method includes updating according to the storage space occupied by the streaming media; the processor is configured to send a play request to the target platform, and is configured to: send the play request to the target platform, where the play request is used to indicate that the target platform sends a dynamic key generation request to the cloud server when the permission verification result indicates verification passed and the key update method indicates an update according to the storage space occupied by the streaming media; the dynamic key generation request is used to indicate that the cloud server determines the key update moment based on the reception moment of the dynamic key generation request and the play duration corresponding to the preset storage space, and generates a dynamic key based on random data, the key update moment, and the identifier of the target streaming media carried in the dynamic key generation request, and sends it to the target platform.

[0107] Among them, for on-demand or playback content, the storage space occupied by the target streaming media is known. For example, the storage space occupied by the target streaming media is 2G. The preset storage space refers to the space interval for dynamically updating the key, and the preset storage space can be converted into the corresponding play duration. For example, a 30M streaming media is played for 2 minutes.

[0108] When the key update method indicates an update according to the storage space occupied by the streaming media, the dynamic key generation request is used to indicate that the cloud server determines the key update moment based on the reception moment of the dynamic key generation request and the play duration corresponding to the preset storage space. For example, the reception moment is summed with the play duration corresponding to the preset storage space to obtain the key update moment. The cloud server regenerates a dynamic key based on random data "random", the key update moment, and the identifier "sessionId" of the target streaming media carried in the dynamic key generation request, and sends it to the target platform. The target platform sends the updated dynamic key to the display device, and the display device synthesizes the feature key and the updated dynamic key into the updated target dynamic key.

[0109] Exemplarily, refer to Figure 8, the target platform cuts the storage space I of the target streaming media according to the preset storage space △L, where I = ∑△L. The dynamic key generation request sent by the target platform to the cloud server includes the reception time Ts of the dynamic key generation request and the playback duration △T corresponding to the preset storage space △L. After receiving the dynamic key generation request, the cloud server determines the key update time time = Ts + △T, and the cloud server regenerates the dynamic key K2'. The display device recombines the target dynamic key key1' = K1 + K2'. K2' is valid within △L. When the target platform encrypts the target streaming media using key', it detects whether the target dynamic key is valid. If the current time Tc is less than the key update time time, then K2' is valid; if the current time Tc is not less than the key update time time, then K2' automatically becomes invalid.

[0110] In some embodiments, after the target platform detects that the dynamic key has become invalid, it uses the current time Tc as Ts and executes the dynamic key update process.

[0111] In this embodiment, when the key update method indicates an update according to the storage space occupied by the streaming media, the dynamic key is updated at intervals of the preset storage space. In this way, the dynamic key is updated regularly, and the old key automatically becomes invalid when it exceeds the preset storage space, which helps to prevent replay attacks and thus improve the security of the streaming media.

[0112] In some embodiments, the processor decrypts the encrypted streaming media using the target dynamic key and is configured as follows: when the current network rate is greater than the first rate threshold, the encrypted streaming media is divided into blocks according to the preset number of bytes; when the current network speed is less than the second rate threshold, the encrypted streaming media data is divided into blocks according to the first duration; when the current network speed is between the second rate threshold and the first rate threshold, the media type of the encrypted streaming media is determined. If the media type is a video type, the encrypted streaming media data is divided into blocks according to key frames; if the media type is an audio type, the encrypted streaming media data is divided into blocks according to the second duration; the first duration is less than the second duration; the target dynamic key is used to decrypt multiple blocks of streaming media data.

[0113] Among them, for different network states, the decryption rate of the encrypted streaming media may be different. Therefore, the embodiments of the present application propose to divide the encrypted streaming media data into blocks, and then decrypt multiple blocks of streaming media data to adapt to different network conditions. The network rate can be the data download amount M within a unit time T (V = M / T).

[0114] Such as Figure 9The figure shows a schematic diagram of the streaming media chunking process provided by some embodiments. Among them, the receiving target platform receives the encrypted streaming media transmitted through the network. When the current network rate V is greater than the first rate threshold Max, it indicates that the current network rate is in a high-speed state, and at this time, the delay caused by the network is small. In this state, the encrypted streaming media can be chunked according to a preset number of bytes. For example, the size of each streaming media data chunk is fixed at 128KB - 1MB.

[0115] When the current network rate V is less than the second rate threshold Min, it indicates that the previous network rate is in a low-speed state, and at this time, the delay caused by the network is large. In this state, the encrypted streaming media data is chunked according to the first duration. For example, the length of each streaming media data chunk is fixed at (such as 2s - 10s).

[0116] When the current network rate V is between the second rate threshold Min and the first rate threshold Max, it indicates that the previous network rate is in a stable state, and at this time, the network delay fluctuation is small. In this state, different chunking methods are used for the encrypted streaming media of different media types. For video types, the key frame alignment method is adopted. For example, during video processing, cutting or operations are only performed at the positions of the key frames (I frames) of the video to ensure that each streaming media data chunk starts with an I frame, avoiding decoding errors or picture damage caused by the missing of dependent frames (P / B frames). For audio types, the chunking method according to the second duration can be adopted, and the first duration is less than the second duration, so as to avoid errors, transmission loss, damage, etc. during the transmission process due to the over-large streaming media data chunks.

[0117] The display device decrypts multiple streaming media data chunks, so as to adapt to different network conditions and avoid data decryption errors caused by abnormal data transmission.

[0118] In this embodiment, by chunking the encrypted streaming media in different ways under different network conditions and performing data chunking processing, it facilitates the streaming transmission of data, ensures that the data transmission can adapt to the network state, and avoids data decryption errors caused by abnormal data transmission.

[0119] In some embodiments, the processor includes multiple processing cores; when the processor executes to decrypt multiple streaming media data chunks using a target dynamic key, it includes: determining the target dynamic key corresponding to each of the multiple streaming media data chunks and the corresponding processing core; and respectively decrypting the corresponding streaming media data chunks by the multiple processing cores using the corresponding target dynamic keys.

[0120] Among them, the processor can include multiple processing cores, and using the multiple processing cores to perform parallel decryption on multiple streaming media data chunks is beneficial to improving the decryption efficiency.

[0121] Since the dynamic key is updated dynamically according to the time interval or the storage space occupied by the streaming media, for different streaming media data chunks, different dynamic keys may be corresponding, or each streaming media data chunk corresponds to at least one dynamic key.

[0122] As Figure 10 shown is a schematic diagram of parallel decryption by multiple processing cores in some embodiments. Taking the processing cores as M CPUs and taking the distribution of the encrypted streaming media on the M processing cores as an example for illustration. Among them, the encrypted streaming media is divided into D(NM) streaming media data chunks. D0, D(M), D(2M) …… D(NM) are allocated to processing core 0, D1, D(M + 1), D(2M + 1) …… D(NM + 1) are allocated to processing core 1, and D(M - 1), D(2M - 1) …… D(NM + M - 1) are allocated to processing core M.

[0123] As Figure 11 shown is a schematic diagram of parallel decryption by multiple processing cores in some other embodiments. Among them, taking the processing cores as M (for example, M is 4) CPUs and taking the uniform distribution of multiple streaming media data chunks on the M processing cores as an example for illustration. For the streaming media data chunk Di, where i = 0, 1, 2 …… m. The display device takes the remainder of i divided by M, denoted as j = i % M. The streaming media data chunk Di is put into the ciphertext buffer Rj of the jth processing core. The jth processing core loads the streaming media data chunk Di and injects the dynamic key Ki corresponding to the streaming media data chunk Di, and decrypts the streaming media data chunks on the 1st, 2nd …… Mth processing cores in parallel to obtain the decrypted data F0 - Fm.

[0124] In some embodiments, the decryption of multiple streaming media data chunks is performed in a trusted execution environment (TEE, Trusted execution environment), which can effectively prevent data from being tampered with.

[0125] In this embodiment, multiple processing cores decrypt multiple streaming media chunks in parallel, and corresponding streaming media chunks can be allocated to different processing cores, which is beneficial to improving the real-time performance of decryption.

[0126] In some embodiments, the processor executes to play the decrypted streaming media, and is configured to: obtain the streaming media watermark content; the streaming media watermark content is determined based on the media type of the encrypted streaming media and the watermark embedding requirement; extract the media features of the decrypted streaming media, and determine the watermark embedding position based on the media features; perform frequency domain conversion on the streaming media watermark content and the watermark embedding position, and perform time domain conversion on the frequency domain converted streaming media data to obtain the watermark embedded streaming media, and play it.

[0127] Among them, the media types include video types, audio types, etc. The watermark embedding requirement refers to the requirement information for embedding watermarks in streaming media of different media types. The streaming media watermark content refers to the content of the watermark that needs to be embedded in the decrypted streaming media. Exemplarily, it can be the account information of the current user, or the identification information of the target platform, etc.

[0128] Exemplarily, when the media types of the encrypted streaming media include video types and audio types, the watermark embedding requirement can be to calculate the streaming media watermark content for the video content in the encrypted streaming media, and can also be to calculate the streaming media watermark content for the audio content in the encrypted streaming media. When the media type of the encrypted streaming media includes audio type, the watermark embedding requirement can be to calculate the streaming media watermark content for the audio content in the encrypted streaming media.

[0129] The watermark embedding position refers to the position where the streaming media watermark content is embedded in the decrypted streaming media. For example, it can be embedded in each video frame of the decrypted streaming media, or can also be embedded at every preset number of data frames. The watermark embedding position can be determined based on media characteristics.

[0130] After determining the watermark embedding position, the display device performs frequency domain conversion on the streaming media watermark content and the watermark embedding position, and performs time domain conversion on the frequency domain converted streaming media data to obtain the streaming media with watermark embedded, and plays the streaming media with watermark embedded.

[0131] As Figure 12 shown is a schematic diagram of embedding watermarks in streaming media of video type in some embodiments. The media type is video type. Frequency domain conversion is performed on the streaming media watermark content Vwm and the watermark embedding position FRy, VFwm = FFT(FRy, Vwm) = FRy * r1 + Vwm * r2, where r1 is the visible spectrum, the human eye can perceive the spectrum in this band, r2 is the invisible spectrum, the human eye is not sensitive to the spectrum in this band and cannot perceive the spectrum in this band. Time domain conversion is performed on the frequency domain converted streaming media data, VTwm = IFFT(VFwm), and VTwm is the plaintext video output with watermark, that is, the streaming media with watermark embedded.

[0132] As Figure 13The figure shows a schematic diagram of implanting watermarks into streaming media of audio type in some embodiments. Exemplarily, the media type is audio type. For the streaming media watermark content Awm and the watermark implantation position Sp, a frequency domain conversion is performed: AFwm = FFT(Sp, Awm) = Sp * f1 + Awm * f2, where f1 is the low-frequency part and the human ear can distinguish the sound in this frequency band, and f2 is the high-frequency part and the human ear is not sensitive to the sound in this frequency band and cannot distinguish the sound in this frequency band. A time domain conversion is performed on the streaming media data after the frequency domain conversion: ATwm = IFFT(AFwm). ATwm is the clear-text audio output with the watermark, that is, the streaming media with the watermark implanted.

[0133] In this embodiment, for different media types and watermark implantation requirements, the streaming media watermark content can be determined, and the streaming media watermark content can indicate the source situation of the target streaming media; for different media characteristics, the watermark implantation position is determined to implant watermarks at different positions, which improves the flexibility of watermark implantation and is beneficial to enhancing the user experience; by performing frequency domain conversion and time domain conversion on the streaming media watermark content and the watermark implantation position, the streaming media with the watermark implanted is obtained. The watermark implanted in the streaming media is a watermark invisible to the user. Playing based on the streaming media with the watermark implanted does not require reducing the user's viewing experience; the streaming media after watermark implantation can be used for tracing the target streaming media, thereby tracing the copyright of the target streaming media.

[0134] In some embodiments, the processor executes determining the watermark implantation position based on media characteristics, and is configured to: in the case where the media characteristics indicate that the media type is video type, according to the video key frame indicated by the media characteristics, use the luminance component of the color space of the video key frame as the watermark implantation position; in the case where the media characteristics indicate that the media type is audio type, determine multiple audio blocks in the decrypted streaming media, and use the positions of the multiple audio blocks as the watermark implantation positions respectively.

[0135] Among them, for target streaming media of different media types, the method of determining the watermark implantation position is different. For the video type, the video key frame can be the I frame of the video, and the color space refers to the color encoding method of the video. For example, in the YUV color space, the video information is divided into two parts: luminance (Y) and chrominance (U and V), and the luminance component is the Y component.

[0136] For the audio type, the decrypted streaming media is divided into multiple audio blocks. The division method of the audio blocks includes dividing according to a preset time, such as 2 seconds, or dividing according to a preset storage space, such as 2M, etc. The division method can be flexibly selected according to requirements. The display device can use the start frame position, end frame position, middle frame position, etc. of each audio block as the watermark implantation position.

[0137] In this embodiment, for the target streaming media of the video type, the luminance component of the color space of the video key frame is used as the watermark implantation position, and for the target streaming media of the audio type, the positions of the audio blocks are respectively used as the watermark implantation positions, so as to implant the streaming media watermark content at the corresponding watermark implantation positions, facilitating the traceability of the target streaming media based on the streaming media watermark content and being conducive to the copyright protection of the target streaming media.

[0138] In some embodiments, the processor is further configured to: obtain the streaming media to be traced; perform frequency-domain conversion on the streaming media to be traced to obtain the frequency-domain content for watermark implantation; filter the frequency-domain content for watermark implantation, and perform time-domain conversion on the filtered frequency-domain content for watermark implantation to obtain the watermark implantation content; the watermark implantation content is used to indicate the source of the streaming media to be traced.

[0139] Among them, the streaming media to be traced refers to the streaming media implanted with the streaming media watermark content. The display device can perform frequency-domain conversion on the streaming media to be traced to obtain the frequency-domain content for watermark implantation. Filter the frequency-domain content for watermark implantation to filter out the data in the frequency bands where the watermark is not located, and obtain the data containing the watermark content, that is, the filtered frequency-domain content for watermark implantation.

[0140] As Figure 14 shown is a schematic diagram of extracting the watermark implantation content of the streaming media of the video type in some embodiments. For the video type, a filter in the r2 frequency band is used to filter out the data in the invisible spectral band. As Figure 15 shown is a schematic diagram of extracting the watermark implantation content of the streaming media of the audio type in some embodiments. For the audio type, a filter in the f2 frequency band is used to filter out the data in the audibly insensitive band.

[0141] Perform time-domain conversion on the filtered frequency-domain content for watermark implantation to obtain the watermark implantation content. The watermark implantation content indicates the source of the streaming media to be traced. Through the watermark implantation content, the account information that distributes the streaming media to be traced can be traced, which is conducive to the copyright protection of the streaming media.

[0142] In this embodiment, by performing frequency-domain conversion on the streaming media to be traced and filtering out the data in the frequency bands where the watermark is not located, the interference of the data in other frequency bands is avoided; perform time-domain conversion on the filtered frequency-domain content for watermark implantation to obtain the watermark implantation content, so as to trace the source of the streaming media to be traced based on the watermark implantation content, which is conducive to the copyright protection of the streaming media.

[0143] To illustrate the display device, the streaming media processing method and the effects in this solution in detail, the following is described with a most detailed embodiment:

[0144] The display device includes a display and at least one processor. Among them, the display is configured to display content from a broadcast system or network and / or a user interface; and at least one processor, which is connected to the display and is configured to execute instructions to enable the display device to implement a streaming media processing method. The display device and the streaming media processing method proposed in the embodiments of the present application can be applied to a variety of application scenarios. For example, video-on-demand scenarios, real-time video conferencing scenarios, etc. As Figure 16 shown is a schematic diagram of data interaction timing of a streaming media processing method provided by some embodiments.

[0145] For a video-on-demand scenario, the streaming media processing method includes the following steps:

[0146] 1. The user triggers the playback control for the target streaming media in the display device, and the display device generates a playback request and sends it to the target platform.

[0147] 2. The target platform performs permission verification on the playback request. For example, it detects whether the display device is bound to an account. If it is not bound or the account is invalid or illegal, etc., the current playback request is rejected. If it is already bound, it is determined that the verification is passed, and the permission verification result is sent to the display device.

[0148] 3. The target platform sends a dynamic key generation request to the cloud server.

[0149] 4. After the cloud server receives the dynamic key generation request, it generates a dynamic key K2 based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried in the dynamic key generation request. The random data is dynamically generated by the cloud server and is used to uniquely identify this playback.

[0150] 5. The cloud server sends the dynamic key K2 to the target platform.

[0151] 6. The target platform sends the dynamic key K2 to the display device.

[0152] 7. The display device receives the dynamic key K2 and starts to synthesize the target dynamic key Key1 = K1 + K2. Among them, K1 is a feature key generated based on device feature information.

[0153] 8. The target platform encrypts the target streaming media based on the target dynamic key Key1.

[0154] 9. The target platform determines whether the current time has exceeded the key update time. If it has not exceeded, the current dynamic key K2 is valid, and it starts to send the encrypted streaming media to the display device; if it has exceeded, the current dynamic key has expired, and a dynamic key update is executed.

[0155] 10. The display device decrypts the encrypted streaming media using the target dynamic key Key1. While decrypting the streaming media, an invisible watermark Vwm is implanted in the corner of each frame. The watermark content of the streaming media includes the user account, the program being played, the playback time, etc.

[0156] 11. The decrypted streaming media is played within a secure container to prevent third-party software from capturing it.

[0157] 12. For unauthorized, pirated, and illegally copied streaming media, watermark extraction is performed to trace the watermark implantation content of the leaked streaming media, including the user account, the program being played, the playback time, etc.

[0158] For the real-time video conferencing scenario, the streaming media processing method includes the following steps:

[0159] 1. The participant requests to intervene in the real-time video conference by triggering the entry control of the real-time video conference in the display device.

[0160] 2. The target platform detects whether the display device is bound to an account. If it is not bound or the account is invalid, illegal, etc., the request is rejected. If it is bound, it is determined that the verification is passed, and the permission verification result is sent to the display device.

[0161] 3. The target platform sends a dynamic key generation request to the cloud server.

[0162] 4. After receiving the dynamic key generation request, the cloud server generates a dynamic key K2 based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried in the dynamic key generation request. The random data is dynamically generated by the cloud server and is used to uniquely identify the current accessed conference.

[0163] 5. The cloud server sends the dynamic key K2 to the target platform.

[0164] 6. The target platform sends the dynamic key K2 to the display device.

[0165] 7. The display device receives the dynamic key K2 and starts to synthesize the target dynamic key Key1 = K1 + K2. Among them, K1 is a feature key generated based on the device feature information.

[0166] 8. The target platform encrypts the target streaming media based on the target dynamic key Key1.

[0167] 9. The target platform determines whether the current time has exceeded the key update time. If it has not exceeded, the current dynamic key K2 is valid, and it starts to send the encrypted streaming media to the display device. If it has exceeded, the current dynamic key has expired, and the key is dynamically updated.

[0168] 10. The display device decrypts the encrypted streaming media using the target dynamic key Key1. While decrypting the streaming media, an invisible watermark Awm is implanted at the corner of each frame. The watermark content of the streaming media includes the attendee account number, conference number, playback time, etc.

[0169] 11. The decrypted streaming media is played within a secure container to prevent the leakage of conference content.

[0170] 12. For illegally distributed streaming media, audio watermark extraction is performed to trace the watermark implantation content of the leaked streaming media, including the attendee account number, conference number, playback time, etc.

[0171] As Figure 17 shown is a schematic flowchart of watermark implantation provided by some embodiments. Among them, the encrypted streaming media is obtained, the encrypted streaming media is data-blocked, and multiple processing cores, such as a CPU array, are used to decrypt multiple data blocks of the streaming media. The multiple data blocks of the streaming media are stored in a data buffer, and a data decoder is used to decrypt the data blocks of the streaming media allocated to each processing core respectively; while decrypting, a watermark generator is used to generate the watermark content of the streaming media, and frequency-domain conversion and time-domain conversion are performed on the watermark implantation position determined based on the decrypted streaming media and the media watermark content to obtain the streaming media with the watermark implanted.

[0172] For the above display device and streaming media processing method, first, the display device responds to a playback request for a target streaming media in a target platform, and the target platform verifies the playback request for permissions. In the case of successful verification, a dynamic key is generated by the cloud server. Then, the display device synthesizes the dynamic key and the local feature key into a target dynamic key. Subsequently, the target platform encrypts the target streaming media using the target dynamic key, and the display device decrypts the encrypted streaming media using the target dynamic key and plays the decrypted streaming media. In the above solution, multiple verifications are performed through permission verification and dynamic keys, effectively improving the security of the display device for playing streaming media; since the dynamic key is generated based on a random number, the acceptance moment of the dynamic key generation request, and the identifier of the target streaming media, therefore, the feature key generated from the local device feature information and the dynamic key generated by the cloud server are synthesized into a target dynamic key, increasing the difficulty of cracking the target dynamic key; the target streaming media is transmitted from the target platform to the display device in the form of encrypted data, improving the security of the target streaming media during transmission. This display device realizes the streaming media processing method through interaction with the target platform and the cloud server, improving the security of playing streaming media in the display device.

[0173] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the indications of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless specifically stated herein, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least some of the steps or stages in other steps or other steps.

[0174] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structural diagram may be as Figure 18 shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used for exchanging information between the processor and external devices. The communication interface of the computer device is used for communicating with external terminals in a wired or wireless manner. The wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a streaming media processing method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0175] Those skilled in the art can understand that Figure 18 the structure shown in

[0176] In an exemplary embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0177] In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0178] In an embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0179] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0180] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., without limitation.

[0181] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as within the scope recorded in the present application.

[0182] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation to the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A display device, characterized in that, Comprising: A display configured to display content from a broadcast system or network and / or a user interface; And at least one processor connected to the display and configured to execute instructions to cause the display device: In response to a play request for a target streaming media in a target platform, send the play request to the target platform, where the play request is used to instruct the target platform to perform permission verification on the play request, and in the case where the permission verification result indicates successful verification, send a dynamic key generation request to a cloud server; The dynamic key generation request is used to instruct the cloud server to generate a dynamic key based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform; Receive the permission verification result and the dynamic key sent by the target platform, and in the case where the permission verification result indicates successful verification, generate a feature key according to device feature information, and synthesize the feature key and the dynamic key into a target dynamic key; Send the target dynamic key to the target platform to instruct the target platform to encrypt the target streaming media based on the target dynamic key; Obtain the encrypted streaming media sent by the target platform, and decrypt the encrypted streaming media using the target dynamic key; Play the decrypted streaming media.

2. The display device according to claim 1, characterized in that The processor's execution of sending the play request to the target platform is configured to: Send the play request to the target platform, where the play request is used to instruct the target platform to determine a key update method according to the content type of the target streaming media in the case where the permission verification result indicates successful verification, and send a dynamic key generation request matching the key update method to the cloud server.

3. The display device according to claim 2, wherein, The key update method includes updating at time intervals; the processor's execution of sending the play request to the target platform is configured to: Send the play request to the target platform, where the play request is used to instruct the target platform to send a dynamic key generation request to the cloud server in the case where the permission verification result indicates successful verification and the key update method indicates updating at time intervals; The dynamic key generation request is used to instruct the cloud server to determine a key update time based on the reception time of the dynamic key generation request and a preset duration, and generate a dynamic key based on random data, the key update time, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform.

4. The display device according to claim 2, wherein, The key update method includes updating according to the storage space occupied by the streaming media; the processor's execution of sending the play request to the target platform is configured to: Send the play request to the target platform, where the play request is used to instruct the target platform to send a dynamic key generation request to the cloud server in the case where the permission verification result indicates successful verification and the key update method indicates updating according to the storage space occupied by the streaming media; The dynamic key generation request is used to instruct the cloud server to determine a key update moment based on the reception moment of the dynamic key generation request and the playback duration corresponding to a preset storage space, and generate a dynamic key based on random data, the key update moment, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform.

5. The display device according to claim 1, wherein The processor executes decrypting the encrypted streaming media using the target dynamic key, and is configured to: When the current network rate is greater than the first rate threshold, divide the encrypted streaming media into blocks according to a preset number of bytes; When the current network speed is less than the second rate threshold, divide the encrypted streaming media data into blocks according to a first duration; When the current network speed is between the second rate threshold and the first rate threshold, determine the media type of the encrypted streaming media. When the media type is a video type, divide the encrypted streaming media data into blocks according to key frames. When the media type is an audio type, divide the encrypted streaming media data into blocks according to a second duration; The first duration is less than the second duration; Decrypt multiple blocks of streaming media data using the target dynamic key.

6. The display device according to claim 5, wherein The processor includes multiple processing cores; The processor executes decrypting multiple blocks of streaming media data using the target dynamic key, including: Determine the target dynamic key corresponding to each of the multiple blocks of streaming media data and the processing core corresponding to each; Have the multiple processing cores respectively decrypt the corresponding blocks of streaming media data using the corresponding target dynamic key.

7. The display device according to claim 1, wherein The processor executes playing the decrypted streaming media, and is configured to: Obtain streaming media watermark content; the streaming media watermark content is determined based on the media type of the encrypted streaming media and the watermark implantation requirement; Extract the media features of the decrypted streaming media, and determine the watermark implantation position based on the media features; Perform frequency domain conversion on the streaming media watermark content and the watermark implantation position, and perform time domain conversion on the frequency domain converted streaming media data to obtain the watermark implanted streaming media, and play it.

8. The display device according to claim 7, characterized in that, The processor executes determining the watermark implantation position based on the media features, and is configured to: When the media features indicate that the media type is a video type, use the luminance component of the color space of the video key frame indicated by the media features as the watermark implantation position; When the media features indicate that the media type is an audio type, determine multiple audio blocks in the decrypted streaming media, and use the positions of the multiple audio blocks as the watermark implantation positions respectively.

9. The display device according to claim 1, wherein The processor is further configured to: Obtain the streaming media to be traced; Perform frequency domain conversion on the streaming media to be traced to obtain the watermark implanted frequency domain content; Filter the watermark implanted frequency domain content, and perform time domain conversion on the filtered watermark implanted frequency domain content to obtain the watermark implanted content; the watermark implanted content is used to indicate the source of the streaming media to be traced.

10. A method for processing streaming media, characterized in that, The method further includes: In response to a play request for a target streaming media in a target platform, send the play request to the target platform. The play request is used to instruct the target platform to perform permission verification on the play request, and when the permission verification result indicates that the verification is passed, send a dynamic key generation request to the cloud server. The dynamic key generation request is used to instruct the cloud server to generate a dynamic key based on random data, the reception time of the dynamic key generation request, and the identifier of the target streaming media carried in the dynamic key generation request, and send it to the target platform. Receive the permission verification result and the dynamic key sent by the target platform. When the permission verification result indicates that the verification is passed, generate a feature key according to the device feature information, and synthesize the feature key and the dynamic key into a target dynamic key. Send the target dynamic key to the target platform to instruct the target platform to encrypt the target streaming media based on the target dynamic key. Obtain the encrypted streaming media sent by the target platform, decrypt the encrypted streaming media using the target dynamic key, and play the decrypted streaming media.

Images