Method, device and electronic equipment for playing multimedia file

Abstract

The present disclosure relates to the technical field of display, and particularly relates to a multimedia file playing method, device and electronic equipment. The method comprises the following steps: when a frame image of a multimedia file to be played is received, the frame image is decrypted to obtain first image information of a first channel and second image information of a second channel; wherein the first image information and the second image information both comprise third-level high-frequency information; a character prediction is performed based on the first image information and the second image information to determine a predicted character contained in the frame image; and a playing result of the frame image is determined based on the predicted character and preconfigured character data; wherein the playing result comprises any one of stopping playing and normal playing.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and more particularly to methods, apparatus and electronic devices for playing multimedia files. Background Technology

[0002] Currently, in special scenarios such as performances and public places, when using displays that employ light-emitting diodes (LEDs) to play content, it is necessary to ensure the safety of the content being played. For example, if staff members accidentally play multimedia files that are not in the playback schedule or click on the wrong multimedia file, it could lead to a playback accident.

[0003] Therefore, how to reduce the failure rate of playback accidents when playing multimedia files on LED displays in special scenarios has become an urgent problem to be solved. Summary of the Invention

[0004] To address the aforementioned technical problems, this disclosure provides a method, apparatus, and electronic device for playing multimedia files.

[0005] In a first aspect, this disclosure provides a method for playing a multimedia file, comprising: upon receiving a frame image of a multimedia file to be played, decrypting the frame image to obtain first image information of a first channel and second image information of a second channel; wherein the first image information and the second image information both include third-level high-frequency information; performing character prediction based on the first image information and the second image information to determine the predicted characters contained in the frame image; and determining the playback result of the frame image based on the predicted characters and pre-configured character data; wherein the playback result includes either stopped playback or normal playback.

[0006] Secondly, this disclosure provides a method for playing a multimedia file, comprising: acquiring a target multimedia file and identification information for characterizing an original watermark image; the identification information including first-level high-frequency information; performing color space conversion on each frame image of the target multimedia file to obtain first image information of a first channel and second image information of a second channel; wherein the first image information and the second image information both include third-level high-frequency information; performing reverse reconstruction of the image based on the first image information, the second image information and the identification information to obtain encrypted frame images; and generating a multimedia file to be played based on all the encrypted frame images.

[0007] Thirdly, this disclosure provides a multimedia file playback device, comprising: a processing unit, configured to decrypt the frame image received by the receiving unit when the receiving unit receives a frame image of a multimedia file to be played, to obtain first image information of a first channel and second image information of a second channel; wherein the first image information and the second image information both include third-level high-frequency information; the processing unit is further configured to perform character prediction based on the first image information and the second image information to determine the predicted characters contained in the frame image; the processing unit is further configured to determine the playback result of the frame image based on the predicted characters and pre-configured character data; wherein the playback result includes either stopped playback or normal playback.

[0008] Fourthly, this disclosure provides a multimedia file playback device, comprising: an acquisition unit, further configured to acquire a target multimedia file and identification information for characterizing an original watermark image; the identification information includes first-level high-frequency information; a processing unit, further configured to perform color space conversion on each frame image of the target multimedia file acquired by the acquisition unit to obtain first image information of a first channel and second image information of a second channel; wherein both the first image information and the second image information include third-level high-frequency information; the processing unit, further configured to perform reverse image reconstruction based on the first image information, the second image information and the identification information acquired by the acquisition unit to obtain encrypted frame images; and the processing unit, further configured to generate a multimedia file to be played based on all the encrypted frame images.

[0009] Fifthly, the present invention provides an electronic device, comprising: a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to, when executing the computer program, cause the electronic device to implement the multimedia file playback method provided in any of the first aspects.

[0010] In a sixth aspect, the present invention provides a computer-readable storage medium, comprising: storing a computer program on the computer-readable storage medium, wherein the computer program is executed by a controller as a method for playing a multimedia file as provided in any of the first aspects.

[0011] In a seventh aspect, the present invention provides a computer program product that, when run on a computer, causes the computer to execute a method for playing multimedia files as provided in any of the first aspects.

[0012] Eighthly, the present invention provides an electronic device, comprising: a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to, when executing the computer program, cause the electronic device to implement the multimedia file playback method provided in any of the second aspects.

[0013] In a ninth aspect, the present invention provides a computer-readable storage medium, comprising: storing a computer program on the computer-readable storage medium, the computer program being executed by a controller as a method for playing a multimedia file as provided in any of the second aspects.

[0014] In a tenth aspect, the present invention provides a computer program product that, when run on a computer, causes the computer to execute a method for playing multimedia files as provided in any of the second aspects.

[0015] It should be noted that the aforementioned computer instructions may be stored, in whole or in part, on the first computer-readable storage medium. The first computer-readable storage medium may be encapsulated together with the controller of the multimedia file playback device, or it may be encapsulated separately from the controller of the multimedia file playback device; this disclosure does not limit this. The descriptions of the third, fifth, sixth, and seventh aspects of this disclosure can be referenced to the detailed description of the first aspect; furthermore, the beneficial effects of the descriptions of the third, fifth, sixth, and seventh aspects can be referenced to the analysis of the beneficial effects of the first aspect, and will not be repeated here.

[0016] The descriptions of aspects four, eight, nine, and ten in this disclosure can be referenced to the detailed description of aspect two; and the beneficial effects of the descriptions of aspects four, eight, nine, and ten can be referenced to the analysis of the beneficial effects of aspect two, which will not be repeated here.

[0017] In this disclosure, the name of the multimedia file playback device does not limit the device or functional module itself. In actual implementation, these devices or functional modules may appear under other names. As long as the function of each device or functional module is similar to that of this disclosure, it falls within the scope of the claims of this disclosure and its equivalents.

[0018] These or other aspects of this disclosure will become more readily apparent in the following description.

[0019] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0020] The multimedia file playback method provided in this disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of a first channel and second image information of a second channel; wherein both the first image information and the second image information include third-level high-frequency information; character prediction is performed based on the first image information and the second image information to determine the predicted characters contained in the frame image; based on the predicted characters and pre-configured character data, the playback result of the frame image is determined; for example, if the pre-configured character data is a key, then when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and thus the multimedia file will not be played, reducing the number of erroneous playbacks, thereby reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios, and solving the problem of how to reduce the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0022] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 The following is an exemplary flowchart illustrating one of the multimedia file playback methods provided in Embodiment 1;

[0024] Figure 2 The image below exemplifies one of the scenario diagrams illustrating a multimedia file playback method provided in Embodiment 1.

[0025] Figure 3 The diagram above exemplarily illustrates the structure of an encoder for a multimedia file playback method provided in Embodiment 1.

[0026] Figure 4 The diagram above illustrates a schematic representation of the original watermark image of a multimedia file playback method provided in Embodiment 1.

[0027] Figure 5 The diagram above illustrates a scrambled image of a multimedia file playback method provided in Embodiment 1.

[0028] Figure 6The diagram above exemplarily illustrates the structure of a decoder for a multimedia file playback method provided in Embodiment 1.

[0029] Figure 7 The diagram above illustrates a schematic representation of the actual watermark image of a multimedia file playback method provided in Embodiment 1.

[0030] Figure 8 The second example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0031] Figure 9 The third example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0032] Figure 10 The fourth example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0033] Figure 11 The fifth example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0034] Figure 12 The sixth example of a flowchart illustrating a method for playing multimedia files provided in Embodiment 1 is shown below;

[0035] Figure 13 The seventh example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0036] Figure 14 The eighth example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0037] Figure 15 The ninth example of a flowchart illustrating a multimedia file playback method provided in Embodiment 1 is shown below;

[0038] Figure 16 The image above illustrates, for example, a flowchart of a multimedia file playback method provided in Embodiment 1.

[0039] Figure 17 The diagram above illustrates, exemplarily, a flowchart of a multimedia file playback method provided in Embodiment 1.

[0040] Figure 18 The following is a schematic flowchart of a multimedia file playback method provided in Embodiment 1, shown in Figure 12.

[0041] Figure 19The following is a schematic flowchart of a multimedia file playback method provided in Embodiment 1.

[0042] Figure 20 The following is a schematic flowchart of a multimedia file playback method provided in Embodiment 1.

[0043] Figure 21 The image below shows one of the structural schematic diagrams of the multimedia file playback device provided in Embodiment 2.

[0044] Figure 22 The diagram below exemplarily illustrates one of the structural schematic diagrams of the electronic device provided in Embodiment 2;

[0045] Figure 23 The second example shown is a schematic diagram of the structure of the multimedia file playback device provided in this embodiment.

[0046] Figure 24 The second example shown is a schematic diagram of the structure of the electronic device provided in this embodiment. Detailed Implementation

[0047] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0048] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0049] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0050] Example 1

[0051] Figure 1The example illustrates a flowchart of a method for playing multimedia files. The execution entity in this example can be an electronic device, such as detection device 3-3. Figure 1 As shown, the method includes:

[0052] S11. Upon receiving a frame image of a multimedia file to be played, the frame image is decrypted to obtain first image information of the first channel and second image information of the second channel. Both the first and second image information include third-level high-frequency information.

[0053] In some examples, the multimedia file playback method provided in this disclosure is applied to, for example... Figure 2 The schematic diagram shown includes: target device 1, broadcast controller 2, public display screen security management platform 3, control device 4, and display screen 5. Target device 1 can be a video watermark encryption server or a device with video watermark encryption software installed. The public display screen security management platform 3 includes distribution device 3-1, video delay controller 3-2, detection device 3-3, and control platform 3-4. Distribution device 3-1 includes either an HDMI splitter or a video bypass acquisition device. Detection device 3-3 includes either a control probe or a watermark detector. Display screen 5 is composed of at least one sub-screen spliced ​​together.

[0054] When a user needs to play a multimedia file on the public display screen security management platform 3, the target multimedia file needs to be encrypted on the target device 1 to generate the multimedia file to be played. Then, the target device 1 sends the multimedia file to be played to the playback controller 2. The playback controller 2 then transmits the frame images of the multimedia file to be played to the public display screen security management platform 3. To avoid playback accidents in special scenarios when playing multimedia files on LED displays, the multimedia file playback method provided in this embodiment involves the public display screen security management platform 3 performing playback verification on the multimedia file to be played. Only when the playback verification result of the multimedia file to be played is normal will the public display screen security management platform 3 send the corresponding frame image to the control device 4, and then the control device 4 will display the frame image on the display screen 5. For example, the playback controller 2 transmits the frame image of the multimedia file to be played to the distribution device 3-1 in the public display screen security management platform 3, and the distribution device 3-1 sends the frame image to the video delay controller 3-2. Because the frame image to be displayed is delayed, time can be reserved for detecting the playback result of the frame image. Simultaneously, the distribution device 3-1 sends the frame image to the detection device 3-3. Upon receiving the frame image of the multimedia file to be played, the detection device 3-3 decrypts the frame image to obtain the first image information of the first channel and the second image information of the second channel. Then, the detection device 3-3 performs character prediction based on the first and second image information to determine the predicted characters contained in the frame image. Based on the predicted characters and pre-configured character data, the detection device 3-3 determines the playback result of the frame image. For example, if the playback result is normal playback, the detection device 3-3 sends playback information to the video delay controller 3-2 to indicate that the current frame image is playing. Upon receiving the playback information from the detection device 3-3, the video delay controller 3-2 sends the frame image from the playback information to the control device 4. Then, the control device 4 controls the display screen 5 to display the frame image. Alternatively, if the playback result is stopped, the detection device 3-3 sends an alarm message to the management platform 3-4 indicating that the playback result of the frame image is stopped. Upon receiving the alarm message from the detection device 3-3, the management platform 3-4 sends a stop message to the detection device 3-3. The stop information is used to indicate one or more of the following: a first instruction to block the playback of a frame image, and / or a second instruction to turn off the display. Afterwards, the detection device 3-3 forwards the stop information to the video delay controller 3-2.

[0055] When the stop message contains the first instruction, the video delay controller 3-2 stops sending frame images to the control device 4 after receiving the stop message sent by the detection device 3-3.

[0056] When the stop message contains a second instruction, the video delay controller 3-2, after receiving the stop message from the detection device 3-3, sends the second instruction to the control device 4. Then, after receiving the stop message from the detection device 3-3, the control device 4 turns off the display 5.

[0057] When the stop message contains both a first instruction and a second instruction, the video delay controller 3-2, upon receiving the stop message from the detection device 3-3, stops sending frame images to the control device 4. Simultaneously, it sends the second instruction to the control device 4. Afterwards, upon receiving the stop message from the detection device 3-3, the control device 4 turns off the display 5.

[0058] In some examples, when a frame image of a multimedia file to be played is received, the frame image can be decomposed into three levels in the vertical and horizontal directions to obtain the first image information of the first channel and the second image information of the second channel. For example, if the color encoding of the multimedia file to be played is luminance Y, blue chromaticity component U, and red chromaticity component V, a three-level two-dimensional dual-tree complex wavelet transform (DT-CWT) is performed on the image to extract the three-level high-pass sub-band information of the corresponding Y channel and the three-level high-pass sub-band information of the U channel. The three-level high-pass sub-band information of the Y channel is named y_highpass, and the three-level high-pass sub-band information of the U channel is named u_highpass.

[0059] In some examples, the first channel can be the Y channel, and the first image information can be y_highpass; the second channel can be the U channel, and the second image information can be u_highpass.

[0060] In some examples, the sub-screen can be a screen that uses LED technology.

[0061] In some examples, target device 1 is equipped with an encoder, and detection device 3-3 is equipped with a decoder. The structure of the encoder is as follows: Figure 3 As shown, it includes: ciphertext module-11, image decomposition module-12, and encryption module-13.

[0062] The ciphertext module-11 includes a ciphertext generation module-111, an arrangement module wm-112, a preprocessing operation module-113, a random shuffle module random shuffle-114, and a first-level dual-tree complex wavelet transform module-115. The preprocessing operation module-113 includes one or more of the following: grayscale operation submodule gray, resize operation submodule resize, and binarization operation threshold submodule. The image decomposition module-12 includes an image input module image-121 and a spatial transformation module YUV-122. The encryption module-13 includes: a third-level dual-tree complex wavelet transform module-133, a Y luminance channel module-132, a U blue chromaticity component module-133, a processing module-134, an inverse transform module inverse-135, and an image output module image-out-136. The processing module-134 includes a filtering operation submodule filter-1340, an average pooling operation submodule avgpooling-1341, and a normalization operation submodule normalize-1342.

[0063] The ciphertext generation module-111 generates character data of a preset length based on the target algorithm. For example, if the target algorithm is a block symmetric encryption algorithm (e.g., SM4.0) and the preset length is 16, the ciphertext generation module-111 generates 16-bit character data based on SM4.0. The arrangement module wm-112 arranges the characters in the character data generated by the ciphertext generation module-111 according to a preset arrangement to generate the original watermark image. For example, if the 16-bit character data generated based on SM4.0 is "JuG136SJ / r1\DDoo", and the preset arrangement is 2 rows and 8 columns, the arrangement module wm-112 generates... Figure 4 The original watermark image is shown. Then, the preprocessing module-113 performs a first preprocessing operation on the original watermark image generated by the arrangement module wm-112. This first preprocessing operation includes grayscale processing, binarization processing, and scaling processing. Specifically, the preprocessing module-113 processes the original watermark image generated by the arrangement module wm-112 through the grayscale operation submodule gray to obtain a grayscale image; the resizing operation submodule resize processes the grayscale image generated by the grayscale operation submodule gray to obtain an adjusted image; and the binarization operation threshold submodule processes the adjusted image generated by the resizing operation submodule resize to obtain a preprocessed image. Next, the shuffling module random shuffle-114 generates a random number sequence according to a pre-configured random seed key. The shuffling module random shuffle-114 rearranges the pixel positions in the preprocessed image generated by the preprocessing module-113 based on the random number sequence to obtain the image shown. Figure 5The scrambled image is shown. The first-level dual-tree complex wavelet transform module-115 performs first-level two-dimensional DT-CWT processing on the scrambled image generated by the random shuffle module-114, such as performing first-level decomposition on the scrambled image in the vertical and horizontal directions to obtain first-level high-frequency information (such as first-level high-pass sub-band information). Then, the ciphertext module-11 uses the first-level high-frequency information as the identifier information wm_highpass used to characterize the original watermark image.

[0064] When frame images need to be encrypted, when the user inputs the corresponding target multimedia file into the encoder, the image input module image-121 in the encoder's image decomposition module-12 reads the frame images from the target multimedia file. The spatial conversion module YUV-122 converts the frame images read by the image input module image-121 according to a preset color encoding method to obtain the first image information of the first channel and the second image information of the second channel. For example, if the preset color encoding method is YUV color space, and the actual color encoding method of the frame image (such as RGB color space) is different from the preset color encoding method, the spatial conversion module YUV-122 converts the color encoding method of the frame images read by the image input module image-121 from the actual color encoding method to YUV color space to obtain the converted image. Subsequently, the three-level dual-tree complex wavelet transform module-133 performs three-level two-dimensional DT-CWT processing on the transformed image generated by the spatial transformation module YUV-122. This involves three-level decomposition of the transformed image in both the vertical and horizontal directions to obtain three-level high-pass sub-band information for the Y luminance channel and the U blue chrominance component channel. The three-level high-pass sub-band information for the Y luminance channel is used as the first image information y_highpass, and the three-level high-pass sub-band information for the U blue chrominance component channel is used as the second image information u_highpass. The processing module-134 performs a second preprocessing operation on the first image information generated by the three-level dual-tree complex wavelet transform module-133. If the second preprocessing operation includes filtering, average pooling, and normalization, the Y luminance channel module-132 inputs the first image information generated by the three-level dual-tree complex wavelet transform module-133 to the filtering operation module filter-134. The filtering operation module filter-134 then performs a filtering operation on the first image information input by the Y luminance channel module-132 to obtain a filtered image. Next, the average pooling module avgpooling-135 performs average pooling on the filtered image from the filter module filter-134 to obtain a pooled image. Then, the normalization module normalizes the pooled image from avgpooling-135 to obtain the processed image. Simultaneously, the U-blue chroma component module-133 inputs the second image information generated by the three-level dual-tree complex wavelet transform module-133 to the inverse transform module inverse-137.

[0065] Next, the encoder determines the identifier image information based on the identifier information and the processed image. For example, the encoder multiplies the identifier information wm_highpass with the processed image, thereby multiplying the contour information of the original watermark image to be embedded with the brightness detail information of the frame image to obtain the identifier image information mask. In this way, the changes can be reasonably scaled within a small space, so that the final generated encrypted image does not change significantly.

[0066] Next, the encoder obtains reconstructed information based on the identifier image information and the second image information. For example, the encoder superimposes the mask and u_highpass, causing subtle changes in the chroma information in the high-frequency detail texture of the U channel of the frame image. Then, the inverse-transform module inverse-135 performs inverse image reconstruction based on the reconstructed information, obtaining the encrypted frame image. Finally, the image-out-136 outputs the encrypted frame image generated by the inverse-transform module inverse-135, thus completing the encryption process for one frame image. Finally, by encrypting each frame image, a multimedia file to be played is generated.

[0067] In some examples, the decoder structure is as follows: Figure 6 As shown, it includes: a three-level dual-tree complex wavelet transform module-21, a Y luminance channel module-22, a U blue chromaticity component module-23, a processing module-24, an inverse transform module-25, a derandomization module-26, a prediction module-27, and a comparison module-28. The processing module-24 includes a filtering operation submodule-240, an average pooling operation submodule-241, a normalization operation submodule-242, and a reciprocal module-243.

[0068] When the three-level dual-tree complex wavelet transform module-21 receives the frame image of the multimedia file to be played, it performs a three-level two-dimensional DT-CWT transform on the image. For example, it performs a three-level decomposition of the frame image in the vertical and horizontal directions to obtain the first image information y_highpass of the first channel and the second image information u_highpass of the second channel. The Y-luminance channel module-22 sends the y_highpass generated by the three-level dual-tree complex wavelet transform module-21 to the processing module-24. The processing module-24 performs a third preprocessing operation on the y_highpass generated by the three-level dual-tree complex wavelet transform module-21 to obtain processed information. For example, when the third preprocessing operation includes filtering, average pooling, and normalization, the filtering operation submodule filter-240 of the processing module-24 performs a filtering operation on the y_highpass to obtain filtered information; the average pooling operation submodule avgpooling-241 performs an average pooling operation on the filtered information generated by the filtering operation submodule filter-240 to obtain pooling information. The normalization submodule `normalize-242` normalizes the pooling information generated by the average pooling submodule `avgpooling-241` to obtain normalized information. The reciprocal submodule `reciprocal-243` performs a reciprocal operation on the normalized information generated by the normalization submodule `normalize-242` to obtain processed information.

[0069] The decoder obtains the target high-frequency information based on the processed information and u_highpass. For example, the decoder multiplies y_highpass with u_highpass to obtain the target high-frequency information of the embedded watermark image.

[0070] Next, the inverse-25 module performs inverse dual-tree complex wavelet transform on the target high-frequency information to obtain the initial extracted theoretical watermark image. However, the theoretical watermark image is scrambled with the key, so it is necessary to restore the scrambled theoretical watermark image according to the random seed pre-set at the encryption end, thus obtaining the image as shown below. Figure 7 The actual watermark image shown.

[0071] The prediction module-27 performs character prediction on the actual watermark image generated by the inverse-transform module-25 to obtain the predicted characters contained in the actual watermark image. For example, it performs character prediction on the actual watermark image using a preset method, which includes any one of image template matching, neural network image classification, object detection, image segmentation, or sequence prediction. For instance, the predicted characters might include "JuG136SJ / r1\DDoo".

[0072] In some examples, since the actual watermark image contains noise and other signals, in order to eliminate the influence of noise and other signals on the prediction results, the multimedia file playback method provided in this disclosure performs derandomization-26 on the actual watermark image to obtain a derandomized image. Then, the prediction module-27 performs character prediction based on the derandomized image generated by derandomization-26 to obtain the predicted characters contained in the derandomized image. For example, character prediction is performed on the derandomized image based on a preset method to obtain the predicted characters contained in the derandomized image.

[0073] The comparison module-28 determines the playback result of the frame image based on the predicted character predicted by the prediction module-27 and the pre-configured character data (e.g., character data of a preset length generated based on the target algorithm). For example, if the comparison module-28 determines that the predicted character is "JuG136SJ / r1\DDoo" and the character data is "JuG136SJ / r1\DDoo", it determines that the predicted character and the character data are the same (e.g., the characters are the same and the order of the characters is the same), and determines that the playback result of the frame image is normal playback; or, if the comparison module-28 determines that the predicted character is "JuG136SJ / r1\DDo0" and the character data is "JuG136SJ / r1\DDoo", it determines that the predicted character and the character data are different (e.g., the characters are the same and / or the order of the characters is different), and determines that the playback result of the frame image is stop playback.

[0074] In some examples, the video is decrypted in real time while playing. The predicted characters of n frames are detected within a preset duration (e.g., 1 second). If the predicted characters of m consecutive frames are found to be different from the pre-configured character data, the video security detection is considered abnormal, the video does not have the right to be displayed, and a signal is sent through the system link to block the screen from being displayed.

[0075] S12. Based on the first image information and the second image information, perform character prediction to determine the predicted characters contained in the frame image.

[0076] In some examples, the prediction model can be used to predict characters by inputting the first and second image information as input values, thus determining the predicted characters contained in the frame image. The training process of the prediction model includes:

[0077] Obtain first training sample data and first labeling results of the first training sample data. The first training sample data includes at least one set of historical images, and the first labeling results include the characters contained in each set of historical images. Each set of historical images includes first image information and second image information corresponding to the same frame image.

[0078] The first training sample data is input into the first neural network model for learning, and the first prediction result of the first neural network model on the first training sample data is obtained.

[0079] Based on the first prediction result and the first labeling result, the network parameters of the first neural network model are adjusted until the first neural network model converges to obtain the prediction model.

[0080] Alternatively, a third preprocessing operation is performed on the first image information to obtain processed information; wherein the third preprocessing operation includes one or more of smoothing, filtering, average pooling, and normalization; based on the processed information and the second image information, target high-frequency information is obtained; inverse dual-tree complex wavelet transform is performed on the target high-frequency information to obtain the actual watermark image; character prediction is performed based on the actual watermark image to obtain the predicted characters contained in the actual watermark image.

[0081] S13. Based on the predicted characters and pre-configured character data, determine the playback result of the frame image; wherein the playback result includes either stopped playback or normal playback.

[0082] In some examples, if the playback result is normal playback, the frame image is played normally; or if the playback result is stopped playback, the frame image is stopped playback, and / or the display screen showing the frame image is turned off.

[0083] In some examples, to avoid the problem of frequently playing the frame image and / or turning off the display screen showing the frame image, the multimedia file playback method provided in this disclosure embodiment blocks the playback of the frame image of the multimedia file to be played and / or turns off the display screen showing the frame image when the playback result of N consecutive frame images is to stop playback. This can avoid the problem of accidentally stopping the playback of the frame image and / or turning off the display screen showing the frame image when the playback result of a single frame image is to stop playback while the playback result of other frame images is to play normally.

[0084] In some examples, N is an integer greater than or equal to 1.

[0085] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of a first channel and second image information of a second channel; wherein, both the first image information and the second image information include third-level high-frequency information; character prediction is performed based on the first image information and the second image information to determine the predicted characters contained in the frame image; based on the predicted characters and pre-configured character data, the playback result of the frame image is determined; for example, if the pre-configured character data is a key, then when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and thus the multimedia file will not be played, reducing the number of misplays, thereby reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0086] In some feasible examples, combining Figure 1 ,like Figure 8 As shown, the above S11 can be implemented by the following S110.

[0087] S110. Upon receiving a frame image of a multimedia file to be played, the frame image is decomposed into three levels in the vertical and horizontal directions to obtain the first image information of the first channel and the second image information of the second channel.

[0088] In some examples, performing a three-level decomposition of a frame image in both the vertical and horizontal directions can also be referred to as a three-level dual-tree complex wavelet transform.

[0089] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, performs a three-level decomposition of the frame image in the vertical and horizontal directions to obtain first image information of the first channel and second image information of the second channel; performs character prediction based on the first and second image information to determine the predicted characters contained in the frame image; and determines the playback result of the frame image based on the predicted characters and pre-configured character data. For example, if the pre-configured character data is a key, when a user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0090] In some feasible examples, combining Figure 1 ,like Figure 9 As shown, the above S12 can be specifically implemented through the following S120-S123.

[0091] S120. Perform a third preprocessing operation on the first image information to obtain processed information; wherein the third preprocessing operation includes one or more of filtering, average pooling and normalization.

[0092] S121. Based on the processed information and the second image information, the high-frequency information of the target is obtained.

[0093] S122. Perform inverse dual-tree complex wavelet transform on the high-frequency information of the target to obtain the actual watermark image.

[0094] S123. Based on the actual watermark image, perform character prediction to obtain the predicted characters contained in the actual watermark image.

[0095] As described above, the multimedia file playback method provided in this embodiment, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of the first channel and second image information of the second channel; performs a third preprocessing operation on the first image information to obtain processing information; obtains target high-frequency information based on the processing information and the second image information; performs inverse dual-tree complex wavelet transform on the target high-frequency information to obtain an actual watermark image; performs character prediction based on the actual watermark image to obtain the predicted characters contained in the actual watermark image; and determines the playback result of the frame image based on the predicted characters and pre-configured character data. For example, if the pre-configured character data is a key, when a user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0096] In some feasible examples, combining Figure 9 ,like Figure 10 As shown, the above S121 can be specifically implemented through the following S1210.

[0097] S1210. Multiply the processed information and the second image information to obtain the target high-frequency information.

[0098] In some examples, the values ​​of pixels that are identical to the processed information and the second image information can be multiplied to obtain the updated value for each pixel. Based on the updated values ​​of each pixel, high-frequency information of the target is generated.

[0099] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of the first channel and second image information of the second channel; performs a third preprocessing operation on the first image information to obtain processing information; multiplies the processing information and the second image information to obtain target high-frequency information; performs inverse dual-tree complex wavelet transform on the target high-frequency information to obtain an actual watermark image; performs character prediction based on the actual watermark image to obtain the predicted characters contained in the actual watermark image; and determines the playback result of the frame image based on the predicted characters and pre-configured character data. For example, if the pre-configured character data is a key, when a user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and the multimedia file will not be played, reducing the number of misplays and thus reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0100] In some feasible examples, combining Figure 9 ,like Figure 11 As shown, the above S123 can be implemented by the following S1230.

[0101] S1230. Based on a preset method, perform character prediction on the actual watermark image to obtain the predicted characters contained in the actual watermark image; wherein, the preset method includes any one of image template matching technology, neural network image classification, object detection, image segmentation, and sequence prediction.

[0102] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of the first channel and second image information of the second channel; performs a third preprocessing operation on the first image information to obtain processing information; obtains target high-frequency information based on the processing information and the second image information; performs inverse dual-tree complex wavelet transform on the target high-frequency information to obtain an actual watermark image; performs character prediction on the actual watermark image based on a preset method to obtain the predicted characters contained in the actual watermark image; and determines the playback result of the frame image based on the predicted characters and pre-configured character data. For example, if the pre-configured character data is a key, when a user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and the multimedia file will not be played, reducing the number of misplays and thus reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0103] In some feasible examples, combining Figure 1,like Figure 12 As shown, the above S13 can be implemented by the following S130.

[0104] S130. Compare the predicted character with the pre-configured character data of a preset length. If the predicted character is the same as the character data, determine that the playback result of the frame image is normal playback.

[0105] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of a first channel and second image information of a second channel; wherein, both the first image information and the second image information include third-level high-frequency information; character prediction is performed based on the first image information and the second image information to determine the predicted characters contained in the frame image; based on the predicted characters and pre-configured character data, the playback result of the frame image is determined; for example, if the pre-configured character data is a key, then when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to be stop playback, and thus the multimedia file will not be played, reducing the number of misplays, thereby reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0106] In some feasible examples, combining Figure 1 ,like Figure 13 As shown, the multimedia file playback method provided in this embodiment of the disclosure further includes: S14 implementation.

[0107] S14. If the playback result of N consecutive frames is "stop playing", then block the playback of the frames of the multimedia file to be played.

[0108] As described above, the multimedia file playback method provided in this embodiment of the present disclosure, upon receiving a frame image of a multimedia file to be played, decrypts the frame image to obtain first image information of a first channel and second image information of a second channel; wherein, both the first image information and the second image information include third-level high-frequency information; character prediction is performed based on the first image information and the second image information to determine the predicted characters contained in the frame image; based on the predicted characters and pre-configured character data, the playback result of the frame image is determined; for example, if the pre-configured character data is a key, then when the user plays an unprocessed multimedia file to be played, since the predicted characters of the frame images in N consecutive frames are different from the key, the playback result is determined to be stop playback, and thus the multimedia file will not be played, reducing the number of misplays, thereby reducing the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0109] Example 2

[0110] Figure 14 The example illustrates a flowchart of a method for playing multimedia files. The execution entity in this example can be an electronic device, such as target device 1. Figure 14 As shown, the method includes:

[0111] S20. Obtain the target multimedia file and the identification information used to characterize the original watermark image; wherein, the identification information includes first-level high-frequency information;

[0112] S21. Perform color space conversion on each frame image in the target multimedia file to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information;

[0113] S22. Based on the first image information, the second image information, and the identification information, the image is reconstructed in reverse to obtain the encrypted frame image;

[0114] S23. Based on all the encrypted frame images, generate a multimedia file to be played.

[0115] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: acquiring the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file to obtain first image information of the first channel and second image information of the second channel; reconstructing the image in reverse based on the first image information, second image information, and identification information to obtain encrypted frame images; and generating a multimedia file to be played based on all encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0116] In some feasible examples, combining Figure 14 ,like Figure 15 As shown, the above S20 can be implemented by the following S200-S206.

[0117] S200: Obtain the target multimedia file and character data of a preset length generated based on the target algorithm;

[0118] S201. Arrange the characters in the character data according to the preset arrangement to generate the original watermark image;

[0119] S202. Perform a first image preprocessing operation on the original watermark image to obtain a preprocessed image; wherein the first preprocessing operation includes one or more of the following: grayscale processing, binarization processing, and scaling processing.

[0120] S203. Generate a random number sequence according to the pre-configured random seed key;

[0121] S204. The pixel positions in the preprocessed image are rearranged based on a random number sequence to obtain a shuffled image;

[0122] S205. Perform first-level decomposition on the scrambled image in the vertical and horizontal directions to obtain first-level high-frequency information;

[0123] S206. Use the first-level high-frequency information as identification information to characterize the original watermark image.

[0124] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as: acquiring the target multimedia file and character data of a preset length generated based on the target algorithm; arranging the characters in the character data according to a preset arrangement to generate an original watermark image; performing a first image preprocessing operation on the original watermark image to obtain a preprocessed image; generating a random number sequence according to a pre-configured random seed key; rearranging the pixel positions in the preprocessed image based on the random number sequence to obtain a scrambled image; performing a first-level decomposition on the scrambled image in the vertical and horizontal directions to obtain first-level high-frequency information; using the first-level high-frequency information as identification information to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information; reconstructing the image in reverse based on the first image information, the second image information, and the identification information to obtain an encrypted frame image; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing a multimedia file, if the pre-configured character data is a key, when the user plays an unprocessed multimedia file, the predicted characters in the file will differ from the key, causing the playback to stop. This reduces the number of misplays and lowers the failure rate of playback accidents when playing multimedia files on an LED display in special scenarios.

[0125] In some feasible examples, combining Figure 14 ,like Figure 16 As shown, the above S21 can be implemented by the following S210.

[0126] S210. Perform color space conversion on each frame image in the target multimedia file according to a preset color encoding method to obtain the first image information of the first channel and the second image information of the second channel.

[0127] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: obtaining the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file according to a preset color encoding method to obtain first image information of the first channel and second image information of the second channel; reconstructing the image in reverse based on the first image information, second image information, and identification information to obtain the encrypted frame image; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0128] In some feasible examples, the preset color coding method includes luminance, blue chromaticity components, and red chromaticity components; combined with Figure 16 ,like Figure 17 As shown, the above S210 can be implemented by the following S2100 and S2101.

[0129] S2100. Perform color space conversion on each frame image in the target multimedia file according to the luminance, blue chrominance component and red chrominance component to obtain the converted image;

[0130] S2101. Perform a three-level decomposition on the converted image in the vertical and horizontal directions to obtain the first image information of the luminance channel and the second image information of the blue chroma component channel.

[0131] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: obtaining the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file according to the luminance, blue chroma component, and red chroma component to obtain a converted image; performing a three-level decomposition on the converted image in the vertical and horizontal directions to obtain the first image information of the luminance channel and the second image information of the blue chroma component channel; performing reverse reconstruction of the image based on the first image information, the second image information, and the identification information to obtain the encrypted frame image; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files on an LED display screen in special scenarios.

[0132] In some feasible examples, combining Figure 14 ,like Figure 18 As shown, the above S22 can be specifically implemented through the following S220-S223.

[0133] S220. Perform a second preprocessing operation on the first image information to obtain a processed image; wherein the second preprocessing operation includes one or more of filtering, average pooling and normalization.

[0134] S221. Based on the identification information and the processed image, determine the identification image information;

[0135] S222. Based on the identified image information and the second image information, the reconstructed information is obtained;

[0136] S223. Reverse reconstruct the image based on the reconstructed information to obtain the encrypted frame image.

[0137] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: acquiring the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file to obtain first image information of the first channel and second image information of the second channel; performing a second preprocessing operation on the first image information to obtain a processed image; determining identification image information based on the identification information and the processed image; obtaining reconstruction information based on the identification image information and the second image information; performing reverse reconstruction of the image based on the reconstruction information to obtain encrypted frame images; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0138] In some feasible examples, combining Figure 18 ,like Figure 19 As shown, the above S221 can be specifically implemented through the following S2210.

[0139] S2210. Multiply the identification information with each pixel in the processed image to obtain the identification image information.

[0140] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: acquiring the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file to obtain first image information of the first channel and second image information of the second channel; performing a second preprocessing operation on the first image information to obtain a processed image; multiplying the identification information with each pixel in the processed image to obtain identification image information; obtaining reconstruction information based on the identification image information and the second image information; performing reverse reconstruction of the image based on the reconstruction information to obtain an encrypted frame image; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0141] In some feasible examples, combining Figure 18 ,like Figure 20 As shown, the above S222 can be specifically implemented through the following S2220.

[0142] S2220. Superimpose the identification image information and the second image information to obtain the reconstructed information.

[0143] As described above, the multimedia file playback method provided in this embodiment encrypts the target multimedia file, such as by: acquiring the target multimedia file and identification information used to characterize the original watermark image; performing color space conversion on each frame image of the target multimedia file to obtain first image information of the first channel and second image information of the second channel; performing a second preprocessing operation on the first image information to obtain a processed image; determining identification image information based on the identification information and the processed image; superimposing the identification image information and the second image information to obtain reconstructed information; performing reverse reconstruction of the image based on the reconstructed information to obtain an encrypted frame image; and generating a multimedia file to be played based on all the encrypted frame images. Thus, when playing the multimedia file to be played, if the pre-configured character data is the key, when the user plays an unprocessed multimedia file to be played, since the predicted characters in the multimedia file to be played are different from the key, the playback result is determined to stop playback, and the multimedia file will not be played, reducing the number of misplays and thus lowering the failure rate of playback accidents when playing multimedia files using an LED display screen in special scenarios.

[0144] Example 3

[0145] A schematic diagram of the structure of the multimedia file playback device provided in Embodiment 3 of this application is shown below. Figure 21 The multimedia file playback device shown includes a processing unit 101 and a receiving unit 102.

[0146] The processing unit 101 is used to decrypt the frame image received by the receiving unit 102 when the receiving unit 102 receives the frame image of the multimedia file to be played, and obtain the first image information of the first channel and the second image information of the second channel; wherein the first image information and the second image information both include third-level high-frequency information.

[0147] The processing unit 101 is also used to perform character prediction based on the first image information and the second image information, and to determine the predicted characters contained in the frame image;

[0148] The processing unit 101 is also used to determine the playback result of the frame image based on the predicted characters and pre-configured character data; wherein the playback result includes either stopped playback or normal playback.

[0149] In some implementable examples, the processing unit 101 is specifically used to perform a three-level decomposition of the frame image in the vertical and horizontal directions when the receiving unit 102 receives the frame image of the multimedia file to be played, to obtain the first image information of the first channel and the second image information of the second channel.

[0150] In some feasible examples, processing unit 101 is specifically used to perform a third preprocessing operation on the first image information to obtain processed information; wherein, the third preprocessing operation includes one or more of filtering, average pooling, and normalization; processing unit 101 is specifically used to obtain target high-frequency information based on the processed information and the second image information; processing unit 101 is specifically used to perform inverse dual-tree complex wavelet transform on the target high-frequency information to obtain the actual watermark image; processing unit 101 is specifically used to perform character prediction based on the actual watermark image to obtain the predicted characters contained in the actual watermark image.

[0151] In some implementable examples, the processing unit 101 is specifically used to multiply the processing information and the second image information to obtain the target high-frequency information.

[0152] In some feasible examples, the processing unit 101 is specifically used to perform character prediction on the actual watermark image based on a preset method to obtain the predicted characters contained in the actual watermark image; wherein, the preset method includes any one of image template matching technology, neural network image classification, object detection, image segmentation, and sequence prediction.

[0153] In some feasible examples, the processing unit 101 is specifically used to compare the predicted character with pre-configured character data of a preset length. If the predicted character is the same as the character data, the playback result of the frame image is determined to be normal playback.

[0154] In some implementable examples, the processing unit 101 is specifically used to block the playback of the frame images of the multimedia file to be played when the playback result of N consecutive frame images is to stop playback.

[0155] All relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and their functions will not be repeated here.

[0156] Of course, the multimedia file playback device provided in this embodiment of the invention includes, but is not limited to, the modules described above. For example, the multimedia file playback device may also include a storage unit 103. The storage unit 103 may be used to store the program code of the multimedia file playback device, and may also be used to store data generated by the multimedia file playback device during operation, such as diagnostic data.

[0157] A schematic diagram of the structure of an electronic device provided in an embodiment of the present invention is shown below. Figure 22 The electronic device shown may include at least one processor 51, a memory 52, a communication interface 53, and a communication bus 54.

[0158] The following is a detailed introduction to the various components of the electronic device:

[0159] The processor 51 is the control center of the electronic device. It can be a single processor or a collective term for multiple processing elements. For example, the processor 51 can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention, such as one or more DSPs, or one or more field-programmable gate arrays (FPGAs).

[0160] In a specific implementation, as one embodiment, processor 51 may include one or more CPUs, such as CPU0 and CPU1. Furthermore, as one embodiment, the electronic device may include multiple processors, such as processor 51 and processor 55. Each of these processors may be a single-core processor or a multi-core processor. Here, "processor" may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0161] The memory 52 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or it may be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. The memory 52 may exist independently and be connected to the processor 51 via a communication bus 54. The memory 52 may also be integrated with the processor 51.

[0162] In a specific implementation, memory 52 is used to store data from this invention and the software program for executing this invention. Processor 51 can perform various functions of the air conditioner by running or executing the software program stored in memory 52 and by calling the data stored in memory 52.

[0163] Communication interface 53, using any transceiver-like device, is used to communicate with other devices or communication networks, such as Radio Access Network (RAN), Wireless Local Area Networks (WLAN), terminals, and the cloud. Communication interface 53 may include an acquisition unit to implement acquisition functions.

[0164] The communication bus 54 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, it is represented by only one thick line, but this does not indicate that there is only one bus or one type of bus.

[0165] As an example, the receiving unit 102 of the multimedia file playback device performs the same function as the communication interface 53, the processing unit 101 of the multimedia file playback device performs the same function as the processor 51, and the storage unit 103 of the multimedia file playback device performs the same function as the memory 52.

[0166] Example 4

[0167] A schematic diagram of the structure of the multimedia file playback device provided in Embodiment 4 of this application is shown below. Figure 23 The multimedia file playback device shown includes an acquisition unit 201 and a processing unit 202.

[0168] The acquisition unit 201 is also used to acquire the target multimedia file and the identification information used to characterize the original watermark image; the identification information includes first-level high-frequency information;

[0169] The processing unit 202 is further configured to perform color space conversion on the frame image of each frame in the target multimedia file acquired by the acquisition unit 201 to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information;

[0170] The processing unit 202 is also used to reverse reconstruct the image based on the first image information, the second image information and the identification information obtained by the acquisition unit 201, so as to obtain the encrypted frame image;

[0171] The processing unit 202 is also used to generate a multimedia file to be played based on all the encrypted frame images.

[0172] In some feasible examples, the acquisition unit 201 is specifically used to acquire character data of a preset length generated based on the target algorithm; the processing unit 202 is specifically used to arrange the characters in the character data acquired by the acquisition unit 201 according to a preset arrangement to generate an original watermark image; the processing unit 202 is specifically used to perform a first image preprocessing operation on the original watermark image to obtain a preprocessed image; wherein, the first preprocessing operation includes one or more of grayscale processing, binarization processing, and scaling processing; the processing unit 202 is specifically used to generate a random number sequence according to a pre-configured random seed key; the processing unit 202 is specifically used to rearrange the pixel positions in the preprocessed image based on the random number sequence to obtain a scrambled image; the processing unit 202 is specifically used to perform a first-level decomposition on the scrambled image in the vertical and horizontal directions to obtain first-level high-frequency information; the processing unit 202 is specifically used to use the first-level high-frequency information as identification information to characterize the original watermark image.

[0173] In some feasible examples, the processing unit 202 is specifically used to perform color space conversion on each frame image of the target multimedia file according to a preset color encoding method to obtain the first image information of the first channel and the second image information of the second channel.

[0174] In some feasible examples, the preset color encoding method includes luminance, blue chroma component and red chroma component; the processing unit 202 is specifically used to perform color space conversion on each frame image of the target multimedia file according to the luminance, blue chroma component and red chroma component to obtain the converted image; and to perform three-level decomposition on the converted image in the vertical and horizontal directions to obtain the first image information of the luminance channel and the second image information of the blue chroma component channel.

[0175] In some feasible examples, processing unit 202 is specifically used to perform a second preprocessing operation on the first image information to obtain a processed image; wherein the second preprocessing operation includes one or more of filtering, average pooling, and normalization; processing unit 202 is specifically used to determine the identifier image information based on the identifier information and the processed image; processing unit 202 is specifically used to obtain reconstructed information based on the identifier image information and the second image information; processing unit 202 is specifically used to perform reverse reconstruction of the image based on the reconstructed information to obtain an encrypted frame image.

[0176] In some implementable examples, the processing unit 202 is specifically used to multiply the identification information with each pixel in the processed image to obtain the identification image information.

[0177] In some feasible examples, the processing unit 202 is specifically used to superimpose the identification image information and the second image information to obtain reconstructed information.

[0178] A schematic diagram of the structure of an electronic device provided in an embodiment of the present invention is shown below. Figure 24 The electronic device shown may include at least one processor 61, a memory 62, a communication interface 63, and a communication bus 64.

[0179] The following is a detailed introduction to the various components of the electronic device:

[0180] The processor 61 is the control center of the electronic device. It can be a single processor or a collective term for multiple processing elements. For example, the processor 61 can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention, such as one or more DSPs, or one or more field-programmable gate arrays (FPGAs).

[0181] In a specific implementation, as one embodiment, processor 61 may include one or more CPUs, such as CPU0 and CPU1. Furthermore, as one embodiment, the electronic device may include multiple processors, such as processor 61 and processor 65. Each of these processors may be a single-core processor or a multi-core processor. Here, "processor" may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0182] The memory 62 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory 62 may exist independently and be connected to the processor 61 via a communication bus 64. The memory 62 may also be integrated with the processor 61.

[0183] In a specific implementation, memory 62 is used to store data from this invention and the software program for executing this invention. Processor 61 can perform various functions of the air conditioner by running or executing the software program stored in memory 62 and by calling the data stored in memory 62.

[0184] Communication interface 63, using any transceiver-like device, is used to communicate with other devices or communication networks, such as Radio Access Network (RAN), Wireless Local Area Networks (WLAN), terminals, and the cloud. Communication interface 63 may include an acquisition unit to implement acquisition functions.

[0185] The communication bus 64 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, it is represented by only one thick line, but this does not indicate that there is only one bus or one type of bus.

[0186] As an example, the acquisition unit 201 of the multimedia file playback device performs the same function as the communication interface 63, the processing unit 202 of the multimedia file playback device performs the same function as the processor 61, and the storage unit 203 of the multimedia file playback device performs the same function as the memory 62.

[0187] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method in any of the embodiments.

[0188] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for playing multimedia files, characterized in that, include: Upon receiving a frame image of a multimedia file to be played, the frame image is decrypted to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information; Based on the first image information and the second image information, character prediction is performed to determine the predicted characters contained in the frame image; Based on the predicted characters and pre-configured character data, the playback result of the frame image is determined; wherein the playback result includes either stopped playback or normal playback.

2. The method for playing multimedia files according to claim 1, characterized in that, Upon receiving a frame image of a multimedia file to be played, the step of decrypting the frame image to obtain first image information of the first channel and second image information of the second channel includes: Upon receiving a frame image of a multimedia file to be played, the frame image is decomposed into three levels in the vertical and horizontal directions to obtain the first image information of the first channel and the second image information of the second channel.

3. The method for playing multimedia files according to claim 1, characterized in that, The step of predicting characters based on the first image information and the second image information to determine the predicted characters contained in the frame image includes: The first image information is subjected to a third preprocessing operation to obtain processed information; wherein the third preprocessing operation includes one or more of filtering, average pooling and normalization. Based on the processed information and the second image information, the target high-frequency information is obtained; The target high-frequency information is subjected to inverse dual-tree complex wavelet transform to obtain the actual watermark image; Based on the actual watermark image, character prediction is performed to obtain the predicted characters contained in the actual watermark image.

4. The method for playing multimedia files according to claim 3, characterized in that, The step of obtaining target high-frequency information based on the processed information and the second image information includes: The target high-frequency information is obtained by multiplying the processed information and the second image information.

5. The method for playing multimedia files according to claim 3, characterized in that, The step of predicting characters based on the actual watermark image to obtain the predicted characters contained in the actual watermark image includes: Based on a preset method, character prediction is performed on the actual watermark image to obtain the predicted characters contained in the actual watermark image; wherein, the preset method includes any one of image template matching technology, neural network image classification, object detection, image segmentation, and sequence prediction.

6. The method for playing multimedia files according to claim 1, characterized in that, Determining the playback result of the frame image based on the predicted character and pre-configured character data includes: The predicted character is compared with pre-configured character data of a preset length. If the predicted character is the same as the character data, the playback result of the frame image is determined to be normal playback.

7. The method for playing multimedia files according to claim 1, characterized in that, The method further includes: If the playback result of N consecutive frames is that playback stops, then the playback of the frames of the multimedia file to be played is blocked.

8. A method for playing multimedia files, characterized in that, include: Obtain the target multimedia file and the identification information used to characterize the original watermark image; wherein, the identification information includes first-level high-frequency information; Color space conversion is performed on each frame image in the target multimedia file to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information; Based on the first image information, the second image information, and the identification information, the image is reconstructed in reverse to obtain the encrypted frame image; Based on all the encrypted frame images, a multimedia file to be played is generated.

9. The method for playing multimedia files according to claim 8, characterized in that, The step of obtaining the identification information used to characterize the original watermark image includes: Obtain character data of a preset length generated based on the target algorithm; The characters in the character data are arranged according to a preset arrangement to generate the original watermark image; The original watermark image is subjected to a first image preprocessing operation to obtain a preprocessed image; wherein, the first preprocessing operation includes one or more of the following: grayscale processing, binarization processing, and scaling processing; Generate a random number sequence according to the pre-configured random seed key; The pixel positions in the preprocessed image are rearranged based on the random number sequence to obtain a shuffled image; The scrambled image is decomposed into first-level high-frequency information in both the vertical and horizontal directions. The first-level high-frequency information is used as identification information to characterize the original watermark image.

10. The method for playing multimedia files according to claim 8, characterized in that, The step of performing color space conversion on each frame image in the target multimedia file to obtain first image information of the first channel and second image information of the second channel includes: Each frame image in the target multimedia file is converted to color space according to a preset color encoding method to obtain the first image information of the first channel and the second image information of the second channel.

11. The method for playing multimedia files according to claim 10, characterized in that, The preset color encoding method includes luminance, blue chromaticity component and red chromaticity component; The step of converting the color space of each frame image in the target multimedia file according to a preset color encoding method to obtain the first image information of the first channel and the second image information of the second channel includes: Each frame image in the target multimedia file is converted to a color space according to its luminance, blue chrominance, and red chrominance components to obtain a converted image; The converted image is decomposed into three levels in the vertical and horizontal directions to obtain the first image information of the luminance channel and the second image information of the blue chroma component channel.

12. The method for playing multimedia files according to claim 8, characterized in that, The process of reconstructing the image based on the first image information, the second image information, and the identification information to obtain the encrypted frame image includes: The first image information is subjected to a second preprocessing operation to obtain a processed image; wherein the second preprocessing operation includes one or more of filtering, average pooling and normalization. Based on the identification information and the processed image, the identification image information is determined; Based on the identified image information and the second image information, reconstructed information is obtained; Based on the reconstructed information, the image is reconstructed in reverse to obtain the encrypted frame image.

13. The method for playing multimedia files according to claim 12, characterized in that, The step of determining the identification image information based on the identification information and the processed image includes: The identification information is multiplied by each pixel in the processed image to obtain the identification image information.

14. The method for playing multimedia files according to claim 12, characterized in that, The process of obtaining reconstructed information based on the identified image information and the second image information includes: The identification image information and the second image information are superimposed to obtain the reconstructed information.

15. A multimedia file playback device, characterized in that, include: The processing unit is configured to decrypt the frame image received by the receiving unit when the receiving unit receives the frame image of the multimedia file to be played, and obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information; The processing unit is further configured to perform character prediction based on the first image information and the second image information, and determine the predicted characters contained in the frame image; The processing unit is further configured to determine the playback result of the frame image based on the predicted character and pre-configured character data; wherein the playback result includes either stopped playback or normal playback; The processing unit is further configured to control the playback unit to play frame images of the multimedia file to be played based on the playback result.

16. A multimedia file playback device, characterized in that, include: The acquisition unit is also used to acquire the target multimedia file and the identification information used to characterize the original watermark image; the identification information includes first-level high-frequency information; The processing unit is further configured to perform color space conversion on each frame image of the target multimedia file acquired by the acquisition unit to obtain first image information of the first channel and second image information of the second channel; wherein, both the first image information and the second image information include third-level high-frequency information; The processing unit is further configured to reverse reconstruct the image based on the first image information, the second image information, and the identification information obtained by the acquisition unit, to obtain an encrypted frame image; The processing unit is also used to generate a multimedia file to be played based on all the encrypted frame images.

17. An electronic device, characterized in that, include: A memory and a processor, wherein the memory is used to store a computer program; the processor is used to cause the electronic device to implement the multimedia file playback method according to any one of claims 1-7 when executing the computer program, or the processor is used to cause the electronic device to implement the multimedia file playback method according to any one of claims 8-14 when executing the computer program.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a computing device, causes the computing device to implement the multimedia file playback method according to any one of claims 1-7, or, when executed by the computing device, causes the computing device to implement the multimedia file playback method according to any one of claims 8-14.

Images