Video processing method and device and storage medium

Abstract

The invention provides a video processing method and device and a storage medium, and relates to the technical field of display. The video processing method comprises the following steps: acquiring a to-be-displayed video; the time sequence structure of the video to be displayed comprises brightness information; analyzing the video to be displayed, and extracting a field synchronization signal and a pulse width modulation signal from the time sequence structure; the field synchronization signal is used for indicating the display speed and sequence of video frames in the to-be-displayed video; the pulse width modulation signal is used for indicating the display brightness of a video frame in the to-be-displayed video; and displaying the to-be-displayed video according to the field synchronization signal, and adjusting the brightness of the displayed video according to the pulse width modulation signal so as to display the to-be-displayed video. The operation complexity of the display device can be reduced.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a video processing method, device and storage medium. Background Art

[0002] At present, when display devices display videos, the processing module in the display device, such as the system on chip (SoC) in the television (TV), performs synchronization separation processing on the video when receiving the video to obtain the vertical synchronization signal (VSync), and performs brightness statistics on the video to obtain the brightness pulse width modulation signal (PWM). After that, the field synchronization signal is used to control the display speed and order of the video frames in the video, and the brightness pulse width modulation signal is used to control the brightness of each area of ​​the video frame image to display the video. It can be seen that the display device needs to perform brightness statistics on the video during the process of displaying the video, which places high requirements on the computing power and real-time performance of the display device. Summary of the invention

[0003] In order to solve the above technical problems, the present application provides a video processing method, device and storage medium, which can reduce the computational complexity of a display device.

[0004] In the first aspect, the present application provides a video processing device, applied to a display device, comprising: a communicator, configured to obtain a video to be displayed; the timing structure of the video to be displayed includes brightness information; a processor, configured to parse the video to be displayed, and extract a field synchronization signal and a pulse width modulation signal from the timing structure; the field synchronization signal is used to indicate the display speed and order of video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed; and a display, configured to display the video to be displayed according to the field synchronization signal, and adjust the brightness of the displayed video according to the pulse width modulation signal to realize the display of the video to be displayed.

[0005] In a second aspect, the present application provides a video processing device, comprising: a communicator, configured to obtain a video to be configured; a processor, configured to count brightness information corresponding to each video frame in the video to be configured; performing an insertion operation on each video frame in the video to be configured to obtain a video to be displayed; the insertion operation comprises: inserting the brightness information of a first video frame into a timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured; the communicator is also configured to send the video to be displayed.

[0006] In a third aspect, the present application provides a video processing method, which is applied to a display device, including: obtaining a video to be displayed; the timing structure of the video to be displayed includes brightness information; parsing the video to be displayed, and extracting a field synchronization signal and a pulse width modulation signal from the timing structure; the field synchronization signal is used to indicate the display speed and order of video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed; displaying the video to be displayed according to the field synchronization signal, and adjusting the brightness of the displayed video according to the pulse width modulation signal to realize the display of the video to be displayed.

[0007] In a fourth aspect, the present application provides a video processing method, including: obtaining a video to be configured; counting the brightness information corresponding to each video frame in the video to be configured; performing an insertion operation on each video frame in the video to be configured to obtain a video to be displayed; the insertion operation includes: inserting the brightness information of a first video frame into a timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured; and sending the video to be displayed.

[0008] In a fifth aspect, the present application provides an electronic device, comprising: a memory and a processor, the memory being used to store a computer program; the processor being used to enable the electronic device to implement any one of the video processing methods provided in the third aspect when executing the computer program.

[0009] In a sixth aspect, the present application provides an electronic device, comprising: a memory and a processor, the memory being used to store a computer program; the processor being used to enable the electronic device to implement any one of the video processing methods provided in the fourth aspect when executing the computer program.

[0010] In a seventh aspect, the present application provides a computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a computing device, the computing device executes any one of the video processing methods provided in the third aspect.

[0011] In an eighth aspect, the present application provides a computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a computing device, the computing device executes any one of the video processing methods provided in the fourth aspect.

[0012] In a ninth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute any one of the video processing methods provided in the third aspect.

[0013] In a tenth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute any one of the video processing methods provided in the fourth aspect.

[0014] Compared with the prior art, the technical solution provided by this application has the following advantages:

[0015] In the above scheme, first, the video to be configured is obtained, the brightness information corresponding to each video frame in the video to be configured is counted, and the insertion operation is performed on each video frame in the video to be configured to obtain the video to be displayed. After that, the video to be displayed is sent to the display device. Among them, the insertion operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured. In this way, before sending the video to the display device, the brightness information corresponding to each video frame is counted in advance, and the brightness information is inserted into the timing structure corresponding to each video frame to form the video to be displayed, and sent to the display device. It avoids the need for the display device to count the brightness information corresponding to each video frame when displaying the video, saves the computing power resources of the display device, and reduces the computational complexity of the display device.

[0016] Secondly, after acquiring the video to be displayed, the display device analyzes the video to be displayed, extracts the field synchronization signal and the pulse width modulation signal from the timing structure, displays the video to be displayed according to the field synchronization signal, and adjusts the brightness of the displayed video according to the pulse width modulation signal to display the video to be displayed. In this way, when the display device acquires the video to be displayed including brightness information in the timing structure, it can directly obtain the pulse width modulation signal from the timing structure to adjust the brightness of the displayed video, avoiding the real-time statistics of the brightness information corresponding to each video frame, saving the computing power resources of the display device, and reducing the calculation complexity of the display device.

[0017] The description of the third, fifth, seventh and ninth aspects of the present application can refer to the detailed description of the first aspect; and the beneficial effects of the description of the third, fifth, seventh and ninth aspects can refer to the beneficial effect analysis of the first aspect, which will not be repeated here.

[0018] The descriptions of the fourth, sixth, eighth and tenth aspects of the present application may refer to the detailed description of the second aspect; and the beneficial effects of the descriptions of the fourth, sixth, eighth and tenth aspects may refer to the beneficial effect analysis of the second aspect, which will not be repeated here.

[0019] In this application, the name of the above video processing device does not limit the device or functional module itself. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those of this application, they fall within the scope of the claims of this application and their equivalent technologies.

[0020] These and other aspects of the present application will become more apparent from the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0023] Figure 1 A schematic diagram of a scenario of a video processing method provided in an embodiment of the present application;

[0024] Figure 2 One of the structural schematic diagrams of the video processing device provided in the embodiment of the present application;

[0025] Figure 3 The second structural diagram of the video processing device provided in the embodiment of the present application;

[0026] Figure 4 The third structural diagram of the video processing device provided in the embodiment of the present application;

[0027] Figure 5 One of the flowcharts of the video processing method provided in the embodiment of the present application;

[0028] Figure 6 The second flowchart of the video processing method provided in the embodiment of the present application;

[0029] Figure 7 The third flowchart of the video processing method provided in the embodiment of the present application;

[0030] Figure 8 A fourth flowchart of the video processing method provided in an embodiment of the present application;

[0031] Fig. 9 A fifth flowchart of the video processing method provided in an embodiment of the present application;

[0032] Fig.10 A fourth structural diagram of a video processing device provided in an embodiment of the present application;

[0033] Fig.11 A fifth structural diagram of a video processing device provided in an embodiment of the present application;

[0034] Fig.12 A schematic diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0036] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.

[0037] It should be noted that, in this application, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0038] Figure 1 Schematic diagram of the scene architecture of the video processing method provided in the embodiment of the present application. Figure 1 As shown, the scene architecture provided by the embodiment of the present application includes: a processing device 100 and a display device 200.

[0039] The processing device 100 provided in the embodiment of the present application may have a variety of implementation forms. For example, the processing device 100 may be a terminal device, for example, a television, a mobile phone, a personal computer (PC), a smart TV, an electronic bulletin board, a wearable device, a vehicle-mounted device, etc. The terminal device may perform an insertion operation on each video frame in the video to be configured according to the brightness information corresponding to each video frame in the video to be configured, obtain the video to be displayed, and send the video to be displayed to the display device 200. In an implementable example, the processing device 100 may also be a server that provides various services, for example, a server that provides support for the video to be configured. The server may perform an insertion operation on each video frame in the video to be configured according to the brightness information corresponding to each video frame in the video to be configured, obtain the video to be displayed, and send the video to be displayed to the display device 200. Among them, the server may be a server cluster or multiple server clusters, and may include one or more types of servers.

[0040] In some embodiments, after the processing device 100 configures the video to be configured and obtains the video to be displayed, it can communicate data with the display device 200. The processing device 100 can be allowed to communicate with the display device 200 through a local area network (LAN) or a wireless local area network (WLAN).

[0041] The display device 200 provided in the embodiment of the present application is a device with a display function, for example, the display device 200 may be a liquid crystal display (LCD), a light emitting diode (LED) backlit liquid crystal display, an LED display, a laser projection device, etc. When the display device 200 acquires the video to be displayed, it parses the video to be displayed, extracts the field synchronization signal and the pulse width modulation signal from the timing structure, displays the video to be displayed according to the field synchronization signal, and adjusts the brightness of the displayed video according to the pulse width modulation signal to display the video to be displayed.

[0042] The video processing device in this application can be hardware or software. When the video processing device is hardware, it can be various electronic devices with the function of running application programs, including but not limited to smart phones, TVs, tablet computers, smart watches, computers, AI devices, robots, smart vehicles, etc. When the video processing device is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, for providing configuration of video services to be configured, or for displaying videos to be displayed), or it can be implemented as a single software or software module. It is not specifically limited here.

[0043] It should be noted that the video processing method provided in the embodiment of the present application can be executed jointly by the processing device 100 and the display device 200.

[0044] For example, when the video processing method provided in the embodiment of the present application is jointly executed by the processing device 100 and the display device 200, the process is as follows:

[0045] The processing device 100 obtains the video to be configured, and counts the brightness information corresponding to each video frame in the video to be configured. Afterwards, an insertion operation is performed on each video frame in the video to be configured to obtain the video to be displayed. Among them, the insertion operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured. Finally, the video to be displayed is sent to the display device 200. The display device 200 obtains the video to be displayed, parses the video to be displayed, and extracts the field synchronization signal and the pulse width modulation signal from the timing structure. Afterwards, the video to be displayed is displayed according to the field synchronization signal, and the brightness of the displayed video is adjusted according to the pulse width modulation signal to realize the display of the video to be displayed. In this way, the display device 200 is avoided from counting the brightness information corresponding to each video frame in real time, the computing power resources of the display device 200 are saved, and the computational complexity of the display device 200 is reduced.

[0046] Figure 2 FIG. 1 shows a hardware configuration block diagram of a processing device 100 in an exemplary embodiment. Figure 2As shown, the processing device 100 may include at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The display 260 may be a display with a touch function, such as a touch display. The tuner 210 receives broadcast television signals by wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and EPG data signals. The detector 230 is used to collect signals of the external environment or interact with the outside. The controller 250 and the tuner 210 may be located in different split devices, that is, the tuner 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0047] In some embodiments, the controller 250 controls the operation of the processing device 100 and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the processing device 100.

[0048] In some embodiments, the operating system of the processing device 100 of one or more embodiments is an Android system as an example. Figure 3 As shown, the processing device 100 can be logically divided into an application layer (referred to as "application layer") 21, an application framework layer (referred to as "framework layer") 22, an Android runtime and system library layer (referred to as "system runtime library layer") 23, and a kernel layer 24.

[0049] Among them, the application layer 21 includes one or more applications. The application can be a system application or a third-party application. For example, the application layer 21 includes a first application, and the first application can provide a function of configuring the video to be configured. The framework layer 22 provides an application programming interface (API) and a programming framework for the application of the application layer 21. The system runtime layer 23 provides support for the upper layer, namely the framework layer 22. When the framework layer 22 is used, the Android operating system will run the C / C++ library contained in the system runtime layer 23 to implement the functions to be implemented by the framework layer 22. The kernel layer 24 serves as a software middleware between the hardware layer and the application layer 21, and is used to manage and control hardware and software resources.

[0050] In some embodiments, after the processing device 100 is turned on, the transceiver unit 202 of the processing device 100 obtains the video to be configured. Afterwards, the processing unit 201 of the processing device 100 counts the brightness information corresponding to each video frame in the video to be configured, and performs an insertion operation on each video frame in the video to be configured according to the brightness information corresponding to each video frame, so as to obtain the video to be displayed. Finally, the transceiver unit 202 of the processing device 100 sends the video to be displayed to the display device. This avoids the display device from counting the brightness information corresponding to each video frame in real time, saves the computing power resources of the display device, and reduces the computational complexity of the display device.

[0051] Specifically, the storage unit 203 of the video processing device is used to store the application program of the first application, and data such as the operating system of the processing device 100 .

[0052] Figure 4 FIG. 2 shows a hardware configuration block diagram of a display device 200 in an exemplary embodiment. Figure 4 As shown, the display device 200 may include a processor 110, a display unit 120, a light source unit 130, a power supply unit 140, and a communication interface unit 150. The processor 110 includes a synchronization separation unit 111 and an image processing unit 112. The communication interface unit 150 is used to obtain the video to be displayed; the synchronization separation unit 111 is used to parse the video to be displayed and extract the field synchronization signal and the pulse width modulation signal from the timing structure. The image processing unit 112 is used to display the video to be displayed on the display unit 120 according to the field synchronization signal, and adjust the brightness of the light source unit 130 according to the pulse width modulation signal to realize the display of the video to be displayed.

[0053] In some embodiments, when the display device 200 is an LCD display device, the light source unit 130 may be a backlight unit, and the brightness of the displayed video may be adjusted by adjusting the brightness of each coordinate point (corresponding to a pixel point of the image) in the backlight unit.

[0054] In some embodiments, when the display device 200 is a laser projection device, the display device 200 further includes a digital light processing (DLP) unit for adjusting the color gamut of the displayed video according to the color gamut range of the display device 200. The light source unit 130 may be a laser unit, and the laser unit may be driven by a pulse width modulation signal to adjust the brightness of the displayed video.

[0055] In the following embodiments, the method of the embodiment of the present application is described by taking the above-mentioned processing device 100 as an example of the execution subject of the video processing method provided by the embodiment of the present disclosure.

[0056] The present application embodiment provides a video processing method, such as Figure 5As shown, the video processing method may include S11-S14.

[0057] S11. Obtain the video to be configured.

[0058] Specifically, the method of obtaining the video to be configured can be to use a camera, mobile phone, camera or other device to record in real time to obtain the video to be configured; or, it can be to download or receive a video file on a specific platform through the Internet to obtain the video to be configured, etc. This application does not impose any restrictions on this.

[0059] S12: Count the brightness information corresponding to each video frame in the video to be configured.

[0060] In some embodiments, a method of counting brightness information corresponding to each video frame in the video to be configured may be: first, extracting at least one video frame from the video to be configured.

[0061] Specifically, the method of extracting at least one video frame from the video to be configured may be: using a preset library or software to parse the video to be configured, and extracting each video frame in the video to be configured. For example, commonly used libraries include OpenCV, FFmpeg, and the like.

[0062] Secondly, a conversion and reading operation is performed on at least one video frame to obtain brightness information corresponding to each video frame. The conversion and reading operation includes: converting the third video frame into a grayscale image; traversing each pixel in the grayscale image to read the grayscale value of each pixel; and using the grayscale value of each pixel in the grayscale image as brightness information corresponding to the third video frame. The third video frame is any video frame in the at least one video frame.

[0063] Specifically, the third video frame may be converted into a grayscale image by using a preset algorithm, for example, the cv2.cvtColor() method.

[0064] In some embodiments, a method for counting brightness information corresponding to each video frame in the video to be configured may also be: first, extracting at least one video frame from the video to be configured.

[0065] Secondly, perform a read average operation on at least one video frame to obtain brightness information corresponding to each video frame. The read average operation includes: traversing and reading each pixel point in the fourth video frame to read the pixel values ​​of three channels (red, green and blue) of each pixel point; taking the average value (or weighted average value) of the three-channel pixel values ​​of a pixel point as the brightness value of the pixel point, and counting the brightness value of each pixel point in the fourth video frame to obtain the brightness information corresponding to the fourth video frame. The fourth video frame is any video frame in the at least one video frame.

[0066] In some embodiments, after counting the brightness information corresponding to each video frame in the video to be configured, the method further includes: generating a sub-signal corresponding to each video frame according to the brightness information corresponding to each video frame.

[0067] Specifically, the method of generating a sub-signal corresponding to each video frame according to the brightness information corresponding to each video frame may include: performing a processing operation on a preset periodic signal according to the brightness information corresponding to each video frame to generate a sub-signal corresponding to each video frame.

[0068] The processing operation includes: converting the brightness information of the second video frame into a duty cycle of a preset periodic signal to obtain a sub-signal corresponding to the second video frame. The second video frame is any video frame in the video to be configured. The duty cycle of a periodic signal refers to the proportion of a high level in the periodic signal. In one cycle, the duty cycle represents the ratio between the duration of the high level and the total time of one cycle.

[0069] In the above scheme, the brightness information corresponding to each video frame in the video to be configured can be counted, and the brightness information corresponding to each video frame can be converted into a sub-signal, so that the sub-signal can be subsequently inserted into the timing structure of the video frame to form a video to be displayed that includes brightness information in the timing structure. This avoids the need for the display device to count the brightness information corresponding to each video frame when displaying the video, saves the computing power resources of the display device, and reduces the computational complexity of the display device.

[0070] S13, performing an insertion operation on each video frame in the video to be configured to obtain a video to be displayed.

[0071] The inserting operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame. The first video frame is any video frame in the video to be configured.

[0072] Specifically, the method of inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame may include: inserting the sub-signal corresponding to the first video frame into the blanking area of ​​the timing structure corresponding to the first video frame.

[0073] The timing structure of the video frame includes two signals, namely horizontal sync (Hs) and vertical sync (Vs). By detecting horizontal sync and vertical sync, field sync signal and line sync signal can be obtained. The field sync signal is used to indicate the start and end position of each field in the video frame so that the display unit can correctly display each field of the image. The line sync signal is used to indicate the start and end position of each line in the video frame so that the display unit can scan and display each line of the video frame in the correct order.

[0074] A field in a video frame refers to a part of a video frame, which consists of multiple rows of pixels. When a field is scanned sequentially in a video frame, it starts from the upper left corner of the field image and scans line by line to the lower right corner. The number of fields and rows in a video frame depends on the resolution and format of the video in which the video frame is located. For example, in a standard defined video system, a field usually consists of about 240-290 lines.

[0075] The blanking area of ​​the timing structure is located at the top and bottom of each video frame, and at the beginning and end of each line in the video frame. The blanking area of ​​the timing structure is used to provide a reference point for video signal synchronization and control to ensure that the video signal is correctly decoded and displayed on the display device.

[0076] Therefore, the sub-signal corresponding to the first video frame is inserted in the blanking area of ​​the timing structure corresponding to the first video frame, that is, the part of the sub-signal corresponding to each field in the first video frame is inserted in the blanking area corresponding to the field.

[0077] In the above scheme, the sub-signal corresponding to the video frame can be inserted in advance in the blanking area of ​​the timing structure corresponding to the video frame to form a video to be displayed including brightness information in the timing structure. This avoids the need for the display device to count the brightness information corresponding to each video frame when displaying the video, saves the computing power resources of the display device, and reduces the computing complexity of the display device.

[0078] S14: Send the video to be displayed to the display device.

[0079] In the above scheme, the video to be configured is obtained, the brightness information corresponding to each video frame in the video to be configured is counted, and each video frame in the video to be configured is inserted to obtain the video to be displayed. After that, the video to be displayed is sent to the display device. In this way, before sending the video to the display device, the brightness information corresponding to each video frame is counted in advance, and the brightness information is inserted in the timing structure corresponding to each video frame to form the video to be displayed, and then sent to the display device. This avoids the need for the display device to count the brightness information corresponding to each video frame when displaying the video, saves the computing power resources of the display device, and reduces the computational complexity of the display device.

[0080] In the following embodiments, the method of the embodiment of the present application is described by taking the above-mentioned display device 200 as an example of the execution subject of the video processing method provided by the embodiment of the present disclosure.

[0081] The present application embodiment provides a video processing method, such as Figure 6 As shown, the video processing method may include S21-S23.

[0082] S21. Obtain the video to be displayed.

[0083] The timing structure of the video to be displayed includes brightness information.

[0084] Specifically, the method of obtaining the video to be displayed may be to receive the video to be displayed sent by the processing device 100, or to directly obtain the video to be displayed including brightness information in the timing structure. The source of the video to be displayed displayed in the display device 200 is not limited in this application.

[0085] S22, parsing the video to be displayed, and extracting a field synchronization signal and a pulse width modulation signal from the timing structure.

[0086] The field synchronization signal is used to indicate the display speed and order of the video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed.

[0087] First, the way to extract the field synchronization signal from the timing structure can be to first detect and identify the vertical synchronization to determine the position of the rising edge or falling edge of the vertical synchronization, which usually marks the beginning and end of each field. Then, based on the edge detection results, the field synchronization signal is extracted according to the preset algorithm and logic. Among them, the algorithm and logic vary according to the definition of the field in the video frame, and the definition of the field includes the number of fields in the video frame, or the number of lines in each field.

[0088] Afterwards, the PWM signal is extracted from the timing structure.

[0089] Specifically, the method of extracting the pulse width modulation signal from the timing structure is as follows: Figure 7 As shown, the following steps are included:

[0090] S221. Extract at least one sub-signal from a blanking area in a timing structure.

[0091] Among them, one video frame corresponds to one sub-signal.

[0092] S222. Determine a sum of at least one sub-signal as a pulse width modulation signal.

[0093] In the above scheme, the display device 200 can directly extract the pulse width modulation signal from the blanking area of ​​the timing structure of the video to be displayed, avoiding real-time statistics of the brightness information corresponding to each video frame, saving the computing power resources of the display device, and reducing the calculation complexity of the display device.

[0094] S23, displaying the video to be displayed according to the field synchronization signal, and adjusting the brightness of the displayed video according to the pulse width modulation signal to realize display of the video to be displayed.

[0095] In the above scheme, after the display device obtains the video to be displayed, it analyzes the video to be displayed, extracts the field synchronization signal and the pulse width modulation signal from the timing structure, displays the video to be displayed according to the field synchronization signal, and adjusts the brightness of the displayed video according to the pulse width modulation signal to display the video to be displayed. In this way, when the display device obtains the video to be displayed including brightness information in the timing structure, it can directly obtain the pulse width modulation signal from the timing structure to adjust the brightness of the displayed video, avoiding the real-time statistics of the brightness information corresponding to each video frame, saving the computing power resources of the display device, and reducing the calculation complexity of the display device.

[0096] In some embodiments, the video processing method further includes extracting a line synchronization signal from the timing structure to control each line of pixels of the video frame to be scanned and displayed in a correct order when the video to be displayed is displayed on a display device.

[0097] In some embodiments, when the display device 200 is a laser projection device, Figure 8 As shown, the video processing method also includes steps S24-S25.

[0098] S24: Obtain a color gamut modulation signal of the video to be displayed.

[0099] S25. Adjust the color gamut of the displayed video according to the color gamut modulation signal.

[0100] In the above scheme, the color gamut of the displayed video can be adjusted according to the color gamut modulation signal, thereby avoiding the problem of inconsistent graphics colors in the video when the video is displayed on different devices or display environments, and ensuring the accuracy of the graphics colors in the displayed video.

[0101] In the following embodiments, the method of the embodiment of the present application is described by taking the execution subject of the video processing method provided by the embodiment of the present disclosure as the above-mentioned processing device 100 and the display device 200 executing together as an example.

[0102] The present application embodiment provides a video processing method, such as Fig. 9 As shown, the video processing method may include S31-S37.

[0103] S31. The processing device obtains the video to be configured.

[0104] S32: The processing device counts brightness information corresponding to each video frame in the video to be configured.

[0105] S33: The processing device performs an insertion operation on each video frame in the video to be configured to obtain a video to be displayed.

[0106] The inserting operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured.

[0107] In some embodiments, the method further includes: generating a sub-signal corresponding to each video frame according to brightness information corresponding to each video frame.

[0108] In some embodiments, the method of generating a sub-signal corresponding to each video frame according to the brightness information corresponding to each video frame includes: performing a processing operation on a preset periodic signal according to the brightness information corresponding to each video frame to generate a sub-signal corresponding to each video frame. The processing operation includes: converting the brightness information of the second video frame into a duty cycle of the preset periodic signal to obtain a sub-signal corresponding to the second video frame; the second video frame is any video frame in the video to be configured.

[0109] In some embodiments, the method of inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame includes: inserting the sub-signal corresponding to the first video frame into the blanking area of ​​the timing structure corresponding to the first video frame.

[0110] S34: The processing device sends the video to be displayed to the display device.

[0111] S35: The display device obtains the video to be displayed.

[0112] The timing structure of the video to be displayed includes brightness information.

[0113] S36: The display device analyzes the video to be displayed, and extracts a field synchronization signal and a pulse width modulation signal from the timing structure.

[0114] The field synchronization signal is used to indicate the display speed and order of the video frames in the video to be displayed; and the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed.

[0115] In some embodiments, the field synchronization signal and the pulse width modulation signal may be extracted from the timing structure by extracting at least one sub-signal from the blanking region in the timing structure and determining the sum of the at least one sub-signal as the pulse width modulation signal, wherein one video frame corresponds to one sub-signal.

[0116] S37. The display device displays the video to be displayed according to the field synchronization signal, and adjusts the brightness of the displayed video according to the pulse width modulation signal to display the video to be displayed.

[0117] In the above scheme, first, the video to be configured is obtained, the brightness information corresponding to each video frame in the video to be configured is counted, and the insertion operation is performed on each video frame in the video to be configured to obtain the video to be displayed. After that, the video to be displayed is sent to the display device. Among them, the insertion operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured. In this way, before sending the video to the display device, the brightness information corresponding to each video frame is counted in advance, and the brightness information is inserted into the timing structure corresponding to each video frame to form the video to be displayed, and sent to the display device. It avoids the need for the display device to count the brightness information corresponding to each video frame when displaying the video, saves the computing power resources of the display device, and reduces the computational complexity of the display device.

[0118] Secondly, after acquiring the video to be displayed, the display device analyzes the video to be displayed, extracts the field synchronization signal and the pulse width modulation signal from the timing structure, displays the video to be displayed according to the field synchronization signal, and adjusts the brightness of the displayed video according to the pulse width modulation signal to display the video to be displayed. In this way, when the display device acquires the video to be displayed including brightness information in the timing structure, it can directly obtain the pulse width modulation signal from the timing structure to adjust the brightness of the displayed video, avoiding the real-time statistics of the brightness information corresponding to each video frame, saving the computing power resources of the display device, and reducing the calculation complexity of the display device.

[0119] The embodiment of the present application can divide the functional modules of the video processing device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0120] like Fig.10 As shown, a schematic diagram of the structure of a video processing device 200 provided in an embodiment of the present application is applied to a display device, including a communicator 2001 , a processor 2002 and a display 2003 .

[0121] The communicator 2001 is configured to obtain the video to be displayed; the timing structure of the video to be displayed includes brightness information; the processor 2002 is configured to parse the video to be displayed, and extract the field synchronization signal and the pulse width modulation signal from the timing structure; the field synchronization signal is used to indicate the display speed and order of the video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed; the display 2003 is configured to display the video to be displayed according to the field synchronization signal, and adjust the brightness of the displayed video according to the pulse width modulation signal to realize the display of the video to be displayed.

[0122] In some embodiments, the processor 2002 is specifically configured to: extract at least one sub-signal from the blanking area in the timing structure; one video frame corresponds to one sub-signal; and determine the sum of the at least one sub-signal as a pulse width modulation signal.

[0123] In some embodiments, the display 2003 is further configured to: obtain a color gamut modulation signal of a video to be displayed; and adjust the color gamut of the displayed video according to the color gamut modulation signal.

[0124] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and its role will not be repeated here.

[0125] Of course, the video processing device 200 provided in the embodiment of the present application includes but is not limited to the above modules, for example, the video processing device 200 may also include a memory 2004. The memory 2004 may be used to store the program code of the video processing device 200, and may also be used to store data generated by the video processing device 200 during operation, such as data in a write request, etc.

[0126] As an example, combining Figure 4 The function implemented by the communicator 2001 in the video processing device 200 is the same as that of the communication interface unit 150 , and the function implemented by the processor 2002 is the same as that of the processing unit 110 .

[0127] like Fig.11 As shown, an embodiment of the present application provides a structural schematic diagram of another video processing device 100 , which includes a communicator 101 and a processor 102 .

[0128] The communicator 101 is configured to obtain the video to be configured; the processor 102 is configured to count the brightness information corresponding to each video frame in the video to be configured; an insertion operation is performed on each video frame in the video to be configured to obtain the video to be displayed; the insertion operation includes: inserting the brightness information of the first video frame into the timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured; the communicator 101 is also configured to send the video to be displayed to the display device.

[0129] In some embodiments, the processor 102 is further configured to generate a sub-signal corresponding to each video frame based on brightness information corresponding to each video frame; the processor 102 is specifically configured to insert the sub-signal corresponding to the first video frame into the blanking area of ​​the timing structure corresponding to the first video frame.

[0130] In some embodiments, the processor 102 is specifically configured to perform processing operations on a preset periodic signal according to brightness information corresponding to each video frame to generate a sub-signal corresponding to each video frame; the processing operation includes: converting the brightness information of the second video frame into a duty cycle of the preset periodic signal to obtain a sub-signal corresponding to the second video frame; the second video frame is any video frame in the video to be configured.

[0131] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and its role will not be repeated here.

[0132] Of course, the video processing device 100 provided in the embodiment of the present application includes but is not limited to the above modules, for example, the video processing device 100 may also include a memory 103. The memory 103 may be used to store the program code of the video processing device 100, and may also be used to store data generated by the video processing device 100 during operation, such as data in a write request, etc.

[0133] As an example, combining Figure 3 The function implemented by the communicator 101 in the video processing device 100 is the same as that of the receiving unit 202 , the function implemented by the processor 102 is the same as that of the processing unit 201 , and the function implemented by the memory 103 is the same as that of the storage unit 203 .

[0134] like Fig.12 As shown, the embodiment of the present application also provides a chip system, which can be applied to the video processing device 100 or the video processing device 200 in the above-mentioned embodiment. The chip system includes at least one processor 1501 and at least one interface circuit 1502. The processor 1501 can be the processor in the above-mentioned video processing device 100 or the video processing device 200. The processor 1501 and the interface circuit 1502 can be interconnected through a line. The processor 1501 can receive and execute computer instructions from the memory of the above-mentioned video processing device 100 or the video processing device 200 through the interface circuit 1502. When the computer instructions are executed by the processor 1501, the video processing device 100 or the video processing device 200 can execute the various steps executed by the video processing device 100 or the video processing device 200 in the above-mentioned embodiment. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiment of the present application.

[0135] The embodiment of the present application also provides a computer-readable storage medium for storing computer instructions executed by the above-mentioned video processing device 100 or video processing device 200.

[0136] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video processing device, applied to a display device, characterized in that: include: A communicator configured to obtain a video to be displayed; The timing structure of the video to be displayed includes brightness information; A processor configured to parse the video to be displayed, and extract a field synchronization signal and a pulse width modulation signal from the timing structure; the field synchronization signal is used to indicate the display speed and order of the video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed; The display is configured to display the video to be displayed according to the field synchronization signal, and adjust the brightness of the displayed video according to the pulse width modulation signal to realize the display of the video to be displayed.

2. The video processing device according to claim 1, characterized in that The processor is specifically configured to: Extracting at least one sub-signal from the blanking area in the timing structure; one video frame corresponds to one sub-signal; The sum of the at least one sub-signal is determined as the pulse width modulated signal.

3. The video processing device according to claim 1 or 2, characterized in that: The display is further configured as: Obtaining a color gamut modulation signal of the video to be displayed; The color gamut of the displayed video is adjusted according to the color gamut modulation signal.

4. A video processing device, characterized in that: include: A communicator is configured to obtain a video to be configured; A processor is configured to count brightness information corresponding to each video frame in the video to be configured; Performing an insertion operation on each video frame in the video to be configured to obtain a video to be displayed; The inserting operation includes: inserting brightness information of a first video frame into a timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured; The communicator is further configured to send the video to be displayed to a display device.

5. The video processing device according to claim 4, characterized in that: The processor is further configured to generate a sub-signal corresponding to each video frame according to the brightness information corresponding to each video frame; The processor is specifically configured to insert the sub-signal corresponding to the first video frame into a blanking area of ​​the timing structure corresponding to the first video frame.

6. The video processing device according to claim 5, characterized in that: The processor is specifically configured to perform a processing operation on a preset periodic signal according to brightness information corresponding to each video frame to generate a sub-signal corresponding to each video frame; the processing operation includes: converting the brightness information of the second video frame into a duty cycle of the preset periodic signal to obtain a sub-signal corresponding to the second video frame; the second video frame is any video frame in the video to be configured.

7. A video processing method, applied to a display device, characterized in that: include: Get the video to be displayed; The timing structure of the video to be displayed includes brightness information; Parsing the video to be displayed, extracting a field synchronization signal and a pulse width modulation signal from the timing structure; the field synchronization signal is used to indicate the display speed and order of the video frames in the video to be displayed; the pulse width modulation signal is used to indicate the display brightness of the video frames in the video to be displayed; The video to be displayed is displayed according to the field synchronization signal, and the brightness of the displayed video is adjusted according to the pulse width modulation signal to realize the display of the video to be displayed.

8. A video processing method, characterized in that: include: Get the video to be configured; Counting brightness information corresponding to each video frame in the video to be configured; Performing an insertion operation on each video frame in the video to be configured to obtain a video to be displayed; The inserting operation includes: inserting brightness information of a first video frame into a timing structure corresponding to the first video frame; the first video frame is any video frame in the video to be configured; The video to be displayed is sent to a display device.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to implement the video processing method according to claim 7 or claim 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the video processing method of claim 7 or claim 8.

Images