Television picture processing method based on MEMC technology and related device

Abstract

The invention discloses a television picture processing method and related device based on MEMC technology, and the method comprises the steps: converting a television audio and video signal into video sequence frame data when a smart television receives the television audio and video signal; performing calculation processing on motion vectors of the moving targets in two adjacent video frames in the video sequence frame data based on an MEMC technology to obtain motion vector data of the moving targets; based on the motion vector data of the moving target, starting an intelligent frame insertion algorithm to perform frame insertion processing on the video sequence frame data to form video sequence frame data after frame insertion; performing light and shade contrast enhancement processing on each piece of video sequence frame data in the video sequence frame data after frame insertion to form enhanced video sequence frame data; and loading the enhanced video frame sequence data to the smart television for playing control. According to the embodiment of the invention, the motion blur and smear phenomena of the moving target during television playing are reduced, and meanwhile, higher detail colors are achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart televisions, and in particular to a television picture processing method based on MEMC technology and related devices. Background Art

[0002] With the development of ultra-high-definition display technology and the increasing demand of consumers for viewing experience, the market demand for optimized picture quality of smart TVs is growing. As an important part of modern home entertainment, smart TVs not only carry the function of daily viewing, but also become the core equipment for multimedia entertainment such as video streaming, games and online interaction. However, the problems of screen smear, jitter and blur in traditional TVs in fast-moving scenes (such as sports events, action movies, etc.) seriously affect the user's viewing experience, especially on large-size screens and 4K and 8K ultra-high-definition resolution TVs.

[0003] Existing smart TVs have the following problems in processing dynamic image quality: (1) Fast-motion scenes are prone to image blur and ghosting, which makes it difficult to clearly present motion details, especially in high-frame rate or high-speed motion video content, which greatly reduces the user experience; (2) Although some high-end TVs on the market are equipped with motion compensation functions, in actual applications, many products still cannot achieve the expected results, and the accuracy and smoothness of the interpolation algorithm need to be further improved; (3) With the popularization of large-screen TVs and high-frame rate content, how to improve dynamic image performance while ensuring ultra-high-definition image quality has become one of the key directions of corporate technology research and development. Summary of the invention

[0004] The purpose of the present invention is to overcome the shortcomings of the prior art. The present invention provides a TV picture processing method and related devices based on MEMC technology, which can reduce motion blur and ghosting of moving targets during TV playback, while having higher detail colors.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides a TV picture processing method based on MEMC technology, the method comprising:

[0006] When the smart TV receives a TV audio and video signal sent by a TV signal source, the TV audio and video signal is converted into video sequence frame data;

[0007] Based on the MEMC technology, the motion vectors of the moving targets in two adjacent video frames in the video sequence frame data are calculated and processed to obtain the motion vector data of the moving targets in the two adjacent video frames;

[0008] Based on the motion vector data of the moving object in two adjacent video frames, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data;

[0009] Based on a high dynamic range algorithm, each video sequence frame data in the interpolated video sequence frame data is subjected to light and dark contrast enhancement processing to form enhanced video sequence frame data;

[0010] The enhanced video frame sequence data is loaded into the smart TV in chronological order for playback control.

[0011] Optionally, converting the television audio and video signal into video sequence frame data includes:

[0012] Extracting a television video signal from the television audio and video signal, and converting the television video signal into video data information;

[0013] Frame processing is performed on the video data information to form the video sequence frame data.

[0014] Optionally, the calculating and processing the motion vectors of the target pixels in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the target pixels in the two adjacent video frames includes:

[0015] Determine a moving target in two adjacent video frames in the video sequence frame data, and extract target pixel data of the moving target in the two adjacent video frames to obtain a first moving target pixel and a second moving target pixel;

[0016] The motion vector between the first moving target pixel and the second moving target pixel is calculated based on the MEMC technology, and the obtained motion vector data is used as the motion vector data of the moving target in two adjacent video frames.

[0017] Optionally, the step of starting an intelligent interpolation algorithm based on motion vector data of a moving target in two adjacent video frames to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data includes:

[0018] Obtaining a program content tag of a current program marked by a television audio and video signal, inputting the program content tag and motion vector data of a moving target in two adjacent video frames into the intelligent interpolation algorithm to perform interpolation mode matching processing, and obtaining a matching interpolation mode, wherein the matching interpolation mode is the number of interpolation frames inserted in two adjacent video frames;

[0019] The video frame to be inserted corresponding to the matching interpolation mode is generated based on the motion vector data of the moving target in two adjacent video frames, and the video frame to be inserted is inserted into the two adjacent video frames to form the interpolated video sequence frame data.

[0020] Optionally, the generating the video frame to be inserted corresponding to the matching interpolation mode based on the motion vector data of the moving target in two adjacent video frames includes:

[0021] Extracting pixel contents corresponding to relevant scene images in two adjacent video frames;

[0022] The video frames to be inserted are generated according to the corresponding number of inserted frames in the matching frame insertion method by using the motion vector data of the moving target in two adjacent video frames and the pixel contents corresponding to the relevant picture scenes.

[0023] Optionally, performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data includes:

[0024] Extracting a dark area in each video sequence frame data in the interpolated video sequence frame data;

[0025] Based on the high dynamic range algorithm, the dark area in each video sequence frame data in the video sequence frame data after the program content marker is inserted is subjected to light-dark contrast enhancement processing to form enhanced video sequence frame data.

[0026] Optionally, the step of loading the enhanced video frame sequence data into the smart TV in time sequence for playback control includes:

[0027] Combining the enhanced video frame sequence data with the audio signal extracted from the television audio and video signal to form audio and video data to be played;

[0028] The audio and video data to be played are loaded into the playback controller in the smart TV in chronological order, and the playback is controlled by the playback controller.

[0029] In addition, an embodiment of the present invention further provides a television picture processing device based on MEMC technology, the device comprising:

[0030] Conversion module: used for converting the TV audio and video signals into video sequence frame data when the smart TV receives the TV audio and video signals sent by the TV signal source;

[0031] A calculation module is used to calculate and process the motion vectors of the moving targets in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the moving targets in the two adjacent video frames;

[0032] Frame insertion module: used for starting an intelligent frame insertion algorithm to perform frame insertion processing on the video sequence frame data based on motion vector data of a moving target in two adjacent video frames, so as to form video sequence frame data after frame insertion;

[0033] Enhancement module: used for performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data;

[0034] Playback control module: used to load the enhanced video frame sequence data into the smart TV in chronological order for playback control.

[0035] In addition, an embodiment of the present invention further provides a smart TV, including a processor and a memory, wherein the processor runs a computer program or code stored in the memory to implement any of the TV picture processing methods described above.

[0036] In addition, an embodiment of the present invention further provides a computer-readable storage medium for storing a computer program or code. When the computer program or code is executed by a processor, the television picture processing method as described in any one of the above is implemented.

[0037] In an embodiment of the present invention, the motion vector of a moving target in two adjacent video frames in a video sequence frame data is calculated and processed by MEMC technology to obtain the motion vector data of the moving target; based on the motion vector data of the moving target, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data; light and dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data to form enhanced video sequence frame data; the enhanced video frame sequence data is loaded into a smart TV for playback control; the calculation accuracy of the motion vector is improved to ensure that the transition between the inserted frame and the original frame is smoother and more natural, thereby improving the fluency and clarity of the overall video, thereby reducing the motion blur and ghosting of the moving target during TV playback, and at the same time, the HDR technology is used to make the details of the dark part of each frame richer and have higher detail colors, so that users have a visual experience that is closer to the real environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0039] Figure 1 is a flow chart of a method for processing television images based on MEMC technology in an embodiment of the present invention;

[0040] Figure 2 is a flow chart of a method for processing television images based on MEMC technology in another embodiment of the present invention;

[0041] Figure 3 is a schematic diagram of the structure of a television picture processing device based on MEMC technology in an embodiment of the present invention;

[0042] Figure 4 It is a schematic diagram of the structure of a smart TV in an embodiment of the present invention. DETAILED DESCRIPTION

[0043] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] For example, see Figure 1 , Figure 1 It is a flowchart of a method for processing television images based on MEMC technology in an embodiment of the present invention.

[0045] Among them, the full name of MEMC technology is Motion Estimate and Motion Compensation, which means motion estimation and motion compensation; HDR is a processing technology for improving image brightness and contrast, which refers to high dynamic lighting rendering.

[0046] like Figure 1 As shown, a TV picture processing method based on MEMC technology, the method comprises:

[0047] S101: When the smart TV receives a TV audio and video signal sent by a TV signal source, the smart TV converts the TV audio and video signal into video sequence frame data;

[0048] In an embodiment of the present invention, the converting of the television audio and video signal into video sequence frame data includes: extracting the television video signal from the television audio and video signal, and converting the television video signal into video data information; performing frame processing on the video data information to form the video sequence frame data.

[0049] Specifically, after the smart TV is started, it monitors the interface of the TV signal source and receives the TV audio and video signals sent by the TV signal source through the interface of the TV signal source. After receiving the TV audio and video signals, it needs to perform decoding operations to form TV audio and video data, and then extract video data information from the TV audio and video data; subsequent video frame processing is performed on the video data information, and no related processing is required on the audio data; after separating the audio data, the corresponding audio data and video data are subsequently recombined.

[0050] After extracting the video data information, frame segmentation processing is performed according to the frame rate of the video data information to form video sequence frame data; subsequently, operations such as frame insertion will be performed based on the formed video sequence frame data, so that the TV picture is clearer and moving targets will not have problems such as ghosting.

[0051] S102: calculating and processing motion vectors of moving objects in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain motion vector data of the moving objects in the two adjacent video frames;

[0052] In the specific implementation process of the present invention, the motion vectors of target pixels in two adjacent video frames in the video sequence frame data are calculated and processed based on the MEMC technology to obtain the motion vector data of the target pixels in the two adjacent video frames, including: determining a moving target in two adjacent video frames in the video sequence frame data, and extracting the target pixel data of the moving target in the two adjacent video frames to obtain a first moving target pixel and a second moving target pixel; calculating the motion vector between the first moving target pixel and the second moving target pixel based on the MEMC technology, and using the obtained motion vector data as the motion vector data of the moving target in the two adjacent video frames.

[0053] Specifically, it is first necessary to determine the moving target in two adjacent video frames in the video sequence frame data. Here, it is necessary to use a target tracking algorithm to realize the recognition and tracking of the moving target in the two adjacent video frames, so as to determine the moving target in the two adjacent video frames; then extract the target pixel data of the moving target in the two adjacent video frames, so as to obtain the first moving target pixel corresponding to the first video frame in the two adjacent video frames and the second moving target pixel corresponding to the second video frame in the two adjacent video frames.

[0054] After obtaining the first moving target pixel corresponding to the first video frame in two adjacent video frames and the second moving target pixel corresponding to the second video frame in two adjacent video frames, the MEMC algorithm is started to calculate the motion vector between the first moving target pixel and the second moving target pixel, and the calculated motion vector data is used as the motion vector data of the moving target in the two adjacent video frames; subsequent interpolation operations will be implemented based on the motion vector data. When the motion vector is large, interpolation operations need to be performed, and the number of interpolation frames is also determined by the motion vector data. Of course, for different program content tags, there may be different interpolation operation methods under the same motion vector data.

[0055] S103: starting an intelligent interpolation algorithm based on motion vector data of a moving object in two adjacent video frames to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data;

[0056] In the specific implementation process of the present invention, the intelligent interpolation algorithm is started based on the motion vector data of the moving target in two adjacent video frames to perform interpolation processing on the video sequence frame data to form the video sequence frame data after interpolation, including: obtaining the program content mark of the current program marked by the television audio and video signal, inputting the program content mark and the motion vector data of the moving target in two adjacent video frames into the intelligent interpolation algorithm to perform interpolation mode matching processing to obtain a matching interpolation mode, and the matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; generating a video frame to be inserted corresponding to the matching interpolation mode based on the motion vector data of the moving target in two adjacent video frames, and inserting the video frame to be inserted into the two adjacent video frames to form the video sequence frame data after interpolation.

[0057] Furthermore, the generation of the video frames to be inserted corresponding to the matching interpolation method based on the motion vector data of the moving target in two adjacent video frames includes: extracting pixel contents corresponding to the correlated picture scenes in the two adjacent video frames; using the motion vector data of the moving target in the two adjacent video frames and the pixel contents corresponding to the correlated picture scenes to generate the video frames to be inserted according to the corresponding number of insertion frames in the matching interpolation method.

[0058] Specifically, at this time, it is first necessary to extract the program content tag of the current program marked by the TV audio and video signal, and then input the program content tag and the motion vector data of the moving target in two adjacent video frames into the intelligent interpolation algorithm for interpolation mode matching processing to obtain a matching interpolation mode. The matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; wherein the intelligent interpolation algorithm is trained according to the program content tag, motion vector data and the required interpolation mode; wherein the matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; and under different program content tags, different motion vector data have different interpolation modes. For example, ordinary TV programs may not have high interpolation requirements, and may only need to insert one frame under the same motion vector data, while sports programs (such as football, basketball and other competitive programs) may need to insert multiple frames.

[0059] Then, a video frame to be inserted corresponding to the matching interpolation mode is generated through the motion vector data of the moving target in two adjacent video frames, and the video frame to be inserted is inserted into the two adjacent video frames to form video sequence frame data after interpolation.

[0060] When generating the video frames to be inserted, it is first necessary to extract the pixel contents corresponding to the correlated picture scenes in the two adjacent video frames; then, the motion vector data of the moving targets in the two adjacent video frames and the pixel contents corresponding to the correlated picture scenes are used to generate the video frames to be inserted according to the corresponding number of insertion frames in the matching interpolation method; that is, the full-process MEMC is called to generate the relevant video frames to be inserted using the motion vector data of the moving targets in the previous and next frames and the correlated picture scenes.

[0061] S104: performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data;

[0062] In the specific implementation process of the present invention, the light-dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data based on the high dynamic range algorithm to form the enhanced video sequence frame data, including: extracting the dark area in each video sequence frame data in the interpolated video sequence frame data; based on the high dynamic range algorithm, using the program content to mark the dark area in each video sequence frame data in the interpolated video sequence frame data to perform light-dark contrast enhancement processing to form the enhanced video sequence frame data.

[0063] Specifically, after the interpolated video sequence frame data is generated, in order to ensure that the TV playback picture has richer details, it is necessary to enhance the light and dark contrast through HDR precise dark areas.

[0064] Therefore, firstly, the dark area in each video sequence frame data in the interpolated video sequence frame data is extracted; then, the high dynamic range algorithm (HDR algorithm) is used to mark the dark area in each video sequence frame data in the interpolated video sequence frame data using the program content, and the light and dark contrast is enhanced to form enhanced video sequence frame data; in this way, the details of each dark area can be made richer, the dark areas can be made darker, and more detailed colors can be enriched, so that movies, pictures, and game screens can present excellent effects, allowing users to have a visual experience closer to the real environment when watching movies and playing games.

[0065] S105: Loading the enhanced video frame sequence data into the smart TV in chronological order for playback control.

[0066] In the specific implementation process of the present invention, the enhanced video frame sequence data is loaded into the smart TV in chronological order for playback control, including: combining the enhanced video frame sequence data with the audio signal extracted from the TV audio and video signal to form audio and video data to be played; loading the audio and video data to be played into the playback controller in the smart TV in chronological order, and performing playback control through the playback controller.

[0067] Specifically, after obtaining the enhanced video frame sequence data, it is necessary to perform playback control on the smart TV; first, the enhanced video frame sequence data is combined with the audio signal extracted from the TV audio and video signal according to the time mark to form the audio and video data to be played; then the audio and video data to be played is loaded into the playback controller in the smart TV according to the time sequence, and the playback control is performed through the playback controller.

[0068] In an embodiment of the present invention, the motion vector of a moving target in two adjacent video frames in a video sequence frame data is calculated and processed by MEMC technology to obtain the motion vector data of the moving target; based on the motion vector data of the moving target, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data; light and dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data to form enhanced video sequence frame data; the enhanced video frame sequence data is loaded into a smart TV for playback control; the calculation accuracy of the motion vector is improved to ensure that the transition between the inserted frame and the original frame is smoother and more natural, thereby improving the fluency and clarity of the overall video, thereby reducing the motion blur and ghosting of the moving target during TV playback, and at the same time, the HDR technology is used to make the details of the dark part of each frame richer and have higher detail colors, so that users have a visual experience that is closer to the real environment.

[0069] For example 2, please refer to Figure 2 , Figure 2 It is a flowchart of a method for processing television images based on MEMC technology in another embodiment of the present invention.

[0070] like Figure 2 As shown, a TV picture processing method based on MEMC technology, the method comprises:

[0071] S201: When the smart TV receives a TV audio and video signal sent by a TV signal source, convert the TV audio and video signal into video sequence frame data;

[0072] S202: calculating and processing the motion vectors of the moving objects in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the moving objects in the two adjacent video frames;

[0073] S203: Obtaining a program content tag of the current program marked by the television audio and video signal, inputting the program content tag and the motion vector data of the moving target in two adjacent video frames into the intelligent interpolation algorithm to perform interpolation mode matching processing, and obtaining a matching interpolation mode, wherein the matching interpolation mode is the number of interpolation frames inserted in two adjacent video frames;

[0074] S204: extracting pixel contents corresponding to the relevant picture scenes in two adjacent video frames;

[0075] S205: generating a video frame to be inserted according to a corresponding number of insertion frames in the matching frame insertion method by using the motion vector data of the moving object in two adjacent video frames and the pixel content corresponding to the relevant picture scene;

[0076] S206: inserting the video frame to be inserted into two adjacent video frames to form video sequence frame data after insertion;

[0077] S207: performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data;

[0078] S208: Loading the enhanced video frame sequence data into the smart TV in chronological order for playback control.

[0079] The specific implementation of the second embodiment can be found in the above embodiments, which will not be described in detail here.

[0080] For example 3, please refer to Figure 3 , Figure 3 It is a schematic diagram of the structural composition of a television picture processing device based on MEMC technology in an embodiment of the present invention.

[0081] like Figure 3 As shown, a TV picture processing device based on MEMC technology, the device comprises:

[0082] The conversion module 301 is used to convert the television audio and video signal into video sequence frame data when the smart television receives the television audio and video signal sent by the television signal source;

[0083] In an embodiment of the present invention, the converting of the television audio and video signal into video sequence frame data includes: extracting the television video signal from the television audio and video signal, and converting the television video signal into video data information; performing frame processing on the video data information to form the video sequence frame data.

[0084] Specifically, after the smart TV is started, it monitors the interface of the TV signal source and receives the TV audio and video signals sent by the TV signal source through the interface of the TV signal source. After receiving the TV audio and video signals, it needs to perform decoding operations to form TV audio and video data, and then extract video data information from the TV audio and video data; subsequent video frame processing is performed on the video data information, and no related processing is required on the audio data; after separating the audio data, the corresponding audio data and video data are subsequently recombined.

[0085] After extracting the video data information, frame segmentation processing is performed according to the frame rate of the video data information to form video sequence frame data; subsequently, operations such as frame insertion will be performed based on the formed video sequence frame data, so that the TV picture is clearer and moving targets will not have problems such as ghosting.

[0086] Calculation module 302: used for calculating and processing the motion vectors of the moving targets in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the moving targets in the two adjacent video frames;

[0087] In the specific implementation process of the present invention, the motion vectors of target pixels in two adjacent video frames in the video sequence frame data are calculated and processed based on the MEMC technology to obtain the motion vector data of the target pixels in the two adjacent video frames, including: determining a moving target in two adjacent video frames in the video sequence frame data, and extracting the target pixel data of the moving target in the two adjacent video frames to obtain a first moving target pixel and a second moving target pixel; calculating the motion vector between the first moving target pixel and the second moving target pixel based on the MEMC technology, and using the obtained motion vector data as the motion vector data of the moving target in the two adjacent video frames.

[0088] Specifically, it is first necessary to determine the moving target in two adjacent video frames in the video sequence frame data. Here, it is necessary to use a target tracking algorithm to realize the recognition and tracking of the moving target in the two adjacent video frames, so as to determine the moving target in the two adjacent video frames; then extract the target pixel data of the moving target in the two adjacent video frames, so as to obtain the first moving target pixel corresponding to the first video frame in the two adjacent video frames and the second moving target pixel corresponding to the second video frame in the two adjacent video frames.

[0089] After obtaining the first moving target pixel corresponding to the first video frame in two adjacent video frames and the second moving target pixel corresponding to the second video frame in two adjacent video frames, the MEMC algorithm is started to calculate the motion vector between the first moving target pixel and the second moving target pixel, and the calculated motion vector data is used as the motion vector data of the moving target in the two adjacent video frames; subsequent interpolation operations will be implemented based on the motion vector data. When the motion vector is large, interpolation operations need to be performed, and the number of interpolation frames is also determined by the motion vector data. Of course, for different program content tags, there may be different interpolation operation methods under the same motion vector data.

[0090] Frame insertion module 303: used to start intelligent frame insertion algorithm to perform frame insertion processing on the video sequence frame data based on motion vector data of the moving object in two adjacent video frames to form interpolated video sequence frame data;

[0091] In the specific implementation process of the present invention, the intelligent interpolation algorithm is started based on the motion vector data of the moving target in two adjacent video frames to perform interpolation processing on the video sequence frame data to form the video sequence frame data after interpolation, including: obtaining the program content mark of the current program marked by the television audio and video signal, inputting the program content mark and the motion vector data of the moving target in two adjacent video frames into the intelligent interpolation algorithm to perform interpolation mode matching processing to obtain a matching interpolation mode, and the matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; generating a video frame to be inserted corresponding to the matching interpolation mode based on the motion vector data of the moving target in two adjacent video frames, and inserting the video frame to be inserted into the two adjacent video frames to form the video sequence frame data after interpolation.

[0092] Furthermore, the generation of the video frames to be inserted corresponding to the matching interpolation method based on the motion vector data of the moving target in two adjacent video frames includes: extracting pixel contents corresponding to the correlated picture scenes in the two adjacent video frames; using the motion vector data of the moving target in the two adjacent video frames and the pixel contents corresponding to the correlated picture scenes to generate the video frames to be inserted according to the corresponding number of insertion frames in the matching interpolation method.

[0093] Specifically, at this time, it is first necessary to extract the program content tag of the current program marked by the TV audio and video signal, and then input the program content tag and the motion vector data of the moving target in two adjacent video frames into the intelligent interpolation algorithm for interpolation mode matching processing to obtain a matching interpolation mode. The matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; wherein the intelligent interpolation algorithm is trained according to the program content tag, motion vector data and the required interpolation mode; wherein the matching interpolation mode is the number of inserted frames inserted in two adjacent video frames; and under different program content tags, different motion vector data have different interpolation modes. For example, ordinary TV programs may not have high interpolation requirements, and may only need to insert one frame under the same motion vector data, while sports programs (such as football, basketball and other competitive programs) may need to insert multiple frames.

[0094] Then, a video frame to be inserted corresponding to the matching interpolation mode is generated through the motion vector data of the moving target in two adjacent video frames, and the video frame to be inserted is inserted into the two adjacent video frames to form video sequence frame data after interpolation.

[0095] When generating the video frames to be inserted, it is first necessary to extract the pixel contents corresponding to the correlated picture scenes in the two adjacent video frames; then, the motion vector data of the moving targets in the two adjacent video frames and the pixel contents corresponding to the correlated picture scenes are used to generate the video frames to be inserted according to the corresponding number of insertion frames in the matching interpolation method; that is, the full-process MEMC is called to generate the relevant video frames to be inserted using the motion vector data of the moving targets in the previous and next frames and the correlated picture scenes.

[0096] Enhancement module 304: used for performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data;

[0097] In the specific implementation process of the present invention, the light-dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data based on the high dynamic range algorithm to form the enhanced video sequence frame data, including: extracting the dark area in each video sequence frame data in the interpolated video sequence frame data; based on the high dynamic range algorithm, using the program content to mark the dark area in each video sequence frame data in the interpolated video sequence frame data to perform light-dark contrast enhancement processing to form the enhanced video sequence frame data.

[0098] Specifically, after generating the interpolated video sequence frame data, in order to ensure that the TV playback picture has richer details, it is necessary to use HDR (a processing technology that improves image brightness and contrast, i.e. high dynamic range) to accurately enhance the light and dark contrast in dark areas.

[0099] Therefore, firstly, the dark area in each video sequence frame data in the interpolated video sequence frame data is extracted; then, the high dynamic range algorithm (HDR algorithm) is used to mark the dark area in each video sequence frame data in the interpolated video sequence frame data using the program content, and the light and dark contrast is enhanced to form enhanced video sequence frame data; in this way, the details of each dark area can be made richer, the dark areas can be made darker, and more detailed colors can be enriched, so that movies, pictures, and game screens can present excellent effects, allowing users to have a visual experience closer to the real environment when watching movies and playing games.

[0100] Playback control module 305: used to load the enhanced video frame sequence data into the smart TV in time sequence for playback control.

[0101] In the specific implementation process of the present invention, the enhanced video frame sequence data is loaded into the smart TV in chronological order for playback control, including: combining the enhanced video frame sequence data with the audio signal extracted from the TV audio and video signal to form audio and video data to be played; loading the audio and video data to be played into the playback controller in the smart TV in chronological order, and performing playback control through the playback controller.

[0102] Specifically, after obtaining the enhanced video frame sequence data, it is necessary to perform playback control on the smart TV; first, the enhanced video frame sequence data is combined with the audio signal extracted from the TV audio and video signal according to the time mark to form the audio and video data to be played; then the audio and video data to be played is loaded into the playback controller in the smart TV according to the time sequence, and the playback control is performed through the playback controller.

[0103] In an embodiment of the present invention, the motion vector of a moving target in two adjacent video frames in a video sequence frame data is calculated and processed by MEMC technology to obtain the motion vector data of the moving target; based on the motion vector data of the moving target, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data; light and dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data to form enhanced video sequence frame data; the enhanced video frame sequence data is loaded into a smart TV for playback control; the calculation accuracy of the motion vector is improved to ensure that the transition between the inserted frame and the original frame is smoother and more natural, thereby improving the fluency and clarity of the overall video, thereby reducing the motion blur and ghosting of the moving target during TV playback, and at the same time, the HDR technology is used to make the details of the dark part of each frame richer and have higher detail colors, so that users have a visual experience that is closer to the real environment.

[0104] An embodiment of the present invention provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the television picture processing method of any one of the above embodiments is implemented. The computer-readable storage medium includes, but is not limited to, any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or optical card. That is, the storage device includes any medium that can store or transmit information in a readable form by a device (for example, a computer, a mobile phone), which can be a read-only memory, a disk or an optical disk, etc.

[0105] An embodiment of the present invention further provides a computer application program, which runs on a computer and is used to execute the television picture processing method of any one of the above embodiments.

[0106] also, Figure 4 It is a schematic diagram of the structure of a smart TV in an embodiment of the present invention.

[0107] The embodiment of the present invention also provides a smart TV, such as Figure 4The smart TV includes a processor 402, a memory 403, an input unit 404, a display unit 405 and other devices. Those skilled in the art will understand that Figure 4 The structural components of the smart TV shown do not constitute a limitation on all devices, and may include more or fewer components than shown, or combine certain components. The memory 403 can be used to store the application 401 and various functional modules, and the processor 402 runs the application 401 stored in the memory 403, thereby executing various functional applications and data processing of the device. The memory can be an internal memory or an external memory, or include both internal and external memories. The internal memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, or a random access memory. The external memory may include a hard disk, a floppy disk, a ZIP disk, a U disk, a magnetic tape, etc. The memory disclosed in the present invention includes but is not limited to these types of memories. The memory disclosed in the present invention is only an example and not a limitation.

[0108] The input unit 404 is used to receive the input of the signal and the keyword input by the user. The input unit 404 may include a touch panel and other input devices. The touch panel can collect the user's touch operation on or near it (such as the user's operation on or near the touch panel using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program; other input devices may include but are not limited to one or more of a physical keyboard, a function key (such as a playback control key, a switch key, etc.), a trackball, a mouse, a joystick, etc. The display unit 405 can be used to display the information input by the user or the information provided to the user and various menus of the terminal device. The display unit 405 can be in the form of a liquid crystal display, an organic light emitting diode, etc. The processor 402 is the control center of the terminal device, which uses various interfaces and lines to connect the various parts of the entire device, and executes various functions and processes data by running or executing software programs and / or modules stored in the memory 403, and calling the data stored in the memory.

[0109] As an embodiment, the smart TV includes: one or more processors 402, a memory 403, and one or more applications 401, wherein the one or more applications 401 are stored in the memory 403 and are configured to be executed by the one or more processors 402, and the one or more applications 401 are configured to execute the corresponding TV picture processing method in any one of the above-mentioned embodiments.

[0110] In an embodiment of the present invention, the motion vector of a moving target in two adjacent video frames in a video sequence frame data is calculated and processed by MEMC technology to obtain the motion vector data of the moving target; based on the motion vector data of the moving target, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data; light and dark contrast enhancement processing is performed on each video sequence frame data in the interpolated video sequence frame data to form enhanced video sequence frame data; the enhanced video frame sequence data is loaded into a smart TV for playback control; the calculation accuracy of the motion vector is improved to ensure that the transition between the inserted frame and the original frame is smoother and more natural, thereby improving the fluency and clarity of the overall video, thereby reducing the motion blur and ghosting of the moving target during TV playback, and at the same time, the HDR technology is used to make the details of the dark part of each frame richer and have higher detail colors, so that users have a visual experience that is closer to the real environment.

[0111] In addition, the above is a detailed introduction to a TV picture processing method based on MEMC technology and related devices provided by an embodiment of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A TV picture processing method based on MEMC technology, characterized in that: The method comprises: When the smart TV receives a TV audio and video signal sent by a TV signal source, the TV audio and video signal is converted into video sequence frame data; Based on the MEMC technology, the motion vectors of the moving targets in two adjacent video frames in the video sequence frame data are calculated and processed to obtain the motion vector data of the moving targets in the two adjacent video frames; Based on the motion vector data of the moving object in two adjacent video frames, an intelligent interpolation algorithm is started to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data; Based on a high dynamic range algorithm, each video sequence frame data in the interpolated video sequence frame data is subjected to light and dark contrast enhancement processing to form enhanced video sequence frame data; The enhanced video frame sequence data is loaded into the smart TV in chronological order for playback control.

2. The television picture processing method according to claim 1, characterized in that: The step of converting the television audio and video signal into video sequence frame data comprises: Extracting a television video signal from the television audio and video signal, and converting the television video signal into video data information; Frame processing is performed on the video data information to form the video sequence frame data.

3. The television picture processing method according to claim 1, characterized in that: The method of calculating and processing the motion vectors of target pixels in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the target pixels in the two adjacent video frames includes: Determine a moving target in two adjacent video frames in the video sequence frame data, and extract target pixel data of the moving target in the two adjacent video frames to obtain a first moving target pixel and a second moving target pixel; The motion vector between the first moving target pixel and the second moving target pixel is calculated based on the MEMC technology, and the obtained motion vector data is used as the motion vector data of the moving target in two adjacent video frames.

4. The television picture processing method according to claim 1, characterized in that: The method of starting an intelligent interpolation algorithm based on motion vector data of a moving target in two adjacent video frames to perform interpolation processing on the video sequence frame data to form interpolated video sequence frame data includes: Obtaining a program content tag of a current program marked by a television audio and video signal, inputting the program content tag and motion vector data of a moving target in two adjacent video frames into the intelligent interpolation algorithm to perform interpolation mode matching processing, and obtaining a matching interpolation mode, wherein the matching interpolation mode is the number of interpolation frames inserted in two adjacent video frames; The video frame to be inserted corresponding to the matching interpolation mode is generated based on the motion vector data of the moving target in two adjacent video frames, and the video frame to be inserted is inserted into the two adjacent video frames to form the interpolated video sequence frame data.

5. The television picture processing method according to claim 4, characterized in that: The generating of the video frame to be inserted corresponding to the matching interpolation mode based on the motion vector data of the moving target in two adjacent video frames includes: Extracting pixel contents corresponding to relevant scene images in two adjacent video frames; The video frames to be inserted are generated according to the corresponding number of inserted frames in the matching frame insertion method by using the motion vector data of the moving target in two adjacent video frames and the pixel contents corresponding to the relevant picture scenes.

6. The television picture processing method according to claim 1, characterized in that: The method of performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on the high dynamic range algorithm to form enhanced video sequence frame data includes: Extracting a dark area in each video sequence frame data in the interpolated video sequence frame data; Based on the high dynamic range algorithm, the dark area in each video sequence frame data in the video sequence frame data after the program content marker is inserted is subjected to light-dark contrast enhancement processing to form enhanced video sequence frame data.

7. The television picture processing method according to claim 1, characterized in that: The step of loading the enhanced video frame sequence data into the smart TV in time sequence for playback control includes: Combining the enhanced video frame sequence data with the audio signal extracted from the television audio and video signal to form audio and video data to be played; The audio and video data to be played are loaded into the playback controller in the smart TV in chronological order, and the playback is controlled by the playback controller.

8. A TV picture processing device based on MEMC technology, characterized in that: The device comprises: Conversion module: used for converting the TV audio and video signals into video sequence frame data when the smart TV receives the TV audio and video signals sent by the TV signal source; A calculation module is used to calculate and process the motion vectors of the moving targets in two adjacent video frames in the video sequence frame data based on the MEMC technology to obtain the motion vector data of the moving targets in the two adjacent video frames; Frame insertion module: used for starting an intelligent frame insertion algorithm to perform frame insertion processing on the video sequence frame data based on motion vector data of a moving target in two adjacent video frames, so as to form video sequence frame data after frame insertion; Enhancement module: used for performing light and dark contrast enhancement processing on each video sequence frame data in the interpolated video sequence frame data based on a high dynamic range algorithm to form enhanced video sequence frame data; Playback control module: used to load the enhanced video frame sequence data into the smart TV in chronological order for playback control.

9. A smart TV, comprising a processor and a memory, characterized in that: The processor runs a computer program or code stored in the memory to implement the television picture processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium for storing a computer program or code, characterized in that: When the computer program or code is executed by a processor, the television picture processing method according to any one of claims 1 to 7 is implemented.

Images